Poke & Wiggle
"We are obsessed with breaking & improving robot policies."
Munich robot-evaluation firm running a Franka FR3 Duo farm at the Deutsches Museum; its PAW-GEN-10 benchmark logged 3,600 real rollouts per policy.
Poke & Wiggle GmbH is a Munich company that evaluates robot foundation models and vision-language-action (VLA) policies on real hardware. It is registered at the Munich local court under HRB 301692, with Nicolas Keller and Jose Ramon Medina Hernandez listed as representatives, and states offices in Munich, San Francisco and London. Its robot operations are located at the Deutsches Museum in Munich, where it runs what it describes as the largest independent farm of Franka FR3 Duo bimanual robot stations.
Each benchmarking station pairs two Franka FR3 arms on a Franka Duo pedestal with Robotiq 2F-85 grippers, Intel RealSense D405 wrist cameras and a ZED Mini head camera. Operators in VR headsets teleoperate the stations to collect demonstration data, and the same stations then execute customer or open-source policies under controlled, repeatable conditions.
The company sells three services. Reality Check benchmarks a robot policy on standardised tasks with real robots, lets the customer compare it with other models and inspect the evidence behind each score, and offers private results or publication on the public Reality Check Leaderboard. Loop gives AI labs remote access to the robot farm to run successive checkpoints across real and simulated stations, with results in a customer data portal; Poke & Wiggle also helps debug training pipelines, collects targeted data and verifies improvements. Application Benchmarking, aimed at industrial teams, turns a customer's own task into a benchmark, tests candidate policies against it and reports what works, what fails and what still needs development.
On 29 September 2026 the company released PAW-GEN-10, a benchmark of ten real-world environments covering basic skills, tool use, high-precision assembly and bimanual handling, such as sorting screws, clamping an electrical component, connecting a DC jack and routing a cable through closed hoops. Five environments are held out and unpublished. Four open policies, MolmoAct 2, Pi 0.5, DiT-Flow and GR00T N1.7, were each fine-tuned on 10, 100 and 300 demonstrations per environment and evaluated over 3,600 rollouts per policy. MolmoAct 2 scored highest at 44% task success with 300 demonstrations, and in 86% of failed episodes the hardware was fine and the policy simply did not finish the task. Metrics include success and progress, execution time, motion smoothness, jerk, safe failure rate and maximum contact force.
In September 2026 world-model developer Odyssey named Poke & Wiggle as a collaborator for assessing how its Odyssey-3 model adapts across robot types and control systems. The company also runs a public Discord community.
Primary type & automation activities this supplier delivers:
Reality Check
Real-robot benchmarking of robot policies on standardised tasks, private or on the public leaderboard.
PAW-GEN-10 benchmark
- Model: PAW-GEN-10
- Launch Year: 2026
Ten-environment real-world manipulation benchmark for VLA policies with reproducible scenes.
Loop
Remote access to a Franka FR3 Duo robot farm to iterate policy checkpoints on real and simulated stations.
Application Benchmarking
Turns an industrial customer's task into a benchmark and tests candidate robot policies against it.
More related news
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
-
10
IROS 2026 Best Paper Finalists: South Korea Leads RobotToday · Oct 07, 2026
-
11
IEEE CASE 2027 Linz: Aug 23–27 | Automation Science RobotToday · Oct 06, 2026
-
12
ROSCon Korea 2027: Feb 17–19 at DGIST, Daegu RobotToday · Oct 05, 2026
-
13
Tuning the Brain Like a Radio: Synapse Symphony’s Plan to Treat Chronic Pain at Home RobotToday · Sep 30, 2026
-
14
RobotToday Weekly September 21 – 25, 2026 RobotToday · Sep 26, 2026
-
15
Glacian: Physics Model Vets AI Data Center Cooling RobotToday · Sep 23, 2026
-
16
Siemens on Robots, Agentic AI and the "Last 3%" Problem RobotToday · Sep 23, 2026
- 17
-
18
Innovation Works Venture Expo 2026: 58 Pittsburgh Startups Pitch to Investors RobotToday · Sep 16, 2026
- 19
-
20
China’s Dexterous Hand Industry, 2026 Part 3 — The Players RobotToday · Sep 06, 2026
Contact Poke & Wiggle
WEBSITE
https://pokeandwiggle.comHEADQUARTERS
Germany
Company Facts
Founded
-
Primary Role
Software/Algorithm
Company Size
-
Primary Region
Europe
Annual Sales
-
Funding Stage
-
Funding Total
-
Keywords
