Solutions · VLA training data

VLA training data

VLA training data is paired video and action data — synchronized camera streams, joint states and a task prompt for every episode — from which vision-language-action models such as π0.5 learn to turn instructions into robot actions.

PrismaX supplies it as teleoperated demonstrations on real robot arms, QA-scored episode by episode, from the catalog or collected to your spec.

The data problem

What gets in the way

“Robotics data” isn't defined

Video, motion capture and teleoperation are all sold as robotics data, and some of it is rebranded machine-vision footage.

Repetitive tasks

Datasets keep growing while task selection stays repetitive and a handful of hardware vendors are over-represented.

Uneven quality

Trace quality and sensor setups vary widely; sub-par data doesn't fail loudly, it quietly degrades the model.

Rigs you can't reproduce

Post-training needs the rig's geometry, control laws and camera specs. Without them you get caught out at deployment.

What the data needs

Video and actions, to a standard.

  • Video–action pairs of an embodiment completing a semantically meaningful task, with a prompt that matches what happens on screen.
  • An overhead camera with full view of the workspace at all times, plus at least one camera on each wrist.
  • Every joint angle recorded, so the robot's configuration can be reconstructed, with a URDF whose kinematic chain matches.
  • Serial arms with six or seven degrees of freedom and 1-DoF grippers or dexterous hands, suited to cross-embodiment transfer.
  • Clean, evenly lit images and smooth, mistake-free demonstrations.

How PrismaX provides it

From the catalog, or collected to spec.

We train VLAs on our own data. A π0.5 fine-tune on 668 YAM pick-and-place episodes (about 10 hours) ran live and zero-shot on a different rig at IROS 2026, with end-to-end latency for those rollouts brought down to 87 ms. Read the fine-tuning notes and the latency write-up.

Industries and scenes

Where the demonstrations come from

Catalog scenes that apply to this use case. Other environments are collected to spec.
  • HomeTidying, sorting, folding, placing
  • KitchenFood handling and clean-up
  • LogisticsPacking, unpacking, bin picking
  • IndustrialComponent handling
  • OfficeDesk and supply handling
  • Lab and ResearchBench work and lab procedures

Related tasks

  • Biology LabLab and Research · 108.8k
  • Pick and place various fruits into containersKitchen · 2.8k
  • Pick and place flowers into vase and vase on shelfHome · 2.0k
  • Block manipulationHome · 2.0k
  • Pack box of componentsLogistics · 1.8k
  • Pick and place slippers into binHome · 1.6k
  • Tying shoelacesHome · 1.5k
  • Clean up kitchen areaKitchen · 1.4k
Browse the full catalog

Sample videos

See the episodes

Model rollout
π0.5 rollout trained on our YAM data

A π0.5 policy fine-tuned on 668 YAM pick-and-place episodes picks fruit from a plate, as shown at IROS 2026.

Teleoperation
Bimanual flower arranging, overhead and wrist cameras

Two robot arms arrange flowers in a vase, seen from the overhead and wrist cameras at the same time.

FAQ

Frequently asked questions

What is VLA training data?

Data that pairs what a robot sees with what it does: synchronized camera video, joint states and a language prompt describing the task. Vision-language-action models learn from it to map instructions and observations to actions.

Which models has PrismaX trained on this data?

We fine-tune and evaluate π0.5 (openpi) on our own YAM data, and publish what we learn — training schemes, lighting, camera placement, latency and memory — in our deep dives.

How many episodes do I need to fine-tune a VLA?

It depends on the task. As one reference point, our π0.5 pick-and-place fine-tune used 668 episodes, about 10 hours of YAM data, and ran zero-shot on a different rig at IROS 2026.

Does each episode come with a language prompt?

Yes. Every episode is recorded against a task prompt, and an episode whose task doesn't match its prompt fails review.

Can you collect VLA data on our robot?

Tell us the embodiment you train on. The catalog covers YAM, Piper, RLM 63 and TOK2 arms and Enterprise supports 12+ robot arm types; for anything else, describe the embodiment and we scope a custom collection around it.

Next step

Fine-tune on data we train on ourselves.

Tell us the model, the tasks and the robot. We'll point you to the catalog or scope a collection.