Generalist AI has introduced GEN-1.5, an advanced embodied foundation model capable of one-shot learning for dexterous tasks. This model can learn new behaviors with just 3 to 12 seconds of sensorimotor demonstration data, eliminating the need for gradient updates. The model's performance shows a 59% success rate in ten manipulation tasks through one-shot prompting, which can be improved to 83% with fine-tuning.
The significance of GEN-1.5 lies in its ability to adapt quickly to new tasks with minimal training, representing a shift towards real-time adaptability in robotics. The model has been continuously trained for over eight months, leading to improvements in data absorption and compute efficiency. This efficiency is crucial as it reduces the traditionally high computational demands for training robotic models.
Looking ahead, GEN-1.5's compositional generalization allows it to chain distinct tasks into longer skills autonomously. Additionally, its zero-shot sim-to-real transfer capability enables it to perform tasks based solely on simulated prompts. While the company acknowledges that skills learned in-context are less robust than those from fine-tuning, the model's improvisational abilities demonstrate significant advancements in robotic flexibility.
Editor's Note
The introduction of GEN-1.5 by Generalist AI marks a pivotal moment in robotics, particularly in the realm of one-shot learning and adaptability. As enterprises seek more efficient automation solutions, the ability to reduce training time and enhance real-time performance will be crucial. This development could reshape procurement strategies and influence investment in advanced robotic technologies.
Leave a comment