OpenAI's GPT-6 Astra achieved the highest overall score in SuperCLUE's September 2026 EmbodiedCLUE-VLA evaluation, leading with a score of 85.71 in interaction and planning. This score significantly surpasses the runner-up, Gemini-3.8-Flash, which scored 64.29, highlighting Astra's notable advantage in planning capabilities.
The importance of this evaluation lies in its comprehensive assessment of ten models, which includes basic perception, visual reasoning, interaction, planning, and embodied safety. SuperCLUE's report indicates that while Astra leads in overall performance, the evaluation's fixed input/output protocol may limit the generalization of results across different tasks and protocols, making it a useful but narrow comparison of each model's capabilities.
Looking ahead, the next critical aspect to observe is how these models perform in real-world scenarios, particularly in executing plans and adapting to unforeseen circumstances. The results from physical trials will be essential to determine the practical applications of these models in robotics, beyond the theoretical scores presented in this benchmark.
Editor's Note
The SuperCLUE benchmark provides valuable insights into the cognitive capabilities of embodied agents, particularly in planning and interaction. As robotics developers assess these models, understanding the nuances of their performance in specific applications will be crucial. The evaluation highlights the need for further physical trials to validate the theoretical advantages demonstrated in the scores.
Copyright Notice
This briefing is an independently written summary based on publicly available reporting and is provided for industry information and news discovery. The original report and source publication are credited and linked where applicable. RobotToday does not claim ownership of third-party source material.
Rights concerns? If you believe any material in this briefing infringes your copyright or other rights, please contact [email protected] with the relevant URL and details. We will review the matter and take appropriate action where warranted.
Leave a comment