Industry Briefing

A single destination for timely, editor-curated robotics news from around the world.

AGIBOT's WITA-Omni Preview Achieves Top Score in Audio-Visual Reasoning Benchmark

AGIBOT's WITA-Omni Preview Achieves Top Score in Audio-Visual Reasoning Benchmark

AGIBOT announced that its WITA-Omni Preview multimodal foundation model has achieved the highest score on the Daily-Omni audio-visual reasoning benchmark, surpassing models from Alibaba, Google, and ByteDance. The model recorded an average accuracy of 85.21 percent, excelling in audio-visual alignment, event sequencing, and various evaluation metrics. This achievement is significant as it demonstrates WITA-Omni Preview's advanced capabilities in understanding and reasoning across audio and visual information, which are crucial for embodied AI systems in dynamic environments. The benchmark evaluates models on their ability to associate sounds with visible events and understand the progression of situations, highlighting the importance of these skills in real-world applications. Looking ahead, AGIBOT's WITA-Omni model is designed to enhance human-robot interactions by integrating movement and facial expressions with speech. The company has developed a human-centric multimodal interaction dataset to further improve the model's performance. No further timeline was disclosed at the time of publication.

Computing Design Humanoids News agibot AI models
Zhejiang University Team Creates Visual Reasoning System That Lets Robots 'Think With Their Eyes' — 22x Faster Than Text

Zhejiang University Team Creates Visual Reasoning System That Lets Robots 'Think With Their Eyes' — 22x Faster Than Text

A team of researchers from Zhejiang University, in partnership with Cornell University, the National University of Singapore, and Xidian University, has unveiled an innovative visual reasoning system named VisualThink-VLA. This advanced technology allows robots to process visual information directly, enabling them to "think with their eyes" instead of relying on traditional language-based reasoning. The system boasts a remarkable speed enhancement, operating 22.8 times faster than conventional text-based methods, while also achieving greater accuracy. This development marks a significant advancement in the field of robotics and artificial intelligence, potentially transforming how machines interpret and interact with their environments.

Technology
RobotToday Initiative

Robotics needs a service framework.

RSF defines a common language for robot service capability, lifecycle operations, certification pathways, and service-provider networks.

inJoin the RobotToday community on LinkedIn

Daily robotics news, in-depth analysis, conference highlights, and discussions with professionals worldwide.