Education & Research Software & Algorithm Provider Collaborative 3D Printing
MIT Develops SceneSmith: AI System for Creating Realistic 3D Training Environments for Robots
Original from InterestingEngineering.com: MIT: Robots gain real-world skills through lifelike 3D virtual environments

MIT Develops SceneSmith: AI System for Creating Realistic 3D Training Environments for Robots

Researchers at MIT have developed SceneSmith, an AI-powered platform that generates realistic 3D indoor environments for robot training. This innovative system utilizes three collaborative AI agents to create detailed virtual spaces, enabling robots to practice everyday tasks safely and efficiently before real-world deployment.

The significance of SceneSmith lies in its ability to reduce the costs and time associated with traditional robot training methods. By providing a virtual setting that mimics real-life environments such as kitchens and offices, robots can learn to interact with various objects without the need for extensive human supervision or physical trials.

Looking ahead, SceneSmith has already generated over 1,300 virtual environments, allowing robots to practice tasks like placing fruit on plates and opening cabinets. Researchers have tested robot control programs in 100 different environments, achieving over 99 percent agreement between AI evaluations and human reviewers. No further timeline was disclosed at the time of publication.

Editor's Note

The development of SceneSmith by MIT represents a significant advancement in robotics training methodologies. By leveraging AI to create immersive virtual environments, the industry can expect faster and more cost-effective training solutions. This innovation could reshape how robots are prepared for real-world applications, enhancing their adaptability and efficiency in various sectors.

RobotToday Initiative

Robotics needs a service framework.

RSF defines a common language for robot service capability, lifecycle operations, certification pathways, and service-provider networks.

Share

Related Articles/News

MIT Team Unveils Transformable Robot Fleet for Advanced Water Navigation

MIT Team Unveils Transformable Robot Fleet for Advanced Water Navigation

A team from MIT, along with collaborators from the University of Wisconsin-Madison, KU Leuven, and Politecnico di Milano, has developed a fleet of eight modular robot boats capable of transforming and navigating water autonomously. Each boat measures 21 cm on each side and can connect to form larger floating platforms, demonstrating advanced coordination ...

Modular Robotics Autonomous Systems Water Navigation
MIT and Toyota Research Institute Unveil SceneSmith for Robot Household Training

MIT and Toyota Research Institute Unveil SceneSmith for Robot Household Training

MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) and the Toyota Research Institute have developed SceneSmith, an AI-powered system that allows robots to practice household tasks in a virtual environment. This system utilizes three visual language models to collaboratively create realistic 3D scenes, enabling robots to learn complex sk...

AI Robotics Virtual Reality
AI Agents Develop Virtual Environments for Essential Robot Training Data

AI Agents Develop Virtual Environments for Essential Robot Training Data

Robots are becoming more visible in public spaces, captivating onlookers. However, they still lack the versatility needed for tasks in kitchens or factories, primarily due to a significant data bottleneck. Similar to human learning, robots acquire skills through experience, but the process of physically training them in various environments is labor-inten...

Robotics
MIT and Toyota Develop SceneSmith to Enhance Robot Training with AI-Generated Environments

MIT and Toyota Develop SceneSmith to Enhance Robot Training with AI-Generated Environments

MIT and the Toyota Research Institute have introduced SceneSmith, a system that utilizes AI agents to create realistic 3D environments for robot training. This innovation addresses the significant challenge of generating diverse simulation content, which is crucial for teaching robots various tasks in a cost-effective manner. The SceneSmith system employs...

Research Robotics Artificial intelligence
Mitsubishi Motors to Begin Mass Production of Humanoid Robots by 2027

Mitsubishi Motors to Begin Mass Production of Humanoid Robots by 2027

Mitsubishi Motors has announced plans to start mass production of humanoid robots at its factory in Japan by 2027. In collaboration with the Tokyo University startup Highlanders, the company aims to produce 1,000 units per month initially, utilizing existing space in its Kyoto engine plant. The robots will first be deployed in Mitsubishi's own facilities ...

Humanoid Robots Manufacturing Automation AI Technology
Ant Group's Robotics Subsidiary Introduces Innovative Robot Brain Technology

Ant Group's Robotics Subsidiary Introduces Innovative Robot Brain Technology

Ant Group's robotics subsidiary, Robbyant, has adopted a unique approach by prioritizing the development of a robot brain over hardware design. This strategy leverages the AI infrastructure behind Alipay, which processes billions of payment transactions daily, to enhance robots' ability to perceive their environment and make autonomous decisions. The intr...

Robotics AI Machine Learning
PrimeBOT Introduces Personal Robotics at the UN's AI for Good Summit in Geneva

PrimeBOT Introduces Personal Robotics at the UN's AI for Good Summit in Geneva

PrimeBOT has introduced a new category of robotics known as Personal Robots at the UN's AI for Good Summit in Geneva. These robots are designed for everyday use in homes, allowing individuals to own, program, and create with them. The significance of PrimeBOT's initiative lies in its focus on education, inclusion, and enhancing human potential rather than...

SoftServe Introduces Virtual Gyms for Enhanced Robotics Training and Deployment

SoftServe Introduces Virtual Gyms for Enhanced Robotics Training and Deployment

SoftServe has highlighted the importance of 'virtual gyms' for robotics teams, emphasizing their role in preparing robots for dynamic environments. These high-fidelity simulation environments allow robots to train, fail, and recover safely before real-world deployment, addressing the challenges posed by unpredictable operational conditions. The global rob...

Artificial Intelligence Artificial Intelligence / Cognition Autonomous Mobile Robots (AMRs)
ROBOTTODAY Weekly July 6 – 10, 2026

ROBOTTODAY Weekly July 6 – 10, 2026

This week in robotics: AI² Robotics raises $735M for wheeled humanoids, Unitree G1 performs first live surgery, Dexmal launches DexOS platform, Agility Robotics announces SPAC, and Ondas acquires DZYNE for $875.8M. July 6–10, 2026.

RobotToday Weekly
AI² Robotics Secures $735 Million Funding for Wheeled Humanoid Robots Development

AI² Robotics Secures $735 Million Funding for Wheeled Humanoid Robots Development

AI² Robotics has successfully raised approximately $735 million in a recent funding round, elevating its valuation to around $2.8 billion. The Shenzhen-based company specializes in wheeled humanoid robots, which feature a humanoid torso and five-fingered hands, offering a unique alternative to traditional bipedal systems. This funding round attracted a di...

Artificial Intelligence / Cognition China Financial
FORT Robotics Enhances AI Safety with Nvidia Halos at Automate Conference

FORT Robotics Enhances AI Safety with Nvidia Halos at Automate Conference

FORT Robotics has joined the Nvidia Halos for Robotics ecosystem to enhance safety for autonomous robots. The company will showcase its agentic safety application, developed using the Nvidia Halos Outside-In Safety Blueprint, at the Automate conference in Chicago. This innovative solution utilizes external infrastructure sensors and visual AI agents to pr...

Artificial Intelligence Industry ai
Richtech Robotics Introduces 24/7 Livestream with AI Robot ADAM for Global Interaction

Richtech Robotics Introduces 24/7 Livestream with AI Robot ADAM for Global Interaction

Richtech Robotics, based in Nevada, has launched a 24/7 interactive livestream featuring its AI humanoid robot, ADAM. This initiative allows global audiences to engage with ADAM in real-time, asking questions and observing the robot's responses. The platform utilizes Nvidia Jetson Thor for onboard computing and the Nvidia Isaac open robotics platform, sho...

Humanoids adam AI-powered robots

Related Suppliers

Mito Robotics

Whelix develops intelligent robotic systems for automated cell culture. Its platform integrates sterile workcells, liquid handling robotics, environmental control, and data-tracked process orchestration to standardize cell expansion, monitoring, and passaging workflows in life science laboratories.

Education & Research

Mitsubishi Electric (JP)

The scraped URL resolved to an unofficial Russian-language Mitsubishi Electric HVAC reseller site. Mitsubishi Electric is a major Japanese multinational manufacturing industrial robots, factory automation systems, PLCs, servo systems, and semiconductors. Classification reflects the company's known robotics and automation product portfolio.

Mitsubishi Electric Automation, Inc.

Mitsubishi Electric Automation manufactures factory automation products including MELSEC PLCs (iQ-R, iQ-F series), FR inverters, servo motors/motion controllers, industrial robots, GOT HMIs, and CNC systems.

Industrial Manufacturing Logistics & Supply Chain Robot Manufacturer

The Robot Studio (FR)

The Robot Studio is a French robotics consultancy and integration firm offering robot programming, simulation, and training services. The company assists manufacturers in deploying and optimizing industrial robot cells across various production environments.

Robot Manufacturer Mobile Robot (AGV/AMR) Human-Machine Interaction

Dexta Robotics (CN)

Dexta Robotics develops force-feedback haptic gloves and dexterous hand hardware enabling users to physically interact with virtual environments. Products target VR simulation, surgical training, and robotics teleoperation applications.

SCANable

US VFX studio specializing in 3D and 4D photogrammetric scanning for film and television. Uses LiDAR, structured-light, and aerial drone photogrammetry to create hyper-realistic digital doubles and virtual sets; not a robotics supplier.

3D Printing Software & Algorithm Provider Perception & Vision

Lucky Robots

The Infinite Data Generation platform utilizes advanced simulation techniques to create hyper-realistic environments for robotic AI training. By generating millions of randomized, labeled episodes, it enhances machine learning efficiency, reducing training time by up to 90%. This approach eliminates hardware constraints and accelerates the development of autonomous systems in diverse scenarios, ensuring robust performance across various tasks.

ELU-AI 原力无限

ELU.AI is a Chinese company specialising in embodied intelligence robotics, launching its “FORCE” series fully-automatic charging robots and developing industry-specific AI Agent products such as the HEE super energy engine.

Buildroid

Buildroid develops a simulation-first robotics platform for construction automation using NVIDIA Omniverse-based digital twins and BIM integration. It transforms specialized and general-purpose robots (compatible with >40 types) into AI agents for multi-robot workflow orchestration, testing scenarios in simulation prior to on-site deployment. Flagship application targets masonry/block-laying with block-laying robot (BLR) and AMRs, achieving up to 30 m²/day throughput and automating ~80% of blockwork/partition-wall tasks via proprietary orchestration software and RaaS model.

Construction Mobile Robot (AGV/AMR)

Vertex Robotics (IN)

Indian robotics company developing industrial and educational robot platforms. Targets domestic manufacturing automation and STEM education markets with cost-effective robot arms and learning kits.

A&R Technology Co.,Ltd

A&R Technology Co.,Ltd is located at Shenzhen China. We are one stop industrial robot supplier and aim at providing the most suitable robot in good price.Now we can provide AUBO cobot, ABB robot, KUKA robot,ADTECH scara robot,DH robotics electric gripper and AGV etc. We promise the best cost-effective robot to every customer.

GBS German Bionic Systems GmbH

German Bionic develops AI-powered exoskeleton systems for industrial and healthcare applications. The Exia exoskeleton supports lifting, carrying, and bent-over work postures, reducing musculoskeletal injury risk in logistics and patient-care environments.

Healthcare & Senior Care Robot Manufacturer Mobile Manipulator