Cambridge, United Kingdom \u2013 17th June 2024<\/p>\n
Toshiba\u2019s Cambridge Research Laboratory (CRL) is excited to announce its acceleration of cutting-edge research into Embodied AI, a technology that combines physical presence with cooperative intelligence. This move reflects CRL\u2019s commitment to advancing innovative research in the field of sustainable and human-centric AI. Our latest results are presented in two papers at the high-impact computer science conference, CVPR (Conference on Computer Vision and Pattern Recognition).<\/p>\n
In today\u2019s rapidly evolving landscape, AI is becoming the cornerstone of technological innovation. In this new world, conversational agents and virtual assistants have become common place, however, AI still hasn\u2019t been effectively brought into physical domains, or to every industry; Fields such as logistics, maintenance and manufacturing cannot be fully addressed in cyberspace or using software alone. For example, Embodied AI plays an important role in reshaping the retail industry which has interaction in dynamic environments with ever-changing product offerings and customer demands.<\/p>\n
CRL is at the forefront of research into Embodied AI, fueled by a \u00a315 million investment from Toshiba in the next five years into the field. In line with this vision, Toshiba is excited to announce that CRL\u2019s innovative core technologies are going to enhance Toshiba\u2019s existing AI catalogue very soon. Our first industrial prototype of Embodied AI is planned for presentation in 2027, bringing us closer to a new era of intelligent collaboration between humans and machines.<\/p>\n
The Essence of Embodied AI<\/b><\/p>\n
Embodied AI is an agent-based AI that can manipulate objects and communicate with people, assisting us in physical tasks. These agents learn interactively from users in their environment, adapt quickly, and continuously expand their capabilities. The classical paradigm of perception and manipulation is to understand to act \u2013 e.g., segmentation is used to detect pedestrians so that ADAS (advanced driver assistance system) can operate. In the new framework of Embodied AI, we instead act to understand: Embodied AI has fast adaptation and continuous learning through task execution at its core, building a growing catalog of skills in perception, reasoning, and action.<\/p>\n
Embodied AI is critical to addressing the real-world challenges of the next generation industry. Fast adaptation enables a workforce that can intuitively deploy the power of physical AI to novel tasks through simple interaction. Our research focuses on software that can be applied to versatile hardware, integrating intelligence from disparate systems, learning from many modalities and deployments. Ultimately, CRL\u2019s Embodied AI will enable a versatile assistive system with the potential to revolutionize business operations for numerous sectors, while also facilitating flexible adaptation to meet the ever-changing needs of industry.<\/p>\n
The Research:<\/b><\/p>\n
The renewed focus of CRL to Embodied AI reflects Toshiba\u2019s ongoing commitment to improve the world through innovation. Building on a foundation of results from former Computer Vision Group and Speech Technology Group in 3D perception and human interaction, CRL\u2019s new Vision & Learning Group (VLG) and Language & Interaction Group (LIG) will drive advancements towards key objectives:<\/p>\n
CRL\u2019s strategic shift to Embodied AI aligns with Toshiba\u2019s strategic plan for software defined services. As part of Toshiba\u2019s broader digital transformation, CRL envisions an AI that can adapt to new hardware with minimal effort and facilitate the completion of long-horizon tasks by combining the collaborative strength of humans and machines.<\/p>\n
Toshiba CRL\u2019s Technical Presentations at CVPR 2024:<\/b><\/p>\n
As part of their latest research achievements, Toshiba\u2019s Vision & Learning Group (VLG) is set to present two papers on Embodied AI at CVPR. CVPR is the largest and one of the most influential international conferences in this field. These breakthroughs address fundamental technologies on two core challenges of Embodied AI: simplified interaction and fast adaptation.<\/p>\n
1. Simplified Interaction: An Innovative Pose estimation through Natural Language<\/b><\/p>\n
Traditionally, setting up robotic systems required expert knowledge, however, VLG\u2019s technology aims to simplify this process, making it accessible to a wider audience. VLG\u2019s Dialogue-Based Localization system pioneers the combination of natural language interaction with geometric computer vision tasks. By reasoning about possible robot poses within novel environments, the system iteratively refines pose estimates during dialogues. Key features include:<\/p>\n
Chao Zhang, VLG\u2019s expert on multi-modal foundation models, emphasises: \u201cNot only does this present a world first in combining a vision and language foundation model in an iterative setting. Looking at it from a customer perspective, our technology is also privacy preserving, as no sensitive image data is required for the localization task.\u201d<\/p>\n
2. Fast Adaptation: Introducing ReCoRe, an Efficient Training Framework of World Models<\/b><\/p>\n
In our ever-changing world, robots must quickly adapt to new environments and tasks. VLG\u2019s approach ensures efficient learning and generalization across diverse scenarios. ReCoRe (Regularized Contrastive Representation Learning) guides the training of world models in autonomous systems. These models represent a simplified internal environment abstraction, capturing essential aspects without unnecessary complexity. Our approach:<\/p>\n
This technology will be presented by Rudra Poudel, VLG\u2019s lead scientist on World Models for Reinforcement Learning, commenting on the results he says \u201cWorld Models compress noisy sensor input, emphasizing task-relevant signals. They let robots \u2018imagine\u2019 future outcomes and choose optimal actions. Our ReCoRe framework leads in efficient world model learning for reinforcement learning and domain adaptation.\u201d<\/p>\n
Toshiba\u2019s Cambridge Research Laboratory (CRL) is excited to announce its acceleration of cutting-edge research into Embodied AI, a technology that combines physical presence with cooperative intelligence. This move reflects CRL\u2019s commitment to advancing innovative research in the field of sustainable and human-centric AI.<\/p>\n","protected":false},"featured_media":0,"parent":0,"template":"","meta":{"_acf_changed":false,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}}},"news_category":[],"class_list":["post-6832","news","type-news","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.toshiba.eu\/cambridge-research-laboratory\/wp-json\/wp\/v2\/news\/6832","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.toshiba.eu\/cambridge-research-laboratory\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/www.toshiba.eu\/cambridge-research-laboratory\/wp-json\/wp\/v2\/types\/news"}],"wp:attachment":[{"href":"https:\/\/www.toshiba.eu\/cambridge-research-laboratory\/wp-json\/wp\/v2\/media?parent=6832"}],"wp:term":[{"taxonomy":"news_category","embeddable":true,"href":"https:\/\/www.toshiba.eu\/cambridge-research-laboratory\/wp-json\/wp\/v2\/news_category?post=6832"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}