New technology behind next-generation robots and embodied intelligenceJamaica Sugar date

Within our dreams and aspirations we find our opportunities.temperance New technology behind next-generation robots and embodied intelligenceJamaica Sugar date

New technology behind next-generation robots and embodied intelligenceJamaica Sugar date

Huaqiu PCB

Highly reliable multilayer board manufacturer

Huaqiu SMT

Highly reliable one-stop PCBA intelligent manufacturer

Huaqiu Mall

Self-operated electronic components mall

PCB Layout

High multi-layer, high-density product design

Steel mesh manufacturing Jamaica Sugar Daddy

Focus on high-quality steel mesh manufacturing

BOM ordering

Specialized one-stop purchasing solution

Huaqiu DFM

One-click analysis of hidden design risks

Hua Autumn certification

Certification testing is beyond doubt


Author: Ma Jian, Vice President of Business Development, IoT Department, Arm

Have you heard of Moravec’s Paradox? pJamaica Sugar Daddyaradox)? It means that for artificial intelligence (AI) systems, advanced reasoning requires very little computing power, and it requires very little computing power to achieve what we humans Jamaica Sugar Daddy The perceptual movement skills that are commonplace require huge computational resources. In essence, complex logical tasks are easier for AI than the basic sensory tasks that humans can perform naturally. This contradictionThe discussion highlights the differences between current AI and human cognitive abilities.

Human beings are born multimodal. Each of us is like a smart terminal. We usually need to go to school to receive knowledge training (training), but the goals and results of training and learning are Jamaicans EscortWe have the ability to work and live independently without always having to rely on internal instructions and control.

We understand the world around us through various sensory modalities such as vision, speech, sound, touch, taste and smell, and then assess the situation, analyze, reason, make decisions and take action.

After years of sensor fusion and AI evolution, robots are basically equipped with multi-modal sensors at this stage. As we bring more computing power to edge devices such as robots, these devices are becoming smarter, able to sense their surroundings, understand and communicate in natural language, gain touch through digital sensing interfaces, And through the combination of accelerometer, gyroscope and magnetometer, it can sense the comparison, angular velocity of the robot, and even the magnetic field around the robot.

Stepping into a new era of robots and

Machine cognition

Before the emergence of Transformer and Large Language Model (LLM), achieving multimodality in AI usually required the use of multiple tasks. Separate models for different types of data (text, images, audio) and integrating different modalities through a complex process.

After the emergence of the Transformer model and LLM, multi-modality has become more integrated, allowing a single model to process and understand multiple data types at the same time, thus creating an AI system with more powerful comprehensive perception of the surrounding environment. This change greatly improves the efficiency and effectiveness of multi-modal AI applications.

Although GPT-3 and other Jamaicans Escort LLM are mainly text-based, the industry has made rapid progress towards multi-modality. Stop quickly. From OpenAI’s CLIP and DALL·E to today’s Sora and GPT-4o, they are all model types moving towards multi-modality and more natural human-computer interaction. For example, CLIP understands images paired with natural language, thus bridging visual and textual information; DALL·E aims to generate images from textual descriptions. We saw a similar evolution with the Google Gemini model.

2024, multi-modal evolutionAccelerate growth. In February of this year, OpenAI released Sora, which can create realistic or imaginative videos based on text descriptions. If you think about it carefully, this can provide a promising path to building a universal world simulator, or become an important tool for training robots. Three months later, GPT-4o has significantly improved the performance of human-computer interaction and can reason between audio, vision, and text in real time. Comprehensive use of text, visual and audio information to train a new model end-to-end, eliminating the two modal conversions from output mode to text, and from text to input mode, thereby greatly improving performance.

On the same week in February this year, Google released Gemini 1.5, which greatly expanded the context length to 1 million tokens. This means that 1.5 Pro can process a large amount of information at once, including one hour of video, 11 hours of audio, including more than 30,000 lines of code or 700,000 words Jamaica Sugar Daddy‘s code base. Gemini 1.5 builds on Google’s leading research into Transformer and Hybrid Expert Architecture (MoE), and open sourced 2B and 7B models that can be deployed on the edge. At the Google I/O conference in May, in addition to doubling the document length and announcing a series of generative AI tools and applications, Google also discussed its future vision for Project Astra, a general-purpose AI assistants can process multi-modal information, understand the context of the user’s situation, and interact with people very naturally in conversations. I also hope it can help me with housework and tasks, not just chat with me!

As the company behind the open source LLM Llama, Meta is also participating in the artificial general intelligence (AGI) track.

Jamaica Sugar This true multimodality greatly improves the level of machine intelligence and will bring benefits to many industries. Come to a new paradigm.

For example, robots are already very single-purpose. They have some sensors and mobility capabilities, but generally speaking, they do not have a “brain” to learn new things and cannot adapt to unstructured and unfamiliar surroundings. .

Multimodal LLM is expected to change the analysis, reasoning and learning capabilities of robots, moving robots from specialized to Jamaicans Sugardaddy . PCs, servers, and smartphones are among the leading general-purpose computing platforms that can run many different types ofSoftware applications are used to achieve rich and colorful functions. Generalization will help expand the scale and produce economic effects of scale, and the price can also drop significantly with the expansion of the scale JM Escorts , and then be adopted by more fields, thus forming a virtuous cycle.

Elon Musk has long noticed the advantages of universal technology, and the robot Tesla launched in 2022 will Bumblebee evolves into Optimus Gen 1, released in March 2023, and Gen 2 in late 2023, with versatile Jamaicans Sugardaddy and learning capabilities. Make progress. Over the past 6 to 12 months, we have witnessed a series of breakthroughs in the robotics and humanoid fields Jamaicans Sugardaddy .

The next generation of robots and

New technologies behind embodied intelligence

Despite this, there is no doubt that we still have a lot of work to do in terms of mass production of embodied intelligence. We need simpler designs, longer runtimes, and faster and more powerful edge computing platforms to process and integrate sensor data to make real-time decisions and control actions.

And we are developing in the direction of creating humanoid robots. Human civilization has produced ubiquitous environments designed for humans for thousands of years, and humanoid robot systems have similar shapes to people. , it is expected to be able to interact with humans and the surrounding environment and perform required operations in the environment around human existence. These systems will be well-suited for handling dirty, dangerous and boring tasks such as patient care and rehabilitation, service tasks in the hotel industry, teaching aids or learning companions in the education field, and for hazardous tasks such as disaster response and hazardous material disposal. Such applications use the human attributes of humanoid robots to promote natural human-machine interaction, move in human-centered spaces, and perform tasks that are often difficult for traditional robots.

Many AI and robotics companies focus on how Jamaica Sugar Daddy how to train machinesPeople can better reason and plan in the unstructured new surrounding environment, and have launched new research Jamaicans Escort and cooperation . As the new “brain” of the robot, the model that has been trained with a large amount of data in advance has excellent generalization capabilities, allowing the robot to be more comprehensive, understand the surrounding situation more comprehensively, and adjust actions based on sensory feedback. and actions to optimize performance in a variety of dynamic surrounding situations.

To give an interesting example, Boston Dynamics’ robotic dog Spot can serve as a tour guide in a museum. Spot can interact with visitors, introducing them to various exhibits and answering their questions. This may be a little hard to believe, but in this use case, Spot’s entertainment, interactivity, and subtle performance are more important than ensuring that the facts are correct.

Robotics TransformJamaicans Escortmer:

Robot’s New Year’s Eve Brain

Robotics Transformer (RT) Under rapid development, it can convert multi-modal output directly into behavioral encoding. Google DeepMind’s RT-2 performs as well as the previous generation RT-1 when performing tasks it has seen, with a success rate of nearly 100%. However, using Jamaica Sugar PaLM-E (embodied multimodal language model for robots) and PaLI-X (large-scale After training on a multilingual visual and language model (not designed specifically for robots), RT-2 has better generalization capabilities and performs better than RT-1 on unseen tasks.

Microsoft released LLaVA, a large language and visual assistant. Originally designed for text-based tasks, LLaVA uses the powerful capabilities of GPT-4 to create a new paradigm of multi-modal command compliance data, seamlessly integrating text and visual components, which is very useful for robotic tasks. As soon as LLaVA was released, it set a new record for multi-modal chat and scientific question and answer tasks, surpassing the average human ability.

With this in mind, Tesla’s entry into the field of armor-shaped robots and AI general-purpose robots is of great significance, not only because it is designed to achieve large-scale and mass production, but also because Tesla The power of Autopilot for car desJamaicans EscortignSheng Complete Autonomous Driving (FSD) technology can basically be used on robots. Tesla also has smart manufacturing use cases that could leverage Optimus into the birthing process of its new electric car.

Arm is the cornerstone of future robot technology

Arm believes that the robot brain, including the “brain” and “cerebellum”, should be a heterogeneous AI computing system to provide excellent performance, real-time response and High energy efficiency.

Robotics technology involves a wide range of tasks, including basic computing (such as sending and receiving electronic signals to motors), advanced data processing (such as image and sensor data interpretation), and running many of the previously mentioned Modal LLM. CPUs are well-suited for general Jamaicans Sugardaddy tasks, while AI accelerators and GPUs can more efficiently handle parallel processing tasks such as machine learning ( ML) and graph disposal. Additional accelerators such as image electronic signal processors and video codecs can also be integrated to enhance the robot’s visual capabilities and storage/transmission efficiency. In addition, the CPU should also have real-time response capabilities and need to be able to run operating systems such as Linux and ROS packages.

When expanding to a robot software warehouse, the operating system layer may also require a real-time operating system (RTOS) that can reliably handle time-critical tasks, and a Linux distribution customized for robots Jamaicans Escort version, such as ROS, can provide services specially designed for heterogeneous computing clusters. We believe that Arm-initiated standards and certification programs such as SystemReady and PSA Certified will help expand the scope of robotics software development. SystemReady is designed to ensure that standard Rich OS distributions can run on a variety of Arm-based system-on-chips (SoCs), while PSA Certified helps simplify security implementation plans to meet regional security and regulatory regulations for connected devices. request.

The advancement of large multi-modal models and generative AI heralds a new era in the development of AI robots and humanoid robots. In this new era, for robotics technology to become mainstream, in addition to AI computing and ecosystems, energy efficiency, security, and performance security are essential. Arm processors have been widely used in the field of robotics, and we look forward to working closely with the ecological Jamaicans Sugardaddy system.Making Arm the cornerstone of future AI robots.


Original titleJM Escorts: Big names’ opinions | AI big models Moving towards multi-modality to help embodied intelligence Jamaicans Sugardaddy achieves innovation with robots

Article source: [Micro Electronic signal: Arm community, WeChat public account: Arm community] Welcome to add tracking and care! Please indicate the source when transcribing and publishing the article.


Embodied Intelligence: A new era of artificial intelligence, empowering the new engine of future technology. The embodied intelligence system is based on the concept of embodied cognition, emphasizing that intelligence not only comes from the brain, but also from the body and surroundings. Situation interaction. 's avatar Published on 07-25 10:19 •493 views
iSoftStone and Zhiyuan Robot reached a joint cooperation to jointly draw the “embodiment” of humanoid robots The new chapter of “intelligence”, especially the technological innovation and scene application of humanoid robots, has taken a solid step. This joint cooperation is not only a positive response to the arrival of the “embodied intelligence” era's avatar Published on 07-04 14:59 •458 views
Published by huawei Cloud Pangu’s large model of embodied intelligence leads a new era of robots. At yesterday’s Huawei Developer Conference 2024, Zhang Anran, Huawei’s Managing Director and Huawei Cloud CEO, announced an innovative achievement that shocked the industry – the official release of Huawei Cloud Pangu’s large model of embodied intelligence was unveiled, and the avatar equipped with this was displayed live. Published on 06-22 11:36 •829 views
Embodied intelligence and the humanoid Jamaica Sugar Current situation, challenges and future directions in the field of robots Among the many frontier fields of artificial intelligence (AI), embodied intelligence (Embodied Intelligence) has become the most eye-catching investment hot spot in the primary market this year. At the 6th Beijing 's avatar Published on 06-20 10:52 •492 views
TE wireless connection to help the next generation of service robots! Application” special session , TE Jamaica SugarConnectivity (Tyco Electronics, referred to as “TE”) Account Manager LiuJamaica Sugar Xiaomin released a speech titled “TE Wireless Connectivity, The keynote speech of “Empowering the Next Generation of Service Robots to Transform the Future”. With the rapid development of the robot industry, robot's avatar Published on 05-17 10:49 •1784 views
Force Control, JM Escorts Flexible touch has become a core demand, and what kind of embodied sensing system robots should be built for robots. Industry insiders believe that embodied intelligent robots are the ultimate form of artificial intelligence. 's avatar Published on 04-26 01:03 •2145 views
The Guangdong Provincial Embodied Intelligent Robot Innovation Center was officially launched, and Obi Zhongguang became a shareholder in April On the 16th, the launch ceremony of the Guangdong Provincial Embodied Intelligent Robot Innovation Center (hereinafter referred to as the “Innovation Center”) was held in Nanshan District, Shenzhen, witnessing the development of the humanoid robot industry entering a new stage. 's avatar Published on 04-18 09:44 •387 views
Yuntian Lifei was invited to attend the Guangdong Province Embodied Intelligent Robot Innovation Event on April 16 , the launching ceremony of the Guangdong Provincial Embodied Intelligent Robot Innovation Center was held in the Nanshan District Government of Shenzhen City. Yuntian Lifei is the embodiment of Shenzhen Guochuangavatar Issued on 04-18 09:32 •281 views
Fibocom releases a mobile phone based on Qualcomm’s high computing power chip Embodied intelligent robot development platform Fibot On March 29, in order to help robot manufacturers and customers quickly reproduce and verify the relevant algorithms of the Stanford Mobile ALOHA robot, Fibocom released Embodied Intelligence. Released on 03-29 14:17 • 247 views
Fibocom released Fibot, an embodied intelligent robot development platform based on Qualcomm’s high computing power chip, on March 29 to help robot manufacturers and customers quickly reproduce and verify StanJM Escorts Fu Mobile ALOHA robot’s related algorithm, Fibocom released embodied intelligence 's avatar Published on 03 -29 11:16 •496 views
Fibocom releases Fibot, an embodied intelligent robot development platform based on Qualcomm’s high computing power chip, March 29, Fibocom released Fibot, the embodied intelligent robot development platform. 1. The upgraded configuration version of the first domestic Mobile ALOHA robot 2. Adopt omnidirectional wheel chassis design 's avatar Published on 03-29 10:50 •269 views
Fibocom released Fibot, an embodied intelligent robot development platform based on Qualcomm’s high computing power chip. On March 29, Fibocom released Fibot, an embodied intelligent robot development platform. 1. Upgraded configuration version of the first domestic Mobile ALOHA robot JM Escorts 2. Adopt omnidirectional wheel chassis design, 's avatar Published on 03-29 10:49 •459 views
Fibot releases the embodied intelligent robot development platform Fibot to assist robot manufacturers to reproduce more efficiently And verifying the advanced algorithm of Stanford Mobile ALOHA robot, Fibocom recently released a new embodied intelligence 's avatar Published on 03-29 09:29 •558 views
Development and research of embodied intelligent position-changing robots Multi-modal perception technology can enable embodied intelligent position-changing robots to achieve higher independence, efficiency, and versatility, and enhance their awareness of the surrounding environment Partial perception ability, and was published on 03-12 11:38 • 509 times viewed