Meet RT-2

[The Bleeding Edge]( Meet RT-2 By Colin Tedards, Editor, The Bleeding Edge Dear Reader, The empty fryer basket hit the oil, and the CEO’s face turned red with embarrassment. I’d been invited out to see a demo of a “robot cook.” It was supposed to automate the messy work of using the fryer and grill in fast-food restaurants. The robot’s french fry hopper had run dry during the demo. But it was still tending to an empty frying basket as if it was full of sizzling fries. It was a good idea. But the tech still had a ways to go. Last week, AI researchers showed off a robot that wouldn’t have made that same mistake. And it has important implications for the future of work… Recommended Link [Can this expert trader’s One Ticker Retirement Plan jump-start your financial freedom?]( [image]( Market Wizard Larry Benedict crushed the market in 2022… He delivered a perfect track record to his One Ticker Trader readers, going 11-for-11. Previously, he went 20 straight years on Wall Street without a single losing year. And when the market plummeted 37% in 2008, he delivered 23% returns… Now he’s sharing an over-the-shoulder “demo” of his winning strategy in action. He calls it the One Ticker Retirement Plan… And it takes less than 10 seconds to demonstrate. [Watch it here.]( -- Meet RT-2 On July 28, DeepMind, Google’s AI research lab, unveiled Robotic Transformer 2 (RT-2), an AI-powered robot. Unlike previous generations of robots that had limited application, RT-2 can use reasoning to understand commands and interact with the world. It does this with two technologies. First, it uses vision-language models to reason through commands and make sense of the world. That means it sees the world and assigns labels to everything within it. It can then process a natural language command and act on it. Today, most robotic automation is designed to complete simple, repetitive tasks. What makes RT-2 unique is that it can “see,” “hear,” and understand the world around it. Let me offer you an example from DeepMind’s presentation. RT-2 was asked to pick up an extinct animal from a table littered with toy animals, fruits, balls, and other objects. Within seconds of being prompted, RT-2 reached for the dinosaur and held it up. The AI was able to identify all of the objects and reasoned that the toy brachiosaurus was the extinct animal. Importantly, RT-2 wasn’t programmed to perform that specific task. It had to “figure out” the command. Source: Google DeepMind That means its AI correctly identified all of the objects on the table, assigned meaningful labels, and translated the command into the correct action. That’s an incredible breakthrough. This is the first time to my knowledge that a robot has shown this level of reasoning and response. And what’s most interesting is how RT-2 “thinks.” Recommended Link [Digital Dollar Could Send These Three Stocks Booming]( [image]( A digital dollar (or CBDC) could soon replace the U.S. dollar. Most people could end up holding worthless dollars. But a few could get rich from this new shift. You see, if you know which companies are working on these CBDC projects, you could come out of this shift wealthier than you ever thought possible. [Click here to get the names of three companies that could benefit from this trend, completely free of charge.]( -- Real-Time Learning Previous versions of robots were trained with large visual data sets. Imagine teaching a robot what everything is with a giant stack of flashcards. In a controlled lab setting, it might do alright. But if you take it out in the real world, it’ll struggle to make sense of what it sees. RT-2 doesn’t work that way. Using two different versions of AI models, it effectively searches a snapshot of the web for all of the objects in its view. In some sense, it learns in real time. RT-2 uses PaLI-X and PaLM-E to make sense of commands and what it sees. PaLI-X is a variant of the Pathways Language and Image model. This is what powers its ability to make sense of what it sees. In essence, it adds captions to everything within its field of view. PaLM-E is the Pathways Language model Embodied. This is a multimodal (language and images) AI that has been “embodied” to make sense of the world through its robotic sensors. PaLI-X uses 32 billion parameters and PaLM-E uses 2 billion. The parameters are the values that make up the final AI model. Despite the difference in the number of parameters used, the “reasoning” abilities of these models surpass previous AI-robot models. [(Click to enlarge)]( The purple and green bars are RT-2. The gray bar is RT-1, the previous version from DeepMind. And VC1 is the classic, visually trained “flashcard” model. You’ll notice a dramatic increase in capabilities. The old visually trained robot never scored higher than 20%. RT-2 scored between 30% and 80%. I’ll admit, that still isn’t high enough for real-world use. We certainly don’t want robots banging around with only a 50% success rate. But what RT-2 shows is a breakthrough in how to program robots. RT-2 isn’t the end… It's the very beginning of interactive robots. Let’s take a moment to consider the practical applications of RT-2. Recommended Link Millionaire Investor Reveals: [“How I Made My Second Fortune… By Avoiding 99% of Stocks”]( [image]( Buy this small group of unique stocks… never sell them… and make all the money you need… No matter what happens in the market. [Revealed here: the name and ticker of the #1 stock.]( -- RT in the Real World I can see an AI-powered robot like RT-2 being used in Amazon warehouses. It would be able to receive items in the warehouse, sort them into bins that go on the shelves, and also retrieve items for shipping. It could use both visual identification and barcode scanning to make sure that it’s handling the correct item. Similarly, robots like RT-2 could be used to restock store shelves overnight. Those are mass commercial applications. I also think these robots could make their way into our homes. Imagine the convenience of being able to ask RT-2 to sort and fold your clothing… set the table for dinner… or let the dog out. Those might seem like mundane uses, but what if these robots allowed the elderly to stay independent for longer? Having an untiring helper always there to assist with daily chores preserves independence and even offers a layer of safety. I’d feel better knowing that my grandma isn’t getting up on a stool to reach dishes. I don’t think these are far-flung dreams. DeepMind unveiled RT-1 in December 2022. Not even a year later, we have RT-2… a 2x-3x improvement. Subsequent versions will get even better. And competitors will use this framework to create rivals that will have an edge in one way or another. RT-2 shows that AI isn’t just capable of doing white-collar work like writing reports or creating images. It can also interact with the physical world. That means we’re heading for a world where certain forms of physical labor are divorced from human effort. I can just imagine robots laying bricks, picking fruits, loading trucks, and so much more… That would create a leap in productivity that we can hardly imagine today. Now, here’s my question to you: Would you invite a future version of RT-2 into your home as an assistant? Share your thoughts with me at feedback@brownstoneresearch.com. Regards, Colin Tedards Editor, The Bleeding Edge --------------------------------------------------------------- Like what you’re reading? Send your thoughts to feedback@brownstoneresearch.com. IN CASE YOU MISSED IT… [The only stock to keep (revealed below)]( Jeff Clark has been trading stocks for nearly 40 years. He knows the market. He predicted the crashes of 2008, 2020, and 2022. He’s helped his readers avoid huge losses… And still had 13 gains last year alone. He’s done it by avoiding 99.9% of all stocks… Only trading this one, [revealed in this video below.]( Now Jeff is helping his 23-year-old son overcome his huge losses in crypto and tech stocks… By using this same method. [Watch how he plans to win back all of his son’s losses with this one ticker revealed here.]( [image]( [Brownstone Research]( Brownstone Research 55 NE 5th Avenue, Delray Beach, FL 33483 [www.brownstoneresearch.com]( To ensure our emails continue reaching your inbox, please [add our email address]( to your address book. This editorial email containing advertisements was sent to {EMAIL} because you subscribed to this service. To stop receiving these emails, click [here](. Brownstone Research welcomes your feedback and questions. But please note: The law prohibits us from giving personalized advice. To contact Customer Service, call toll free Domestic/International: 1-888-512-0726, Mon–Fri, 9am–7pm ET, or email us [here](mailto:memberservices@brownstoneresearch.com). © 2023 Brownstone Research. All rights reserved. Any reproduction, copying, or redistribution of our content, in whole or in part, is prohibited without written permission from Brownstone Research. [Privacy Policy]( | [Terms of Use](