Nvidias researchers teach a robot to perform simple tasks by observing a human

Industrial robots are typically all about repeating a well-defined task over and over again. Usually, that entails performing those chores a safe distance away from the fragile humans that programmed them. More and more, however, researchers are now thinking about how robots and humen can work in close proximity to humans and even learn from them. In portion, that’s what Nvidia’s new robotics lab in Seattle focuses on and the company’s research team today presented some of its most recent work around teaching robots by observing humans at the International Conference on Robotics and Automation( ICRA ), in Brisbane, Australia.

Nvidia’s director of robotics research Dieter Fox.

As Dieter Fox, the senior director of robotics research at Nvidia( and a professor at the University of Washington ), told me, the team wants to enable this next generation of robots that can safely work in close proximity to humen. But to do that, those robots need to be able to detect people, tracker their activities and learn how they can help people. That may be in small-scale industrial situate or in somebody’s home.

While it’s possible to train an algorithm to successfully play a video game by rote repetition and teaching it to learn from its mistakes, Fox argues that the decision space for developing robots that route is far too large to do this efficiently. Instead, a squad of Nvidia researchers led by Stan Birchfield and Jonathan Tremblay, developed a system that enable them to teach a robot to perform new chores by simply observing a human.

The undertakings in this example are pretty straightforward and involve nothing more than stacking a few colored cubes. But it’s also an important step in this overall journey to enable us to promptly teach a robot new tasks.

The researchers first developed a sequence of neural networks to detect objects, deduce the relationship between them and then generate a program to repeat the steps it witnessed the human perform. The researchers say this new system allowed them to develop their robot to perform this stacking task with a single demo in the real world.

One nifty aspect of this system is that it generates a human-readable description of the steps it’s performing. That way, it’s easier for the researchers to figure out what happened when things go wrong.

Nvidia’s Stan Birchfield tells me that the team is also intended to build developing the robot easy for a non-expert — and few things are easier to do than to demonstrate a basic undertaking like stacking blocks. In the example the team presented in Brisbane, a camera watches the scene and the human simply strolls up, picks up the blocks and stacks them. Then the robot recurs the chore. Sounds easy enough, but it’s a massively difficult task for a robot.

To train the core models, the team mostly utilized synthetic data from a simulated surrounding. As both Birchfield and Fox stressed, it’s these simulations that allow for promptly training robots. Develop in the real world would take far longer, after all, and can also be more far more dangerous. And for most of these tasks, “were not receiving” labeled developing data available to begin with.

” We believe utilizing simulation is a powerful paradigm going forward to train robots do things that weren’t possible before ,” Birchfield noted. Fox echoed this and noted that this need for simulations is one of the reasons why Nvidia thinks that its hardware and software is ideally suited for this kind of research. There is a very strong visual aspect to this training process, after all, and Nvidia’s background in graphics hardware surely helps.

Fox admitted that there’s still a lot of research left to do be done here( most of the simulations aren’t photorealistic yet, after all ), but that the core foundations for this are now in place.

Going forward, the team plans to expand the range of tasks that the robots can learn and the vocabulary necessary to describe those tasks.

Make sure to visit: CapGeneration.com


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s