Giving robots the gift of sight

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

Topics

Robots, 3d vision

NEWS
A Carnegie Mellon University professor known for predicting the evolution of super-capable robots says he's just given robots better eyesight. Hans Moravec has completed work on a three-dimensional robotic vision system he says will allow machines to make their way through offices and homes. The technology is "more than good enough to reliably navigate robots through a general environment," he said. Moravec's system consists of stereoscopic digital cameras and a 3D grid set up in the robot's computer brain. The system determines the robot's distance from objects by noticing the different placement of the object in the two camera images and applying a geometric equation. The grid, which is made up of 32 million digital cells, is used to help handle incomplete or potentially misleading visual data. For example, an object visible in one camera lens might be blocked from the view of the other, or a blank wall may lack distinct features that can be used for triangulation. Moravec assigns visual input to the 3D grid, and he's come up with a statistical method of judging the reliability of the data assigned to each cell. By adjusting the parameters of the formula, Moravec says the system can interpret visual input from different environments, such as regular light and low light. Robots outfitted with his system will automatically switch to the correct setting, he says. If a robot operating with a "lights on" mode comes close to hitting objects it didn't observe in the grid -- it would notice the near-miss by other proximity sensors -- it would know to change to a different setting. "It would just have to sit there for a few seconds -- sort of clear its eyes," Moravec said. In the past few decades, bad "eyes" have been a major factor limiting robots largely to industrial environments. Expectations for people-friendly droids similar to Star Wars' C3PO haven't panned out, partly because of the difficulty of training robots to move effectively and safely through the cluttered, oft-changing settings of offices and homes. Moravec knows as well as anyone about this challenge. He's been working on robotic vision and navigation since the 1970s. "It was much, much harder than we thought," he said. But there has been momentum in recent years. The HelpMate, an R2-D2-shaped robot sold by medical products firm Pyxis, carries blood samples, medicine and meals through the corridors of more than 100 hospitals. Matsushita Electric Works is working on its own medical courier robot and expects to begin selling it next spring. Robotic vacuum cleaners have been developed, and both Honda and Sony have built humanoid robots. Sony's SDR-4X is a 23-inch-tall walking robot equipped with 38 joints and stereo cameras imbedded in a shiny silver head. The robot avoids obstacles in its path, recognizes faces and sings. Toys aren't the end of the story
Moravec credits Sony with building a sophisticated machine, but says his vision technology is for more practical uses. "They're building a toy at this point," he said. "I'm looking for a utility product." Moravec initially hopes to attach his vision system to existing industrial robots. With the gift of sight, those workhorse robots will be more effective, he argues. In general, Moravec says the technology will allow robot buyers to avoid installing items such as reflective tape or bar code signs on walls that many robots need in order to get their bearings. He isn't alone in working on computer vision. Other firms tackling the topic include a Californian company called Tyzx, Vancouver-based Point Grey Research and California-based Videre Design. The 3D grid distinguishes his system from these other efforts, and that it is better suited to handling complex, cluttered environments or those with unreliable range measurements, such as the blank wall example, Moravec says. Another method for robotic vision now used involves laser range-finders, which measure the distance between the robot and objects by timing how quickly light bounces back. But Moravec says his technology will be less expensive in the long run. He estimates his system costs $5,000 (£3,100), but should decrease to $1,000 in three years thanks to ever-cheaper computer chips. "The expensive part is the computing," he said. "But the computing is falling in cost at a very predictable rate." Moravec has teamed with a small company called Botfactory to seek about $5m in investment capital to build a prototype robot "head." So far, he says he's found some interest from US industrial products company FMC Technologies and German company Karcher, which makes floor-cleaning machines. Joe Engelberger, who developed the first industrial robots for General Motors in the 1960s and built the HelpMate machine, said Moravec's work could be an important step toward robots that serve people directly. "If anyone contributes a great vision system, that's a dramatic improvement," he said. "It's probably the most important sensory capability in the robot." But Engelberger, who's trying to build a robot to take care of the elderly, says identification technology is crucial along with vision. In other words, a useful service robot will not only observe and avoid obstacles, but recognize them. "If I say to a robot, 'Get me a beer,' I would hope it doesn't bring me back a Coke," he said. Object recognition is on Moravec's "short list of next steps." He says the grid again can help with this task. "A simple approach for solid objects that have a known fixed shape would be to scan a 3D template of that shape through the 3D grid, measuring statistical correlation," he says. "There would be a big spike in correlation when the template passes an object that matches its shape." Moravec envisions more observant robots as just the beginning of an imminent robotic era. In his book, "Robot: Mere Machine to Transcendent Mind," he speculates that robots will eventually displace humans from essential roles. But Moravec isn't terribly alarmed by the thought of robots taking over. "I consider these future machines our progeny, 'mind children' built in our image and likeness," he wrote. "Ourselves in more potent form."
See the Hardware News Section for the latest update on everything from MP3 players and PDAs to supercomputing. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

greycynic

The product that scares me every time I have to use it is the Office 2007 version of Excel. The first bug that I found was applying the median...

2 minutes ago by greycynic on Ten flawed products that derail productivity
GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

1 hour ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

2 hours ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

3 hours ago by bdantas on A tale of two distros: Ubuntu and Linux Mint
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

3 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

4 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Moley

For Gnome 2 die-hards, it is possible to add icons to the bottom panel (or top top panel, if you prefer) which provide the exact Gnome 2...

4 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
ramwellian

Your comments would seem pretty naive and immature. Your 'solution' appears to be, "gee, let's all just give in to the hackers and give them...

4 hours ago by ramwellian on Cloud computing security: no more oxymoron?
BugStalker

"Interesting thought ... If you installed Win7 as a dual boot on a machine that previously only had Linux, and it wrecked your Linux installation,...

5 hours ago by BugStalker on Windows 7 Declares War on GRUB
whs001

This is an excellent summary of Ubuntu and Mint and the interface differences between them. Most such articles take a very partisan position for...

5 hours ago by whs001 on A tale of two distros: Ubuntu and Linux Mint
Moley

@ewallace. Not so clear. Anyone can obtain the text, for example from here http://www.ustr.gov/webfm_send/2379. I support ACTA so long as it and...

5 hours ago by Moley on ACTA: Facts, misconceptions and questions
45283

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

8 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA
Burn-IT

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

9 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs
ewallace

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

9 hours ago by ewallace on ACTA: Facts, misconceptions and questions
fgvrg56

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

11 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?
Ben Woods

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

12 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule
Marcus Karlsson

Any update on this, considering the claimed "first week of February"?

13 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule
apexwm

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

21 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility
txtrainguy

Replying to an old topic that I'm currently facing with my CEO (who is on a Mac). Our servers are primarily Windows Servers, office is about...

1 day ago by txtrainguy on Windows Server 2008 drops the ball for Mac compatibility
k0tcs3

Sure, that makes perfect sense. Pay wrong-doers money and thank them for breaching your security and pointing out your flaws, that would surely...

1 day ago by k0tcs3 on US indicts Romanian over NASA climate change hack