[ Surfball Home Page | Algorithm | Construction | Press | Contacts ]

Note: This page has been downloaded and stored locally because the original page may disappear without warning. All buttons (in grey) have been disabled. All copyrights are reserved by Japan High-Tech Satellite Network Co., Ltd., NEC Corporation, Copyright (C) 1996. For further information about High-Tech Shower, please click on the icon below. Nothing below this line has been otherwise altered from the original page.

11/12#03
VISUAL ROBOTICS

Yale University



0941

(0941) DID YOU KNOW THAT ROBOTS ARE NOW ALMOST CAPABLE OF SEEING? THAT'S RIGHT, COMPUTER WHIZZES ON THE YALE CAMPUS ARE LINKING COMPUTERS AND ROBOTS WITH CAMERAS THAT ACT LIKE EYES.

0953

(0953) DR. GREGORY HAGER OF YALE UNIVERSITY IS ACTUALLY PAID TO SIT IN FRONT OF A COMPUTER SCREEN AND MAKE SILLY FACES. BUT WHAT'S GOING ON HERE IS MORE THAN WHAT MEETS THE EYE. THERE'S A CAMERA NEAR HIS COMPUTER THAT'S OBSERVING HIS EVERY MOTION.

1009

(1009) The computer is seeing only in a very restricted sense. We've told it, for example, if it's going to track a face, than what it wants to do is find an eye for example in one image. And in the next image, find that same eye again. It doesn't understand anything about eyes. It merely understand that there is an an object with a particular appearance and in subsequent images, it's trying to find the same object with roughly the same appearance.

(1036) THE IDEA OF LINKING COMPUTERS WITH CAMERAS IS NOT NEW. FOR INSTANCE, BASIC TELECONFERENCING CAN ALREADY LINK PEOPLE TOGETHER INTO A LONG DISTANCE MEETING AS LONG AS THE PARTICIPANTS STAY SEATED DIRECTLY IN FRONT OF THE COMPUTER'S CAMERA.

1056

(1056) BUT WITH HAGER'S VISUAL TRACKING TECHNIQUE, THE CAMERA ACTUALLY HAS A ROVING EYE AND CAN FOLLOW A TARGET THAT HAS BEEN MARKED, LIKE THE EYES AND MOUTH ON THE CLOWN.

(1105) THIS MEANS THAT A LECTURER CAN GET UP, MOVE AROUND, MAKE A DEMONSTRATION AND THE CAMERA WOULD CONTINUE TO FOLLOW THE SUBJECT AND PROJECT THE IMAGE. ACTORS COULD FILM THEMSELVES AND THE LIST OF POSSIBILITIES GOES ON...

1118

(1118) BEYOND FACES, COMPUTERS WITH CAMERAS CAN ALSO TRACK OTHER THINGS AND ALLOW FOR ALL SORTS OF MOVEMENT.

1125

(1125) This is our surf ball and that camera over there is watching this ball which has special markings on the other side and using the information contained in those markings, it determines that now I'm moving the ball.

1137

(1137) IMAGINE A COMPUTER MOUSE THAT MOVES IN THREE DIMENSIONS. THAT'S EXACTLY THE IDEA BEHIND THIS SURF BALL--UNLIKE THE STANDARD MOUSE ON YOUR COMPUTER WHICH ONLY MOVES UP AND DOWN, LEFT AND RIGHT, THE SURF BALL ALLOWS YOU TO MOVE IN THREE DEGREES OF FREEDOM IN ROTATION.

(1153) NOW ATTACH THIS FLEXIBLE VISUAL SENSOR TO A ROBOT AND YOU'VE GOT A ROBOT WITH A SET OF EYES THAT HAS DEPTH PERCEPTION, MUCH LIKE HUMAN BEINGS.

(1203) The computer interprets the ball's motion and sends commands to the robot that mimic my motions. For example, if I push forward, the robot moves forward. If I pull back, it moves backwards, and similarly side to side and up and down.

(1218) THIS SAME TECHNOLOGY COULD BE USED TO CONTROL A VIRTUAL REALITY ENVIRONMENT OR ANY TYPE OF ENVIRONMENT THAT YOU NEED TO MOVE IN ALL DIRECTIONS.

1226

(1226) The next generation of computers are going to be fundamentally three-dimensional. Graphics will go from the two-dimensional doman to full 3-D perception. And when you do so, there are undoubtedly any number of applications.
(1241) For example, imagine a drawing program in three dimensions. And you have to now manipulate and rotate the structures in that space. It would be very natural to have a device like this that lets you, for all practical purposes, latch onto the object you're trying to manipulate, and then have the sense of manipulating it directly.

(1303) RIGHT NOW ROBOTS WITHOUT EYES LIKE THESE IN A CAR FACTORY ARE LIMITED TO PLAYING BACK A SPECIFIC MOTION OVER AND OVER. PUT THEM IN AN ENVIRONMENT WHERE THEY NEED TO FIND OBJECTS AND THEY'RE LOST.

(1315) BUT THE POSSIBILITIES FOR SEEING-EYE ROBOTS BECOME EXPLOSIVE WHEN YOU CONSIDER THAT THEY--INSTEAD OF HUMANS-- COULD BE OUT HERE IN BOSNIA DISMANTALING LAND MINES OR IN A ONLY ROBOTS VARIETY OF DANGEROUS PLACES. WITH THAT KIND OF FLEXIBILITY, THE ONLY RISK TO LIFE OR LIMB.



Copyright (C) 1996 Japan High-Tech Satellite Network Co., Ltd., NEC Corporation
All Rights Reserved. Reproduction of the information hereby is strictly prohibited without written consent.