Fast Indoor Robot Watches Ceiling Lights, Instead of the Road

[Andy]'s robot is an autonomous RC car, and he shares the localization algorithm he developed to help the car keep track of itself while it zips crazily around an indoor racetrack. Since a robot like this is perfectly capable of driving faster than it can sense, his localization method is the secret to pouring on additional speed without worrying about the car losing itself.

The regular pattern of ceiling lights makes a good foundation for the system to localize itself.

To pull this off, [Andy] uses a camera with a fisheye lens aimed up towards the ceiling, and the video is processed on a Raspberry Pi 3. His implementation is slick enough that it only takes about 1 millisecond to do a localization update, netting a precision on the order of a few centimeters. It's sort of like a fast indoor GPS, using math to infer position based on the movement of ceiling lights.

To be useful for racing, this localization method needs to be combined with a map of the racetrack itself, which [Andy] cleverly builds by manually driving the car around the track while building the localization data. Once that is in place, the car has all it needs to autonomously zip around.

Interested in the nitty-gritty details? You're in luck, because all of the math behind [Andy]'s algorithm is explained on the project page linked above, and the GitHub repository for [Andy]'s autonomous car has all the implementation details.

The system is location-dependent, but it works so well that [Andy] considers track localization a solved problem. Watch the system in action in the two videos embedded below.

This first video shows the camera's view during a race.

This second video is what it looks like with the fisheye lens perspective corrected to appear as though it were looking out the front windshield.

Small racing robots have the advantage of not being particularly harmed by crashes, which is something far more embarrassing when it happens to experimental full-sized autonomous racing cars.

#carhacks #robotshacks #autonomous #diyrobocars #indoorracing #localization #opencv #positionsensing #racing #robotcar

« Our #gophercars are looking forward to today's @GopherCon #hardware hack session... #diyrobocars #golang #dnn #movidius #openvino https://t.co/PXH6yXc923 »

— Retweet https://twitter.com/gobotio/status/1155108370770063360

« Hi @GopherCon just about 24 hours until our community day #hardware hack session! We have 300 @arduino Nano33 boards, we have #drones we have #diyrobocars and more! Tomorrow 9AM Pacific Ballroom 21 be there! »

— Retweet https://twitter.com/gobotio/status/1154769892580765696

« Just 1 week until the @GopherCon community day #Hardware hack session! We will have #drones #robots #diyrobocars and so much more. Hardware for all provided by our "secret sponsor" to be revealed next week...

https://www.gophercon.com/agenda/session/49050 »

— Retweet https://twitter.com/deadprogram/status/1152609071050055680