Email: [email protected]
GPS can be a useful inclusion in a drone’s navigational toolkit, but despite (pretty much) blanket coverage, there are areas where the technology just doesn’t cut it. Researchers from GPU maker Nvidia are currently working on a navigation system that relies on visual recognition and computer learning to make sure drones don’t get lost in the woods.
Rather than build a flying bot from scratch, Nvidia’s researchers opted to use an off-the-shelf drone. The navigation system has the company’s Jetson TX1 machine learning module at its heart, which is fed visual data from two cameras.
Still, at the experimental stage of development, it was initially designed to make its way through forest trails on rescue missions – looking out for fallen hikers or storm damage, for example. But the team believes the low-flying drone could broaden its scope to anywhere GPS would prove less than reliable or not available at all, including canyons, crowded city landscapes or checking stock in a warehouse. The system could even be adapted to search for damaged cables underwater.
The drone’s navigation system also boasts obstacle avoidance prowess, and has been taught to follow train tracks, too, and has been installed in a wheeled robot for zipping around the halls of buildings. But the main project proving ground has been forest paths, which can be more of a challenge than a relatively predictable urban setting where points of reference such as mailboxes and curb heights often remain constant. Wooded areas, by comparison, offer little in the way of uniformity – varying light, lack of markings and trees of different shapes and sizes all help to push a camera-based navigation system to its limits.
“Our whole idea is to use cameras to understand and navigate the environment,” said Smolyanskiy. “Jetson gives us the computing power to do advanced AI on board the drone, which is a requirement for operating in remote environments.”
The researchers believe that the system has already managed the longest and most stable GPS-free flight to date, flying itself along a center of a forest trail for a kilometer (0.6 mi) while also dodging obstacles.
The flying boat was taught the ins and outs of forest flying by watching video captured by three GoPro cameras attached to a rig as Smolyanskiy walked through eight miles of trails in the Pacific Northwest. The team’s TrailNet neural network was also fed video of trails in the Swiss Alps recorded by the Istituto Dalle Molle di Studi sull’Intelligenza Artificial in Zurich.
The long-term goal of the project is to be able to program coordinates into a bot’s camera-based navigation system and then have it make the trip on its own. In the shorter term, software is being developed that robot builders can download and use to get their own creations to navigate using only visual data.
- Here’s the teaser for the Mini-drone DJI is announcing this week
- Twitter launches its biggest redesign and it just got better
- Apple Announces Smart Speaker, Device Upgrades, and iOS 11
- Google’s Latest Android Update Fixes Pixel Phone Freezing
- Google launches animation tool so you can turn boring data into cool GIFs