AI Beats Humans At First-person Drone Racing

Republished By Plato

Followers: 0

A fully autonomous flight AI has steered a drone through a racetrack faster than human pilots in the fledgling sport of first-person view (FPV) drone racing.

Built by researchers in Switzerland, the AI named Swift has won several races against human champions and achieved the fastest time on the pre-defined track.

With a field of competitors who look like they could be in dire need of sunlight, drone racing reached about 320 million households globally in its 2022-2023 season. News outlets have even suggested the nascent sport could eventually lead to applications in battlefield warfare.

A team of researchers led by Elia Kaufmann, a PhD student at the University of Zurich, developed a system that combines deep reinforcement learning (RL) in simulation with data collected in the physical world.

A research paper published in Nature said: “Reaching the level of professional pilots with an autonomous drone is challenging because the robot needs to fly at its physical limits while estimating its speed and location in the circuit exclusively from onboard sensors.”

Swift uses a combination of learning-based and traditional algorithms to map onboard sensory readings to control commands, the paper said. The mapping comprises of an observation policy, which distils high-dimensional visual and inertial information into “a task-specific low-dimensional encoding,” and a control policy that transforms the encoding into commands for the drone.

“Notwithstanding the remaining limitations and the work ahead, the attainment by an autonomous mobile robot of world-champion-level performance in a popular physical sport is a milestone for robotics and machine intelligence. This work may inspire the deployment of hybrid learning-based solutions in other physical systems, such as autonomous ground vehicles, aircraft and personal robots, across a broad range of applications,” the researchers said.

In an accompanying article, Guido de Croon, professor of aerospace engineering at the Netherland’s Delft University of Technology, said further developments would be required to realize the full potential of the technology.

Youtube Video

“The authors’ tests took place in a controlled indoor environment, but real drone races are held in varying environments, both indoors and outdoors. To beat human pilots in any racing environment, the drone will have to deal with external disturbances such as the wind, as well as with changing light conditions, gates that are less clearly defined, other racing drones and many other factors – all of which pose sizeable challenges to existing AI techniques,” he said.

Nonetheless, the likelihood is that piloted drones will start to perform significantly better than humans.

“Given that drones acquire sensing information more rapidly than do human pilots, who rely on delayed images, drones will no doubt eventually beat humans under these difficult conditions as well. The future could well turn, then, to ever-faster drone races that pit autonomous drones against each other – a development that will keep pushing the boundaries of this widely relevant technology,” De Croon added. ®