DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

This tech controls drones by following your eyes

Sep 24, 2018 by Dunja Djudjic Leave a Comment

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

We’ve seen tech that lets you control a drone with body movement and with facial expressions. And now, the engineers at New York University, the University of Pennsylvania, and the U.S. Army Research Laboratory have teamed up to create a new tech that lets you control a drone with your eye movement. With a pair of eye-tracking glasses, you can tell your drone where to fly simply by moving your eyes.

YouTube video

The research team explains how the system works, describing that it uses a gaze tracker, a camera, and an Inertial Measurement Unit (IMU) installed into the glasses. This system can perform different tasks. It can estimate the relative position of the pilot in relation to the drone and allow them to send new 3D navigation waypoints to the drone. Also, it can “decouple the gaze direction from the head orientation,” meaning that you can control the drone with your gaze no matter in which direction your head is turned.

The team writes that they use a combination of camera and IMU data to decouple the human gaze from the head motion. And in order to detect the drone, they use a deep neural network. As for the applications of this method, there are a number of them. The first that came to my mind is using this tech for people with disabilities. The team behind the eye-controlled drone mentions it too, but they also point out that it could be used for “inspection” and “first response” as well.

Now, this seems pretty awesome at the first sight (no pun intended). But a drawback I see is that you have to be really focused on the direction of your gaze, which isn’t always as easy as it may sound. The direction of your gaze is not always voluntary and completely controlled, so I guess this can be a bit of a challenge.

[Human Gaze-Driven Spatial Tasking of an Autonomous MAV voice via Digital Trends]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Virginia Tech crash tests collisions between humans and drones Loupedeck puts Lightroom controls right at your fingertips The Portkeys LH5P is a great monitor that also controls your camera Canon Announces the New EF 50mm f/1.8 STM Lens; Following in Yongnuo’s Footsteps?

Filed Under: Gear Tagged With: drone

Dunja Djudjic: from diyphotography.net

About Dunja Djudjic

Dunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

« Panasonic to announce 2 new full frame mirrorless cameras and 3 L mount lenses
Photo of new medium format Leica S3 leaks on Leica China website »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup

Recent Comments

Free Resources

Advanced lighting book

Learn photography

Recent Posts

  • AstrHori new 28mm f/13 2x Macro Periscope lens sees round corners
  • Sony World Photography Awards under fire for age limitations in Student contest
  • 5 ways to find inspiration when the weather is sad and grey
  • Photographers, keep an eye out for auroras around the world this weekend
  • How to make beautiful frozen soap bubble photos this winter

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy