DIY Photography

Your one stop shop for everything photo-video

  • News
  • Inspiration
  • Reviews
  • Tutorials
  • DIY
  • Gear
Search

Submit A Story

Sony’s new AI image sensors could become the future of cameras everywhere

May 19, 2020 by John Aldred 7 Comments

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Sony recently announced a pair of new smartphone-sized IMX camera sensors. They’re the first two models of what Sony calls their “intelligent vision” sensors. Sony says that they’re the world’s first image sensors to be equipped with AI processing functionality built right into the sensor itself for the fastest possible processing speeds.

This first generation of sensors, which includes the IMX500 and IMX501 (both 12.3-megapixels), is destined more towards Sony’s commercial and industrial product clients, but their smartphone sensors will almost certainly evolve to incorporate this technology over the next few years.

The two new IMX500 and IMX501 sensors are both 12.3-megapixels and shoot 4K video at up to 60fps, with 1080p up to 240fps. They offer full video+AI processing at up to 30fps. IMX500 samples already started shipping out last month to device manufacturers, with the IMX501 expected to ship in June.

AI has come a long way in smartphones over the last few years, from a capabilities standpoint, but it’s somewhat limited by the processing methods right now. At the moment, it generally works one of two ways…

  1. The image data is uploaded from your device to the cloud, processed, and the final result is sent back down to the user’s device
  2. The image data stays within the device and is sent to another dedicated chip within the smartphone for AI processing

Both of these methods have advantages and disadvantages over the other. The advantage of #1 is that it requires fewer chips inside your device and lower hardware requirements. But it does so at the cost of speed. And if you’re out of signal area, then you may not be able process the images at all. The advantage of #2 is speed and reliability, as you’re not reliant on outside forces to process your work, but that extra chip requires space inside the device (as well as potentially a faster regular processor, more RAM, etc), making the unit larger overall.

Shifting the AI processing from a separate chip and into the sensor itself incorporates the advantages of both methods (smaller size requirements, faster processing speed and reliability) without any of the downsides of either. So, while these first two chips are destined for more commercial and industrial work, I think it’s quite logical to assume that this tech will come to smartphones in the relatively near future.

Sony has also said in the past that it sees AI as the future of mirrorless cameras, and this seems to be a step towards that goal. If Sony can scale the system up for their Micro Four Thirds, APS-C, full-frame and medium format sensors, we might start to see this type of technology appearing across the board, not just in Sony’s own cameras.

[via Android Central]

FIND THIS INTERESTING? SHARE IT WITH YOUR FRIENDS!

  • Share
  • Tweet
  • Flipboard
  • WhatsApp

Related posts:

Future iPhones could have smaller, spherically curved image sensors Future Fujifilm X cameras could get in body image stabilization Sony Banking on Its Image Sensors; Will Raise $4 Billion to Invest in Development and Production Qualcomm’s latest Snapdragon chipsets can handle 192-megapixel image sensors

Filed Under: news Tagged With: IMX500, IMX501, sensors, smartphone photography, sony, sony sensor

John Aldred: from diyphotography.net

About John Aldred

John Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

« When life imitates art – Roadrunner caught on camera being chased by coyote in Arizona desert
Cine Gear Expo 2020 in Los Angeles has been cancelled due to coronavirus »

Submit A Story

Get our FREE Lighting Book

DIYP lighting book cover

* download requires newsletter signup
DIYPhotography

Recent Comments

Free Resources

Advanced lighting book

Recent Posts

  • Here’s a bullet time video booth you can build yourself
  • Ricoh has discontinued the HD PENTAX-DA 21mm F3.2AL Limited silver lens
  • This “stellar flower” unravels the twilight’s evolution in 360 degrees
  • Strobes vs Continuous LEDs – Which is right for you?
  • Wave goodbye to Apple’s My Photo Stream next month

Udi Tirosh: from diyphotography.netUdi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Alex Baker: from diyphotography.netAlex Baker is a portrait and lifestyle driven photographer based in Valencia, Spain. She works on a range of projects from commercial to fine art and has had work featured in publications such as The Daily Mail, Conde Nast Traveller and El Mundo, and has exhibited work across Europe

David Williams: from diyphotography.netDave Williams is an accomplished travel photographer, writer, and best-selling author from the UK. He is also a photography educator and published Aurora expert. Dave has traveled extensively in recent years, capturing stunning images from around the world in a modified van. His work has been featured in various publications and he has worked with notable brands such as Skoda, EE, Boeing, Huawei, Microsoft, BMW, Conde Nast, Electronic Arts, Discovery, BBC, The Guardian, ESPN, NBC, and many others.

John Aldred: from diyphotography.netJohn Aldred is a photographer with over 20 years of experience in the portrait and commercial worlds. He is based in Scotland and has been an early adopter - and occasional beta tester - of almost every digital imaging technology in that time. As well as his creative visual work, John uses 3D printing, electronics and programming to create his own photography and filmmaking tools and consults for a number of brands across the industry.

Dunja Djudjic: from diyphotography.netDunja Djudjic is a multi-talented artist based in Novi Sad, Serbia. With 15 years of experience as a photographer, she specializes in capturing the beauty of nature, travel, and fine art. In addition to her photography, Dunja also expresses her creativity through writing, embroidery, and jewelry making.

Copyright © DIYPhotography 2006 - 2023 | About | Contact | Advertise | Write for DIYP | Full Disclosure | Privacy Policy