Your penguin photos from Antarctica now help scientists track them

You may have heard that you can help NASA with their research of black holes or solar storms. But did you know your tourist photos can contribute to other areas of science, too?

Researchers from Stony Brook University have developed a computer vision method that use penguin photos taken in Antarctica to study ecological changes in the region. By determining the precise locations of penguin colonies through these images, scientists hope to gain insights into shifts in penguin abundance and distribution over time.

“There are far more tourists in Antarctica than scientists, and virtually everybody has a camera in their pocket and many take photos of penguins,” says Heather Lynch, a lead researcher on the project, published in PLOS One.

With many thousands of photos of Antarctica potentially available on the web, the question is how can we use the data collected by all those photos to track penguin populations? Our challenge was to figure out how to extract information about precisely where the penguins were in a photograph even if no additional information was available.”

The research team combined satellite images with advanced AI techniques to pinpoint the geographic location of penguin colonies captured in photos. By draping satellite images over a 3D digital elevation model, the researchers determined the location and orientation of the cameras used to take the photos. This allowed them to map colony boundaries accurately.

They also addressed two major technical hurdles: delineating colony edges (segmentation), and georeferencing, which assigns precise geographic coordinates to objects in images. Lynch praised a new AI model, Segment Anything Model, for automating the boundary detection process in their study.

Georeferencing proved to be a unique challenge in Antarctica, as the continent’s natural landscapes lack the distinctive features common in urban environments, like buildings, that help in 3D mapping. The researchers overcame this by constructing a detailed 3D model of the penguin-inhabited islands.

Implications

The technique opens up new avenues for long-term environmental monitoring. Unlike satellites or drones, which may not always be accessible, tourist photos can provide a wealth of untapped data. Lynch emphasized the method’s potential, stating:

“In theory, this information gathered by the computational technique can be compared to other similarly processed images of the Antarctic to see how penguin colonies are changing over time.”

While promising, the researchers note that some challenges still remain. They include varying image quality and the dynamic nature of Antarctic environments. However, they believe this method could also be applied to track other environmental changes, such as glacial retreat.

With the growing prevalence of tourists in remote locations like Antarctica, this research highlights how everyday photography can contribute to crucial scientific knowledge. Visitors get to capture breathtaking memories, and science gains a new tool to protect the planet’s fragile ecosystems. It’s a win-win!

[via PetaPixel, Stony Brook University]

---