麻豆传媒

Software meshes photos to create 3D landscape

Overlapping image areas are identified and used to determine how images should be displayed in 3D environment
Photosynth stitches overlapping pictures together to create a 3D landscape, in this case of St. Mark's Square in Venice, Italy
Photosynth stitches overlapping pictures together to create a 3D landscape, in this case of St. Mark鈥檚 Square in Venice, Italy
(Image: Microsoft)

Software that automatically stitches together hundreds of photographs to create a virtual world that can be explored using a computer is to be released by Microsoft.

Called Photosynth, the software takes individual images and performs careful analyses to find matching sections. It then 鈥渟titches鈥 overlapping pictures together to create a three-dimensional landscape composed of many different snaps.

The software was developed by Noah Snavely and Steven Seitz at the University of Washington, in Seattle, US, in collaboration with Microsoft researcher Richard Szeliski.

鈥淚t鈥檚 like a hybrid of a slide show and a gaming experience,鈥 says Szeliski, manager of the Interactive Visual Media Group at Microsoft Research in Washington, US. 鈥淭his is a revolutionary way for people to interact with photos in a 3D context that more closely resembles the place where the images were captured.鈥

Zoom in

Photosynth first finds distinctive features of each image. It then creates a 鈥渨eb鈥 representing the relationships between different pictures. From this, the software can determine where the camera was positioned for each picture. It can then produce a 鈥3D pointcloud鈥 which looks as if each picture has been projected from its original camera position in three dimensions.

If a user, for example, uploads a series of holiday images featuring the same landmark they should be able explore it virtually in three dimensions and zoom in to see more features in close up.

The programmers behind the software say it could eventually be used to link up different photo collections. The research will be demonstrated at the SIGGRAPH computer graphics conference in Boston, US, on Tuesday. Microsoft has produced a video .

鈥淚t sounds very clever,鈥 says John Carter, an expert in computer vision at the University of Southampton in the UK, but he notes that its usefulness will only be proven over time.