麻豆淫院

During a semester, a class of EPFL Master鈥檚 students took photographs of Lausanne鈥檚 statues and then modeled them in three dimensions to create a virtual museum.

Armed with ordinary digital cameras, 24 EPFL students roamed Lausanne taking pictures of the city鈥檚 statues, and then displayed them in three dimensions in a virtual museum exhibit. To give depth to their images, they used an algorithm developed by Pix4D, a spin-off of the Computer Vision Laboratory (CVLab).

To carry out this project of this scope, the group participated in defining objectives, organizing and planning the various stages. The students from EPFL鈥檚 Computer Graphics and Geometry Laboratory (LGG) then put their expertise into practice in the streets of Lausanne, tracking down statuary and photographing them from a variety of angles.

Statues with black holes

Even though the software does a lot of the work, making the task seem simple on paper, in reality, the work was far from straightforward. Christophe Chiche, like all the students in the group, had to try out several methods before finding one that was satisfactory: 鈥淚nitially we took 30 to 40 pictures of a statue, but the program only needed about 15 to reconstruct the image.鈥�

The algorithm generates a cloud of points that must then be reworked and reconstructed. The program cannot reconstruct all the hidden elements that don鈥檛 appear on a photograph, such as the top of a statue鈥檚 head, or the underside of its arms or shoulders. 鈥淚n their place we had black holes, so we had to calibrate programs in other algorithms in order to fill in the missing parts; it was a mess.鈥�

Capturing the texture was another challenge. 鈥淲e had several possibilities,鈥� explains Michael Barroco, another student. 鈥淓ither we glued the photo onto the 3D image, or we reworked the entire texture, which we had to do several times because some statues had been defaced by graffiti. Some even sported handsome sprayed-on mustaches.鈥�

Collaboration with the department of culture

This artistic idea was the brainchild of professor Mark Pauly, an amateur art enthusiast. He had dreamed of using Pix4D to model the details of Lausanne cathedral鈥檚 porch. But that would have required installing way too much equipment. Instead, he chose to model human-sized sculptures, spread around the city. The initiative led to an unexpected collaboration with Lausanne鈥檚 department of culture. 鈥淲hen I asked them about it, they didn鈥檛 know exactly how many sculptures the city owned, or where they all were. Our project allowed them to start an inventory of Lausanne鈥檚 public artwork.鈥�

Enter a 3D city

Pix4D has extensive experience in using aerial photography to generate three-dimensional images. The spin-off modeled Lausanne鈥檚 old town using photographs taken by a micro-drone flying over the city. It was a lengthy project, requiring 500 aerial photographs.

The company hadn鈥檛 yet done anything on a small scale. 鈥淲e take photographs from an altitude of 100m. This time, the students took pictures at just a few meters away from their model. Their work on the ground helped us improve our software, which hadn鈥檛 allowed this level of precision before,鈥� explains one of Pix4D鈥檚 founders, Olivier K眉ng. He also hopes to be able to integrate these improvements into ordinary cameras.

This collaboration has been a real transfer of technology. 鈥淥ur dream,鈥� he continues, 鈥渨ould be not only to get a bird鈥檚 eye view of a city in three dimensions, but to glide among its buildings and wander through its streets.鈥�

Lausanne鈥檚 cathedral

The collaboration between Pix4D and the LGG is not over. The cathedral鈥檚 porch will be photographed and modeled in 3D by the next crop of students, using a combination of photographs taken on the ground and in the air by small, remote-controlled helicopters.