Perspective techniques to extract a 3D model from a painting, nice! –
Constructing 3D models of buildings is all about extracting the geometry from images using photogrammetric techniques. As such, although it goes against basic geometric principles it also lends itself to historic reconstruction via referenced hand drawn images.
Over eight years ago we used the now sadly demised software CANOMA to create a view of London in 1616 – as the YouTube movie illustrates. CANOMA excelled at such scenes as it required only a single image to define the 3D space compared with many photogrammetric packages which require matching views and overlapping construction points.