Beruflich Dokumente
Kultur Dokumente
Propaganda Users
Search
This article provides a manual approach to solving problems related to the following topics:
Projecting on 3D Geometry
Texturing real Architecture via Projections
Projection/Video Mapping
Undistoring Projections
Augmented Reality
C amera Matching/Resectioning/C alibration
Pose Estimation
Note that due to the manual nature of the described approach your results will not be perfect, but can
be quite good depending on your patience.
Shoutbox
~3h ago
udo2013:
http://www.youtube.com/watch?
v=xoG24x137ac
~6h ago
Introduction
Projection on a flat surface
Projection on an arbitrary surface
Manually matching a static virtual projector with a real projector
Virtual replica of the real scene
Flat textures aligned to the surface
Lights and Shadows
3d illusion
Virtual C amera's perspective is different to real world projector position
Projecting on two sides of a house with one perspective
360 projection setup
phlegma: H OM E OMOR
PH ISM_Dome A/V
Performance https://vimeo.com/109912712
~7h ago
Introduction
All the above mentioned topics deal with the same problem: Find the pose (position, orientation) of an object or
the pose and lens characteristics (field of view, shift) of a camera viewing that object.
~1d ago
In cinematography with 3d visual effects the terms "match moving" or "camera tracking" are used to
describe the problem of matching a real world scene with its virtual counterpart in order to mix them together
seamlessly. For this task a list of software exists ( boujou, 3d equalizer, ...) that makes the live of visual
effects people easier.
For realtime computergraphics the ARToolKit provides a way that works for certain situations (see
ARTK+Tracker? for a vvvv implementation) and companies like domeprojection offer projector
autocalibration services. But as long as vvvv doesn't have nodes to patch something like this or even this
the manual approach for static matching can still help to solve certain problems.
Noir:
https://developer.nvidia.com/content/newflex-features
~4d ago
MartinUI:
https://www.youtube.com/watch?
v=aMli33ornEU
~5d ago
Note: Like this you can always get a correctly looking projected image on a flat surface independent of the
projectors position, orientation to the surface and its lens characteristics.
Joanie_AntiVJ: testers
needed :) mapping-toolkit2d
read more
follow on twitter
converted by W eb2PDFConvert.com
Having seen the above you should now understand that the key to a correctly undistorted projection is the
following:
A projection onto an arbitrary surface looks undistorted (ie. exactly as being projected) when seen
from the point of view of the projector.
Also compare
3D Painted Rooms.
So in order to achieve an undistorted look on an arbitrary surface you simply have to provide the projector
with an image that depicts a view onto that surface from its own (the projectors) position. Or in other words:
consider the real projector being a camera in virtual space, viewing a virtual replica of the real projection
surface. If you project the image this virtual camera sees with the real projector, it would fit exactly and look
undistorted on the real surface.
Note that this works perfectly only in theory, as chances are that your virtual scenes parameters will never
exactly match your real world parameters, as some of them, like the projectors orientation, are hard to
measure precisely. But never mind, there begins the manual tweaking of those parameters and with some
patience and practice you'll get quite good results.
create the target projection surface as a 3d model and place it correctly in your virtual scene regarding the
coordinate systems origin: you can do this using an external 3d modelling tool or using vvvvs geometric
primitivs. Anyway its best to have a mesh which you can finetune manually using
PointEditor (3D Persistent) during the matching process.
measure the position, orientation and lens-characteristics of the projector: use the Projector (EX9)
module and specify all parameters this node offers. Look for sketches like the following in the projectors
manual that provide you with the information for lens-shift and field of view of the lens.
At this point you have a basic setup where the virtual scene matches the real world. Take your time to fiddle
with the parameters of the Projector (EX9) module or slightly adapt your mesh using the
PointEditor (3D Persistent) module until you are satisfied with the overlapping of your virtual and real world
scene.
ProjectionMapping_SimpleSetup.v4p (27.74 Kb)]
converted by W eb2PDFConvert.com
By rendering the 3d model from the same viewpoint and using the same lens-characteristics as the real
projector has for the virtual camera, the resulting image will perfectly fit the projected surface. Any flat
textures you give the 3d model (in the above example a simple black cross on white) will look undistorted on
the real surface and therefore look and behave naturally like flat textures that look the same independent of
the spectators point of view.
3d illusion
Fake 3d effects like seen in Pablo Valbuena's The Hague C ity Hall projection, AntiVJs Nuit Blanche Bruxelles
projection and some of easyweb's projections contain an additional quirk you should be aware of.
While with the above setup those effects are quite easy to achieve, by simply adding 3d extensions to your
virtual model, for a spectator they really only work from the one point in real world that corresponds to the
virtual cameras position. Like this simple example shows, when viewed from about the projectors perspective
the text seems to be extruded from the little box. When viewing the same projection from a completely
different point, the illusion is gone.
But never mind, in many cases this isn't a big deal as our TV/cinema trained eyes and brains are quite tolerant
with such visual challenges as long as our viewing position isn't too far off the actual position. Also compare
John Beever's Pavement Drawings.
Knowing that those effects only work from one perspective a spectators view was chosen from which both sides
of the facade can be seen. That is in the middle of the two real projectors to be used.
converted by W eb2PDFConvert.com
The above picture demonstrates that the 3d-illusion only works from the specified virtual camera/spectator
position. For more results of the 5 days workshop in Schwbisch Gmnd see here.
converted by W eb2PDFConvert.com