The quality of an appearance edit is directly related to the resolution achievable by the projectors available. Various factors affect a projector's resolution and radiant power, including the projector's distance to the object and the orientation of the projector to the object. In this work, we analyze the appearance editing setup and projector pixel interaction to improve the quality of our appearance edits. Our projectors are set up such that their fields of projection are superimposed on the object's surface, and we model projector pixels as elliptical Gaussians. Thus, we require inverting a complex multi-projector light transport matrix via a constrained optimization when modeling the projector pixel interaction. We also introduce a technique to swap quickly between different appearances without having to recalculate full compensation images.
Below is a figure of our appearance editing pipeline. Using the original object as input, acquiring a 3D model of the object, calibrating the projectors and camera, projector pixel modeling, and inverting the multi-rojector light transport matrix are performed once per object as a priori computations. Then, at runtime, any target appearance can be applied quickly to produce our appearance edited objects. |