Interactive Shape Deformation
Interactive deformation is an important aspect of geometry processing, used for instance in CAGD and the movie industry. In our work, shape manipulation is driven by a variational optimization, which guarantees high quality deformations by minimizing physically-inspired energies subject to user-controlled constraints (Figures 1,2). We distinguish between linear and nonlinear approaches, depending on whether the energy minimization leads to the solution of a linear or nonlinear problem.
Using simplified quadratic energies leads to a linear system to be solved for the deformed surface each time the user changes the constraints or drags some surface points [3]. These so-called multiple right-hand side problems can be solved efficiently using sparse Cholesky factorization [4]. Precomputing deformation response functions, which can then be evaluated instead of solving the linear system, even allows for real-time mesh editing [3]. Fine-scale geometric details are intuitively preserved through so-called multi-resolution or multi-scale deformations [1,2,3,6], which first separate the global shape from the fine-scale details, then deforms the global shape, and finally adds back the fine-scale details (Figure 3).
Space deformations warp the whole embedding space of an object, instead of computing the deformation on the surface mesh only. As a consequence, the complexity and stability of the deformation is decoupled from the object’s mesh representation, such that on the one hand very complex models, and on the other hand also point clouds or irregular triangle soups can be processed. In [5,8] we represent the space deformation by triharmonic radial basis functions, which provides smoothness guarantees similar to surface-based deformations. Since each mesh vertex is now transformed individually, the involved computations can be delegated to the programmable shaders of recent graphics hardware, which enables real-time shape editing of complex models at a rate of 30M vertices/sec (Figure 4).
While linear deformation approaches are extremely efficient, the involved linearizations can lead to artifacts under large deformations, in particular for large rotations (Figure 5), as we analyzed in our survey [10]. In such cases, nonlinear deformation techniques have to be employed. However, since then a nonlinear constrained minimization problem is to be solved for each step of an interactive deformation, particular attention has to be paid to computational efficiency and numerical robustness.
In [7] we developed a new nonlinear method for 3D surface deformation that achieves intuitive and robust deformations by emulating physically plausible surface behavior inspired by thin shells. The surface mesh is embedded in a layer of volumetric rigid cells, which are coupled through non-linear, elastic forces (Figure 6). To deform the mesh, cells are rigidly transformed to satisfy user constraints while minimizing the nonlinear elastic energy. The nonlinearity allows for intuitive results even under large scale deformations. The rigidity of the prisms prevents degeneration even under extreme deformations, making the method numerically stable. Our modeling framework allows for the specification of various geometrically intuitive parameters that provide control over the physical surface behavior (Figures 7, 8). Interactive performance is achieved by a hierarchical multi-grid solver [7] or by an adaptive space deformation approach [9]. For the latter, the object is embedded into an adaptively refined octree-like voxelization (Figure 9), which can even be dynamically refinement during object deformation (Figure 10). Thanks to the space embedding, the approach is applicable to arbitrary sample-based representations, such as meshes, triangle soups, or point clouds (Figure 11).
Related Publications
[1] |
Multiresolution Surface Representation Based on Displacement Volumes
Computer Graphics Forum 22(3), Proc. Eurographics 2003, pp. 483-491.
|
|
[2] |
An Intuitive Framework for Real-Time Freeform Modeling
ACM Transactions on Graphics 23(3), (Proc. SIGGRAPH), 2004, pp. 630-634.
|
|
[3] |
A Remeshing Approach to Multiresolution Modeling
Eurographics Symp. on Geometry Processing 2004, pp. 189-196.
|
|
[4] |
Real-Time Shape Editing using Radial Basis Functions
Computer Graphics Forum 24(3), Proc. Eurographics 2005, pp. 611-621.
|
|
[5] |
Efficient Linear System Solvers for Mesh Processing
IMA Mathematics of Surfaces XI, Lecture Notes in Computer Science, Vol 3604, 2005, pp. 62-83.
|
|
[6] |
Deformation Transfer for Detail-Preserving Surface Editing
Vision, Modeling & Visualization 2006, pp. 357-364.
|
|
[7] |
PriMo: Coupled Prisms for Intuitive Surface Modeling
Eurographics Symp. on Geometry Processing 2006, pp. 11-20.
|
|
[8] |
Adaptive Space Deformations Based on Rigid Cells
Computer Graphics Forum 26(3), Proc. Eurographics 2007, pp. 339-347.
|
|
[9] |
GPU-Based Multiresolution Deformation Using Approximate Normal Field Reconstruction
Journal of Graphics Tools 12(1), 2007, pp. 27-46.
|
|
[10] |
On Linear Variational Surface Deformation Methods
IEEE Transactions on Visualization and Computer Graphics, 14(1), 2008, pp. 213-230.
|
|
[11] |
Interactive Shape Modeling and Deformation
Eurographics 2009 Course Notes
|
|
[12] |
Example-Driven Deformations Based on Discrete Shells
Computer Graphics Forum 30(8), 2011, pp. 2246-2257.
|
|
[13] |
A Comprehensive Comparison of Shape Deformation Methods in Evolutionary Design Optimization
Proceedings of International Conference on Engineering Optimization, 2012
|
|
[14] |
High Quality Mesh Morphing Using Triharmonic Radial Basis Functions
Proceedings of the 21st International Meshing Roundtable, 2012, pp. 1-15
|
|
[15] |
RBF Morphing Techniques for Simulation-based Design Optimization
Engineering with Computers, 30(2), 2014, pp. 161-174
|
|
[16] |
Constrained Space Deformation for Design Optimization
Proceedia Engineering 82 (Proc. International Meshing Roundtable), 2014, pp. 114-126.
|
|
[17] |
On Shape Deformation Techniques for Simulation-based Design Optimization
New Challenges in Grid Generation and Adaptivity for Scientific Computing, SEMA SIMAI Springer Series, 2015, pp. 281-303.
|
|
[18] |
Constrained Space Deformation Techniques for Design Optimization
Computer Aided Design 72, 2016, pp. 40-51.
|