IMATI-CNR, Genova, Italy
3D shape approximation and processing with implicitly defined surface primitives (Radial Basis Functions and more general kernel-based approximations, Partition of Unity approximations, Moving Least Squares, etc.) are currently a subject of intensive research in Geometric Modeling and Computer Graphics. In this paper, we propose an approach that combines two conflicting criteria: achieving a high approximation accuracy and obtaining an economical surface representation. We employ compactly-supported Radial Basis Functions and use Tikhonov Regularization to achieve a near optimal selection of their centers. An iterative approach, which defines a multi-level approximation, is used to cope with arising constrained optimization problems.
Current scanning techniques are capable of acquiring large and redundant data sets, thus arising the problem of defining approximations that use only a small percentage of the available information. On discrete 3D surfaces, a common approach to approximating, reducing, and hierarchically organizing the input data is provided by simplification and multi-resolution techniques [3, 14, 19].
Implicit modeling [8] represents a valid and equally expressive alternative to the
above-mentioned techniques. For instance, implicit reconstruction does not impose
constraints on the topological complexity of the input data and guarantees that the
reconstructed surface is water-tight. In this case, a 3D data set
:= {pi : i = 1,…,N} is approximated by an implicit surface Σ := {x
3 : f(x) = 0}, where f(x) := ∑ i=1Nα iφi(x) is a linear combination of the basis elements
:= {φi(x)}i=1,…,N.
The underlinying mathematical framework builds on numerical linear algebra
and the degrees of freedom on the choice of
(e.g. globally [10, 44] and
compactly [25, 26] supported RBFs, Partition of Unity [28, 47], Moving-Least-Squares
methods [2, 16, 22, 23, 31, 38]) enable to adapt the model parameters to specific
problem constraints such as huge data sets with attributes, local accuracy, and degree
of smoothness. Furthermore, multi-resolution techniques have been recently
proposed [42] and a wide range of applications, including deformation, fast
rendering, and collision detection [4, 27, 43], have been targeted by several
authors.
Previous work on surface sparsification can be subdivided into three main groups: local, global, and clustering techniques. Local methods build a smooth surface through
an iterative and multi-scale procedure based on a local polynomial approximation. In
this case, the centers and radii are determined by a-posteriori updates of the model and
guided by the local approximation error [10, 11, 21, 27, 38]. Global methods find a
sparse representation by minimizing a constrained convex quadratic optimization
problem [17, 30, 40, 46]. Since each φi is centered at a point pi of
, clustering
techniques can also be used to select the centers of the sparse representation. The idea is
to group those points which satisfy a common “property” and to center a basis function
at a representative point of each cluster. Planarity and closeness, measured in
the Euclidean space using k-means clustering [24], Principal Components
Analysis (PCA) [20], and Voronoi diagrams [33], are possible criteria (see
Fig. 1
). These methods are quite stable with respect to outliers and noise but
they do not take into account the kernel function used to construct the implicit
surface. To overcome the limitations of Euclidean-based clustering, kernel-based
methods [13] evaluate the correlation among points with respect to the scalar
product induced by a positive defined kernel. Then, the PCA and the k-means
algorithm lead to efficient clustering techniques such as the KPCA [34] (Ch. 1) and
the Voronoi tessellation of the feature space [45]. An example is shown in
Fig. 1
.
Overview and contribution. While previous work [37, 39] has been focused on Support-Vector Machine (SVM) [13, 34], in this paper we consider an equivalent formulation [17] provided by Tikhonov regularization theory [7, 41]. In this way, we introduce a novel approach to sparse approximation that replaces the large and constrained minimization problem related to SVM with an approximate formulation, which is defined by a system of non-linear equations. This choice enables to substitute heuristic and decomposition methods for constrained convex minimization problems with standard iterative solvers of non-linear equations. Therefore, we provide a multi-level approach to Sparse IMplicit approximations (SIMS for short [30]) and we prove that
We note that multi-resolution techniques such as [42] are not defined on the implicit representation of f⋆ but on the sampling and polygonalization process; therefore, the resolution of the voxel grid determines the complexity of the reconstructed surface. In [27], a multi-scale representation of a smooth surface is achieved by applying a local polynomial approximation, whose number of centers and radii are adapted to the required resolution. This local approximation makes the approach best-suited for interactive visualization and feature extraction of large-size models.
The main difference with respect to our approach is that SIMS achieves a compact representation through a global procedure, which builds on well-defined properties such as approximation accuracy and smoothness. Therefore, it avoids a-posteriori updates of the model that are based on the evaluation of the reconstruction error. Since we use a global formulation of the sparsification problem, the center selection is achieved by a top-down procedure instead of a bottom-up structure as done by local methods [10, 15, 29, 32].
The paper is organized as follows: Section 2 defines our approach and its main features, Section 3 discusses numerical aspects and results, and future work is presented in Section 4 .
2. Surface reconstruction with sparse implicits
In our formulation, we consider a Reproducing Kernel Hilbert Space
(RKHS, for short) [5] with kernel Φ(x,y); in this case, each basis function φi(x) := Φ(x,pi), i = 1,…,N, is centered at a point of the input data set. Among the
properties of RKHS, we remind the reproduction property
|
(1) |
that will be used in the following discussion. Common choices are the Gaussian kernel Φ(x,y) := e(-∥x-y∥2∕2σ) or the polynomial of degree d Φ(x,y) := (1- < x,y >)d.
Among all the possible approximations of f with the same error, a sparse approximation method searches for the one f⋆ that involves the smallest number of
basis functions. In terms of the corresponding iso-surfaces, this is equivalent to
approximating Σ with Σ⋆ := {x
3 : f⋆(x) = 0}.
|
It follows that any sparsification scheme combines two conflicting criteria: achieving a high approximation accuracy and obtaining an economical surface representation. The approach we present builds on a global approximation method which does not require the use of heuristics. We employ compactly-supported radial basis functions and use Tikhonov regularization to achieve a near optimal selection of their centers; an iterative approach, which defines a multi-level approximation, is used to cope with arising constrained optimization problems.
|
Following [17], the quality of the approximation of f with f⋆ is measured by the
quadratic misfit error ∥ f - f⋆ ∥
2 and the selection of the basis functions
which contribute to f⋆(x) := ∑ i=1Na iφi(x) is given by the coefficients ai
0, i = 1,…,N. The sparsification value, i.e. the number of basis functions used in f⋆, is
quantified by the l1-norm ∥ a ∥l1 := ∑ i=1N∣a i∣ of the vector a := (ai)i=1N.
Then, we consider a compromise between these two terms and minimize the
functional
|
(2) |
where ε > 0 is the tradeoff between the misfit measure and sparsity. If ε = 0, we get the standard least-squares approximation scheme, while by increasing ε we neglect a greater number of basis functions and accept a lower approximation accuracy.
As shown in [17], replacing each unknown ai of (2 ) with a pair of positive variables (ai+,a i-), such that a i = ai+ - a i-, results in the following constrained convex quadratic optimization problem (i.e. Support Vector Machine) [17]:
|
(3) |
with
f(pi) = yi, i = 1,…,N, and feasible set
This last formulation is equivalent to (2
) and facilitates its numerical optimization
by removing the absolute values. If
is a large data set, defining a sparse
representation of f as a solution of the quadratic minimization problem (3
) with 2N unknowns is generally unfeasible due to the amount of input data, the possible
ill-conditioning of the coefficient matrix L := (Lij)i,j=1,…,N, Lij := Φ(pi,pj), and the
unbounded feasible set
. Therefore, all these factors badly affect the stability and
convergence of iterative methods [12, 18]. In [36, 40], (3
) is solved by applying a
decomposition method and a heuristic coordinate descendent optimization scheme
respectively. In the last case, at each iteration (2N - 1) variables are fixed
and the objective function is minimized with respect to the remaining free
parameter.
To avoid the formulation in (3 ), which is a consequence of the C0-regularity of the l1-norm in (2 ), we use the smooth approximation
and we replace the functional (2 ) with
In the following, we prove that minimizing G is equivalent to solving a system of non-linear equations. Using the reproduction property (1 ), we can rewrite G as
where the term
∥ f ∥
2 is constant. Then, the critical points of G are the solutions of
the following system of non-linear equations
|
(4) |
with
and y := (yi)i=1N. The matrix formulation shows the two factors of the sparsification scheme: the matrix L, which is associated to the kernel function, and the diagonal matrix Δ(a) related to the sparsification term.
|
If we consider a Gaussian or compactly supported kernel, which corresponds to a
positive/semi-positive definite matrix L, the Hessian matrix
of G is
positive definite and the convex functional G admits a unique minimum. The solution of
(4
) is evaluated by applying the iterative scheme
|
(5) |
with a(0) initial guess and n ≥ 1. The term a(n+1) is achieved from a(n) by solving a linear system with direct or iterative solvers, e.g. the Gauss-Seidel or conjugate gradient method [18]. The iterative procedure stops when the solution becomes stationary, i.e. we do not improve the number of null coefficients and/or the residual error between two consecutive iterations is below a given threshold.
Let us suppose that yi := 0 and xi is a point of the input data set, i = 1,…,N; then, the
surface must interpolate the boundary constraints f(xi) = 0 at
. As done in [44] and in
order to avoid the trivial solution f ≡ 0, we add positive (resp., negative)-valued normal
constraints at xi close to the boundary constraints and in the direction ni (resp., -ni),
where ni is the normal at xi. If a polyhedral surface is given, surface normals are
approximated by averaging the face normals; otherwise, we use those ones
provided by the shape acquisition or achieved by a local fitting or clustering [1, 23]. Clearly, positive
+ and negative-valued
- constraints can be set on a
subset of
where shape variations occur and selected by using the Principal
Components Analysis [20]. Therefore, as centers of the basis functions we
can consider the set
∪
+ ∪
-, thus solving the 3N × 3N equation in
(5
).
Recently [46], the surface normal vectors have been incorporated in the regularization framework, thus avoiding off-set conditions to guarantee a non-null solution. This approach uses curvature and grid-based clustering on point clouds to guide the selection of the basis function centers and radii, and to achieve high-quality approximations.
Fig.s 2
and 3
show the curve reconstruction with several sparsification
percentages (Φ is the Gaussian Kernel); we note that the local noise and irregular
sampling, which affect the approximation in Fig. 3
(a), are attenuated in (b) where we
use a minor number of basis functions. This property is due to the misfit error in (2
) and
to a lower conditioning number of the coefficient matrix related to the least-squares
approximation. Furthermore, a smooth kernel function Φ and the induced norm ∥ ∥
provide a smooth solution, thus reducing the influence of noise and outliers of
in the
reconstructed surface. Finally, Fig. 3
(c-d) shows the center selection on a curve with
a non-uniform sampling.
Using a k-neighborhood of each center [6] requires a storage overhead of (3k + 1)N non-null entries for the matrix L. Then, each iteration (5 ) updates only the principal diagonal of L, preserves its sparsity and positive definiteness, and requires O(N) time to solve the linear system. The proposed sparsification scheme is equivalent to Support Vector Machine and it avoids the constrained convex quadratic minimization and the use of heuristics involved in SVMs. Since the sparsification starts from the full resolution with 3N basis functions, we get a fine-to-coarse approach and the iterative procedure (5 ) builds a multi-level approximation scheme based on a sequence of nested spaces; for more details, we refer the reader to [30]. If we get a complete sparsification, i.e. the iterative solver of the system of non-linear equations converges to the null solution, each approximation is achieved by using the intermediate iterations (see Fig. 4 ).
|
As the iterations in (5 ) proceed, the L∞ error between the current approximation f(n)(x) = ∑ i=1Na i(n)φ i(x) and f, measured by
The fine-to-coarse structure requires a storage overhead and computational cost greater than local approximation [2, 27, 26]. For instance, if k = 20 we are able to handle at last 500K centers on a Pentium IV 2.80 GHz with 1 GB RAM; in this case, the evaluation of L and the sparsification scheme require approximately 90 - 180 seconds. Our method always converges to a global minimum and it can be used for those applications where center selection is mandatory to speed up surface sampling, interactive modeling and queries [9, 40]. However, it cannot deal with huge data sets, which can be handled efficiently by [28, 27, 46].
Setting the support of the basis functions is a delicate part of the approximation and
sparsification scheme; in fact, its choice affects the size of the details that will be
recovered as well as the maximum sparsification percentage, which avoids artifacts in
the reconstructed model. In our framework, the support associated to the basis
function φi is set equal to the minimum radius of the sphere centered at pi that contains the k-nearest neighbor points of pi, and k varies from 10 to 20 depending on the number of input points. Our tests have shown that these values
lead to a good compromise between sparsification rate and approximation
accuracy (see Fig. 5
). Finally, in the examples of Fig.s 4
and 5
we used Φ(r) := (1 - r)+4(4 + 16r + 12r2 + 3r3) [25, 35] as sparse kernel, where r =
and σ is its compact support.
4. Conclusions and future work
While there has been much work on implicit modeling and related applications, the study of implicit sparse approximations has been focused mainly on Support Vector Machine. Exploiting a formulation equivalent to SVM and based on Tikhonov regularization, the paper discussed an iterative method that defines a compact surface approximation while guaranteeing a good approximation accuracy. We introduced a novel multi-level sparsification scheme where a different resolution in the approximation of the input data is achieved by selecting the parameter ε or a different number of centers, which have been sorted in increasing order of importance by the iterative procedure.
The advantages of our approach are its efficiency and simplicity; it differs from previous work on the use of an approximated formulation of the sparsification problem, which avoids to use heuristic solvers of convex quadratic optimization problems. This aim is simply achieved by taking advantage of a smooth approximation of the l1-norm and of robust iterative solvers of systems of non-linear equations.
Even thought the number of used centers can be set in a simple way trough the multi-level scheme, the main open issue is to control directly, and not through the parameter ε, the final error approximation.
Special thanks are given to Alexander Belyaev and the AG4-Computer Graphics Group at MPII-Saarbruecken for motivating and supporting the author to consider the problem discussed here. This work has been supported by the EC-IST FP6 Network of Excellence “AIM@SHAPE”; models are courtesy of the AIM@SHAPE repository (http://shapes.aimatshape.net).
[1] M. Alexa, J. Behr, D. Cohen-Or, S. Fleishman, D. Levin, and C. T. Silva. Computing and rendering point set surfaces. IEEE Trans. Vis. Comput. Graph, 9(1):3–15, 2003.
[2] M. Alexa, J. Behr, D. Cohen-Or, S. Fleishman, and C. T. Silva. Point set surfaces. IEEE Visualization 2001, pages 21–28, October 2001.
[3] N. Amenta, M. Bern, and M. Kamvysselis. A new voronoi-based surface reconstruction algorithm. In SIGGRAPH-98, pages 415–421, 1998.
[4] A. Angelidis and M.-P. Cani. Adaptive implicit modeling using subdivision curves and surfaces as skeletons. In SMA ’02: Proc. of the ACM Symposium on Solid modeling and Applications, pages 45–52. ACM Press, 2002.
[5] N. Aronszajn. Theory of reproducing kernels. Trans. Amer. Math. Soc., 68:337–404, 1950.
[6] S. Arya, D.M. Mount, N.S. Netanyahu, R. Silverman, and A.Y. Wu. An optimal algorithm for approximate nearest neighbor searching in fixed dimensions. JACM: Journal of the ACM, 45(6):891–923, 1998.
[7] M. Bertero. Regularization methods for linear inverse problems. Inverse Problems, Springer-Verlag, Berlin, 1986.
[8] J. Bloomenthal and B. Wyvill, editors. Introduction to Implicit Surfaces. Morgan Kaufmann Publishers Inc., 1997.
[9] M. Botsch and L. Kobbelt. Real-time shape editing using radial basis functions. Computer Graphics Forum, 24(3):611–621, 2005. Proc. Eurographics 2005.
[10] J. C. Carr, R. K. Beatson, J. B. Cherrie, T. J. Mitchell, W. R. Fright, B. C. McCallum, and T. R. Evans. Reconstruction and representation of 3D objects with radial basis functions. In SIGGRAPH ’01, pages 67–76. ACM Press, 2001.
[11] S. Chen and J. Wigger. Fast orthogonal least squares algorithm for efficient subset model selection. IEEE Transactions on Signal Processing, 43(7):1713–1715, July 1995.
[12] T. F. Coleman and Y. Li. An interior trust region approach for nonlinear minimization subject to bounds. SIAM Journal on Optimization, 6:418–445, 1996.
[13] C. Cortes and V. Vapnik. Support-vector networks. Machine Learning, 20(3):273–297, 1995.
[14] T. K. Dey and S. Goswami. Tight cocone: a water-tight surface reconstructor. In Symposium on Solid Modeling and Applications, pages 127–134, 2003.
[15] Shachar Fleishman, Daniel Cohen-Or, Marc Alexa, and Cláudio T. Silva. Progressive point set surfaces. ACM Trans. Graph, 22(4):997–1011, 2003.
[16] Shachar Fleishman, Daniel Cohen-Or, and C. T. Silva. Robust moving least-squares fitting with sharp features. ACM Trans. Graph., 24(3):544–552, 2005.
[17] F. Girosi. An equivalence between sparse approximation and support vector machines. Neural Computation, 10(6):1455–1480, 1998.
[18] G. Golub and G.F. VanLoan. Matrix Computations. John Hopkins University Press, 2nd. edition, 1989.
[19] H. Hoppe. Progressive meshes. In SIGGRAPH ’96 Proc., pages 99–108, August 1996.
[20] I. T. Jolliffe. Principal component analysis. In Principal Component Analysis. Springer Verlag, 1986.
[21] T. Kanai, Y. Ohtake, and K. Kase. Hierarchical error-driven approximation of impplicit surfaces from polygonal meshes. In Proc. of Geometry Processing, pages 21–30, 2006.
[22] M. M. Kazhdan. Reconstruction of solid models from oriented point sets. In Symposium on Geometry Processing, pages 73–82, 2005.
[23] D. Levin. The approximation power of moving least-squares. Math. Comput, 67(224):1517–1531, 1998.
[24] S.P. Lloyd. An algorithm for vector quantizer design. IEEE Transaction on Communications, 28(7):84–95, 1982.
[25] B. S. Morse, T. S. Yoo, D. T. Chen, P. Rheingans, and K. R. Subramanian. Interpolating implicit surfaces from scattered surface data using compactly supported radial basis functions. In Proc. of SMI, pages 89–98. IEEE Computer Society, 2001.
[26] Y. Ohtake, A. Belyaev, and H.-P. Seidel. 3D scattered data interpolation and approximation with multilevel compactly supported RBFs. Graph. Models, 67(3):150–165, 2005.
[27] Y. Ohtake, A. G. Belyaev, and M. Alexa. Sparse low-degree implicits with applications to high quality rendering, feature extraction, and smoothing. In Symposium on Geometry Processing, pages 149–158, 2005.
[28] Yutaka Ohtake, Alexander Belyaev, Marc Alexa, Greg Turk, and Hans-Peter Seidel. Multi-level partition of unity implicits. ACM Transactions on Graphics, 22(3):463–470, July 2003. (Proc. ACM SIGGRAPH ’ 03).
[29] Yutaka Ohtake, Alexander G. Belyaev, and Hans-Peter Seidel. 3D scattered data approximation with adaptive compactly supported radial basis functions. In Proc. of SMI, pages 31–39, 2004.
[30] G. Patané. SIMS: a multi-level approach to surface reconstruction with sparse implicits. In IEEE International Conference on Shape Modeling and Applications, pages 222–233, 2006.
[31] M. Pauly, R. Keiser, L. P. Kobbelt, and M. Gross. Shape modeling with point-sampled geometry. Proceedings of SIGGRAPH 2003, 22:641–650, 2003.
[32] Mark Pauly, Markus H. Gross, and Leif Kobbelt. Efficient simplification of point-sampled surfaces. In IEEE Visualization, 2002.
[33] M. Samozino, M. Alexa, P. Alliez, and M. Yvinec. Reconstruction with voronoi central radial basis functions. In Computer Graphics Forum (Proc. Eurographics), pages 51–60. Blackwell, 2006. to appear.
[34] B. Schoelkopf and A. J. Smola. Learning with Kernels. The MIT Press, 2002.
[35] B. Schoelkopf, F. Steinke, and V. Blanz. Object correspondence as a machine learning problem. In ICML ’05: Proceedings of the 22nd international conference on Machine learning, pages 776–783. ACM Press, 2005.
[36] B. Schölkopf, J. Giesen, and S. Spalinger. Kernel methods for implicit surface modeling. In Advances in Neural Information Processing Systems 17, pages 1193–1200. MIT Press, Cambridge, MA, 2005.
[37] Bernhard Schölkopf, Joachim Giesen, and Simon Spalinger. Kernel methods for implicit surface modeling. In Lawrence K. Saul, Yair Weiss, and Léon Bottou, editors, Advances in Neural Information Processing Systems 17, pages 1193–1200. MIT Press, Cambridge, MA, 2005.
[38] C. Shen, J. F. O’Brien, and J. R. Shewchuk. Interpolating and approximating implicit surfaces from polygon soup. ACM Trans. Graph, 23(3):896–904, 2004.
[39] F. Steinke, B. Schoelkopf, and V. Blanz. Support vector machines for 3d shape processing. In Proc. EUROGRAPHICS, volume 24 (3), pages 285–294, 2005.
[40] F. Steinke, B. Schölkopf, and V. Blanz. Support vector machines for 3D shape processing. Computer Graphics Forum, 24(3):285–294, 2005. Proceedings of EUROGRAPHICS 2005.
[41] A.N. Tikhonov and V.Y. Arsenin. Solutions of Ill-posed Problems. W.H. Winston Washington, D.C., 1977.
[42] I. Tobor, P. Reuter, and C. Schlick. Multi-scale reconstruction of implicit surfaces with attributes from large unorganized point sets. In Proc. of SMI, pages 19–30, 2004.
[43] G. Turk and J. F. O’Brien. Shape transformation using variational implicit functions. In Proc. of SIGGRAPH ’99, pages 335–342. ACM Press/Addison-Wesley Publishing Co., 1999.
[44] G. Turk and J. F. O’Brien. Modelling with implicit surfaces that interpolate. ACM Trans. Graph., 21(4):855–873, 2002.
[45] Alessandro Verri and Francesco Camastra. A novel kernel method for clustering. IEEE Trans. Pattern Anal. Mach. Intell., 27(5):801–804, 2005.
[46] C. Walder, B. Schlkopf, and O. Chapelle. Implicit surface modelling with a globally regularised basis of compact support. In Computer Graphics Forum (Proc. Eurographics). Blackwell, 09 2006. to appear.
[47] H. Xie, K. T. McDonnell, and H. Qin. Surface reconstruction of noisy and defective data sets. In IEEE Visualization, pages 259–266, 2004.