Project Description

A method for six degree-of-freedom haptic rendering of isosurface geometry embedded within sampled volume data is presented. The algorithm uses a quasi-static formulation of motion constrained by multiple contacts to simulate rigid-body interaction between a haptically controlled virtual tool, represented as a point-sampled surface, and volumetric isosurfaces. Unmodified volume data, such as CT or MR images, can be rendered directly with this approach, making it particularly suitable for applications in medical or surgical simulation.

The Algorithm

The distinguishing characteristics of the presented method are:

• The algorithm executes at haptic update rates of 1000 Hz.
• A constraint-based approach allows for distributed contact using a massless proxy, enabling the rendering of very stiff contacts.
• Isosurfaces within volumetric data of any type (eg. CT scans) can be rendered directly at sub-voxel resolution without any preprocessing.

Key functional components are depicted in the diagram below.

Data Representation

The geometry of the virtual environment exists as an isosurface within a sampled volume. A central differencing scheme is used to estimate the normals on the surface for computing contact constraints and for shading in the visual rendering. The virtual tool is represented as a point shell derived from its polygonal model.

Collision Detection

Every vertex of the point shell surface is queries against the volume intensity field during collision detection. A point’s path is subdivided into feature-sized segments to detect and enforce non-penetration. Interval bisection is used to refine the contact position.

Configuration Solver

Each contact imposes a constraint on the proxy’s motion:

Minimization of the “acceleration energy” (Gauss’ Principle) subject to the contact constraints yields the correct motion path for the proxy.

Results

The method was tested using a variety of haptic devices including the Force Dimension sigma.7 and our custom-built 6-DOF µHaptic device depicted below. Performance characteristics of the algorithm on four different data sets were collected.

The simulation remained stable throughout interactions that included hooking, wedging, and prying, even with a coupling stiffness set as high as 5000 N/m. The tool could be moved quickly in free space or in contact without feeling effects of artificial mass, inertia, or viscosity.

Conclusion

Physical interaction with the world using a rigid tool is inherently a six degree-of-freedom task. Our haptic rendering algorithm provides a means for exploring isosurfaces embedded within volumetric data using an arbitrarily shaped virtual instrument. The algorithm prevents object interpenetration and allows quick movements of the tool without conveying artificial mass or inertia, thus enhancing the perceived realism of the virtual object interaction.

Related Publications

Chan, S., Conti, F., Blevins, N. H., & Salisbury, K. Constraint-based six degree-of-freedom haptic rendering of volume-embedded isosurfaces. Proc. IEEE World Haptics Conference (2011).

Project Staff

• Sonny Chan
• Nikolas Blevins
• J. Kenneth Salisbury

Status

Active since 2002.

Funding Sources

This project was funded in part by NIH Grant 5R01LM010673-02
and in part by the Veterans Administration.