ImFusion Suite

Basics

  • Introduction
    • Loading Data
    • Views / Visualization
    • Annotations
    • Running Algorithms on Data
  • Data Widget
    • Basic Interaction
    • Dataset Attributes
    • Dataset Linking
    • Options
  • Views
    • Interaction
    • Windowing
    • Blending
    • Interaction list
  • Selection Widget
    • Concept
    • Target Datasets
    • Controls
      • Selection
      • Playback
  • Annotations
    • Creation and Editing Annotations
    • Essential properties
    • Global annotation vs. annotation attached to a data
    • Curved View Annotations
    • Data Annotations
  • Workspaces
    • Saving Workspaces
    • Loading Workspaces
    • Editing Workspace Files
      • Nesting of Workspace Files
    • Placeholders in Workspace files
      • Defining Placeholders
      • Running Workspace Batches
  • Global Settings
    • General settings
    • Visualization settings
    • DataWidget settings
    • Overlay settings
    • Interaction mapper
    • License information
    • Import/Export settings
    • Plugin settings
  • Tutorial Videos
    • Loading and Visualizing Medical Image Data
    • Running Algorithms
    • Annotating Data
    • Interactive Segmentation
    • Multi-Modal Image Registration
    • Working with Meshes
    • Working with Point Clouds
    • Aligning Point Clouds and Meshes
    • Working with Videos and Streams
    • Exporting Data
  • Commandline Arguments
    • ImFusionConsole Executable
    • ImFusionSuite Executable
  • Environment Variables

Modules

  • Base
    • Point cloud
      • Annotation
      • Working with Point Clouds
        • Transformation
        • Processing
        • Rendering
    • Algorithms
      • Apply Mask
        • Input
        • Output
        • Description
      • Apply Deformation
        • Input
        • Output
        • Description
      • Apply Transformation
        • Input
        • Output
        • Description
      • Attach Displacement Field
        • Input
        • Output
        • Description
      • Attach Mask
        • Input
        • Output
        • Description
      • Basic Processing
        • Input
        • Output
        • Description
      • Combine Images
        • Input
        • Output
        • Description
      • Combine Point Clouds
        • Input
        • Output
        • Description
      • Combine Split Volumes
        • Input
        • Output
        • Description
      • Filter
        • Input
        • Output
        • Description
      • Compare Images
        • Input
        • Output
        • Description
      • Connectivity Analysis
        • Input
        • Output
        • Description
      • Convert To Label Map
        • Input
        • Output
        • Description
      • Convert to Volume
        • Input
        • Output
        • Description
      • Distance Transformation
        • Input
        • Output
        • Description
      • Duplicate Data
        • Input
        • Output
        • Description
      • Edit Anatomy
        • Input
        • Output
        • Description
      • Edit Deformations
        • Input
        • Output
        • Description
        • See also
      • Edit Mask
        • Input
        • Output
        • Description
      • Edit Transformation
        • Input
        • Output
        • Description
      • Extract Point Cloud
        • Input
        • Output
        • Description
      • Extract Selection
        • Input
        • Output
        • Description
      • Image Inpainting
        • Input
        • Output
        • Description
      • Image Resampling
        • Input
        • Output
        • Description
      • Image Statistics
        • Input
        • Output
        • Description
      • Labels Operations
        • Input
        • Output
        • Description
      • Link Mouse Pointer
        • Input
        • Output
        • Description
      • Link Pose
        • Input
        • Output
        • Description
      • Link Pose Deformable
        • Input
        • Output
        • Description
      • Match Windowing
        • Input
        • Output
        • Description
      • Merges Channels
        • Input
        • Output
        • Description
      • Morphological Operations
        • Input
        • Output
        • Description
        • Notes
      • Reduce to Selection
        • Input
        • Output
        • Description
      • Replace Values
        • Input
        • Output
        • Description
      • Set Modality
        • Input
        • Output
        • Description
      • Set Property
        • Input
        • Output
        • Description
      • Split Channels
        • Input
        • Output
        • Description
      • Split Images
        • Input
        • Output
        • Description
      • Superpixels Filter
        • Input
        • Output
        • Description
      • Superpixels Segmentation
        • Input
        • Output
        • Description
      • Tracking Properties
        • Input
        • Output
        • Description
      • Volume Freehand Cropping
        • Input
        • Output
        • Description
  • IO
    • Algorithms
      • 2D Image Set
        • Input
        • Output
        • Description
      • 2D Image
        • Description
      • ImFusionFile
        • Description
      • Mesh File
        • Input
        • Output
        • Description
      • MetaImage
        • Description
      • Point Cloud
        • Input
        • Output
        • Description
      • Raw Image
        • Description
      • Unpack Video
        • Input
        • Output
        • Description
  • Mesh
    • Mesh
      • Annotation
      • Context menu
      • Mesh Display Options
      • Mesh Data Controller
    • Algorithms
      • Poisson Reconstruction
        • Input
        • Output
        • Description
      • Crop Mesh or Point Cloud
        • Input
        • Output
        • Description
      • Mesh Collision Detection
        • Input
        • Output
        • Description
      • Mesh Measurements
        • Input
        • Output
        • Description
      • Texture Mapping
        • Input
        • Output
        • Description
      • Extract Mesh Texture
        • Input
        • Output
        • Description
      • Set Image Texture
        • Input
        • Output
        • Description
      • Combine Meshes
        • Input
        • Output
        • Description
      • Create Mesh Primitive
        • Input
        • Output
        • Description
      • Interactive Mesh and Point Cloud Editing
        • Input
        • Output
        • Description
      • Mesh Boolean Operations
        • Input
        • Output
        • Description
      • Mesh Processing
        • Input
        • Output
        • Description
      • Visualize Mesh or Point Cloud Distances
        • Input
        • Output
        • Description
      • Mesh Mask
        • Input
        • Output
        • Description
  • Python
    • Configuration
    • Integrated Python interpreter
    • Running Python scripts
    • Generating Python code
  • DICOM
    • DICOM settings
    • Algorithms
      • DICOM Editor
        • Description
      • Scan for DICOM Files
        • Input
        • Output
        • Description
      • Show Dicom Tags
        • Input
        • Output
        • Description
    • Importing DICOM files
    • Importing from PACS
  • Stream
    • Algorithms
      • Forward to OutStream
        • Input
        • Output
        • Description
      • Combined Tracking Streams
        • Input
        • Output
        • Description
      • OpenIGTLink
        • Input
        • Output
        • Description
      • Record Stream
        • Input
        • Output
        • Description
      • Playback
        • General concept
        • Three playback modes (timestamp validity)
        • Input
        • Output
        • Playback controller
      • Tracking Stream Visualization
        • Input
        • Output
        • Description
      • Video Camera Stream
        • Input
        • Output
        • Description
      • Video File Stream
        • Input
        • Output
        • Description
    • Imaging Plugins
    • Tracking Plugins
  • Navigation
    • Tracking Plugins
  • Machine Learning
    • Main Algorithms
      • Run Model
        • Input
        • Output
        • Description
      • Operations Sequence
        • Input
        • Output
        • Description
      • Landmark Prediction Algorithm
        • Input
        • Output
        • Description
      • Create Pixelwise Stream
        • Input
        • Output
        • Description
    • Machine Learning Model
      • Inference YAML Config
    • Engines
    • Changelog of the Inference YAML Configuration
      • Version 8
        • Example 1
        • Example 2
      • Version 7
      • Version 6
      • Version 5
      • Version 4
      • Version 3
  • Registration
    • Algorithms
      • Analyze Motion
        • Input
        • Output
        • Description
      • Fit Bounding Box
        • Input
        • Output
        • Description
      • Image Registration
        • Input
        • Output
        • Description
      • Linear Grid Image Registration
        • Input
        • Output
        • Description
      • Point Correspondences
        • Input
        • Output
        • Description
      • Registration Results
        • Input
        • Output
        • Description
      • Reset Linked Pose
        • Input
        • Output
        • Description
      • Surface Registration
        • Input
        • Output
        • Description
      • Visualize Deformation
        • Input
        • Output
        • Description
      • Visualize Displacement
        • Input
        • Output
        • Description
      • Volume Compounding
        • Input
        • Output
        • Description
  • Segmentation
    • Algorithms
      • Extract Mesh
        • Input
        • Output
        • Description
      • Fiducial Extraction
        • Input
        • Output
        • Description
      • Interactive Segmentation
        • Input
        • Description
      • Interactive Watershed Segmentation
        • Description
      • Labeling
        • Input
        • Description
      • Statistics
        • Input
        • Output
        • Description
      • Structures View
        • Input
        • Output
        • Description
  • Ultrasound
    • Ultrasound Sweep
      • Structure
      • Image Pose Look-up
      • Visualization
    • Ultrasound Frame Geometry
    • Algorithms
      • Sweep Compounding
        • Input
        • Output
        • Description
      • Convert to Sweep
        • Input
        • Output
        • Description
      • Sweep Properties
        • Input
        • Output
        • Description
      • Sweep Tracking Properties
        • Input
        • Output
        • Description
      • Ultrasound Calibration
        • Input
        • Output
        • Description
        • References
      • Frame Geometry Properties
        • Input
        • Output
        • Description
        • Features
      • Ultrasound Registration
        • Input
        • Output
        • Description
      • Record Ultrasound Sweeps
        • Input
        • Output
        • Description
      • Ultrasound Simulation
        • Input
        • Output
        • Description
      • Hybrid Ultrasound Simulation
        • Input
        • Output
        • Description
      • User Defined Sweep for Simulation
        • Exemplary User Defined Sweeps
    • Tutorials
      • Basic Usage
        • Loading a Sweep
        • Visualizing a Sweep
        • Annotating a Sweep
        • Reducing a Sweep to a Selection of Frames
        • Inspecting a Sweep’s Tracking Sequence(s)
        • Inspecting a Sweep’s Frame Geometry
      • Ultrasound Registration
        • Data loading
        • Data exploration
        • Registration
        • Result analysis
        • Saving and export
  • Live Ultrasound
    • Algorithms
      • Record Ultrasound Sweeps
        • Input
        • Output
        • Description
      • Sweep Plaback
        • Input
        • Output
        • Description
    • Frame Grabbing of Ultrasound Images
      • Preparing the Ultrasound Machine
      • Connecting a Framegrabber Device
      • Processing the Video Stream into an Ultrasound Stream
      • Configuring a Frame Geometry
      • Configuring other Processing Parameters
      • Configuring Presets for the Frame Geometry
      • Creating a New Preset
      • Using an Existing Preset
      • Deleting an Existing Preset
      • Modifying an Existing Preset
      • Saving the Configured Presets
  • CT
    • Algorithms
      • Cone Beam Simulation
        • Input
        • Output
        • Description
      • Hounsfield Calibration
        • Input
        • Output
        • Description
      • CT Reconstruction
        • Additional parameters
      • XRay 2D-3D Registration
        • Input
        • Output
        • Description
        • Initialization
        • Edit X-Ray Geometry
        • History
        • Parameters:
      • Post Processing
        • Input
        • Parameters
  • Vision
    • Camera Calibration Data Component
      • Contents of Camera Calibration Data Component
      • Creating a Camera Calibration Data Component
    • RGB-D Calibration Data Component
      • Contents
      • Typical use
    • Stereo Camera Calibration Data Component
      • Contents
      • Creating or editing
    • Multi-Camera Calibration Data Component
      • Contents
      • Typical use
      • Creating or editing
    • Marker Board Configuration Widget
      • Single Markers
        • 1. ArUco Marker
        • 2. AprilTag Marker
        • 3. STag Marker
      • Marker Boards
        • 1. ArUco Board
        • 2. ChArUco board
        • 3. Chessboard
        • 4. Circle Board
        • 5. April Tag Board
    • Camera Calibration Settings
    • Algorithms
      • Barcode Decoder
        • Input
        • Output
        • Description
      • Camera Calibration
        • Input
        • Output
        • Description
      • Edit Camera Calibration
        • Input
        • Output
        • Description
      • Camera Registration
        • Input
        • Output
        • Description
      • Create Stereo Image Stream
        • Input
        • Output
        • Description
      • Camera Calibration
        • Input
        • Output
        • Description
      • Convert to Mesh
        • Input
        • Output
        • Description
      • Convert to Point Cloud
        • Input
        • Output
        • Description
      • Feature Detection
        • Input
        • Output
        • Description
      • Hand-Eye Calibration
        • Input
        • Output
        • Description
      • Image Sharpness Estimation
        • Input
        • Output
        • Description
      • Image Undistortion
        • Input
        • Output
        • Description
      • Interlaced To Stereo
        • Input
        • Output
        • Description
      • Interlaced To Stereo
        • Input
        • Output
        • Description
      • Live Hand-Eye Calibration
        • Input
        • Output
        • Description
      • Live Hand-Eye Evaluation
        • Input
        • Output
        • Description
      • Live Stereo Calibration
        • Input
        • Output
        • Description
      • Live Tracking
        • Input
        • Output
        • Description
      • Marker Detection
        • Input
        • Output
        • Description
      • Marker Generation
        • Input
        • Output
        • Description
      • Marker Hand-Eye Calibration
        • Input
        • Output
        • Description
        • Marker detection and frame selection
        • Hand-eye computation
        • Refinement and output
        • Visualization
      • Mesh Alignment (ICP)
        • Input
        • Output
        • Description
      • Mesh Collision Detection
        • Input
        • Output
        • Description
        • Pair mode
        • Group mode
      • Monocular Depth Estimation
        • Input
        • Output
        • Description
        • Streaming and live use
      • Monocular Stream Depth Estimation
        • Input
        • Output
        • Description
        • Depth backend
        • Processing
      • Multi Modal Object Tracking
        • Input
        • Output
        • Description
        • Tracking parameters
        • Detector, matcher, and pruner settings
      • Multi-View Reconstruction (MapAnything)
        • Input
        • Output
        • Description
        • Parameters
      • Object Coordinate Rendering
        • Input
        • Output
        • Description
      • Optical Flow
        • Input
        • Output
        • Description
      • Playback Stereo Image Stream
        • Input
        • Output
        • Description
      • Calibrate Point Cloud
        • Input
        • Output
        • Description
      • Convert to Dense Point Cloud
        • Input
        • Output
        • Description
      • Filter Point Cloud
        • Input
        • Output
        • Description
      • Point Cloud Measuring
        • Input
        • Output
        • Description
      • Point Cloud Overlap
        • Input
        • Output
        • Description
      • Point Cloud Plane Fitting
        • Input
        • Output
        • Description
      • Convert to Depth Map
        • Input
        • Output
        • Description
      • Point Cloud Triangulation
        • Input
        • Output
        • Description
      • Pose Graph Optimization
        • Input
        • Output
        • Description
      • Shape Registration
        • Input
        • Output
        • Description
      • Side-by-side To Stereo
        • Input
        • Output
        • Description
      • Side-by-side To Stereo Stream
        • Input
        • Output
        • Description
      • Sphere Detection
        • Input
        • Output
        • Description
      • Edit Stereo Calibration
        • Input
        • Output
        • Description
      • Stereo Image Extract Selection
        • Input
        • Output
        • Description
      • Stereo Image Reduce to Selection
        • Input
        • Output
        • Description
      • Stereo Reconstruction
        • Input
        • Output
        • Description
      • Stereo Rectification
        • Input
        • Output
        • Description
      • Stereo Stream Reconstruction
        • Input
        • Output
        • Description
        • Common parameters (all backends)
        • Stereo Block Matching and Stereo Semi Global Block Matching
        • Stereo RAFT
        • Stereo CGI
        • Processing
        • Live point-cloud preview
        • Debug streams
      • Stereo Stream To Video
        • Input
        • Output
        • Description
      • Surface To Volume Registration
        • Input
        • Output
        • Description
        • Volume-side target surface
        • Sensor setup
        • Registration options
        • Automatic skin extraction
      • Texturing
        • Input
        • Output
        • Description
      • Compare Tracking Sequences
        • Input
        • Output
        • Description
      • Object Detection
        • Input
        • Output
        • Description
  • Anatomy
    • Anatomical Structure Collection (ASC)
      • Summary
      • Contents
      • Generic ASC
      • ASC Sets
      • Anatomical Structures
      • Style Sheets
      • Save and load
      • See also
    • Anatomical Registration
      • Overview
      • Outcomes
      • Modes and pipeline
      • Registration data and propagation
      • See also
    • Algorithms
      • ASC Registration
        • Summary
        • See also
        • Compatible data
        • Input
        • Output
        • Workflow
      • ASC 2D–3D Registration
        • Summary
        • Compatible data
        • Input
        • Output
        • Workflow
      • ASC Projection
        • Summary
        • Compatible data
        • Input
        • Output
        • Workflow
      • ASC I/O
        • Summary
        • Input
        • Output
      • ASC Viewer
        • Summary
        • Compatible data
        • Input
        • Workflow
  • Spine
    • Data Structure
      • SpineData
        • Overview
        • Contents
        • Save and load
        • Template usage
    • Algorithms
      • Algorithms
        • SpineData from Multi-Label
        • Spine Localization and Classification
        • Deformable Spine-to-Spine Registration
        • Load Spine Template
        • Spine Poly-rigid Deformation
        • Spine Mesh Curvature
        • Poly Rigid Registration
        • Spine 2D Localization
  • Atracsys Tracking Plugin
    • Overview
    • Key Functionalities
    • Tool definition (INI-files)
    • Usage
  • NDI Tracking Plugin
    • Overview
    • Key Functionalities
    • Tool definition (ROM-files)
    • Usage
  • Endoscopy
    • Algorithms
      • Endoscopic Tool Segmentation
        • Input
        • Output
        • Description
  • RGB-D
    • RGB-D Stream
      • Settings and properties
      • Creating an RGBD Stream
    • RGB-D Sequence
    • RGB-D Data Component
      • Contents of RGB-D Data Component
      • Creating an RGB-D Data Component
    • Algorithms
      • Convert to RGB-D Sequence
        • Input
        • Output
        • Description
      • Depth Change Estimation
        • Input
        • Output
        • Export
        • Description
      • Extract Frames
        • Input
        • Output
        • Description
      • Frame Capture
        • Input
        • Output
        • Description
      • Record Sequence
        • Input
        • Output
        • Description
      • Kinect Azure Stream Playback
        • Input
        • Output
        • Description
      • Kinect Azure Stream Recorder
        • Input
        • Output
        • Description
      • Multi Sensor Point Cloud Capture
        • Input
        • Output
        • Description
      • RGB-D Calibration
        • Input
        • Output
        • Description
      • RGB-D Reconstruction
        • Input
        • Output
        • Description
      • RGB-D Sequence IO
        • Input
        • Output
      • RGB-D Sensor Stream
        • Input
        • Output
        • Description
      • RGB-D Simulation
        • Input
        • Output
        • Description
      • Stream Properties
        • Input
        • Output
        • Description
  • Ultrasound Image Formation
    • Channel Data
      • Required Metadata
      • Optional Metadata
    • Simulated Channel Data Stream
      • Key Features
      • Typical Use Cases
      • Usage
    • Algorithms
      • Beamforming
        • Input
        • Output
        • Description
      • Channel Data Filter
        • Input
        • Output
        • Description
      • Channel Data Remapping
        • Input
        • Output
        • Description
      • Envelope Detection
        • Input
        • Output
      • Log Compression
        • Input
        • Output
      • IQ Demodulation
        • Input
        • Output
        • Description
      • Scan Conversion
        • Input
        • Output
        • Description
        • Algorithm Variants
    • Overview
    • Key Functionalities
    • Relation to the US Module
    • Getting Started

Other links

  • ImFusion Website
  • Support Forum
ImFusion Suite
  • Navigation
  • View page source

Navigation

The Navigation module provides tools to process real-time tracking data - referred to as tracking streams - and use this information for visualization and guidance in surgical or diagnostic scenarios.

Tracking data can be sourced from optical or electromagnetic systems, robotic devices, or other sensors that provide real-time positional data. For an overview of natively supported tracking hardware, see the Tracking Plugins section.

This module includes various utilities for combining and smoothing tracking poses, and displaying tools in 3D scenes. It also supports navigation workflows that guide a tool or object toward a target point along a predefined trajectory.

Key features of the Navigation module include:

  • Smoothing and stabilizing noisy tracking input

  • Combining tracking tools with reference datasets such as MR or CT scans in a unified scene * Interactive calibration of tools * Definition of reference coordinate systems using tracker-attached objects to maintain scene consistency upon movement * Landmark registration by identifying coordinates with a tracked pointer to bring all objects into one scene

  • Real-time 3D visualization of custom objects and synchronized updates of MPR views to provide spatial context

  • Interactive navigation to a target location via a predefined path * Trajectory planning and target point definition * Visual feedback during navigation in 3D environments

Tracking Plugins

The following plugins provide integration with supported tracking systems:

  • NDI Tracking Plugin: Aurora (electromagnetic) and Polaris Vega/Lyra (optical) tracking systems

  • Atracsys Tracking Plugin: fusionTrack and spryTrack optical systems

  • OptiTrack Tracking Plugin: OptiTrack tracking bar cameras, e.g. Duo3 and Trio3 optical tracking system

Previous Next

© Copyright 2026, ImFusion GmbH.

Built with Sphinx using a theme provided by Read the Docs.