SENSING TECHNOLOGY MAP · 01

Body signals,
made visible and audible

From body-surface sounds to medical imaging, mapping the HolyLens multimodal sensing technology landscape.

08Sensing Domains
30Devices & Modalities
04Priority Product Directions

R&D MAP · NOT CLINICAL ADVICE

01

ACOUSTIC SENSING

Body Sound Acquisition

Near-term Priority
♥

Heart Sounds

S1/S2, additional heart sounds and valvular murmurs

Sensor
Electronic chestpiece · MEMS · Piezoelectric
Output
PCG / WAV / PCM
Open HL.AI.PCG →
◒

Lung Sounds

Breath sounds, crackles, wheezes and friction rubs

Sensor
Contact microphone · Auscultation array
Output
Multichannel audio
Open HL.AI.VAG →
≈

Bowel Sounds

Abdominal motility sounds and gastrointestinal acoustic signals

Sensor
Piezoelectric patch · Contact microphone
Output
Long-duration acoustic sequence
Research
⌁

Vascular Sounds

Carotid bruits, fistula sounds and blood-flow acoustics

Sensor
Electronic auscultation · Doppler probe
Output
Audio / Doppler spectrum
Research
◖

Cough and Breathing

Cough, snoring, respiratory rhythm and voice

Sensor
Air microphone · Throat sensor
Output
Audio / Event sequence
Portable
✦

Fetal Heart Sounds

Fetal heartbeat and heart-rate rhythm

Sensor
Fetal auscultation · Ultrasound Doppler
Output
Audio / FHR
Professional Device
⌇

Joint Sounds

Friction, clicks and vibration during movement

Sensor
Contact microphone · Accelerometer
Output
Combined acoustic-vibration signal
Exploratory
◫

Swallowing Sounds

Pharyngeal swallowing sounds and surface vibration

Sensor
Throat microphone · Accelerometer
Output
Audio / Vibration
Exploratory
02

OPTICAL IMAGING

Optical and Miniature Imaging

Near-term Priority
◎

Body Surface and Wounds

Skin, wounds, limbs and color changes

Device
RGB camera · Calibrated illumination
Output
Photo / Video
Portable
◉

Dermatoscopy

Polarized magnification of skin surface and pigmented structures

Device
Polarized lens · Ring light
Output
High-resolution image
Suggested Direction
◔

Digital Otoscopy

Ear canal, tympanic membrane and ear lesions

Device
Miniature lens · Cold light source
Output
Image / Video
Suggested Direction
◇

Oral Cavity and Throat

Teeth, gums, tongue surface and pharynx

Device
Oral scope · Macro camera
Output
Image / Video
Portable
◉

Fundus Imaging

Retina, optic disc and fundus vasculature

Device
Fundus camera · Dedicated optics
Output
Fundus image
Professional Device
▤

OCT

Low-coherence light for shallow tomographic imaging

Device
Infrared source · Interferometric optics
Output
Tomographic volume data
High Complexity
⌘

Endoscopic Imaging

Real-time visualization of lumens and internal organs

Device
Flexible fiber optics · Miniature camera
Output
Video / Image
Professional Device
✣

Digital Microscopy

Digital capture of cells, blood and tissue slides

Device
Microscope · Pathology scanner
Output
Whole-slide image
Laboratory
03

THERMAL & INFRARED

Infrared and Thermal Imaging

Portable Direction
♨

Infrared Thermometry

Non-contact surface temperature and trend monitoring

Device
Infrared temperature array
Portable
▧

Medical Thermography

Temperature distribution, inflammation and wound observation

Device
Long-wave infrared camera
Suggested Direction
◡

Foot Temperature Map

Bilateral foot-temperature differences and localized hot spots

Device
Thermal array · Standardized footplate
Research
04

ULTRASOUND

Ultrasound Imaging

Mid-term Direction
◒

2D B-mode

Cross-sectional structure of organs and soft tissue

Output
2D grayscale image
Professional Device
♥

Cardiac and M-mode

Cardiac structures, valves and motion trajectories

Output
Cine / M-mode
Professional Device
≋

Doppler Ultrasound

Blood-flow direction, velocity and spectrum

Output
Color / Spectral data
Professional Device
◈

Elastography

Tissue stiffness and deformation distribution

Output
Elastogram / Values
Advanced
05

IONIZING IMAGING

X-ray and CT

Ionizing Radiation
X

Digital X-ray

Chest radiographs, skeletal and static projection imaging

Output
DICOM image
Highly Regulated
⊚

CT

Tomographic volume data reconstructed from multi-angle X-ray acquisition

Output
DICOM series / 3D
Large Equipment
▣

Fluoroscopy and Angiography

Interventional procedures and dynamic contrast observation

Output
Real-time X-ray sequence
Large Equipment
06

MAGNETIC RESONANCE

Magnetic Resonance Imaging

Advanced Imaging
◎

Anatomical MRI

Three-dimensional imaging of the brain, spine, joints and soft tissue

Output
DICOM / 3D volume data
Large Equipment
◌

Functional and Diffusion MRI

Brain function, fiber connectivity and water diffusion

Output
Time series / Parametric maps
Specialist Research
07

NUCLEAR MEDICINE

Nuclear Medicine Imaging

Radioactive Tracer
✦

PET

Functional imaging of metabolic and molecular activity

Output
3D activity distribution
Very High Complexity
✧

SPECT

Organ function, perfusion and tracer distribution

Output
Tomographic functional map
Very High Complexity
08

MULTIMODAL FUSION

Multimodal Combined Acquisition

Platform Direction
Heart Sounds＋ECG＋Ultrasound

Combined acoustic, rhythm and structural signals

Lung Sounds＋SpO₂＋Respiratory Rate

Combined respiratory-state observation

Wound Image＋Thermal

Combined morphology and temperature trends

Fundus＋Blood Pressure＋Blood Glucose

Multi-source chronic-disease risk research

HOLYLENS RECOMMENDED PATH
  1. NOWElectronic Auscultation
  2. NEXTOtoscope / Dermatoscope / Thermal
  3. MIDPortable Ultrasound
  4. PLATFORMMultimodal AI