Skip to Content

Ambient Diagnostics

By Yang Cai

CRC Press – 2014 – 404 pages

Purchasing Options:

  • Add to CartHardback: $99.95
    December 1st 2014


Ambient Diagnostics addresses innovative methods for discovering patterns from affordable devices, such as mobile phones, watches, cameras, and game interfaces, to interpret multimedia data for personal health monitoring and diagnosis. This is the first comprehensive textbook on multidisciplinary innovations in affordable healthcare—from sensory fusion, pattern detection, to classification.

Connecting the Dots

The material in this book combines sensing, pattern recognition, and visual design, and is divided into four parts, which cover fundamentals, multimedia intelligence, pervasive sensors, and crowdsourcing. The author describes basic pattern discovery models, sound, color, motion and video analytics, and pattern discovery from games and social networks. Each chapter contains the material’s main concepts, as well as case studies, and extensive study questions.

  • Contains overviews about diagnostic sensors on mobile phones
  • Reflects the rapidly growing platforms for remote sensing, gaming, and social networking
  • Incorporates cognitive tests such as fatigue detection
  • Includes pseudo code and sample code
  • Provides vision algorithms and multimedia analytics

Covers Multimedia Intelligence Extensively

Ambient Diagnostics includes concepts for ambient technologies such as point-and-search, the pill camera, active sensing with Kinect, digital human labs, negative and relative feature spaces, and semantic representations. The book also introduces methods for collective intelligence from online video games and social media.


Part I. Fundamentals


What is Ambient Diagnostics?

Diagnostic Models

Multimedia Intelligence

Crowd Sourcing

Soft Sensors

Science of Simplicity

Personal Diagnoses

Basic Algorithms

Basic Tools




Early Discoveries of Heartbeat Patterns

Transforms, Features, and Attributes

Sequential Features

Spatiotemporal Features

Shape Features

Imagery Features

Frequency Domain Features

Multi-Resolution Features



Pattern Recognition

Similarities and Distances

Clustering Methods

Classification Methods

Classifier Accuracy Measures



Part II. Multimedia Intelligence

Sound Recognition

Microphone Apps

Modern Acoustic Transducers (Microphones)

Frequency Response Characteristics

Digital Audio File Formats

Heart Sound Sensing

Lung Sound Sensing

Snore Meter

Spectrogram (STFT)

Ambient Sound Analysis

Sound Recognition

Recognizing Asthma Sound

Peak Shift

Feature Compression


Noise Issues

Future Applications



Color Sensors

Color Sensing

Human Color Vision

Color Sensors

Color Matching Experiments

Color Spaces

Color Segmentation

Color Consistency Calibration

Surface Color Diagnosis

Colorimetric Paper Sensor ¬– Lab on Paper

Colorimetric Smell Sensors



Kinect Sensors

The Kinect Revolution

How Does It Work?

Object Tracking

Gesture Alignment

Gesture Recognition

Surface Modeling

Biometric Measurements

Sound Source Location



Video Analytics

Object Detection by Motion

Object Tracking

Shape Descriptions

Visualization of Video Data

Activity Recognition

Color and Motion Amplification


Fatigue Sensing

Diseases- and Treatment-Related Fatigue

Vigilance Theories

The Vigilance Clock

Facial Fatigue Detection

Passive Face Detection

Passive Face Tracking

Active Sensing for Detecting Blinking and Yawning



Part III. Pervasive Sensors

Mobile Sensors



Magnetic Field Sensor

Orientation Sensor

Touch Gesture Sensors

Environment Sensors

Proximity Sensor

Near Field Communication (NFC) Sensors

GPS Sensors

WiFi (Wireless Fidelity) Sensing

Bluetooth Sensing

Sensory Fusion

Motion Classification

Accessing Sensors on Mobile Phones



Body Media

Emerging Wearable Sensors

Body Area Networks (BANs)

Brain-Computer Interface (BCI)

Epidermal Electronics (Smart Fiber)

Pill Cameras



Pocket Microscopes

The Amateur Expert

Sizes of Microoorganisms

Mobile Phone Microscopes

Digital Microscopes

Spectrum Lighting

Observing Yeast Cells

Observing Parasitic Worms

Time-Lapse Video

Laser Holography

Virtual Microscopy

Labeling and Counting

Usability Study



Personal Spectrometers

Beer’s Law

Diffraction Grating

DIY Spectrometer

Analytical Algorithm

Urine Sample Test

Crowd Sourcing Spectrometer

Diagnostic Applications



Part IV. Crowd Sourcing

Remote Sensing

Remote Sensing in Public Space

Human Body Segmentation

Waist Perimeter and Body Mass Calculations

Fuzzy Diagnostic Heuristics

Digital Human Modeling

Physically Augmented Virtual Human Model

Surface Analysis



Games for Diagnosis

Emerging Games for Diagnosis

Anatomy of Game Engines


Finite State Machine

World Modeling

Motion Capture and Control

Game Displays

Game Development Toolkits



Social Media

The Pregnant Man

Relevancy Analysis

Reputation Analysis

Visualizing Social Networks

Correlation Analysis



Further Readings

Sample Source Code


Author Bio

Yang Cai is a computer scientist at Carnegie Mellon University, where he has taught graduate courses in cognitive video, multimedia, human algorithms, creativity, and innovation process. Cai is the founder of the Visual Intelligence Studio and author of the emerging theories of instinctive computing, ambient diagnostics, and empathic computing. He has hosted international workshops on ambient intelligence for scientific discovery, instinctive computing, digital human modeling, and video intelligence. He has been working on research projects with the National Science Foundation, NASA, the Air Force Research Lab, and various industries.

Name: Ambient Diagnostics (Hardback)CRC Press 
Description: By Yang Cai. Ambient Diagnostics addresses innovative methods for discovering patterns from affordable devices, such as mobile phones, watches, cameras, and game interfaces, to interpret multimedia data for personal health monitoring and diagnosis. This is the first...
Categories: Biomedical Engineering, Instrumentation, Measurement & Testing, Data Preparation & Mining