Part 3: Future
Sense-Compute-Communicate-Actuate
Sense-Compute-Communicate-Actuate
Part 1
Technologies of Today and Near Future
Technologies of Today and Near Future
Many technologies share this theme of a Sense-Compute-Communicate-Actuate loop.
Sense
Sense
Use sensors to pick up signals - get information about the environment
Compute
Compute
Use computation using that information
Communicate
Communicate
Send results of computation (or some of the sensed information) to other systems or to humans
Actuate
Actuate
Take some action: physically move (with help of motors) or send a signal
Loop
Loop
Go through the four-step process again and again
Today’s topic: Sensing
Today’s topic: Sensing
The Loop in Humans
The Loop in Humans
Sense
Sense
◼
see
◼
hear
◼
touch
◼
smell
◼
taste
Compute
Compute
In the brain
◼
Visual cortex
◼
Auditory cortex
◼
Sensory cortex
Communicate
Communicate
◼
Facial expression
◼
Gestures
◼
Voice
Actuate
Actuate
◼
Muscular and skeletal movements
The Loop in a Machine: Drone Delivery Systems
The Loop in a Machine: Drone Delivery Systems
Sense
Sense
◼
GPS location
Compute
Compute
◼
Process sensed data
◼
Decisions based on the results
Communicate
Communicate
◼
with other drone systems
◼
base camp
◼
destination
Actuate
Actuate
◼
Control rotors to land safely or hover
◼
Deposit package
The Loop in a Machine: Autonomous Vehicles
The Loop in a Machine: Autonomous Vehicles
Sense
Sense
◼
Camera; LIDAR
◼
GPS
◼
others
Compute
Compute
◼
Processing video and images
◼
Location information
◼
Audio
Communicate
Communicate
◼
Communicate with cloud
◼
Communicate with human
Actuate
Actuate
◼
Turn wheels
◼
Speed up
◼
Slow down
◼
Basically drive the car
The Loop in a Machine: Digital Assistants
The Loop in a Machine: Digital Assistants
E.g. Amazon Alexa
Sense
Sense
Wake up: “Alexa”, “Hey Siri”,”Hey Google”
Compute
Compute
Matching signals
Communicate
Communicate
Communicate with the database, cloud, information on the web.
Actuate
Actuate
Turn on screen, speaker, light
The Loop in a Machine: Smart Treadmill
The Loop in a Machine: Smart Treadmill
Sense
Sense
Motion sensor, microphone, medical sensors
Compute
Compute
To interpret voice commands, suggest exercise routine based on information collected, find music matching your speed and gait
Communicate
Communicate
Record of previous workout, music database, medical data lookup
Actuate
Actuate
Stop, slow down, incline, change speed
The Loop in a Machine: Cleaning Robots
The Loop in a Machine: Cleaning Robots
Sense
Sense
Sense obstacles, sense motion, camera
Compute
Compute
Distance to obstacle, direction of motion
Communicate
Communicate
Among multiple cleaning robots
Actuate
Actuate
Move, change direction, turn vacuum on or off
SLAM: Simultaneous Localization and Mapping
Sensors
Sensors
Camera: IR, thermal, LIDAR, RADAR
Camera: IR, thermal, LIDAR, RADAR
Microphones: audible, ultrasound
Microphones: audible, ultrasound
IMU (Inertial Measurement Unit): accelerometer, gyroscope, magnetometer
IMU (Inertial Measurement Unit): accelerometer, gyroscope, magnetometer
Wireless: GPS, WiFi, Radio signals
Wireless: GPS, WiFi, Radio signals
Assorted: Pressure, humidity, proximity, temperature, chemical traces
Assorted: Pressure, humidity, proximity, temperature, chemical traces
The Humble Camera
The Humble Camera
◼
The Pinhole Camera: https://youtu.be/jhBC39xZVnw
◼
Camera Lenses: https://youtu.be/Q5Jat06VM6o
The Smartphone Camera
The Smartphone Camera
Source: Structure and Imaging Principles of a Smartphone Camera
◼
Article: https://www.utmel.com/blog/categories/optoelectronics/structure-and-imaging-principle-of-smartphone-camera
◼
Video: https://youtu.be/fkG3D0WXRAw