My handsome nephew Sage Rowan

Hoping I could give my sister a piece of mind and some time back so she could at least eat 🍝.

Angel Eyes is an IoT device that monitors a baby’s sleeping position and environment. Caregivers can view a live stream from anywhere and receive notifications if the device detects any issues.

Angel Eyes was created to ensure a safe and non-intrusive way of monitoring the infant that is leaps and bounds ahead of the on-market baby monitor cameras utilizing the recent advancements in Deep Learning. Angel Eyes is a non-intrusive, safe and efficient monitoring system, that proactively alerts the care givers as the environment or the infant position changes.

The need

Accidental Suffocation and Strangulation in Bed (ASSB) is a prominent cause of death for newborns. Baby monitors could be smart enough to react to scenarios and data, and to proactively alert caregivers when a baby is at risk for ASSB.

The idea

A smart baby monitor uses AI to track the infant and their surrounding conditions. The system is always on, continuously monitoring and alerting caregivers. The device is non-intrusive, monitoring externally without any physical restrictions.

The solution

Angel Eyes uses Microsoft Azure, with a camera and sensors for temperature and humidity. When it detects risks like high room temperature, an object in the crib, or the baby’s unsafe position — it alerts the caregiver to take corrective action.

Safer monitoring for newborns

Angel Eyes was created by parents who wanted to track their baby’s safety at all times, without losing sleep. Learn how Microsoft Azure’s cognitive and visual services plus IoT monitoring devices helps ensure their baby’s well-being.

Always On: Continually watching over the baby and its surrounding conditions.
Proactive: Proactively notifying the caregiver if the surrounding conditions change.
Non-Intrusive: Externally observing the infant’s environment without poking and prodding, thereby allowing the infant the least restrictive environment.

Infant found but not sleeping in the position

Infant sleeping in right position

Key components

Microsoft Azure
Raspberry PI device
Pi-Camera
DHT11 Temperature and Humidity Sensor and utilizing the Microsoft Azure stack to relay communications back to the caregiver.

Angel Eyes Architecture

Process and classify images with the Azure cognitive vision services

Identify faces and expressions by using the Computer Vision API in Azure Cognitive Services

Face API — The Face API provides algorithms, exposed as REST-based web service calls, to detect, verify, identify, and analyze faces. The service can provide face matching, face attributes, and characteristic analysis. The Face API can also organize people and facial definitions into groups to locate similar faces.

The Face API tasks fall into five categories:

Verification: Check the likelihood that two faces belong to the same person.
Detection: Detect human faces in an image.
Identification: Search and identify faces.
Similarity: Find similar faces.
Grouping: Organize unidentified faces into groups, based on their visual similarity.

The Face API uses artificial intelligence to:

Detect human activity in images.
Attempt to match faces to existing image databases.
Detect human faces and return their coordinates.
Manage profiles based on face attributes.
Analyze and identify faces in video frames.

Use Cases

When the infant is sleeping on their back with no objects detected, a safe light is visible.
When Angel Eyes visually detects that the infant has moved to their side, or that an object is in the crib, it sends an alert to the caregiver.
When Angel Eyes environmental sensors detects that the room temperature is high, an alert is sent to the caregiver notifying them to take corrective action.

Angel Eyes 👼