Technical Whitepaper: Audio AI in the FLEXIDOME panoramic 5100i for Gunshot Detection

Written by Matt Golueke | Feb 14, 2024 6:47:12 PM

Our team has a gunshot detection evaluation coming up at the end of February 2024 and in an effort to ensure we are testing the solution properly and comparing our results to others, we reference the related technical whitepaper recently released by Bosch during our preparation phase.

Intelligent Audio Analytics allows a Bosch FLEXIDOME panoramic 5100i (IR) camera to recognize and identify the unique audio signatures of sounds like gunshots or a smoke alarm sound. High level feature extraction is done by Convolutional Neural Networks (CNN) that mimics the human auditory system for sound perception. By creating large datasets to drive the deep neural networks, Bosch is constantly building and improving the algorithms to differentiate similar audio signatures like a car door slam or a truck backfiring, from an actual gunshot. Each one of these events can make a similar sound to human hearing, and yet the response, especially if the event is known, would be very different. By enabling a "sound detector" in the camera, the camera will detect and classify the sound, while ignoring false positives. It will alert the operator instantaneously when the sound matches the audio signature of the selected sound detector, and can also be configured in combination with non-Bosch management systems, such as Milestone Systems or Genetec.

Download the Technical Whitepaper here >>

The FLEXIDOME panoramic 5100i cameras are the first cameras enabled for Intelligent Audio Analytics, helping security staff see with sound to understand the situation quickly and appropriately respond to an incident.

Intelligent Audio Analytics detects and classifies sounds and identifies the approximate direction of the source. This new audio AI is trained on field data sets in various environments and background noises to detect sound signatures of gunshots, smoke alarms (T3), and carbon monoxide alarms (T4) while ignoring false positives, like slamming car doors or banging carts. This precise detection enables security guards to confirm the alarm visually and act proactively. The cameras offer 360-degree coverage without blind spots, an integrated microphone array, and three MEMS acoustic sensors that can capture sound from any direction to help guide an operator to the area of interest. More sound detectors are planned in future releases.

Like all Bosch cameras, the new panoramic cameras combine built-in AI with the Internet of Things (IoT), easily converting video data into valuable insights. Remote Portal fully supports these video cameras, enabling system integrators to remotely perform services such as changing configuration settings and installing firmware updates to ensure systems meet the highest reliability standards and support sustainable business practices.

Benefits

Series Options

Brochure

System Design Assistance

View full post