Face identification and movement tracking for video surveillance systems
Depending on the surveillance system design, one of these algorithms may be used:
A system based on SentiVeillance 6.0 SDK is able to log face, pedestrian or object appearance, disappearance and tracking. The detected faces are matched against the watchlist in the internal database and recognized faces are immediately reported to the system. The system uses face tracking for automatic enrollment from video stream and adding new facial templates to watch list on the fly.
SentiVeillance 6.0 SDK allows to integrate its technology into surveillance systems with multiple cameras and multiple data-processing nodes. A single computer can process video data from up to 10 cameras simultaneously. Multiple computers with running SentiVeillance software can quickly synchronize biometric and surveillance data between each other over the network. The synchronization can be customized as the SDK includes sample source code for using the communication and synchronization processes.
SentiVeillance also accepts data from video files. The video files are processed in real time as coming from a virtual camera, therefore an hour-long video will be processed in one hour
SentiVeillance 6.0 SDK is based on the SentiVeillance 6.0 technology that is specially designed for integrating biometric facial recognition into video surveillance systems. Face templates created with SentiVeillance SDK are fully compatible with VeriLook SDK and MegaMatcher SDK multi-biometric technology.SentiVeillance 6.0 SDK includes Device Manager library for Microsoft Windows and Linux that allows to perform simultaneous capture from multiple cameras.
Components | Microsoft Windows (64 bit only) |
Linux (64 bit only) |
• SentiVeillance 2-camera component | 1 single computer license | |
• SentiVeillance 10-camera component | Optionally available | |
• Face Extractor component | 1 single computer license | |
• Device Manager library | + | + |
Programming samples | ||
• C++ | + | + |
• C# | + | |
• Visual Basic .NET | + | |
Programming tutorials | ||
• C | + | + |
• C# | + | |
• Java | + | + |
Documentation | ||
• SentiVeillance 6.0 SDK documentation | + |
The SentiVeillance 2-camera component is designed for using in small-scale video surveillance systems with several cameras. The component performs real-time detection and tracking of all detected faces from up to 2 live video streams. The component installations can be run on several computers distributed over network and synchronize data between themselves.
The SentiVeillance component is able to track multiple faces simultaneously and match them with faces from internal database (i.e. a watch-list of suspects or a list of company employees). New faces may be enrolled to the database either automatically or manually from image files. Person’s gender can be optionally determined for each person in a frame.
The C# and VB .NET samples from the SDK show how to use the component.
One SentiVeillance 2-camera component license is included with SentiVeillance 6.0 SDK. More licenses for this component can be purchased any time by SentiVeillance 6.0 SDK customers.
The SentiVeillance 10-camera component is designed for using in large surveillance systems with multiple cameras and has the same functionality as the SentiVeillance 2-camera component. It supports input from up to 10 live video streams on the same PC or server. The component installations can be run on several computers distributed over network and synchronize data between themselves.
The SentiVeillance 10-camera component licenses can be purchased any time by SentiVeillance 6.0 SDK customers.
The Face Extractor creates face templates from face images. The component is intended for enrolling faces from still images into a surveillance system and provides its functionality for reasonable price
The component extracts a single face template in 1.34 seconds. The specified performance requires a PC or laptop with at least Intel Core 2 Q9400 (2.67 GHz) processor.
Face Extractor can generalize a face template from several images that include the same face to improve the template’s quality.
One Face Extractor license is included with SentiVeillance 6.0 SDK. More licenses for this component can be purchased any time by SentiVeillance 6.0 SDK customers.
Device Manager library works under Microsoft Windows and Linux and provides functionality for simultaneous capture from multiple cameras. The library supports a range of high-resolution digital surveillance cameras and other cameras that provide DirectShow interface for Windows platform, or GStreamer interface for Linux platform.
The list of supported cameras is available below in the system requirements.
The Device Manager includes a plug-in framework that allows integrators to write plug-ins to support their cameras using the provided API. The SentiVeillance SDK documentation contains the detailed information and samples.
A video file can be also used as a data source for SentiVeillance. The input from the file is processed as coming from a virtual camera, thus the video is processed in real-time.
These supported cameras are suitable for using with SentiVeillance 6.0 SDK:
SentiVeillance SDK includes separate algorithms for biometric face recognition and motion detection and tracking. Depending on the surveillance system design, one of these algorithms may be used. Below are specifications for these algorithms.
Technical Specifications for Biometric Face Recognition Algorithm
4 % of the frame’s larger side (at least 32 pixels) is the minimal recommended distance between eyes for a face on video stream or image to perform reliable face tracking and template extraction. The speeds of face tracking, template extraction and matching against a watchlist database are dependent on actual size of a face in a frame, not on the size of the whole frame.
SentiVeillance has certain tolerance to face posture that assures face detection and tracking:
See also the whole list of recommendations and constraints for SentiVeillance usage.
The performance specifications are provided for Intel Core i7-4771 processor, running at 3.5 GHz clock rate, and 1920 x 1080 pixels videos.
SentiVeillance 6.0 biometric face recognition algorithm technical specifications | |
Frame rate when tracking up to 5 faces | More than 25 frames per second |
Face watch-list database matching time (1) | Less than 0.5 second |
Single face record size in a template (kilobytes) | 5.0 or 7.0 (configurable) |
Maximum face watch-list database size | Limited by amount of free RAM |
(1) up to 20,000 face records in the database; larger database yelds slower response time. Note that each person may be represented by several records in the database with different appearance variations, different capture angles etc.
40 x 40 pixels is the minimal moving object size for its detection and tracking. The pedestrians or moving objects tracking performance is dependent on actual size of an object in a frame, not on the size of the whole frame.
The performance specifications are provided for Intel Core i7-4771 processor, running at 3.5 GHz clock rate, and 1920 x 1080 pixels videos.
SentiVeillance 6.0 motion detection and tracking algorithm technical specifications | |
Frame rate when tracking up to 3 pedestrians | More than 30 frames per second |
Frame rate when tracking up to 4 cars and occasional pedestrians | More than 27 frames per second |
The following licensing model is intended for end-userproduct developers. Integrators who want to develop and sell a SentiVeillance based development tool (with API, programming possibilities, programming samples, etc.), must obtain permission from Neurotechnology and sign a special VAR agreement.
An integrator should obtain a SentiVeillance 6.0 SDK (EUR 790) to develop a product based on SentiVeillance technology. The SDK needs to be purchased just once and may be used by all the developers within the integrator’s company.
A license for a specific component of SentiVeillance SDK is required for each computer that runsthe component.
SentiVeillance 6.0 SDK includes:
SentiVeillance 10-camera component licenses are not included with the SentiVeillance 6.0 SDK, but can be purchased separately.
Components are copy-protected – a license is required for a component to run. License activation options are listed below on this page.
Additional component licenses may be obtained by SentiVeillance SDK customers as required by their development process.
To deploy a product developed with SentiVeillance 4.0 / 5.0 / 6.0 SDK or VeriLook Surveillance 1.x / 2.x / 3.x SDK, an integrator need obtain only the additional licenses required for the SentiVeillance 6.0 SDK components that will run on each computer belonging to their customers. The available license types for product deployment are the same as for product development.
Each SentiVeillance 6.0 SDK component running on a computer belonging to the integrator’s customer requires a license. License activation options are listed below on this page.
Prices for SentiVeillance 6.0 SDK and additional component licenses can be found here.
The Licensing Agreement contains all licensing terms and conditions.
Note that you unambiguously accept this agreement by placing an order using Neurotechnology online ordering service or by email or other means of communications. Please read the agreement before making an order.
A single computer license allows the installation and running of a SentiVeillance SDK component installation on one computer. Neurotechnology provides a way to renew the license if the computer undergoes changes due to technical maintenance.
Each single computer license requires activation for a SentiVeillance SDK component to run. The available activation options are listed below on this page.
Additional single computer licenses for SentiVeillance SDK components may be obtained at any time by SentiVeillance SDK customers.
The algorithm ignores rain and snow, as well as trees and bushes, which are swayed by wind.
Single computer licenses are supplied in three ways:
Volume license manager is used on site by integrators or end users to manage licenses for SentiVeillance SDK components. It consists of license management software and a dongle, used to store the purchased licenses. An integrator or an end-user may use the volume license manager in the following ways:
The SentiVeillance enterprise license allows an unlimited use of SentiVeillance SDK components in end-user products for a specific territory, market segment or project. Specific restrictions would be included in the licensing agreement.
The enterprise license price depends on the application size and the number of potential users of the application within the designated territory, market segment or project.
For more information please contact us.
Object recognition for robotics and computer vision
Read moreLarge-scale AFIS and multi-biometric identification
Add to cartFace identification for stand-alone or Web applications
Add to cart