Object recognition for mobile computer vision applications
SentiSight Embedded is designed for developers who want to use computer vision-based object recognition in their applications for smartphones, tablets and other mobile devices. SentiSight is designed to be as universal as possible and is able to perform fully automatic or manual object learning. It enables searching for learned objects in images or videos from built-in cameras with PC-like accuracy.
Available as a software development kit that provides for the development of object recognition applications for the devices that are running Android OS.
The SentiSight Embedded 1.3 technology has these capabilities for visual-based object learning and recognition on mobile and embedded devices:
The SentiSight algorithm is able to find out:
Depending on the object type, one of these algorithms (or both) may be used for successful recognition:
The shape-based algorithm is useful for objects which do not have any distinctive details but have stable external edges (boundaries) and/or internal edges. This algorithm performs at slower speeds but allows for the recognition of most objects not identified by the blob-based algorithm.
The blob-based and shape-based algorithms may be configured to detect object colors and use this information for improving recognition accuracy. This mode enables SentiSight-based applications to distinguish similar objects that only differ in color.
A quality threshold can be used during object learning to ensure that only the best quality object model will be stored into database.
The SentiSight Embedded is able to detect and recognize several 2D and 3D objects simultaneously.
The algorithm makes estimates based on the region an object occupies in a scene, providing additional information about the size, orientation and scale of the recognized object.
SentiSight Embedded 1.3 SDK is based on SentiSight Embedded object recognition technology and is intended for computer vision systems developers and integrators. The SDK allows rapid development of object recognition applications for smart phones, tablets and other devices that are running Android OS. The integrator has complete control over SDK data input/output and can call the functions from the SentiSight Embedded algorithm. SentiSight Embedded SDK is able to capture images and video streams from cameras that are built-in in Android devices.
The SentiSight Embedded 1.3 SDK contains:
See the licensing model for more information on specific license types.
The SentiSight Embedded component is able to enroll new objects by creating object models from videos or still images and saving the models to database. Also the component can recognize objects by comparing the object models with the actual objects found in images or video frames.
The recognized objects are tracked on the subsequent frames until they disappear.
One SentiSight Embedded Component license is included with SentiSight Embedded SDK. More licenses for this component can be purchased any time by SentiSight Embedded SDK customers.
A Java application based on SentiSight Embedded 1.3 technology is able to process a image with an object in less than 1 second. Object recognition algorithms can be run on more than one thread of multi-core processors.
These conditions may alter the performance of the algorithms:
Object model size depends on how feature-rich is an object, and thus is individual for each object. All object models should be loaded into RAM before identification, thus the maximum object model database size is limited by the amount of available RAM.
The SentiSight Embedded 1.3 algorithm was tested with a subset of Amsterdam Library of Object Images (ALOI).
The average object model size when testing with the 768 x 576 pixels images (the original resolution) was:
When the images were resized to 320 x 240 pixels, the average object model size was:
At 0.1 % False Acceptance Rate (FAR), the recognition rate is from 70 % – 99 %, depending on object structural appearance, transparency, etc. For objects with well-defined internal structure, the recognition rate is 98 % – 99 % at 0.1 % FAR.
An integrator should obtain a SentiSight Embedded 1.3 SDK (EUR 339) to develop a product based on SentiSight Embedded technology. The SDK needs to be purchased just once and may be used by all the developers within the integrator’s company.
SentiSight Embedded 1.3 SDK includes SentiSight Embedded component. A license for an individual SentiSight Embedded component is required for each CPU that runs the component (a processor can have any number of cores).
1 single computer license for SentiSight Embedded component is included with SentiSight Embedded 1.3 SDK.
Components are copy-protected – a license is required for a component to run. License activation options are listed below on this page.
Additional component licenses may be obtained by SentiSight Embedded SDK customers as required by their development process.
To deploy a product developed with SentiSight Embedded SDK, an integrator needs to obtain only the additional licenses required for the particular SentiSight Embedded components that will run on each CPU of their customer’s devices or computers. The available SentiSight Embedded components and license types for product deployment are the same as for product development.
Each SentiSight Embedded component running on a device or computer belonging to the integrator’s customer requires a license. License activation options are listed below on this page.
Prices for SentiSight Embedded 1.3 SDK and additional SentiSight Embedded component licenses can be found here.
The Licensing Agreement contains all licensing terms and conditions.
Note that you unambiguously accept this agreement by placing an order using Neurotechnology online ordering service or by email or other means of communications. Please read the agreement before making an order.
A single computer license allows the installation and running of a SentiSight Embedded component installation on one CPU (a processor can have any number of cores).
Each single computer license requires activation for a SentiSight Embedded component to run. The available activation options are listed below on this page.
Additional single computer licenses for SentiSight Embedded components may be obtained at any time by SentiSight Embedded SDK customers.
Volume license manager is used on site by integrators or end users to manage single computer licenses for SentiSight Embedded components via a LAN or the Internet. It consists of license management software and a dongle, used to store the purchased licenses.
The license manager allows the management of installation licenses for SentiSight Embedded components across multiple devices or computers in the network. The number of managed licenses is limited by the number of licenses in the license manager. Once issued, the license is assigned to a specific device or computer on the network.
The volume license manager requires a PC with Microsoft Windows or Linux to run the license management software; the dongle would be connected to the PC.
Additional SentiSight Embedded component licenses for the license manager may be purchased at any time. Neurotechnology will generate an update code and send it to you. Simply enter the code into the license manager to add the purchased licenses.
The SentiSight Embedded enterprise license allows an unlimited use of SentiSight Embedded components in end-user products for a specific territory, market segment or project. Specific restrictions would be included in the licensing agreement.
The enterprise license price depends on the application size and the number of potential users of the application within the designated territory, market segment or project.