IP cameras with built-in video analytics function.
Video analytics is a new and promising direction that can increase the efficiency of a security system and even make a certain revolution in the standards of building video surveillance systems. According to the assessment of the analytical company IMS Research, by 2012, sales of systems and software with a video analysis function will make up more than 30% of the total sales of security video surveillance equipment. Despite the possibility of using video analysis technologies in digital video recorders, there is a problem of transmitting a video signal via analog interfaces without loss of quality. Low signal quality and interference lead to a decrease in the reliability of detection. This problem does not exist in the case of implementing video analysis algorithms directly in the IP camera processor.
In fairness, it should be noted that automated image analysis has been used in video surveillance systems for many years. In fact, since the first computer systems appeared. The most common solutions were recognition systems (faces, license plates). Actually, analytical detectors, which are behavior detectors, appeared at the same time. However, close interest from the consumer arose from the time when analytical detectors became a characteristic functional feature of digital cameras. As soon as the market determined the priority of IP technology development and the need to use IP cameras, it was presented with another gift. «An IP camera with video analytics allows you to significantly increase the level of security, it does not get tired and does not lose vigilance, like an operator, it is endowed with intelligence,» marketers from many manufacturing companies assure consumers.
In reality, if you remove the marketing hype, everything will look more down-to-earth. Video analytics in IP cameras is a customizable video detector, the reliability of which is mainly determined by the correct choice of observation conditions and image angle. IP camera processors are not so powerful as to count people in a crowd on the fly or identify abandoned objects in a huge airport hall. The choice of observation angle should be meaningful. The observation area should not be too large. However, the likelihood that an operator will be able to record an event in a system of hundreds of cameras is even smaller. Therefore, when used correctly, video analytics can really improve the efficiency of your video surveillance system or solve specific problems.
Existing types of video analytical detectors
Today, there are quite a large number of analytical detectors implemented in IP cameras. Here are the most famous ones.
Detector of abandoned and taken away objects.The detector records an event when an object that was absent or present in the area in the previous frame suddenly appears or disappears without passing through it. When setting up this detector, you can define the time of presence in the area and the time of detector reset. The detector allows you to monitor the appearance of foreign objects or the disappearance of objects.
Crossing a virtual line. The detector allows you to monitor the intersection of a line added to the image. You can set the intersection rule from left to right, from right to left, or in both directions. The detector distinguishes the direction of movement. The detector allows you to monitor movement in a certain area, territory, corridors.
Entering and exiting the zone. Entry: detects an event when a moving object enters and passes through a certain area. Exit: detects an event when a moving object passes through and leaves a certain area. The detector allows you to monitor the movement of people and vehicles in a certain area.
Anti-sabotage. The detector records a change in the camera's viewing angle in a situation where the camera is shifted or the lens is covered by an object (out of focus).
Counting objects. The detector automatically counts objects crossing a given line or a certain zone. The detector allows you to quite successfully count the passage of vehicles through a checkpoint or barrier.
Staying in the zone beyond the set time.The detector is designed to track idly wandering people who may actually be observing a particular private action, such as entering a card code at an ATM. At the same time, it is possible to display and record the trajectory of movement.
Change in speed of movement. The detector determines the speed of movement of objects, such as a stream of cars. A stop in traffic (traffic jam) is considered an alarming event.
Highlighting cars and people. The detector is designed to determine the appearance of a person and a car in the frame, understanding the difference between them (their sizes and behavioral characteristics). In the image, objects are marked with different colors.
It should be noted that a number of IP system software manufacturers implement additional functionality in their products through a combination of detectors built into the IP camera and a set of macros configured in the program.
Configuring the detector
In most IP cameras, the video analytics detector is configured via the camera's web interface. For this purpose, there is a specific section in the menu, in which not only the detector's operation is programmed, but also the reaction that follows when triggered. Typically, this is the visualization of an alarm on an image in the form of letters or an icon; transmission of an alarm frame to the operator's workstation; transmission of metadata of the alarm image, which can then be used to search the archive; transmission of a frame to a specific e-mail; transmission of a frame to an FTP server; recording a video clip with a prehistory on the camera's flash card; triggering the camera relay. After configuring the detector, you can check its operation and determine the operating period or activation time.
If the setup is carried out through the centralized monitoring software, all the listed functions are available through the program interface.
Compatibility of IP cameras with video analytics and programs
The issue of compatibility of IP cameras with analytical detectors with various programs (system-forming software) is becoming increasingly acute due to the growing demand for analytics technologies in video surveillance systems. In fact, the integration of IP cameras is a resolved issue today — almost all major manufacturers are members of ONVIF. ONVIF is an open industry forum for the development of an international standard for the interaction of network video surveillance devices and systems. Currently, cameras with support for the first version of the ONVIF standard from various manufacturers are offered on the market, and software developers are rushing to add support for the standard to their products. However, ONVIF only defines the mechanisms for identifying devices in the network, their configuration, management and setting the format for transmitting metadata. Support for video analytics is an open question. This means that using ONVIF compatible IP cameras and software from different manufacturers, you will not be able to use an analytical detector. You can work with it only by means of the camera itself, and configure it through its interface. However, ONVIF's North American competitor, the PSIA Integration Alliance, has just recently posted a draft specification on its website that allows defining a standard for the interaction of devices and programs working with analytical detectors. Undoubtedly, standardization and compatibility will ensure the fastest possible spread of automated image analysis technologies in video surveillance systems.
AXIS P1347 (Axis Communications)
5-megapixel fixed network camera. This is the top representative of the line, supporting HDTV 1080p resolution and H.264 compression algorithm, with precise iris control for excellent image clarity. The camera is suitable for surveillance in airports, banks, stores, on the street and in any place where a large coverage area or exceptional image detail is required.
P-Iris control automatically and precisely changes the aperture position to optimize depth of field and lens resolution, allowing for the sharpest possible image. The camera is also backward compatible with DC lenses. To reduce bandwidth and storage requirements, the camera features digital pan/tilt/zoom and multi-streaming video. The camera supports multiple, individually configurable video streams in H.264 and Motion JPEG.
AXIS P1347 features intelligent motion, sound and tamper detection, such as covering or spraying.
Dinion IP NBN-498-12P Day/Night IP Camera (Bosch)
The camera has a 1/3″ day/night CCD with progressive scan, 20-bit 2X image processing technology, wide dynamic range, 2X dynamic engine and SmartBLC.
Video formats — CIF, 4CIF@25IPS. Three-stream data transmission: two H.264 streams and one M-JPEG stream simultaneously. Multicast, direct recording to iSCSI arrays. The camera complies with the Open Network Video Interface Forum (ONVIF) standards.
Key features of the integrated video analytics (IVA):
Detection of incoming, outgoing, and in-area objects.
Detection of loiterers.
Abandoned object detection.
Carried away object detection.
Multiple line intersection detection (from one to three).
Object filtering by color.
Filtering by size, speed, aspect ratio, etc.
Head detection.
Cisco 4500 IP camera with HD 720p resolution at 60 fps and video analytics processor (Cisco)
The 2-megapixel network camera of the 4500 series provides effective video surveillance of a large number of fast-moving objects, such as cars, people in railway stations, banks, etc., since it is capable of transmitting video over the network in H.264 format with a resolution of Full HD 1080p (1920 x 1080) at a frame rate of 30 fps and HD 720p (1280 x 720) at 60 fps. Along with a configurable motion detector, 2 alarm inputs/outputs, event notification, etc., this camera uses a dedicated processor designed to analyze video images in real time. Based on this processor, new generation video analytics algorithms can be implemented, and all analytical information from the camera will not affect the quality of the video stream. Video image analysis in the camera allows avoiding the deployment of additional servers and is used for counting visitors, cars in parking lots, queue management, as well as for automatic speed control, detection of suspicious behavior of people, etc. Cisco 4500 operates under the control of a web browser, Cisco Video Surveillance Manager software and seamlessly integrates into third-party software applications.
Pelco Sarix™ IDE20 2.1-megapixel IP cameras with Extended Platform and video analytics (Pelco by Schneider Electric)
In addition to the renowned Sarix technology and 1/3″ progressive scan CMOS sensor with WDR, these day/night dome network cameras use the Extended Platform (EP) processor, which is the basis for video analytics algorithms. The IDE20 has a resolution of up to 2.1 MPx, a 2.8-8 mm zoom lens and can be supplied in various modifications, including pre-installed Pelco Analytic Suites and ObjectVideo® (OV) Analytic Suites. Each camera has a standard or extended kit, including, in particular, detectors of people crossing a certain zone, human movement in the opposite direction to the correct one, movement of objects, etc. These cameras allow you to count the number of people entering/leaving a certain zone, notice unattended things and activate an alarm signal when an attempt is made to damage the optics, the appearance of idle people, improperly parked cars, etc. In addition, IDE20 has a motion detector, alarm input/output, and a slot for MicroSD memory cards, on which it is possible to store alarm video.
SNB-5000 – IP camera with 1.3 MP resolution with WiseNet processor and built-in video analytics (Samsung Techwin)
SNB-5000 transmits images with 1280 x 960 resolution over IP network.
The camera has exceptionally high sensitivity thanks to the CCD matrix and the shiftable IR filter. The minimum illumination is 0.3 lux (color) and 0.1 lux (B/W) at F1.2, 50% IRE. The camera uses patented H.264/MPEG-4/JPEG triple codec technology, which allows achieving clear images and real-time multi-stream data transmission with a high degree of information compression. The SNB-5000 supports various protocols, two-way audio transmission, has a motion detection function and analytical detectors: abandoned/taken away objects, entry/exit to the zone, crossing the line. Recording to a 32 GB SDHC card is possible. The Net-I centralized management software supplied with the camera helps users create an effective network management system with convenient visual surveillance options, including various events and map images. The camera supports PoE.
IP-camera Smartec STC-IPX3061A NEYRO series with video analytics (Smartec)
STC-IPX3061A of the NEYRO series with built-in video analytics from the English company VCA Technology is equipped with a 1/3” Sony Super HAD CCD matrix and ensures operation at a minimum illumination of 0.3/0.01 lux (color/b/w) with a resolution of D1 (720 x 576 pixels) at 25 fps. It is capable of transmitting 2 video streams in H.264, MPEG-4 or MJPEG, as well as audio signals in two directions. The camera is equipped with a slot for SD cards and supports PoE technology.
The STC-IPX3061A is equipped with a set of VCApresence video analytics algorithms, providing tracking of up to 100 objects and configuration of up to 40 controlled zones. When the optional VCAsurveillance license is activated, such functions as object registration upon entry/exit or appearance/disappearance in a specified surveillance zone, upon its stop or delay in the zone, registration of abandoned/stolen items, classification of objects by area and speed, object counting, etc. become available.
S2610e-AS IP camera (VERINT)
The S2610e-AS with built-in hardware video analytics is used in Itrium®video solutions. Supports 6 reference views and 5 active analysis rules.
View count matrix – CIF. 4 types of filters to reduce false alarms.
Possibility of fine-tuning – up to 100 internal parameters when optimizing the analytics unit on complex scenes. High accuracy of scene analysis regardless of weather and time of day. Invariance to changes in scene lighting.
Classification of moving objects by type (car, person) and analysis of their speed of movement.
Detection: appearance/disappearance of an object (entrance, exit); chaotic movement; stationary left/taken away objects. Virtual analysis on perimeters (control of the intersection of an object with one or more virtual lines in the frame, taking into account the order and direction). Combining several rules for one type when analyzing complex scenes.
Pelco IXE20DN (Pelco by Schneider Electric)
The Sarix line includes a wide variety of cameras with built-in analytics. All 2-megapixel IP cameras, including classic box cameras, dome cameras, and day/night cameras, have a second built-in processor that is used to work with video analytics.
Pelco offers video analytics from Pelco and ObjectVideo. The camera is loaded with analytical packages related to “motion” (adaptive motion detector, direction of motion, camera damage detection, etc.) or “objects” (abandoned object detector, object counting, object removal, camera damage detection, etc.).
The number of modules is constantly expanding. For example, the latest development is the “idle wandering” module, the purpose of which is to recognize people who often cross selected areas.
Most of the analytical functions are used outdoors, and Sarix cameras are the best choice for this task. They are “day-night”, have a minimum sensitivity of 0.03 Lux f1.2, are equipped with special Low Light technology and autofocus, and support H.264.
Network IP camera GF-IP4370MPDN «day/night» (Giraffe)
GF-IP4370MPDN is built on a megapixel 1/3″ CMOS matrix with a wide-angle megapixel lens f 4.0mm/F1.5. Broadcasting of high-resolution images (1280×1024 at 15 fps) can be carried out using H.264, MPEG-4, MJPEG compression, which allows to significantly reduce the archive size. The camera is equipped with a built-in microphone and speaker for two-way audio communication, a motion detector, IR illumination, and a port for connecting external alarm sensors and an actuator (e.g., a siren, floodlight, etc.). Monitoring can be carried out both on a computer and from mobile terminals and phones with a web browser. The camera comes with original software Iwizard, WebVUer and ComproView.