intelligent_video_surveillance_system.pdf

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

TITLE PAGE

CASE STUDY

CASE STUDY ON HUAWEI’S INTELLIGENT VIDEO SURVEILLANCE SYSTEM

 (11065981) (05055868) (11047106) MODULE CODE: CTP 148N MODULE NAME: ADVANCED COMMUNICATION SYSTEMS MODULE LEADER: DR MORI S. VAEZI-NEJAD V AEZI-NEJAD

FACULTY OF COMPUTING LONDON METROPOLITAN UNIVERSITY 166-220 HOLLOWAY ROAD N7 8DB LONDON, UK

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 1

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

TABLE OF CONTENT

TITLE PAGE TABLE OF CONTENT CHAPTER ONE 1.0 INTRODUCTION 1.1 HUAWEI'S INTELLIGENT INTELLIG ENT SURVEILLANCE SYSTEM SYSTE M CHAPTER TWO 2.0 EVOLUTION OF VIDEO SURVEILLANCE SURVEILLANCE 2.1 ANALOG CCTV SYSTEM USING DVR: 2.2  NETWORK DVR-BASED ANALOG CCTV SYSTEMS 2.3 VIDEO ENCODER-BASED NETWORK VIDEO SYSTEMS CHAPTER THREE 3.0 ARCHITECTURE OF AN INTELLIGENT VIDEO SURVEILLANCE SURVEILLANCE SYSTEM 3.1 ACQUISITION 3.2 TRANSMISSION 3.3 COMPRESSION 3.4 PROCESSING 3.5 ARCHIVING 3.6 DISPLAY CHAPTER FOUR 4.0 VIDEO ANALYTICS ANALYTICS 4.1 REASONS FOR DEPLOYING VIDEO ANALYTICS ANALYTICS 4.2 ADVANTAGES ADVANTAGES OF VIDEO ANALYTICS 4.3 LIMITATIONS LIMITATIONS AND DISADVANTAGES DISADVANTAGES OF VIDEO ANALYTICS ANALYTICS 4.4 DESCRIPTION OF VIDEO ANALYTICS ANALYTICS TECHNIQUES CHAPTER FIVE 5.0 SECTORS OF APPLICATION 5.1 RETAIL TRADE 5.2 TRANSPORTATION 5.3 EDUCATION 5.4 GOVERNMENT AND PUBLIC SECURITY 5.5 AIRPORTS 5.6 STATIONS STATIONS AND PUBLIC TRANSPORT TRANSP ORTA ATION 5.7 BANK SETTING 5.8 OTHER CONCLUSION REFERENCES

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

1 2 3 3 3 6 6 7 7 8 9 9 9 12 13 14 15 16 17 17 17 18 18 18 23 23 24 24 25 25 26 26 26 27 28 29

Page 2

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

CHAPTER ONE INTELLIGENT VIDEO SURVEILLANCE SYSTEM

1.0

INTRODUCTION

The goal of this report is to briefly describe an Intelligent Video Surveillance System, using The Huawei’s Intelligent Video Surveillance System.

Intelligent video surveillance system can be defined as the real-time monitoring within a specific environment of both persistent and transient object. Top priorities of this system is to maintain access control to secure area, monitor perimeter for intrusion and important personalities, watch public areas for suspicious behaviors, unattended object, etc [2-3].

The evolution of intelligent video surveillance systems, architecture (acquisition, transmission,  processing, compression, archiving and display), video analytics (object detection, recognition, tracking and behavior), and applications of intelligent video surveillance system are briefly covered in this case study report, with a brief introduction to the Huawei’s Intelligent Video Surveillance System. 1.1

HUAWEI'S INTELLIGENT SURVEILLANCE SYSTEM

The Huawei’s Intelligent Video Surveillance System is designed to provide high definition, high reliability, high performance, manageable small and medium video surveillance services to meet the needs of its clients. To over the limitations posed by traditional video surveillance systems, Huawei uses new technologies in digital video coding, compression, digital networks and digital storage, with real-time monitoring, recording video playback, control centers, alarm detection and sharing, and intelligence analysis. It adopts an all-IP implementation, using network cameras, encoders and storage devices [4-5]. High points of the Huawei’s Intelligent Video Surveillance System include [4-5] a. Unified Management: it supports automatic deployment, remote maintenance, reports and alarm management. It can monitor the entire systems’ temperature and fan speed in real time.  b. The system incorporates the Smart NVR 3000, which consists of a flexible, highly efficient and reliable storage system. It uses RAID 5 to maximize hard disk usage and provide up to 16TB storage from the recordings of 100 cameras. Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 3

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

c. The system integrates several intelligence analysis modules which can be used for license plate recognition, behavior analysis, demographics, and quality video analysis. All of these incorporated together reduces operation cost, improves efficiency and increases accuracy in monitoring. d. The system adopts various energy-saving techniques to reduce costs, especially when its is lightly loaded. It also incorporates an enhanced heat dissipation design and fan rotation speed control based on the temperature of heat prone components.

Figure 5: Huawei Intelligent Video Surveillance System

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 4

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

The Huawei’s Symnatec Surveillance system consists of four (4) parts, namely: Video storage management platform system, surveillance centre system, transmission network system and front end system [3]. This is shown in figure 5 above. The video management platform basically provides platform management, intelligent storage management and client management. The transmission system performs the transmission of video services using any TCP/IP supported network including Ethernet, PON networks and wireless networks. The front end system consists of video encoders, cameras and alarm probes. The surveillance system is made up of the large display system, software/hardware decoder, console and surveillance management for professional users [4].

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 5

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

CHAPTER TWO 2.0

EVOLUTION OF VIDEO SURVEILLANCE

Video surveillance is an industry that is more than 30yrs old and also had its share of technology changes. The demands in a video surveillance market includes; 

Simplified installation and maintenance



Longer retention of recorded video



Better image quantity



Reduction in costs



Size and scalability



More secure and reliable technology



Remote monitoring capabilities



More limit in system intelligence

In order to meet these requirements, video surveillance has experienced a number of technology shifts. The latest is the shift from analog cctv surveillance to fully digital, network based video surveillance systems. Video surveillance systems started out as 100 percent analog systems and are gradually  becoming digital [1, 4-5].

Video surveillance industry saw its first digital revolution with the introduction of the DVR in the mid1990s. Most DVR had several video imputs, With early DVRS, hard disk space was limited. The introduction of the DVR system provided the following major advantag es [1, 4-5] 

 No need to change tapes



Consistent image quality



Ability to quickly search through recorded video

The sections below outline the evolution of video surveillance systems. Different system configurations, from fully analog to fully digital, are explained, along with the benefits of each configuration. The solution comprises of the number of digital components but do not represent fully digital systems. The video is constantly being transported over an IP network and which are fully scalable and flexible in network video systems [1, 4-5].

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 6

 Case Study Report on Intelligent Video Surveillance System 2.1

 Akoma et al 

ANALOG CCTV SYSTEM USING DVR:

The diagram below represents an analog CCTV system using DVR(Digital video recorder).This is an analog system with digital recording, In a DVR, the video is digitized and compressed so as to store as as many videos as possible, The videotape is replaced with hard drives for the video recording.

Fig1:Analog CCTV using DVR (Digital video recorder)

ANALOG CCTV USING VCR: An analog cctv using VCR(video cassette recorder)represents a fully analog system consisting of analog cameras with coax output connecting to the VCR from recording. The video of the VCR is not compressed. It uses the same type of cassettes as a home VCR.An analog monitor is used to monitor the video [1, 4-5].

Fig 2 showing a classical analog video surveillance system 2.2

NETWORK DVR-BASED ANALOG CCTV SYSTEMS

DVR was equipped with an Ethernet port for network connectivity. This introduced network DVRs to the market and enabled remote video monitoring using PCs . Some network DVR systems in use today enable the monitoring of both live and recorded video, whereas some allow the monitoring of only recorded video. therefore, some systems require a special Windows client to monitor the video, whereas others use a standard Web browser; the latter makes remote monitoring more flexible [1, 4-5].

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 7

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

Figure 3. This system shows how analog cameras can be networked using a network DVR for remote monitoring of live and recorded video. The network DVR system provides the following advantages:

2.3



Remote monitoring of video via a PC



Remote operation of the system

VIDEO ENCODER-BASED NETWORK VIDEO SYSTEMS

A video encoder connects to analog cameras and digitizes and compresses the video. It then sends the video over an IP network via a network switch to a PC server that runs video management software for monitoring and recording (Figure 4). This is a true network video system because the video is consistently sent over an IP network. In essence, the tasks previously performed by the DVR are now divided up - with the digitization and compression being done by the video encoder and the recording  by the PC server - thus providing better scalability [1, 4-5].

Figure 4. A network video system, where video is continuously transported over an IP network. It uses a video encoder as the cornerstone to migrate the analog security system into an open IP-based video solution. A video encoder-based network video system has the following advantages: 

Scalability in steps of one camera at a time



Possibility to record off site



Use of standard network and PC server hardware for video recording and management



Scalability in steps of one camera at a time



Future-proof because the system is expanded easily by incorporating network camera

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 8

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

CHAPTER THREE 3.0

ARCHITECTURE OF AN INTELLIGENT VIDEO SURVEILLANCE SYSTEM

Based on the distribution of components, an Intelligent Video Surveillance system can be classified in Centralized and Distributed platforms. In centralized intelligent video system, video content analysis is done at the back-end, using DVR to process and analyze data from all cameras. But in a distributed  platform, intelligent network cameras are used to analyze video content in real time for prompt response. Advantages of the distributed platform include enables easy expansion in adding new cameras and scalability, deployment cost, decrease in server workload, storage and bandwidth usage and content accuracy, reduced labour cost [6-7]. The Huawei’s system uses a distributed platform.

Figure 6: Video content analysis of (a) Centralized and (b) distributed architecture [6] The components of a video surveillance system are briefly discussed below. 3.1

ACQUISITION

This refers to the various camera models used to acquire the videos/sounds into the surveillance system. The camera models could analogue or digital, and some may be power-operated. Before the advent of IP or network cameras, analogue or CCTV was in used, in which recordings was stored on tapes. This was then replaced by digital video recorder (DVR) which converts the analogue videos to digital. IP surveillance system uses cameras that are Internet Protocol (IP) enabled to transmit digital data over an Ethernet or wireless network. An IP or network camera is completely a digital system.  New intelligent video surveillance systems deploy IP/network cameras alongside the analogue cameras. The advantages of using IP cameras include, standard-based open architecture, function capabilities (remote and shared viewing via internet or wireless), facilitation of intelligent surveillance (facial recognition, object recognition, license plat recognition, automated alert/response, etc), scalability, cost, recording, transmission and monitoring, better resolution [6,8-10]. This can be summarized in table 1.

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 9

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

Table 1: Comparison between CCTV and IP surveillance system Cost

CCTV (ANALOGUE) Tend to use coaxial cables which are expensive to deploy and large cable runs involved. Cameras and operating costs can be expensive 

IP SURVEILLANCE (DIGITAL) Reduced system cost and added functionality Less cabling required IP cameras are inexpensive   



Resolution



Scalability





Functionality



CCTV cameras have improved image quality but lack support for megapixel image resolution Can be complex to deploy as cables runs with CCTV cameras can be thousands of feet Expanding requires adding camera capacity in units of 16 and additional cabling Many of the analogue cameras lack some of the more advanced features such as digital zoom















Support for variety of image resolutions including both standard analogue CCTV and megapixel resolutions Easy convergence onto new existing IP cabling infrastructure Easy and flexible to deploy-PoE allows the camera to be placed just about anywhere Very scalable-can be configured to meet your  precise requirements. Integration of video surveillance with other systems and functions such as access control, alarm systems, building management, traffic control management etc. offers automated real-time alerting via email, text or file transfer in response to video motion detection Allows for secure, remote access from any device on the network-or outside the network via VPN or https Allows for secure, unlimited data storage.

Source [9]

Figure 7: Comparison between DVR and IP camera operations [10]

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 10

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

An IP camera consists mainly of a lens, image sensor and processor, video compression (SoC) and an Ethernet chip for network connectivity and data transmission [6].

Figure 8: An IP camera

IP camera can be divided in the following classes a. Fixed: it Points in a single/fixed direction. It is used to cover a defined area such as an entrance,  part of a parking lot, etc. It is the camera of choice if the camera is to monitor a direction and be visible, but it is prone to vandalism [6-7]  b. PTZ (Pan-Tilt-Zoom): it is Power-operated and can be manually or automatically configured for  pan/tilt/zoom movements to cover a wider field such as lobbies or parking lots. It can be used to follow objects or individuals moving or even to zoom into particular areas of interest, such as a license plate [6-7 c. Dome: it can be fixed or speed dome type. It is covered by a case, making it less obvious to vandalism and weatherproof. The power-operated versions can do a 360º horizontal sweep and 180 º vertical sweeps [6-7]. d. Megapixel: it offers a higher resolution compared to standard cameras, ranging from 1 to 16 megapixels. It is used to capture more detailed images or to cover a wider field, thereby reducing the number of cameras needed for that scene. It offers the possibility of zooming into the picture using the software as an alternative to the PTZ mechanical camera (which is subject to wear in its parts). Its high resolution enables the detection and recognition algorithms requiring a high level of detail, such as license plates and face recognition [7]. e. Infrared and thermal: it is sensitive to infrared radiation (IR) and can produce a good quality image in the dark especially for night surveillance. Thermal cameras do not need light source, since it record the thermal radiation from objects [7].

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 11

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

Figure 9: Types of IP cameras, (a) fixed (b) PTZ (c) Fixed dome (d) Speed dome [6]

3.2

TRANSMISSION

The video captured by the camera has to be transmitted over the network for recording, processing and viewing. Transmission is done using either one or more of the following: cable (coaxial, fibre optic cables, stranded copper wire, RJ45) or by air (infrared signal, RF). Wired transmission offers greater  bandwidth and reliability over wireless connections at a lower cost while wireless transmission is best in situations where a large perimeter is in surveillance or when the area under surveillance cannot be reached using cables [6-7].

Irrespective of either wired or wireless or both being deployed in a surveillance system, the use of IP has replaced previous systems. In a hybrid system consists of both IP cameras and analogues cameras (a DVR is used to convert the analogue to digital) [6-7, 11].

IP network protocols that enable secure connection between devices include Domain Name Server (DNS), Dynamic Domain Name Server (DDNS), Point-to-Point over Ethernet (PPPoE) and Universal Plug and Play (UPnP). Protocols used in data transmission include User Datagram Protocol (UDP), Transmission Control Protocol (TCP), Hypertext Transfer Protocol (HTTP). Real Time Streaming Protocol (RTSP) is the media protocol used to stream live multimedia over the internet including mobile phones [8, 10].

Wireless technologies used in IP video surveillance networks include WiFi, WiMAX and 3GPP. WiMAX is preferred for long distance over WiFi because of its wider coverage, higher transfer rate,

Module Leader: Dr S. Mori

Module Assist: Sharmama M.S

Page 12

 Case Study Report on Intelligent Video Surveillance System

 Akoma et al 

higher transmission volume and better QoS. WiFi standards include 802.11b (11Mbps for 100m range max), 802.11g (54Mbps for 75m range max) and 802.11n (600Mbps for 300m range max). WiMAX standard in use is the 802.16, with a transfer rate of 70Mbps per 70km [6].

Methods used in transmitting video over the IP network are Unicast, Broadcast and Multicast. Multicast is a One-to-Many or Many-to-Many transmission method, where the data is transmitted a group of PCs requesting for the same data. The Multicast method reduces bandwidth usage and is best for web video applications [6, 11]. 3.3

COMPRESSION

Processing of digital signals is easier compared to analogue signal. Methods in compression techniques include eliminating irrelevant portions of images or eliminating redundant parts in the media stream [7, 11-12].

Compression entails that the data is packed in a smaller space by a process of removing irrelevant bits of the information. In compression, care should be taken not to lose too much data. A trade off should  be made between file size and image quality [7, 11]

There are two main reasons why video should be compressed are: •

To reduce the amount of storage space used in the storage of the video so that storing capacities of hard disk, solid state memory, CDs and DVDs can be maximized.

•

To reduce the bandwidth required to transmit the video IP networks, the Internet, SCSI connections and USB connections etc.

Tables 2 show the comparison between different compression algorithms used. Compression JPEG



  

Strengths An industry standard, meaning that a camera they can generate JPEGs is likely to be ‘viewable’ by the largest range of video management systems. No noticeable degradation at 10-20xcompression. Effective with very active scenes. Particularly easy to implement trick-play(play/ pause /rewind / forward wind/ step fwd/rev etc.)

Module Leader: Dr S. Mori







Weakness Under high compression ratios the video appears blocky. Inefficient at compressing quietmoderate activity scenes. Bitrates of 8 Mbps are very common, which makes it hard to transmit but almost unaffordable to store

Module Assist: Sharmama M.S







Ideal Applications Storing photographs or snapshots from a video Very low frame rate CCTV (