Chapter 1 - Introduction To Machine Vision Systems

 

PLT 425 VISION SYSTEM CHAPTER 1: INTRODUCTION TO MACHINE VISION

From Wikipedia: Machine vision (MV) is the technology and methods used to provide imaging-based automatic inspection and analysis for such applications as automatic inspection, process control, and robot guidance in industry. “The scope of MV is  broad”. 1

 

INTRODUCTION

  A machine

vis vision ion system rec recovers overs useful information information about a scene from its 2-dimensional projections.



The goal of machine vision is to create a model of the real world from images.

2

 

FIELDS THAT DEAL WITH IMAGES   Image Images are two-dimensional projections of the three-dimensional world. 



  Image Processing  –

Enhancement or manipulation of the image usually another image. 

the result of which is

  Computer Computer Vision Vision

 Analysis and understanding understanding of image content.   Video Processing Sim Si mil ila ar with with imag image e pro process cessin ing g, but but proc proces essi sing ng of mult multip iple le imag im ages es/f /fra rame mes. s. Comb Combin ined ed with with comp comput uter er visi vision on,, en end d resu result lt is normal nor mally ly extrac extracted ted inform informati ation. on. 

3

 

3 PRINCIPAL USES FOR IMAGE PROCESSING



Improvement of pictorial information for human interpretation Do you have example in mind?



Compression of image data for storage and transmission



Processing of image data for autonomous machine perception to enable object representation, detection, classification classifica tion and tracking Which is why we learn this course.

4

 

FUNDAMENTAL STEPS

COMPONENTS OF

MACHINE VISION SYSTEMS •

Image acquisition

The first stage of any vision system is the image acquisition stage. s ource, • The action of retrieving an image from some source, usually a hardware-based source for processing. • To create a digital image, it requires 2 process: Image sampling and quantization. • Improves

Image processing

image for human and computer consumption, highlight / extract relevant feature • Remove noises, deblurred etc • Color Conversion • Segmentation and representations s urfaces • Extract features such a edge, regions, surfaces etc. • Measurement analysis - measure features on the object • Image

  lassification

classification refers to the labelling of images into one of a number of predefined categories 5

 



Example: Face Recognition Workflow

6

 



Example: Face Recognition Workflow

7

 



Machine vision system is a sensor used in the robots for viewing and recognizing an object with the help of a computer. computer.



It is mostly used in the industrial robots for inspection purposes.

8

Source: http://www.roboticsbible.com/machine-vision-system.html

 

APPLICATIONS OF MACHINE VISION SYSTEMS



Law enforcement



Medical imaging



Remote sensing



Satellite image processing



Industrial inspection



Robot control

  And

so other many many applications applications

9

 

LAW ENFORCEMENT How to extract features that can be used to differentiate among different images?

10

 

LAW ENFORCEMENT 

Example: Face Recognition System

11

 

LAW ENFORCEMENT 

Example: Automated license plate recognition

12

 



Comprises different imaging modalities and processes of

MEDICAL IMAGING

image human body for diagnostic and treatment purposes. 

 Allowing doctors to find disease earlier and improve patient outcomes.



How to to process/ process/ analyze analyze the image to help diagnosis or treatment?



Types of image modalities:

 –

Ultra Sound (US)

 –

Magnetic Resonance Imaging (MRI)

 –

Computerr Tomograp Compute Tomography hy (CT)

 –

X-Rays 13

 

14

 

REMOTE SENSING





The use use of satelli satellitete- or aircraftaircraftbased sensor technologies to detect and classify objects on Earth Example: Weather observation and prediction

Multispectral image of Hurricane  Andrew from satellites satellites using sensors in the visible and infrared bands  –

New York (from Landast-5 TM)

15

 

REMOTE SENSING 

Example: Palm Mapping Using Drones

16

 

SATELLITE IMAGE PROCESSING

Infrared image of hurricane Irma 17

 

INDUSTRIAL INSPECTION

Vision sensor detects torn label

Monitor bottle overfill and underfill

18

 

INDUSTRIAL INSPECTION

Inspecting date/code and label quality

19

 

ROBOT CONTROL



Unmanned operations autonomous vehicle driving



How to detect and track target?



How to avoid obstacles?

Mars Rover: An example of an unmanned land-based vehicle. Notice the stereo cameras mounted on top of the Rover. 20

 

OTHERS

21

 

ADVANTAGES OF MACHINE VISION SYSTEMS

 Cutting out defective goods 

Making better use of raw materials



Cutting the cost of quality control



Enabling real-time process monitoring



Improving employment conditions

22