22CS006 COMPUTER VISION 2023
Course Objectives
To understand the fundamental concepts related to Image formation and processing
To learn feature detection, matching and detection
To become familiar with feature based alignment, motion estimation and 3D reconstruction
To understand image based rendering and recognition.
To learn to detect and analysis objects from motion or scene
Programme Outcomes (POs)
a. Engineering Knowledge: Apply the knowledge of mathematics, science, engineering fundamentals, and
an engineering specialization to the solution of complex engineering problems.
b. Problem Analysis: Identify, formulate, review research literature, and analyse complex engineering
problems reaching substantiated conclusions using first principles of mathematics, natural sciences, and
engineering sciences.
c. Design/ Development of Solutions: Design solutions for complex engineering problems and design
system components or processes that meet the specified needs with appropriate consideration for the
public health and safety, and the cultural, societal, and environmental considerations.
d. Conduct Investigations of Complex Problems: Use research-based knowledge and research methods
including design of experiments, analysis and interpretation of data, and synthesis of the information to
provide valid conclusions.
e. Modern Tool Usage: Create, select, and apply appropriate techniques, resources, and modern
engineering and IT tools including prediction and modeling to complex engineering activities with an
understanding of the limitations.
f. The Engineer and Society: Apply reasoning informed by the contextual knowledge to assess societal,
health, safety, legal and cultural issues and the consequent responsibilities relevant to the professional
engineering practice.
g. Environment and Sustainability: Understand the impact of the professional engineering solutions in
societal and environmental contexts, and demonstrate the knowledge of, and need for sustainable
development.
i. Individual and Team Work: Function effectively as an individual, and as a member or leader in diverse
teams, and in multidisciplinary settings.
j. Communication: Communicate effectively on complex engineering activities with the engineering
community and with society at large, such as, being able to comprehend and write effective reports and
design documentation, make effective presentations, and give and receive clear instructions.
k. Project Management and Finance: Demonstrate the knowledge and understanding of the engineering
and management principles and apply these to one's own work, as a member and leader in a team, to
manage projects and in multidisciplinary environments.
l. Life-long Learning: Recognize the need for, and have the preparation and ability to engage in
independent and life-long learning in the broadest context of technological change.
m. Apply suitable algorithmic thinking and data management practices to design, develop, and evaluate
effective solutions for real-life and research problems.
Course Outcomes (COs)
1. Understand basic knowledge, theories and methods in image processing and computer vision.
2. Implement basic and some advanced image processing techniques in OpenCV.
3. Apply 2D feature-based based image alignment, segmentation, motion estimations and 3D
image reconstruction techniques
4. Design and develop innovative image processing and computer vision applications.
5. Apply the concept in understanding the scene and process the background part of the
image
Articulation Matrix
CO No PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12 PSO1 PSO2
1 3 1 1 1 1 2 1 3 2 2
2 3 3 3 2 3 1 2 1 2 2 3
3 3 3 2 2 3 1 1 2 2 3
4 2 3 3 2 3 2 1 2 3 2
5 2 3 3 2 2 2 2 1 2 3 3
UNIT I 6 Hours
INTRODUCTION TO IMAGE FORMATION AND PROCESSING
Computer Vision Geometric primitives and transformations Photometric image formation The digital
camera Point operators Linear filtering More neighborhood operators Fourier transforms Pyramids and
wavelets Geometric transformations Global optimization.
UNIT II 6 Hours
FEATURE DETECTION, MATCHING AND SEGMENTATION
Points and patches - Edge detection - Edges Lines Segmentation - Region Based Segmentation - Graph
Based segmentation - Active contours - Split and merge Mean shift and mode finding - Normalized cuts
Graph cuts and energy-based methods.
UNIT III 6 Hours
FEATURE-BASED ALIGNMENT AND 3D RECONSTRUCTION
2D and 3D feature-based alignment Pose estimation Geometric intrinsic calibration - Triangulation Two
frame structure from motion - Factorization Bundle adjustment - Constrained structure and motion
Translational alignment Parametric motion Spline-based motion Optical flow Layered motion - Shape
from X Active range finding - Surface representations - Point based representations - Volumetric
representations - Model based reconstruction.
UNIT IV 6 Hours
IMAGE-BASED RENDERING AND RECOGNITION
View interpolation Layered depth images Light fields and Lumigraphs Environment mattes Video based
Rendering Object detection Face recognition Instance recognition Category recognition Context and
scene understanding Recognition databases and test sets.
UNIT V 7 Hours
MOTION ANALYSIS AND SCENE ANALYSIS
Optical Flow – Detection and Correspondence of Interest Points - Detection of Motion Patterns – Video
Tracking – Motion Models to aid tracking: Kalman Filters - stereo mapping - image fusion - Detection of
known objects by linear filters - Detection of unknown objects - The Hough
transform for the detection of lines - Corner detection - image tagging.
1 3 Hours
EXPERIMENT 1
Perform histogram equalization on the image.
2 3 Hours
EXPERIMENT 2
Perform the edge detection process and extract edges from the input image
3 5 Hours
EXPERIMENT 3
Perform segmentation, extract and display the segmented region.
4 3 Hours
EXPERIMENT 4
Program to detect an object from the input frame.
5 5 Hours
EXPERIMENT 5
Program to track the object between two frames from image/video.
6 5 Hours
EXPERIMENT 6
Program to demonstrate to understand a scene and generate caption.
7 5 Hours
EXPERIMENT 7
Program to classify defective object from the correct object.
Total: 60 Hours
REFERENCE(S)
1. Richard Szeliski, Computer Vision Algorithms and Applications, Springer- Texts in Computer
Science, Second Edition, 2022.
2. Computer Vision A Modern Approach, D. A. Forsyth, J. Ponce, Pearson Education, Second
Edition, 2015.
3. Richard Hartley and Andrew Zisserman, Multiple View Geometry in Computer Vision, Second
Edition, Cambridge University Press, March 2004.
4. Christopher M. Bishop Pattern Recognition and Machine Learning, Springer, 2006.
5. E. R. Davies, Computer and Machine Vision, Fourth Edition, Academic Press, 2012.
6. Jurgen Beyerer, Fernando Puente Leon, Christian Frese,” Machine Vision Automated Visual
Inspection: Theory, Practice and Applications”, 2016, Springer
7. AI Bovik, “The Essential Guide to Image Processing”, 2009, Academic Press
