Course
Number Course Name Category L T P Credit
AI21C10 MACHINE LEARNING III 58 2 - 3
Preamble
This course introduces the fundamentals of Machine Learning and its algorithms. It
also covers various supervised and unsupervised learning algorithms used for classification,
prediction, and clustering.
Pre-requisite
● Linear Algebra
● Data Mining
MACHINE LEARNING (AI21C10) - – [58 Hrs]
UNIT I (10 Hrs.)
Introduction: Machine Learning Basics – Examples of Machine Learning Applications.
Supervised Learning: Learning a class from Examples - Vapnik- Chervonenkis Dimension -
Probably Approximately Correct Learning – Noise - Learning Multiple Classes – Regression
- Model Selection and Generalization - Dimensions of a Supervised Machine Learning
Algorithm.
UNIT II (12 Hrs.)
Bayesian Decision Theory: Classification - Losses and Risks - Discriminant Functions -
Association Rules. Parametric Methods: Maximum Likelihood Estimation - Evaluating an
Estimator: Bias and Variance - The Bayes’ Estimator - Parametric Classification –
Regression - Tuning Model Complexity: Bias/Variance Dilemma - Model Selection
Procedures.
UNIT III (14 Hrs.)
Multivariate Methods: Multivariate Data - Parameter Estimation - Estimation of Missing
Values - Multivariate Normal Distribution - Multivariate Classification - Tuning
Complexity - Discrete Features - Multivariate Regression. Nonparametric Methods:
Nonparametric Density Estimation - Generalization to Multivariate Data - Nonparametric
Classification - Condensed Nearest Neighbor - Distance-Based Classification - Outlier
Detection - Nonparametric Regression: Smoothing Models.
UNIT IV (12 Hrs.)
Decision Trees: Univariate Trees – Pruning - Rule Extraction from Trees - Learning Rules
from Data - Multivariate Trees. Clustering: Mixture Densities - k-Means Clustering -
Expectation-Maximization Algorithm - Mixtures of Latent Variable Models - Supervised
Learning after Clustering - Spectral Clustering - Hierarchical Clustering - Choosing the
Number of Clusters.
UNIT V (10 Hrs.)
Multilayer Perceptrons: Introduction – Perceptron - Training a Perceptron - Learning
Boolean Functions - Multilayer Perceptrons - MLP as a Universal Approximator - Back
propagation Algorithm - Training Procedures - Tuning the Network Size - Bayesian View of
Learning - Dimensionality Reduction - Learning Time. Deep learning: Deep Feed forward
Networks - Training and Evaluating -Deep Networks - Convolutional Neural Networks –
Auto encoders - Stochastic Deep Networks - Recurrent Neural Networks - Deep Learning
Software and Network Implementations - WEKA Implementations.
TEXT BOOK:
Ethem Alpaydm, “Introduction to Machine Learning”, PHI Learning Pvt. Ltd.; Third edition,
2015
REFERENCE BOOKS:
1. Ian Witten, Data mining: Practical Machine Learning Tools and Techniques, Fourth
edition, Morgan Kaufmann Publishers, 2016
2. Tom M. Mitchell (1997). Machine Learning, Tata McGraw-Hill, New Delhi
