0% found this document useful (0 votes)
172 views9 pages

Types of Machine Learning Explained

Uploaded by

Rohan Ghodge
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
172 views9 pages

Types of Machine Learning Explained

Uploaded by

Rohan Ghodge
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

Experiment No.

Title: Supervised/unsupervised/Reinforcement learning approach.

Aim: To study supervised/unsupervised/Reinforcement learning approach.

Objectives:

1. To study the different types of Machine Learning Techniques

THEORY:

Machine Learning:

Definition: Machine learning is a part of AI which provides intelligence to machines with


the ability to automatically learn with experiences without being explicitly programmed.

o It is primarily concerned with the design and development of algorithms that allow the
system to learn from historical data.
o Machine Learning is based on the idea that machines can learn from past data, identify
patterns, and make decisions using algorithms.
o Machine learning algorithms are designed in such a way that they can learn and
improve their performance automatically.
o Machine learning helps in discovering patterns in data.
Types of Machine Learning

1. Supervised learning:
Supervised learning, as the name indicates, has the presence of a supervisor as a teacher.
Basically supervised learning is when we teach or train the machine using data that is well
labeled. Which means some data is already tagged with the correct answer. After that, the
machine is provided with a new set of example (data) so that the supervised learning algorithm
analyses the training data(set of training examples) and produces a correct outcome from
labeled data.

For instance, suppose you are given a basket filled with different kinds of fruits. Now the first
step is to train the machine with all different fruits one by one like this:
Since the machine has already learned the things from previous data and this time has to use it
wisely. It will first classify the fruit with its shape and color and would confirm the fruit name
as BANANA and put it in the Banana category. Thus the machine learns the things from
training data (basket containing fruits) and then applies the knowledge to test data(new fruit).

Supervised learning is classified into two categories of algorithms:

1. Classification: A classification problem is when the output variable is a category, such


as “Red” or “blue” or “disease” and “no disease”.
2. Regression: A regression problem is when the output variable is a real value, such as
“dollars” or “weight”.
Supervised learning deals with or learns with “labeled” data. This implies that some data is
already tagged with the correct answer.

Types:-
 Regression
 Logistic Regression
 Classification
 Naive Bayes Classifiers
 K-NN (k nearest neighbors)
 Decision Trees
 Support Vector Machine

Advantages:-
 Supervised learning allows collecting data and produces data output from previous
experiences.
 Helps to optimize performance criteria with the help of experience.
 Supervised machine learning helps to solve various types of real-world computation
problems.
Disadvantages:-
 Classifying big data can be challenging.
 Training for supervised learning needs a lot of computation time. So, it requires a lot of
time.

2. Unsupervised learning
Unsupervised learning is the training of a machine using information that is neither classified
nor labeled and allowing the algorithm to act on that information without guidance. Here the
task of the machine is to group unsorted information according to similarities, patterns, and
differences without any prior training of data.

Unlike supervised learning, no teacher is provided that means no training will be given to the
machine. Therefore the machine is restricted to find the hidden structure in unlabeled data by
itself.
For instance, suppose it is given an image having both dogs and cats which it has never seen.

Thus the machine has no idea about the features of dogs and cats so we can’t categorize it as
‘dogs and cats ‘. But it can categorize them according to their similarities, patterns, and
differences, i.e., we can easily categorize the above picture into two parts. The first may
contain all pics having dogs in them and the second part may contain all pics having cats in
them. Here you didn’t learn anything before, which means no training data or examples.
It allows the model to work on its own to discover patterns and information that was
previously undetected. It mainly deals with unlabelled data.
Unsupervised learning is classified into two categories of algorithms:

 Clustering: A clustering problem is where you want to discover the inherent groupings
in the data, such as grouping customers by purchasing behavior.
 Association: An association rule learning problem is where you want to discover rules
that describe large portions of your data, such as people that buy X also tend to buy Y.

Types of Unsupervised Learning:-

Clustering
1. Exclusive (partitioning)
2. Agglomerative
3. Overlapping
4. Probabilistic
Clustering Types:-
1. Hierarchical clustering
2. K-means clustering
3. Principal Component Analysis
4. Singular Value Decomposition
5. Independent Component Analysis

Supervised vs. Unsupervised Machine Learning

Supervised Learning Unsupervised Learning

Supervised learning algorithms are trained Unsupervised learning algorithms are trained using
using labeled data. unlabeled data.

Supervised learning model takes direct Unsupervised learning model does not take any
feedback to check if it is predicting correct feedback.
output or not.

Supervised learning model predicts the Unsupervised learning model finds the hidden
output. patterns in data.
In supervised learning, input data is In unsupervised learning, only input data is
provided to the model along with the provided to the model.
output.

The goal of supervised learning is to train The goal of unsupervised learning is to find the
the model so that it can predict the output hidden patterns and useful insights from the
when it is given new data. unknown dataset.

Supervised learning needs supervision to Unsupervised learning does not need any
train the model. supervision to train the model.

Supervised learning can be categorized Unsupervised Learning can be classified


in Classification and Regression problems. in Clustering and Associations problems.

Supervised learning can be used for those Unsupervised learning can be used for those cases
cases where we know the input as well as where we have only input data and no
corresponding outputs. corresponding output data.

Supervised learning model produces an Unsupervised learning model may give less
accurate result. accurate result as compared to supervised learning.

Supervised learning is not close to true Unsupervised learning is more close to the true
Artificial intelligence as in this, we first Artificial Intelligence as it learns similarly as a
train the model for each data, and then only child learns daily routine things by his experiences.
it can predict the correct output.

It includes various algorithms such as It includes various algorithms such as Clustering


Linear Regression, Logistic Regression,
Support Vector Machine, Multi-class
Classification, Decision tree, Bayesian
Logic, etc.

3. Reinforcement Learning:
In this technique, the model keeps on increasing its performance using Reward Feedback to
learn the behavior or pattern. These algorithms are specific to a particular problem e.g. Google
Self Driving car, AlphaGo where a bot competes with humans and even itself to getting better
and better performers of Go Game. Each time we feed in data, they learn and add the data to its
knowledge that is training data. So, the more it learns the better it gets trained and hence
experienced.
 Agents observe input.
 An agent performs an action by making some decisions.
 After its performance, an agent receives a reward and accordingly reinforces and the
model stores in state-action pair of information.
 Temporal Difference (TD)
 Q-Learning
 Deep Adversarial Networks

Types of Reinforcement:

There are two types of Reinforcement:


1. Positive
Positive Reinforcement is defined as when an event, occurs due to a particular behavior,
increases the strength and the frequency of the behavior. In other words, it has a positive effect
on behavior. Advantages of reinforcement learning are:

 Maximizes Performance

 Sustain Change for a long period of time

 Too much Reinforcement can lead to an overload of states which can diminish the results

[Link] –
Negative Reinforcement is defined as strengthening of behavior because a negative condition is
stopped or avoided. Advantages of reinforcement learning:

 Increases Behavior

 Provide defiance to a minimum standard of performance

 It Only provides enough to meet up the minimum behavior

Various Practical applications of Reinforcement Learning –

 RL can be used in robotics for industrial automation.


 RL can be used in machine learning and data processing
 RL can be used to create training systems that provide custom instruction and materials
according to the requirement of students.

Conclusion:______________________________________________________
________________________________________________________________
________________________________________________________________
_____________________________________________________________

******
Oral Questions:

1. What is Machine Learning?


2. What are Different Types of Machine Learning algorithms?
3. What is Supervised Learning? Explain with examples
4. What is Un-supervised Learning? Explain with examples
5. What is Reinforced Learning? Explain with examples
6. Compare Supervised and Un-supervised Learning.

Common questions

Powered by AI

Supervised learning relies heavily on labeled data, with models being trained on input-output pairs that enable precise output predictions based on past experiences. A feedback loop using these labeled outcomes helps refine model accuracy . In contrast, unsupervised learning operates without labeled datasets, focusing instead on identifying patterns and insights from unstructured data without direct input-output mappings or a feedback system . Reinforcement learning combines elements of trial-and-error and feedback, where models learn strategies to maximize a cumulative reward in a given environment, allowing the system to self-improve by evaluating actions based on gained feedback . While supervised learning depends on data with predefined labels, unsupervised and reinforcement learning adapt to environments where such guidance is unavailable, with reinforcement learning also incorporating a decision-driven reward system for continuous feedback .

Classifying large datasets in supervised learning presents significant challenges, primarily due to the computational resources and time required to process and label large volumes of data . These datasets demand substantial storage capacity and high-performing computational power to train models efficiently. One method to address these challenges is through the use of cloud computing resources, which can provide scalable infrastructure and parallel processing capabilities to handle large datasets effectively. Additionally, employing techniques such as data pre-processing and feature selection can reduce the data dimensions and focus computational efforts on the most relevant features, improving efficiency . Another approach is the use of transfer learning, where pre-trained models are adapted to new, but similar tasks, reducing the computational overhead required for training from scratch .

Reinforcement learning incorporates feedback through a reward system, enhancing its learning process by encouraging or discouraging behaviors based on the received rewards. The agent observes its environment, makes decisions, performs actions, and receives feedback in the form of rewards, which reinforces its learning strategy . Compared to supervised learning, reinforcement learning does not require labeled datasets but instead uses trial-and-error to improve performance over time. Unlike unsupervised learning, reinforcement learning uses feedback to directly influence the learning path, making it more controlled and targeted towards specific goals . Its strengths include the ability to solve complex problems where the model learns over time to maximize performance and adapt to different scenarios, which can linger longer and affect change sustainably . However, it may also lead to state overload, which can diminish result efficacy .

Reinforcement learning can be leveraged to create customized educational tools by adapting learning materials and feedback dynamically based on student interaction and performance. These tools tailor instruction by recognizing individual learning patterns and adjusting difficulty levels and content delivery, promoting optimized learning processes . The potential impact on educational outcomes includes improved knowledge retention, personalized pacing that accommodates diverse learner needs, and motivation enhancement through a reward system that acknowledges achievements and progress. This can empower teachers by providing insights into student's learning paths and enable adaptive curriculum designs that focus on individual strengths and challenges, ultimately fostering a more inclusive and effective educational environment . However, the successful implementation of reinforcement learning in education depends on sophisticated models that can accurately interpret and react to varied educational scenarios, which can be complex and require significant modeling expertise and technological investment .

Unsupervised learning offers flexibility by enabling models to operate on datasets without predefined labels, allowing them to discover patterns and insights without supervision. This contrasts with supervised learning, which requires labeled datasets . The ability to group data and uncover hidden structures without explicit guidance makes unsupervised learning more adaptable to situations where labeled data is scarce or unavailable. However, this flexibility may lead to less accurate results compared to supervised learning models, and the insights gained might be less precise . Additionally, the lack of feedback during the learning process can hinder the accuracy and interpretation of the discovered patterns, impacting its wider applicability to tasks that require precise outcomes .

Supervised learning utilizes historical data that is well-labeled, meaning some data is already tagged with the correct answer. This allows the model to learn patterns and make decisions, thus enabling it to predict outcomes for new, similar data. A significant advantage of supervised learning is that it can optimize performance criteria based on past experiences, helping solve various real-world computation problems . However, one potential drawback is the computational cost and time required to train models, especially with large datasets, which can be resource-intensive . Additionally, the model heavily relies on the quality and amount of labeled data provided, which might not always be readily available .

Reinforcement learning is heavily utilized in robotics and automation to enhance performance through trial-and-error learning, allowing systems to adapt and optimize their actions based on feedback. In industrial automation, reinforcement learning can improve precision in robotic tasks, such as assembly lines, ensuring efficiency and reducing error rates . Its impact on industry innovation is significant, fostering advancements in adaptive systems that can handle dynamic and unpredictable environments without the need for explicit programming of every scenario. This enables the development of autonomous machines capable of learning complex tasks, driving innovation in sectors ranging from manufacturing to deep-space exploration . Reinforcement learning's accessibility to create personalized learning systems aligns with the industry's shift towards intelligent automation, suggesting a trend towards more independent, adaptable, and efficient systems, ultimately pushing technological boundaries .

Labeled data plays a crucial role in supervised learning by providing a clear input-output mapping, which models use to learn patterns and relationships. During model training, labeled data serves as a reference, allowing the algorithm to adjust its parameters based on the known outcomes, thus facilitating accurate output predictions for new, similar data . This mapping of input features to output labels directly influences the learning process, enabling the model to develop an understanding of the dataset's patterns and nuances. Consequently, the quantity and quality of labeled data directly impact the model's accuracy; higher volumes and well-curated labels lead to more effective and precise models, while insufficient or incorrect labeling can degrade performance and reliability .

Clustering and association are two key techniques in unsupervised learning, each serving different purposes. Clustering involves grouping data objects into clusters based on similarities, where items within a cluster resemble each other more than those in other clusters. This method is commonly used in customer segmentation or pattern recognition tasks where identifying natural groups within data is crucial, such as categorizing user behavior for targeted marketing . Association, on the other hand, involves finding rules that capture large portions of the dataset, often used in market basket analysis to identify items that frequently co-occur, such as the likelihood of purchasing product X with product Y . While clustering focuses on forming groups, association focuses on discovering interesting relationships and co-occurrence among dataset items. Both methods are instrumental for gaining insights from unlabelled data, but their applicability varies with the nature of the insights sought: group patterns for clustering and rule-based associations for data co-occurrence .

Reinforcement learning boosts AI performance in competitive environments by continually optimizing decision-making strategies based on past experiences and received feedback. Through a reward-based mechanism, AI agents learn to maximize long-term benefits, adjusting strategies to outperform opponents or environments, exemplified by applications like AlphaGo and autonomous vehicles . This method enables AI systems to adapt complex maneuvers and strategies dynamically. However, a challenge in relying on reward-based feedback is the potential for encountering suboptimal solutions if the reward structure isn't well-defined, leading to AI systems maximizing short-term gains over more beneficial long-term strategies . Additionally, the trial-and-error nature can result in excessive exploration or state space overloads, affecting performance and efficiency due to computational demands .

You might also like