Lecture 5
Cloud Services Concepts
CS5068NI - Cloud Computing and the Internet of Things
Sugat Man Shakya
[Link]@[Link]
Lecture Objectives
• High Availability Concepts & technologies
• Scalability—manual scaling & auto-scaling
• Some of the Cloud Services Concepts :-
• Compute
• Storage
• Database
• Networking & Content Delivery
• Artificial Intelligence
• Machine Learning
• Internet of Things (IoT)
February 27, 2023 Lecture 5 – Cloud Service Concepts | 2
High Availability Concept
• High Availability (HA) is used to describe
the period of time when a service is
available as well as the time required by a
system to respond to a request made by a
user.
• HA is a quality of a system or component
that assures a high level of operational
performance for a given period of time.
• HA functions as a failure response
mechanism for infrastructure.
| 3
Server Clustering
• Clustering is group of two or more servers
that work together and represent
themselves as a single server (virtual
server) in the network.
• A server cluster is a collection of servers,
called nodes that communicate with each
other to make a set of services highly
available to clients.
• Server clusters are designed for applications
that have long running in-memory state or
frequently updated data.
| 4
Load balancing & Failover / fault-tolerance
• Load balancing is automatically
distributing traffic among multiple servers,
sending requests to the least loaded server
in the dedicated server cluster
• Weights and load sharing definitions can be
put on servers with greater CPU and
memory
• If a server experiences a problem, it is taken
out of the cluster and future traffic is not
directed to it until it comes back online.
| 5
Replication
• Replication Process of keeping IDENTICAL
COPY of your data on different servers.
• Replication offers Minimum Downtime in
case of hardware failure, software failure or
maintenance
• For replication, replica is created.
• A replica set is a group of servers with one
primary, the server taking client requests,
and multiple secondaries, servers that keep
copies of the primary’s data.
| 6
Scalability
• Successful, growing, systems often see an
increase in demand over time.
• A system that is scalable can adapt to meet this
new level of demand.
• Manual scaling is predicting the demand and
manually preparing the capacity to run at need
• Auto Scaling monitors your applications and
automatically adjusts capacity to maintain
steady, predictable performance at the lowest
possible cost
| 7
Cloud Service - Compute
• Compute refers to applications and workloads
that require a great deal of computation,
necessitating sufficient resources to handle these
computation demands in an efficient manner.
• Compute includes services like:- Virtual server
hosting, container management, and serverless
computing
Amazon AWS Compute Services
| 8
Cloud Service – Storage
• Cloud storage service can be used to store,
access, govern, and analyze your data to reduce
costs, increase agility, and accelerate innovation.
• You can select from object storage (music,
images, videos, etc.), file storage, and block
storage services, backup, and data migration
options to build the foundation of your cloud IT
environment.
Amazon AWS Storage Services
| 9
Cloud Service – Database
• Cloud databases are built for business-critical,
enterprise workloads offering high availability,
reliability, and security.
• These databases support multi-region, multi-master
replication, and provide full oversight of your data with
multiple levels of security, including network isolation,
encryption at rest using keys you create and control
through Key Management Services as well as
encryption-in-transit.
• Refer to the figure for Amazon database services
Figure: Amazon AWS Storage Services | 10
Cloud Service – Networking & Content Delivery
• Cloud Networking & content delivery service is used to
connect and manage your on-premises data center to
cloud, delivers data, videos, applications, and APIs to
customers globally with low latency and high transfer
speeds
• It is also used to establish private connectivity between
cloud provider and your datacenter, office, or colocation
environment, which in many cases can reduce your
network costs, increase bandwidth throughput, and
provide a more consistent network experience than
Internet-based connections.
Figure: Amazon AWS Storage Services | 11
Cloud Service – Machine Learning
• Cloud services provide pre-trained AI services for computer
vision, language, recommendations, and forecasting to
quickly build, train and deploy machine learning models at
scale; or build custom models with support for all the
popular open-source frameworks.
• Implementing machine learning across use cases and
industries—from running models for real-time fraud
detection, to virtually analyzing biological impacts of
potential drugs, to predicting stolen-base success in baseball
is made easy with cloud machine learning services
Figure: Amazon AWS Storage Services | 12
Cloud Service – Artificial Intelligence
• Artificial intelligence (AI) can enhance the customer
experience in a contact center, automate content
moderation in media, improve healthcare analytics, forecast
demand more accurately, and much more.
• With AI Services from cloud provider, you can use add
capabilities like image and video analysis, natural language,
personalized recommendations, virtual assistants, and
forecasting to your applications without deep expertise in
machine learning..
| 13
Cloud Service – Internet of Things (IoT)
• Connecting IoT devices to cloud, you can send the data to cloud storage, process there and analyze data at the edge and
the cloud.
• The benefits of Cloud Platform in IoT are :-
• Scalability
• Data Mobility
• Time to Market
• Security
• Cost effectiveness
• Leveraging IoT technologies by moving them from centralized local server systems to distributed cloud infrastructure can
be beneficial in many use cases such as device management
| 14
Conclusion
• High Availability Concepts & technologies
• Scalability—manual scaling & auto-scaling
• Cloud Services Concepts
February 27, 2023 | 15
References:-
• Digital Ocean :- [Link]
availability
• AWS Products :- [Link]
• AWS Documentation :- [Link]
• AVS System :- [Link]
February 27, 2023 | 16
End of Lecture
Any Questions???
February 27, 2023 | 17
