Dive Into Storage !!!
27th Oct 2015
Moores Law
Moores Law is a computing term which
originated around 1970; the simplified
version of this law states that processor
speeds, or overall processing power for
computers will double every two years.
Since circuit density increases, storage
capacity increases at a factor of 100x
every 10 years.
Conversely the price of a storage unit
decreases.
Calsoft Confidential
Parameters of Evolution
How to compute???
How to store data???
How to access data???
Calsoft Confidential
Evolution of Storage Devices
IBM Punch Card (1937)
Paper Tape
IBM Magnetic Tape(1950)
Audio Cassette Tape(1963)
8" Floppy Disk (1971)
5.25/3.5 Floppy Disk (1976)
Compact Disc(1982)
Zip Drive (1994)
DVD (1995)
SD Memory (2000)
USB Flash Drive (2000+)
Calsoft Confidential
Evolution of Storage Devices
IBM 350 (1956)
Storage
3.75MB
Lease $3200-permonth
Calsoft Confidential
Evolution of Storage Devices
IBM 1301 (1961)
Storage
19MB
Lease $2100-permonth
Price
$115,500
Calsoft Confidential
Evolution of Storage Devices
IBM 1311 (1962)
Calsoft Confidential
Evolution of Storage Devices
IBM 2311 (1964) **
Storage 7.25 MB per disk
pack
Speed 156KB/s
Calsoft Confidential
Evolution of Storage Devices
IBM 62PC Piccolo: The Worlds first 8-inch HDD (1979)
Storage 64.5MB
Calsoft Confidential
Evolution of Storage Devices
1980 IBM 3380: The Worlds first gigabyte HDD
1980 Seagate ST-506: The Worlds first 5.25-inch HDD
Storage 2.52 GB
@ 3MB/s
Price - $81,000
Storage 5MB
Price - $1500
Calsoft Confidential
10
Evolution of Storage Devices
1983 Rodime RO-352: The Worlds first 3.5-inch HDD
11MB @ 600KB/s
1988 PrairieTek 220: The Worlds first 2.5-inch HDD
21.3MB
1997 IBM Deskstar 16GP
16.8GB @ $420,000
2000 Trek ThumbDrive:
The Worlds first USB Flash Drive
2006 Sandisk 2GB microSD Card
(Flash drives/arrays)
2007 Hitachi Deskstar 7K1000: The Worlds first 1TB HDD
Calsoft Confidential
11
Evolution of Storage Devices
Fusion-io ioDrive2 Duo SLC Application
Accelerator Review (1.2TB)
Seagate 120GB SSD drive
Calsoft Confidential
12
Magnetic Storage Disk Architecture
Calsoft Confidential
13
Magnetic Storage Disk Architecture
Seek time
Latency / RPM
Data transfer rate
Different from
USB/SSDs
Calsoft Confidential
14
Magnetic Storage Disk Architecture
Disk controllers
A chip and associated circuitry that is responsible for controlling a disk drive.
There are different controllers for different interfaces
Calsoft Confidential
15
Electronic Standards IDE, SATA, ATA, SCSI
Acronym
SASI
SCSI
Meaning
Shugart Associates System
Interface
Small Computer System
Interface
Description
Historical predecessor to SCSI.
Bus oriented that handles concurrent
operations.
SAS
Serial Attached SCSI
Improvement of SCSI, uses serial
communication instead of parallel.
ST-506
Seagate Technology
Historical Seagate interface.
ST-412
Seagate Technology
Historical Seagate interface (minor
improvement over ST-506).
ESDI
Enhanced Small Disk Interface
Historical; backwards compatible with ST412/506, but faster and more integrated.
(P)ATA
SATA
Successor to ST-412/506/ESDI by
integrating the disk controller completely
(Parallel) AT Attachment
onto the device. Incapable of concurrent
operations.
Modification of ATA, uses serial
Serial ATA
communication instead of parallel.
Calsoft Confidential
16
Electronic Standards IDE, SATA, ATA, SCSI
IDE / ATA
Hardcards - 3.5" hard disks that were mounted directly to a controller card that plugged
into an ISA expansion slot.
Issues with weight, cooling, vibration and space.
No reason to keep the hard disk physically on the controller
IBM PC/AT was the first PC to use the now-standard 16-bit ISA bus.
Interface
Standard
ANSI Standard Number PIO Modes
(includes date)
Added
DMA Modes Added
Ultra DMA Modes Added
Notable Features or Enhancements
Introduced
ATA-1
X3.221-1994
0, 1, 2
Single word 0, 1, 2; multiword
0
--
--
ATA-2
X3.279-1996
3, 4
Multiword 1, 2
--
Block transfers, Logical block addressing,
Improved identify drive command
ATA-3
X3.298-1997
--
--
--
Improved reliability, SMART, Drive security
ATA/ATAPI-4
NCITS 317-1998
--
--
0, 1, 2
Ultra DMA, 80-conductor IDE cable, CRC
ATA/ATAPI-5
NCITS 340-2000
--
--
3, 4
--
ATA/ATAPI-6
Under Development
--
--
5?
LBA expansion? Acoustic
management? Multimedia streaming?
Calsoft Confidential
17
Electronic Standards IDE, SATA, ATA, SCSI
Max. Bus Length
Max. Bus
Bus Width (Metres)
Speed (MBps) (Bits)
Single-ended
Max. Device
Support
LVD
HVD
25
25
25
16
1.5
3
25
-
8
4
SCSI-1
Fast SCSI
10
Fast Wide SCSI
20
Ultra SCSI
Ultra SCSI
20
20
8
(Narrow)
8
16
(Wide)
8
8
Wide Ultra SCSI
40
16
25
16
Wide Ultra SCSI
40
16
1.5
Wide Ultra SCSI
40
16
Ultra2 SCSI
40
Not defined for speeds
beyond Ultra
12
25
Wide Ultra2 SCSI
80
16
12
25
16
Ultra3 SCSI or
Ultra160 SCSI
160
16
12
Not defined for speeds beyond
Ultra2
16
Ultra320 SCSI
320
16
Calsoft Confidential 12
16
18
Storage outside the box!!
Number of devices simultaneously connected.
Length of the cable.
Sharing of resources.
Concept of storage library.
Advent of better transport protocols.
Calsoft Confidential
19
Various components of storage stack.
HDD
HDD
HDD
HBA
Calsoft Confidential
20
Various components of storage stack.
JBOD / Enclosure
HDD
HDD
HDD
HBA
Calsoft Confidential
21
Various components of storage stack
(SCSI/FC/SAS).
JBOD / Enclosure
HDD
HDD
HDD
Target
Initiator
Calsoft Confidential
22
Various components of storage stack
(SCSI/FC/SAS).
JBOD / Enclosure
HDD
Initiator
HDD
Initiator
HDD
S/W
Target
Initiator
Calsoft Confidential
23
Various components of storage stack
(SCSI/FC/SAS) Hardware.
Target
HBAs
SP1
SP2
Disk
subsystem
Calsoft Confidential
24
Target Protocols
(FC/SCSI/SAS)
NFS/CIFS
Target Stack
FS
Auxillary Functionality (Dedupe,
Snapshot)
Volume Manager
Block driver (possible RAID)
Management Layer
Various components of storage stack
(SCSI/FC/SAS) Hardware.
EMC AX 150
Disk
subsystem
Calsoft Confidential
25
Various components of storage stack
(SCSI/FC/SAS) Software.
Target Protocols
(FC/SCSI/SAS)
NFS/CIFS
Target Stack
FS
Auxillary Functionality (Dedupe,
Snapshot)
Volume Manager
Management Layer
BlueArc Titan
Block driver (possible RAID)
Disk
subsystem
Calsoft Confidential
26
Target Protocols
(FC/SCSI/SAS)
NFS/CIFS
Target Stack
FS
Auxillary Functionality (Dedupe,
Snapshot)
Volume Manager
Block driver (possible RAID)
Disk
subsystem
Management Layer
Various components of storage stack
(SCSI/FC/SAS) Software.
Pillar Data Systems
Calsoft Confidential
27
Assignments
Cassette / CD player from storage point of view.
Different storage vendors, What is the design of their arrays.
Difference between various cables and their history.
Mechanisms of SSD disks/arrays/Optical drives. (NAND vs NOR Flash)
Equations related to drive speeds.
Tape libraries and corresponding hardware.
Reference Material.
What are the limits of current scsi bus / protocol?
Can you share a scsi disk between two VMs?
Calsoft Confidential
28
References
[Link]
[Link]
[Link]
[Link]
[Link]
[Link]
[Link]
[Link]
[Link]
[Link]
[Link] Confidential
Attachment-or-PATA
29
