Wcb Inkll gene.
and Bi Data [fTCS-418
he lats technologes usd un Bn Da/a )
what ae
a om Jon data Als hat are so lag on Cpnplir
Big Data
Big Data
oaung applhcahon setune [Link]
n
hat tradhsnal d a
te deal wh hm challnges nclud (opkvL, Aotage, analys
data Cuahon, Bach, AMara, andtt, updadug and larmaho
Pvacy
Uheatkih aa iCan
volum Siuej doa dithmnvs whelhea
or n e
ko condbad as bg data
Velouky-s Aped at whuch daba u genvad and
Procomd.
Big Dota Type and Natue of Data
Vauabuludy nunsisny of dava lan hanpo
Procomes
Voauhy
hualuyg aphuned data. Can
vahy eny aykchrig onalysd
Technolegies
Data wanekouses
Phocoun
may ng ke cble tohandle he ocwaing dmands
posed y Ss o big dala hat need to ke updard quonty ot even
Conhnally as ui he. Case o Onl tum data oN Mock toadng
toacdurg
ha. enluhe achntis efuebudes vtou a peprmante ot mobul
pplicabrons
ea Lesult, many og ansadans
hat
collect, poos and analyhe
big data wn to NoSOL databases as wcll as ladoop
Map Keduto_ seftwae hamewosk hat allou! durtlopers lo-
wne Poopams dhat prcons masive ammout
[Link] data. in panalkel aca a ditabutd,
tuwsto ocons
spark An open-s0ume2 parallel pocemeng hamawook, hat
enabls ueu u n agebcale data analytic
opplucadons acess cluhwud ystemt
(3 H Bae HCclunn- uentd koy/valu data s t w bult e
u n on
op the Hadoop Distnbued file Syslem
( Hive An open- ource data wawwhouse Aystem o
9uyny and analyaing kangc. dataletierad. u
Hodeepls
Nen he emoizena o Web nkllyente
Prtihioial Ondelllgente Hechmqjunsat b tale. andude. Predictive
tellugence
Cvauwling- Poon y which searth
engunu duscavt updated covert
en the ueb, Such a ne Ars a pagcs hanges to enntrig zites
and. dtad nks
Once Stach engine ptcenmes each g the pages i-Caauuls,
ndening a
U
Compults a maMire nden q all the wards
Seol and. heuin Jocalhon on tach page eenhally a
database o pullions oweb pagc
On
One aa byuwerd is entoud. uder a Aearch bon, Learch
Ranky
enguries wll theck Ja payes h i he nde hat a e
a closestmat th; a sore wll ke agnd the
Pagcs based on an algoothm Conusdny hundradi of
duyjerent beg nals
fase Kank ' b a hik, analys algondhn and i- amignt a
numesuCal
weghtrg der each element a
hyptsliked documerds Such as wold wde
web, wdh ha puspose of meas
wng" ds xelatve
mportanc wthin the Sett.
Entspnie. Search h e prochc omakn Conte rom
muulhiple enepusa-tpe Bouncel, Such as databasel
and uusanets, eanchablo. 8 a deluned audence
Localuy Senishire Hashing. LSH an alyouhm uled fa
obruig Aha oppronumate. and enact neaizhbor nea
Seanch u Jughn dunenienal paces
aces
Gthan hueh teehnolegus a 010T Edse camputng, tellgent AFPS et.
2 Eaplar Hbase and biy lablo
Ang H8ase. as a lone of Bi lable hos doty phdosphit!
ato oBally 8ame
HBaue is open 80ouvced., big lable u not
BigTableu wnten wrdh Ctt , HBase o wnten uth Janva.
> umcnly, bi_lable has uthir fratures han HBale
Big Table suppetStransochons, thouyh HBake BuppostS
rous\u
sunsle now oR but tonsachons aosa) mulhple.
,
nat upportd natwely wvwnMy
B1g lable ionday ndm huldng much moe maku
han HBase
ut Ho dortlopmentSpnd HBase u vt fu Many P
durloponk a C8tnbuhvig to the psope. b d vey ponuble
Hbase wll tath uyp wthLeen upam lable n
feuycas
Ezplaun he upcemung oends in g Data ?
Sel big Dota eehnobaicsrends a
Open SOuy open Sount-opplicaHons Juke Apathe Hadoop
pank har tomi to dlømunae. he bi datau
Apaca,and. hat Pund looks Lkely to continue
n - Memory Tene oy One
of the tenolosus hat Companies
a uuyahng nan aempt to Spud
hun big datu prwnaug u
n-memDn ech.
(3)Mathune loasnung Machue lewvng A a b»andh of
adihcial nllgence dh JöCunes on alloce
p0goarmed
Computos elearun new hungs unthoubug enpherty
ocdidire Analyi:hedecdive analis dauely elard
Ja, ML syblems eyten
omachne hatn
honde he.
Phovnide engnes o puduchre analydis Aefune
ncllgent Apps Anohu Way h a enlopw a t wng
A Hehnologis u Cocal
h Caras
mahurie leanng and
intelligent ps
Many entoprus an also npurarg
llgnt Stcumty
g data analytnca
U Hw wny AAraty.
Lretournet e Thungs Thentone 7hungs alse htely e
sizable unpalt on by data
hart a
tehnolog that could hulp
edge Connpuhg Onnw
tda
bg data dge
data y
hui l
Companuis deal wtth
Computng' edge cemputg, thu bug da
7
DSe. the 1O7 dunus and
analys hopons vy
Snsars nead o ua data. tontot ar the cloud.
erplaun he applicahons ef Ma- Kadute
ramwooR, ung whuch we Can wnte
Map Koduc u a
H pown4 huge.
ameusks
of clat ,un parallet,
applucaho
Com meduty handuatL. n a oleable
oh lyc ustos q
map Kaduce a pocAsung Jechniqu and a poyoaum mods tor
dusnbued. Cemputu bnsed. on ava
Aao h m .
and odata. yage
Mop ag Shujjl Maye
he. map job s pocons h e nput data
Map Stage
Riduce stage
Riduce stage cembnahon g Ahule age. and Rdute stap Raduce ta
Roduuc ob s te pooCos h data hat Cones om
he mappe
APpicaion/Uses Map duce-
Map Reduce useJal a .wde ange 9/ aPplucahant, undudino
u
dnhrbtd. patleun based Jeabung, duhn buA Sopding, wtb unk
araph velsal Sngular vaue
oloeompaaihion ue aces leg Mas
u o censhachan, couumetdutoung, machure orrug
ond tasical ma hu hanglanan
model. has Lertal
Mocor, Map Racluce
been adapho to
MorrcorU
enw vohmants
Jk mulh-cor and many-CoDSyens
cemputug
dkrop nds, mulh-APOL vo/Lwtee connputng ennonmet
