尊敬的 微信汇率:1円 ≈ 0.046089 元 支付宝汇率:1円 ≈ 0.04618元 [退出登录]
SlideShare a Scribd company logo
Susan Etlinger
Susan Etlinger is an industry analyst with
Altimeter Group, where she focuses on data
and analytics.
She conducts independent research and has
authored two intriguing reports: “The Social
Media ROI Cookbook” and “A Framework for
Social Analytics.”
She also advises global clients on how to work
measurement into their organizational
structure and how to extract insights from
the social web which can lead to tangible
actions.
In addition, she works with technology
innovators to help them refine their roadmaps
and strategies.
What is BIG DATA?
● ‘Big Data’ is similar to ‘Small Data’, but bigger in size
● But having data bigger it requires different approaches:
-Techniques, tools and architecture
● An aim to solve new problems or old problems in a better way
● Big Data generates value from the storage and processing of very large
quantities of digital information that cannot be analyzed with traditional
computing techniques.
● Walmart handles more than 1 million customer transactions every hour.
● Facebook handles 40 billion photos from its user base.
● Decoding the human genome originally took 10 years to proces; now it can be
achieved in one week.
So what does this mean for Analytics?
So what does this
mean for Analytics?
Yes, the amount of data that is available to us is exploding
And Big Data Platforms and Commodity Hardware and bringing in additional capabilities
Media is rife with Big Data and Analytics
Big Data and analytics is touted as the panacea for all problems
…makes it to on top of CIO agenda AND
The Data Scientist makes it from Nerd to the most cool person!!
.
Data Science
perspective
– A Data Science perspective
Big Data and AnalyticsImpact of
A brief history of Data Science
Pre 1800s 1800-1900 1900-1940 1940-1960 1960 1970 1980 1990 2000 2010
▪ Text/ string search
▪ 1974 Peter Naur “Concise Survey of Computer
Methods”, Data Science, Datalogy
▪ Knuth – Art of Computer Programming.
▪ 1976 – SAS Institute
▪ 1977 The International Association for
Statistical Computing (IASC).
Computer Science
Data Technology
Visualization
Mathematics/ OR
Statistics
▪ Probability
▪ Correlation
▪ Bayes Theorem.
▪ Regression, Least
Squares
▪ Time Series.
▪ Theoretical Foundations of Modern Stats
▪ Hypothesis, DOE
▪ Mathematical Statistics.
▪ Bayesian Methods
▪ Time Series Methods (Box Cox,
Survival, etc.)
▪ Stochastic Methods.
▪ Simulation, Markov
▪ Computational Statistics.
▪ Decision Science
▪ Pattern recognition
▪ Machine learning.
▪ Liebniz – Binary Logic. ▪ Babbage, Lovelace
▪ Boolean Algebra
▪ Punch cards.
▪ Turing machines
▪ Information Theory
▪ Weiner & Cybernetics
▪ Von Neumann Architecture.
▪ Calculus
▪ Logarithms
▪ Newton-Raphson.
▪ 1989 First KDD Workshop
▪ Gregory Piatetsky-Shapiro.
▪ Sort & Search Algorithms –
Dijkstra, Kruskal, Shell Sort, …
▪ Heuristics – Simulated Annealing, …
▪ Graph Algorithms
▪ Multigrid methods
▪ Tree based methods.
▪ Database Marketing
▪ Data Mining, Knowledge Discovery
▪ “Data science, classification, and related methods.”
▪ William Cleveland: Data Science
▪ Leo Breimann: Statistical Modeling: 2 Cultures.
▪ Optimization Methods
▪ Fourier and other transforms
▪ Matrix & Generalizations
▪ Non-euclidean geometries.
▪ Applications to Military,
manufacturing,
Communications.
▪ 1962 John W. Tukey, Future of
Data Analysis
▪ Networks
▪ Assignment Problems
▪ Automation
▪ Scheduling.
▪ First IBM
Computers
▪ DBMS.
▪ Removable Disk drives
▪ Relational DBMS.
▪ Desktop, floppy
▪ SQL, OOP
▪ High level languages.
▪ William Playfair
▪ Charles Minard
▪ Florence Nightingale.
▪ Catrography
▪ Astronomical Charts.
▪ John Tukey
▪ Jacques Bertin. ▪ Edward Tufte.
▪ Grammar of Graphics
▪ Word Cloud, Tag Cloud.
Drivers of change
Data
Availability
Technology
Ability to
Handle
Structured and
unstructured
data
Platform Cost Agility
Business
Expectation
Digital
Experience
Strategic
Initiatives
New Business Models
Why Big Data?
● FB generates 10TB daily
● Twitter generates 7 TBof
Data Daily
● IBM claims 90% of
today’s store data was
generated in just the last
two years
How is Big Data Different ?
1) Automatically generated by a machine
(e.g. Sensor embedded in an engine)
2) Typically an entirely new source of data
(e.g. Use of the internet)
3) Not designed to be friendly
(e.g. Text streams)
4) May not have much values
● Need to focus on the important part
Three Characteristics of Big Data V3S
1. Volume (Data Quantity)
Boeing 737 generate 240 terabytes of flight data during a single flight across the US
2. Volume (Data Speed)
Machine to machine processes exchange data between billions of devices
3. Variety (Data Types)
Big Data isn’t numbers, dates and strings. It is also geospatial data, 3D data, Audio and Video and
Unstructured text, including log file and social media
The Structure of Big Data
● Structured
Most traditional data sources
● Semi-structured
Many sources of big data
● Unstructured
Video data, audio data
3 new insights from the video
1
Big Data = Poor
Data
● The more data you
have, the less probable
your chance of
discovering meaning --
the "why" of things.
2
To accelerate our
demise
● "We are in an age where
guided missiles are
operated by misguided
men"
● Unless we slow down
and analyze our needs
we will surely
accelerate our demise
3
Coding is not in
our control
● Big data can be a
transformative force,
and should be treated
as such
Why and How these Insights relevant
to Managers in India ?
1. Cost Reduction
Big data technologies such as Hadoop and cloud-based
analytics bring significant cost advantages when it comes
to storing large amounts of data – plus they can identify
more efficient ways of doing business.
2. Faster, Better Decision Making
With the speed of Hadoop and in-memory analytics,
combined with the ability to analyze new sources of data,
businesses are able to analyze information immediately –
and make decisions based on what they’ve learned.
3. New Products and Services
With the ability to gauge customer needs and satisfaction
through analytics comes the power to give customers
what they want. Davenport points out that with big data
analytics, more companies are creating new products to
meet customers’ needs.
Decreased
response time
Customer experience
Information is becoming the
new battleground
Business expectation
Analytics is playing an ever important role
Increased Focus on identifying the
customer across all channels
Segmentation to Micro segmentation
to the individual
Personalized Messaging and offers –
Increased Individual Customer Centricity
Gradual evolution of Customer Analytics
Past
▪ Customer segments who are
most likely to respond to
targeted campaigns for new
products offers
▪ Can tailor offers to specific to
each customer segment
▪ Mostly delivered through mass
mail campaigns and in store
promotions.
Now
▪ Micro segmentation
▪ Analyze customer behavior
and buying patterns across
channels
▪ Delivery through email, web,
mass mail campaigns.
Moving toward
▪ Historical individual customer behavior
and buying patterns across channels
▪ Individual customer consumption
pattern
▪ In-store basket analytics
▪ Additional dimensions Location & time
▪ Targeted Strategies to pre-empt
customers from visiting competition
▪ Instantaneous Delivery in store or a
proactive delivery via mobile to bring the
customer to store.
Segment to Individual to Individual @ time, place and behavior
You have purchased
Cheese, here are
the
offers on Bagels
You are within 2
KMs of a store
offering 50% off
garden furniture
Do you
need coffee?
much of which is outside the
organization
Increased availability of data
Analytics as a Service and Data
Monetization
New service models
Decreasing Time value of data!
Scalability and industrialization to address skill shortage
Key to a Great Data Scientist
Technical skills (Coding, Statistics,
Math)
+ Perseverance
+Creativity
+ Intuition
+Presentation Skills
+Business Savvy
= Great Data Scientist!
▪ Identified four Data Scientist clusters based on
how data scientists think about themselves and
their work, not
• Years of experience,
• Academic degrees, favorite tools
• Titles, pay scales, org charts.
▪ Most successful data scientists are those
with substantial, deep expertise in at
least one aspect of data science, be it
statistics, big data, or business
communication
▪ T-Shaped Skills.
Presented By
Prince Barai
Data Analytics Intern at IIM, Lucknow

More Related Content

What's hot

Digital-Warriors-Marketing Roadmap with Big Data Analytics
Digital-Warriors-Marketing Roadmap with Big Data AnalyticsDigital-Warriors-Marketing Roadmap with Big Data Analytics
Digital-Warriors-Marketing Roadmap with Big Data Analytics
JaysonBowden
 
Big Data & Analytics (Conceptual and Practical Introduction)
Big Data & Analytics (Conceptual and Practical Introduction)Big Data & Analytics (Conceptual and Practical Introduction)
Big Data & Analytics (Conceptual and Practical Introduction)
Yaman Hajja, Ph.D.
 
Big data
Big dataBig data
Big data
Abhishek Palo
 
Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data
DATAVERSITY
 
Big Data and the Art of Data Science
Big Data and the Art of Data ScienceBig Data and the Art of Data Science
Big Data and the Art of Data Science
Andrew Gardner
 
Data science
Data scienceData science
Data science
SwapnilDahake2
 
Policy paper need for focussed big data & analytics skillset building throu...
Policy  paper  need for focussed big data & analytics skillset building throu...Policy  paper  need for focussed big data & analytics skillset building throu...
Policy paper need for focussed big data & analytics skillset building throu...
Ritesh Shrivastava
 
Applications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesApplications of Big Data Analytics in Businesses
Applications of Big Data Analytics in Businesses
T.S. Lim
 
Big Data and The Future of Insight - Future Foundation
Big Data and The Future of Insight - Future FoundationBig Data and The Future of Insight - Future Foundation
Big Data and The Future of Insight - Future Foundation
Foresight Factory
 
Is big data just a buzzword -Big data simply explained
Is big data just a buzzword -Big data simply explainedIs big data just a buzzword -Big data simply explained
Is big data just a buzzword -Big data simply explained
Vivek Srivastava
 
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of thingsBig Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Ramakant Gawande
 
Big data
Big dataBig data
Big data
Pooja Shah
 
Team 2 Big Data Presentation
Team 2 Big Data PresentationTeam 2 Big Data Presentation
Team 2 Big Data Presentation
Matthew Urdan
 
Big data Introduction by Mohan
Big data Introduction by MohanBig data Introduction by Mohan
Big data Introduction by Mohan
Venkata Reddy Konasani
 
Final_Bigdata_pret
Final_Bigdata_pretFinal_Bigdata_pret
Final_Bigdata_pret
Simranjit Mann
 
Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolution
itnewsafrica
 
Big Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation SlidesBig Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation Slides
SlideTeam
 
Big Data Information Architecture PowerPoint Presentation Slide
Big Data Information Architecture PowerPoint Presentation SlideBig Data Information Architecture PowerPoint Presentation Slide
Big Data Information Architecture PowerPoint Presentation Slide
SlideTeam
 
Fraud and Risk in Big Data
Fraud and Risk in Big DataFraud and Risk in Big Data
Fraud and Risk in Big Data
Umma Khatuna Jannat
 
Big Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar SemwalBig Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar Semwal
IIIT Allahabad
 

What's hot (20)

Digital-Warriors-Marketing Roadmap with Big Data Analytics
Digital-Warriors-Marketing Roadmap with Big Data AnalyticsDigital-Warriors-Marketing Roadmap with Big Data Analytics
Digital-Warriors-Marketing Roadmap with Big Data Analytics
 
Big Data & Analytics (Conceptual and Practical Introduction)
Big Data & Analytics (Conceptual and Practical Introduction)Big Data & Analytics (Conceptual and Practical Introduction)
Big Data & Analytics (Conceptual and Practical Introduction)
 
Big data
Big dataBig data
Big data
 
Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data Data-Ed Webinar: Demystifying Big Data
Data-Ed Webinar: Demystifying Big Data
 
Big Data and the Art of Data Science
Big Data and the Art of Data ScienceBig Data and the Art of Data Science
Big Data and the Art of Data Science
 
Data science
Data scienceData science
Data science
 
Policy paper need for focussed big data & analytics skillset building throu...
Policy  paper  need for focussed big data & analytics skillset building throu...Policy  paper  need for focussed big data & analytics skillset building throu...
Policy paper need for focussed big data & analytics skillset building throu...
 
Applications of Big Data Analytics in Businesses
Applications of Big Data Analytics in BusinessesApplications of Big Data Analytics in Businesses
Applications of Big Data Analytics in Businesses
 
Big Data and The Future of Insight - Future Foundation
Big Data and The Future of Insight - Future FoundationBig Data and The Future of Insight - Future Foundation
Big Data and The Future of Insight - Future Foundation
 
Is big data just a buzzword -Big data simply explained
Is big data just a buzzword -Big data simply explainedIs big data just a buzzword -Big data simply explained
Is big data just a buzzword -Big data simply explained
 
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of thingsBig Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
Big Data & Future - Big Data, Analytics, Cloud, SDN, Internet of things
 
Big data
Big dataBig data
Big data
 
Team 2 Big Data Presentation
Team 2 Big Data PresentationTeam 2 Big Data Presentation
Team 2 Big Data Presentation
 
Big data Introduction by Mohan
Big data Introduction by MohanBig data Introduction by Mohan
Big data Introduction by Mohan
 
Final_Bigdata_pret
Final_Bigdata_pretFinal_Bigdata_pret
Final_Bigdata_pret
 
Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolution
 
Big Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation SlidesBig Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation Slides
 
Big Data Information Architecture PowerPoint Presentation Slide
Big Data Information Architecture PowerPoint Presentation SlideBig Data Information Architecture PowerPoint Presentation Slide
Big Data Information Architecture PowerPoint Presentation Slide
 
Fraud and Risk in Big Data
Fraud and Risk in Big DataFraud and Risk in Big Data
Fraud and Risk in Big Data
 
Big Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar SemwalBig Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar Semwal
 

Similar to Big data

SKILLWISE-BIGDATA ANALYSIS
SKILLWISE-BIGDATA ANALYSISSKILLWISE-BIGDATA ANALYSIS
SKILLWISE-BIGDATA ANALYSIS
Skillwise Consulting
 
introduction to data science
introduction to data scienceintroduction to data science
introduction to data science
bhavesh lande
 
bigdatappt.pptx
bigdatappt.pptxbigdatappt.pptx
bigdatappt.pptx
KrishnaTeja570279
 
PresentationBig Data111111111111111.pptx
PresentationBig Data111111111111111.pptxPresentationBig Data111111111111111.pptx
PresentationBig Data111111111111111.pptx
harshadbhaitalpada49
 
365 Data Science
365 Data Science365 Data Science
365 Data Science
IvanHo572682
 
Big data Analytics
Big data AnalyticsBig data Analytics
Big data Analytics
ShivanandaVSeeri
 
Introduction to Big Data
Introduction to Big DataIntroduction to Big Data
Introduction to Big Data
Roi Blanco
 
Big Data, NoSQL, NewSQL & The Future of Data Management
Big Data, NoSQL, NewSQL & The Future of Data ManagementBig Data, NoSQL, NewSQL & The Future of Data Management
Big Data, NoSQL, NewSQL & The Future of Data Management
Tony Bain
 
Datascience
DatascienceDatascience
big-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdfbig-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdf
VirajSaud
 
Data Mining With Big Data
Data Mining With Big DataData Mining With Big Data
Data Mining With Big Data
Muhammad Rumman Islam Nur
 
Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)
Thinkful
 
Big data
Big dataBig data
Data science
Data scienceData science
Big Data Scotland
Big Data ScotlandBig Data Scotland
Big Data Scotland
Ray Bugg
 
Data Science - An emerging Stream of Science with its Spreading Reach & Impact
Data Science - An emerging Stream of Science with its Spreading Reach & ImpactData Science - An emerging Stream of Science with its Spreading Reach & Impact
Data Science - An emerging Stream of Science with its Spreading Reach & Impact
Dr. Sunil Kr. Pandey
 
Big-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigBig-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-Koenig
Manish Chopra
 
Data sciences and marketing analytics
Data sciences and marketing analyticsData sciences and marketing analytics
Data sciences and marketing analytics
MJ Xavier
 
Data Science Overview
Data Science OverviewData Science Overview
Data Science Overview
Davide Mauri
 
Bda assignment can also be used for BDA notes and concept understanding.
Bda assignment can also be used for BDA notes and concept understanding.Bda assignment can also be used for BDA notes and concept understanding.
Bda assignment can also be used for BDA notes and concept understanding.
Aditya205306
 

Similar to Big data (20)

SKILLWISE-BIGDATA ANALYSIS
SKILLWISE-BIGDATA ANALYSISSKILLWISE-BIGDATA ANALYSIS
SKILLWISE-BIGDATA ANALYSIS
 
introduction to data science
introduction to data scienceintroduction to data science
introduction to data science
 
bigdatappt.pptx
bigdatappt.pptxbigdatappt.pptx
bigdatappt.pptx
 
PresentationBig Data111111111111111.pptx
PresentationBig Data111111111111111.pptxPresentationBig Data111111111111111.pptx
PresentationBig Data111111111111111.pptx
 
365 Data Science
365 Data Science365 Data Science
365 Data Science
 
Big data Analytics
Big data AnalyticsBig data Analytics
Big data Analytics
 
Introduction to Big Data
Introduction to Big DataIntroduction to Big Data
Introduction to Big Data
 
Big Data, NoSQL, NewSQL & The Future of Data Management
Big Data, NoSQL, NewSQL & The Future of Data ManagementBig Data, NoSQL, NewSQL & The Future of Data Management
Big Data, NoSQL, NewSQL & The Future of Data Management
 
Datascience
DatascienceDatascience
Datascience
 
big-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdfbig-datagroup6-150317090053-conversion-gate01.pdf
big-datagroup6-150317090053-conversion-gate01.pdf
 
Data Mining With Big Data
Data Mining With Big DataData Mining With Big Data
Data Mining With Big Data
 
Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)Career in Data Science (July 2017, DTLA)
Career in Data Science (July 2017, DTLA)
 
Big data
Big dataBig data
Big data
 
Data science
Data scienceData science
Data science
 
Big Data Scotland
Big Data ScotlandBig Data Scotland
Big Data Scotland
 
Data Science - An emerging Stream of Science with its Spreading Reach & Impact
Data Science - An emerging Stream of Science with its Spreading Reach & ImpactData Science - An emerging Stream of Science with its Spreading Reach & Impact
Data Science - An emerging Stream of Science with its Spreading Reach & Impact
 
Big-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-KoenigBig-Data-Seminar-6-Aug-2014-Koenig
Big-Data-Seminar-6-Aug-2014-Koenig
 
Data sciences and marketing analytics
Data sciences and marketing analyticsData sciences and marketing analytics
Data sciences and marketing analytics
 
Data Science Overview
Data Science OverviewData Science Overview
Data Science Overview
 
Bda assignment can also be used for BDA notes and concept understanding.
Bda assignment can also be used for BDA notes and concept understanding.Bda assignment can also be used for BDA notes and concept understanding.
Bda assignment can also be used for BDA notes and concept understanding.
 

More from Prince Barai

Big Data Hype (And Reality)
Big Data Hype  (And Reality)Big Data Hype  (And Reality)
Big Data Hype (And Reality)
Prince Barai
 
The Big Data Revolution In Healthcare
 The Big Data Revolution In Healthcare The Big Data Revolution In Healthcare
The Big Data Revolution In Healthcare
Prince Barai
 
Relevant insights for a manager in India
Relevant insights for a manager in IndiaRelevant insights for a manager in India
Relevant insights for a manager in India
Prince Barai
 
The Big-Data Revolution in Healthcare
The Big-Data Revolution in Healthcare The Big-Data Revolution in Healthcare
The Big-Data Revolution in Healthcare
Prince Barai
 
A Leader’s Guide to Data Analytics
A Leader’s Guide to Data AnalyticsA Leader’s Guide to Data Analytics
A Leader’s Guide to Data Analytics
Prince Barai
 
3 ways to spot wrong statistics
3 ways to spot wrong statistics3 ways to spot wrong statistics
3 ways to spot wrong statistics
Prince Barai
 
A Predictive Analytics Primer
A Predictive Analytics PrimerA Predictive Analytics Primer
A Predictive Analytics Primer
Prince Barai
 
The best stats you've ever seen
The best stats you've ever seenThe best stats you've ever seen
The best stats you've ever seen
Prince Barai
 
Data is worthless
Data is worthlessData is worthless
Data is worthless
Prince Barai
 
The beauty of Data Visualization
The beauty of  Data VisualizationThe beauty of  Data Visualization
The beauty of Data Visualization
Prince Barai
 
Data driven
Data drivenData driven
Data driven
Prince Barai
 
More data more human
More data more human More data more human
More data more human
Prince Barai
 
How to start thinking like a Data Scientist !
How to start thinking like a Data Scientist !How to start thinking like a Data Scientist !
How to start thinking like a Data Scientist !
Prince Barai
 
Data Scientist
Data ScientistData Scientist
Data Scientist
Prince Barai
 

More from Prince Barai (14)

Big Data Hype (And Reality)
Big Data Hype  (And Reality)Big Data Hype  (And Reality)
Big Data Hype (And Reality)
 
The Big Data Revolution In Healthcare
 The Big Data Revolution In Healthcare The Big Data Revolution In Healthcare
The Big Data Revolution In Healthcare
 
Relevant insights for a manager in India
Relevant insights for a manager in IndiaRelevant insights for a manager in India
Relevant insights for a manager in India
 
The Big-Data Revolution in Healthcare
The Big-Data Revolution in Healthcare The Big-Data Revolution in Healthcare
The Big-Data Revolution in Healthcare
 
A Leader’s Guide to Data Analytics
A Leader’s Guide to Data AnalyticsA Leader’s Guide to Data Analytics
A Leader’s Guide to Data Analytics
 
3 ways to spot wrong statistics
3 ways to spot wrong statistics3 ways to spot wrong statistics
3 ways to spot wrong statistics
 
A Predictive Analytics Primer
A Predictive Analytics PrimerA Predictive Analytics Primer
A Predictive Analytics Primer
 
The best stats you've ever seen
The best stats you've ever seenThe best stats you've ever seen
The best stats you've ever seen
 
Data is worthless
Data is worthlessData is worthless
Data is worthless
 
The beauty of Data Visualization
The beauty of  Data VisualizationThe beauty of  Data Visualization
The beauty of Data Visualization
 
Data driven
Data drivenData driven
Data driven
 
More data more human
More data more human More data more human
More data more human
 
How to start thinking like a Data Scientist !
How to start thinking like a Data Scientist !How to start thinking like a Data Scientist !
How to start thinking like a Data Scientist !
 
Data Scientist
Data ScientistData Scientist
Data Scientist
 

Recently uploaded

Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
sapna sharmap11
 
Interview Methods - Marital and Family Therapy and Counselling - Psychology S...
Interview Methods - Marital and Family Therapy and Counselling - Psychology S...Interview Methods - Marital and Family Therapy and Counselling - Psychology S...
Interview Methods - Marital and Family Therapy and Counselling - Psychology S...
PsychoTech Services
 
machine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Mamachine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Ma
Vijayabaskar Uthirapathy
 
🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...
🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...
🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...
yuvishachadda
 
Classifying Shooting Incident Fatality in New York project presentation
Classifying Shooting Incident Fatality in New York project presentationClassifying Shooting Incident Fatality in New York project presentation
Classifying Shooting Incident Fatality in New York project presentation
Boston Institute of Analytics
 
CAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdfCAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdf
frp60658
 
PCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdfPCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdf
incitbe
 
Do People Really Know Their Fertility Intentions? Correspondence between Sel...
Do People Really Know Their Fertility Intentions?  Correspondence between Sel...Do People Really Know Their Fertility Intentions?  Correspondence between Sel...
Do People Really Know Their Fertility Intentions? Correspondence between Sel...
Xiao Xu
 
Pune Call Girls <BOOK> 😍 Call Girl Pune Escorts Service
Pune Call Girls <BOOK> 😍 Call Girl Pune Escorts ServicePune Call Girls <BOOK> 😍 Call Girl Pune Escorts Service
Pune Call Girls <BOOK> 😍 Call Girl Pune Escorts Service
vashimk775
 
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering RoadshowDirect Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
Gabi Münster
 
AI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOW
AI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOWAI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOW
AI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOW
arash10gamer
 
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your DoorHyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Russian Escorts in Delhi 9711199171 with low rate Book online
 
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENTHigh Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
ranjeet3341
 
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
sapna sharmap11
 
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
mparmparousiskostas
 
_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf
rc76967005
 
Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...
Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...
Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...
wwefun9823#S0007
 
❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...
❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...
❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...
#kalyanmatkaresult #dpboss #kalyanmatka #satta #matka #sattamatka
 
IBM watsonx.data - Seller Enablement Deck.PPTX
IBM watsonx.data - Seller Enablement Deck.PPTXIBM watsonx.data - Seller Enablement Deck.PPTX
IBM watsonx.data - Seller Enablement Deck.PPTX
EbtsamRashed
 
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
PsychoTech Services
 

Recently uploaded (20)

Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
 
Interview Methods - Marital and Family Therapy and Counselling - Psychology S...
Interview Methods - Marital and Family Therapy and Counselling - Psychology S...Interview Methods - Marital and Family Therapy and Counselling - Psychology S...
Interview Methods - Marital and Family Therapy and Counselling - Psychology S...
 
machine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Mamachine learning notes by Andrew Ng and Tengyu Ma
machine learning notes by Andrew Ng and Tengyu Ma
 
🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...
🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...
🔥Night Call Girls Pune 💯Call Us 🔝 7014168258 🔝💃Independent Pune Escorts Servi...
 
Classifying Shooting Incident Fatality in New York project presentation
Classifying Shooting Incident Fatality in New York project presentationClassifying Shooting Incident Fatality in New York project presentation
Classifying Shooting Incident Fatality in New York project presentation
 
CAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdfCAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdf
 
PCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdfPCI-DSS-Data Security Standard v4.0.1.pdf
PCI-DSS-Data Security Standard v4.0.1.pdf
 
Do People Really Know Their Fertility Intentions? Correspondence between Sel...
Do People Really Know Their Fertility Intentions?  Correspondence between Sel...Do People Really Know Their Fertility Intentions?  Correspondence between Sel...
Do People Really Know Their Fertility Intentions? Correspondence between Sel...
 
Pune Call Girls <BOOK> 😍 Call Girl Pune Escorts Service
Pune Call Girls <BOOK> 😍 Call Girl Pune Escorts ServicePune Call Girls <BOOK> 😍 Call Girl Pune Escorts Service
Pune Call Girls <BOOK> 😍 Call Girl Pune Escorts Service
 
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering RoadshowDirect Lake Deep Dive slides from Fabric Engineering Roadshow
Direct Lake Deep Dive slides from Fabric Engineering Roadshow
 
AI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOW
AI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOWAI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOW
AI WITH THE HELP OF NAGALAND CAN WIN. DOWNLOAD NOW
 
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your DoorHyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
Hyderabad Call Girls 7339748667 With Free Home Delivery At Your Door
 
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENTHigh Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
High Profile Call Girls Navi Mumbai ✅ 9833363713 FULL CASH PAYMENT
 
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
 
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
Optimizing Feldera: Integrating Advanced UDFs and Enhanced SQL Functionality ...
 
_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf_Lufthansa Airlines MIA Terminal (1).pdf
_Lufthansa Airlines MIA Terminal (1).pdf
 
Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...
Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...
Call Girls In Tirunelveli 👯‍♀️ 7339748667 🔥 Safe Housewife Call Girl Service ...
 
❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...
❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...
❻❸❼⓿❽❻❷⓿⓿❼KALYAN MATKA CHART FINAL OPEN JODI PANNA FIXXX DPBOSS MATKA RESULT ...
 
IBM watsonx.data - Seller Enablement Deck.PPTX
IBM watsonx.data - Seller Enablement Deck.PPTXIBM watsonx.data - Seller Enablement Deck.PPTX
IBM watsonx.data - Seller Enablement Deck.PPTX
 
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
 

Big data

  • 1.
  • 2. Susan Etlinger Susan Etlinger is an industry analyst with Altimeter Group, where she focuses on data and analytics. She conducts independent research and has authored two intriguing reports: “The Social Media ROI Cookbook” and “A Framework for Social Analytics.” She also advises global clients on how to work measurement into their organizational structure and how to extract insights from the social web which can lead to tangible actions. In addition, she works with technology innovators to help them refine their roadmaps and strategies.
  • 3. What is BIG DATA? ● ‘Big Data’ is similar to ‘Small Data’, but bigger in size ● But having data bigger it requires different approaches: -Techniques, tools and architecture ● An aim to solve new problems or old problems in a better way ● Big Data generates value from the storage and processing of very large quantities of digital information that cannot be analyzed with traditional computing techniques. ● Walmart handles more than 1 million customer transactions every hour. ● Facebook handles 40 billion photos from its user base. ● Decoding the human genome originally took 10 years to proces; now it can be achieved in one week.
  • 4. So what does this mean for Analytics? So what does this mean for Analytics? Yes, the amount of data that is available to us is exploding And Big Data Platforms and Commodity Hardware and bringing in additional capabilities Media is rife with Big Data and Analytics Big Data and analytics is touted as the panacea for all problems …makes it to on top of CIO agenda AND The Data Scientist makes it from Nerd to the most cool person!! .
  • 5. Data Science perspective – A Data Science perspective Big Data and AnalyticsImpact of
  • 6. A brief history of Data Science Pre 1800s 1800-1900 1900-1940 1940-1960 1960 1970 1980 1990 2000 2010 ▪ Text/ string search ▪ 1974 Peter Naur “Concise Survey of Computer Methods”, Data Science, Datalogy ▪ Knuth – Art of Computer Programming. ▪ 1976 – SAS Institute ▪ 1977 The International Association for Statistical Computing (IASC). Computer Science Data Technology Visualization Mathematics/ OR Statistics ▪ Probability ▪ Correlation ▪ Bayes Theorem. ▪ Regression, Least Squares ▪ Time Series. ▪ Theoretical Foundations of Modern Stats ▪ Hypothesis, DOE ▪ Mathematical Statistics. ▪ Bayesian Methods ▪ Time Series Methods (Box Cox, Survival, etc.) ▪ Stochastic Methods. ▪ Simulation, Markov ▪ Computational Statistics. ▪ Decision Science ▪ Pattern recognition ▪ Machine learning. ▪ Liebniz – Binary Logic. ▪ Babbage, Lovelace ▪ Boolean Algebra ▪ Punch cards. ▪ Turing machines ▪ Information Theory ▪ Weiner & Cybernetics ▪ Von Neumann Architecture. ▪ Calculus ▪ Logarithms ▪ Newton-Raphson. ▪ 1989 First KDD Workshop ▪ Gregory Piatetsky-Shapiro. ▪ Sort & Search Algorithms – Dijkstra, Kruskal, Shell Sort, … ▪ Heuristics – Simulated Annealing, … ▪ Graph Algorithms ▪ Multigrid methods ▪ Tree based methods. ▪ Database Marketing ▪ Data Mining, Knowledge Discovery ▪ “Data science, classification, and related methods.” ▪ William Cleveland: Data Science ▪ Leo Breimann: Statistical Modeling: 2 Cultures. ▪ Optimization Methods ▪ Fourier and other transforms ▪ Matrix & Generalizations ▪ Non-euclidean geometries. ▪ Applications to Military, manufacturing, Communications. ▪ 1962 John W. Tukey, Future of Data Analysis ▪ Networks ▪ Assignment Problems ▪ Automation ▪ Scheduling. ▪ First IBM Computers ▪ DBMS. ▪ Removable Disk drives ▪ Relational DBMS. ▪ Desktop, floppy ▪ SQL, OOP ▪ High level languages. ▪ William Playfair ▪ Charles Minard ▪ Florence Nightingale. ▪ Catrography ▪ Astronomical Charts. ▪ John Tukey ▪ Jacques Bertin. ▪ Edward Tufte. ▪ Grammar of Graphics ▪ Word Cloud, Tag Cloud.
  • 7. Drivers of change Data Availability Technology Ability to Handle Structured and unstructured data Platform Cost Agility Business Expectation Digital Experience Strategic Initiatives New Business Models
  • 8. Why Big Data? ● FB generates 10TB daily ● Twitter generates 7 TBof Data Daily ● IBM claims 90% of today’s store data was generated in just the last two years
  • 9. How is Big Data Different ? 1) Automatically generated by a machine (e.g. Sensor embedded in an engine) 2) Typically an entirely new source of data (e.g. Use of the internet) 3) Not designed to be friendly (e.g. Text streams) 4) May not have much values ● Need to focus on the important part
  • 10. Three Characteristics of Big Data V3S 1. Volume (Data Quantity) Boeing 737 generate 240 terabytes of flight data during a single flight across the US 2. Volume (Data Speed) Machine to machine processes exchange data between billions of devices 3. Variety (Data Types) Big Data isn’t numbers, dates and strings. It is also geospatial data, 3D data, Audio and Video and Unstructured text, including log file and social media
  • 11. The Structure of Big Data ● Structured Most traditional data sources ● Semi-structured Many sources of big data ● Unstructured Video data, audio data
  • 12. 3 new insights from the video 1 Big Data = Poor Data ● The more data you have, the less probable your chance of discovering meaning -- the "why" of things. 2 To accelerate our demise ● "We are in an age where guided missiles are operated by misguided men" ● Unless we slow down and analyze our needs we will surely accelerate our demise 3 Coding is not in our control ● Big data can be a transformative force, and should be treated as such
  • 13. Why and How these Insights relevant to Managers in India ?
  • 14. 1. Cost Reduction Big data technologies such as Hadoop and cloud-based analytics bring significant cost advantages when it comes to storing large amounts of data – plus they can identify more efficient ways of doing business.
  • 15. 2. Faster, Better Decision Making With the speed of Hadoop and in-memory analytics, combined with the ability to analyze new sources of data, businesses are able to analyze information immediately – and make decisions based on what they’ve learned.
  • 16. 3. New Products and Services With the ability to gauge customer needs and satisfaction through analytics comes the power to give customers what they want. Davenport points out that with big data analytics, more companies are creating new products to meet customers’ needs.
  • 17.
  • 18. Decreased response time Customer experience Information is becoming the new battleground Business expectation
  • 19. Analytics is playing an ever important role Increased Focus on identifying the customer across all channels Segmentation to Micro segmentation to the individual Personalized Messaging and offers – Increased Individual Customer Centricity Gradual evolution of Customer Analytics Past ▪ Customer segments who are most likely to respond to targeted campaigns for new products offers ▪ Can tailor offers to specific to each customer segment ▪ Mostly delivered through mass mail campaigns and in store promotions. Now ▪ Micro segmentation ▪ Analyze customer behavior and buying patterns across channels ▪ Delivery through email, web, mass mail campaigns. Moving toward ▪ Historical individual customer behavior and buying patterns across channels ▪ Individual customer consumption pattern ▪ In-store basket analytics ▪ Additional dimensions Location & time ▪ Targeted Strategies to pre-empt customers from visiting competition ▪ Instantaneous Delivery in store or a proactive delivery via mobile to bring the customer to store. Segment to Individual to Individual @ time, place and behavior You have purchased Cheese, here are the offers on Bagels You are within 2 KMs of a store offering 50% off garden furniture Do you need coffee?
  • 20. much of which is outside the organization Increased availability of data Analytics as a Service and Data Monetization New service models Decreasing Time value of data!
  • 21. Scalability and industrialization to address skill shortage Key to a Great Data Scientist Technical skills (Coding, Statistics, Math) + Perseverance +Creativity + Intuition +Presentation Skills +Business Savvy = Great Data Scientist! ▪ Identified four Data Scientist clusters based on how data scientists think about themselves and their work, not • Years of experience, • Academic degrees, favorite tools • Titles, pay scales, org charts. ▪ Most successful data scientists are those with substantial, deep expertise in at least one aspect of data science, be it statistics, big data, or business communication ▪ T-Shaped Skills.
  • 22. Presented By Prince Barai Data Analytics Intern at IIM, Lucknow
  翻译: