尊敬的 微信汇率:1円 ≈ 0.046089 元 支付宝汇率:1円 ≈ 0.04618元 [退出登录]
SlideShare a Scribd company logo
Quanti-litative Revolution 
in GIS
@Noootsab 
Pre-NextLab 
Licence in Maths, ULg 
Licence in Computer Sciences, ULg 
Geospatial specialization, ULg 
Many years in GIS (Ionic Software and its mutations) 
Always in data management and semantic 
New technologies enthusiast 
NextLab age 
Project in for the SPW 
Project in for Virdata 
Wrote a about Play! 2 
evangelist (OKFN, ...), speaker 
Distributed + Distributed expert 
co-founder | organizer 
And the list goes on... and on...
@NextLab_be
Qualitative GIS 
Coined in 1963
Raster 
vulgus: Big Fat 
MultiBand Images 
SPOT (see later) 
IKONOS (greek: image) 
LANDSAT 
ALOS 
QuickBird: resolution 64cm 
→ 2m44cm 
Vector 
vulgus... nah, vector 
Feature extraction 
Landmeters (rare) 
Field surveying 
~GPS (GNS)
hence, Producers were... 
Govs!
thus, Users were 
Govs! 
Oh yeah, researchers as well... huh!? wait! 
Okay, very feeeew privates
in consequence, Analyses were 
Performed by experimented folks... 
... or nerds
finally, Tools were... 
You don't even know them! 
ESRI, Oracle Spatial, 
OGC, RedSpider (yeah), ...
Qualitative GIS 
"Started" around 2000 
Actually, not really before 2010
GIS Revolution 
Induce theories from data 
The river has flooded on 3km 
The river will flood if it rains more than...
New producers 
Google, 4², OSM, GPS 
old: Mappy, Michelin, ...
New Users 
Devs, Lambda 
Billioooooons
Analyses 
Routing, Accurate GWR¹, ... 
Disaster prediction, flood prevention, crash probability, ... 
¹Geospatial Weight Regression
Tools? 
User friendly and/or Open Source 
OSM 
GeoServer 
OpenLayers 
Google Maps
Quantilitative GIS 
Coined by @Noootsab^^
WTF?!
Rasters today (f.i. Spot7) 
Red Green Blue + Near Infra Red Bands 
One shot: 60x60km (3.600 sq km) 
Takes 3.600.000 sq km of geodata per DAY 
Resolution 2 satellites at and 2 others at 
Revolution: 110 minutes 
26 days to complete the geoid (all pieces of crap covered) 
1 single f*****g file for a 60x60km tile is worth up to
Vector (mostly position) 
everywhere and everytime 
Twitter, Facebook, ... 
Foursquare, Instagram 
Waze 
Google (in its whole) 
Connected Devices
Presidente 
Model-Driven 
Deductive 
Top-Down 
Quantitative 
Lagged Time 
GIS Putsch 
Commandante 
Data-Driven 
Inductive 
Bottom-Up 
Qualitative 
Real Time 
Marcelino 
Data Lake 
Machine Learning 
Variety 
Value 
Velocity 
VOLUME? It was there for ages!
Who, What, How 
You thought I was joking, huh!
Socrata 
Evan Chan using Spark 
Customers have point data (many millions of 
rows) 
PostGIS: point-in-polygon and other does 
Partitioning point data in (tiling, Z-curve) 
Partitions into for quick analysis 
Adding to Spark for speeding up
Azavea 
Rob Emanuele on Geotrellis 
Run of climate data against daily 
temperature and precipitation data out to 2009 
Create suitability maps over high-res raster layers 
spanning the for Urban Forestry 
Modeling. 
GeoTrellis is providing with geospatial capabilities. 
Ingest, mosaic and pyramid raster data into 
for fast (sub-500ms) tile fetching
Snips 
Rand Hindi in his Labs 
Tranquilien: seating availability in public 
transport 
RiskContext: Determining the risk of bicycle and car 
Using technologies that can scale linearly 
(Akka, Scala) 
Thanks to the bottom up of the architecture, the 
clusters keeps crunching data in a resilient manner
Done! 
Thx & cu on Twitter 
@noootsab 
@NextLab_be

More Related Content

What's hot

RJW CCAE Course 1977-79
RJW CCAE Course 1977-79RJW CCAE Course 1977-79
RJW CCAE Course 1977-79
Robert (Bob) Williams
 
Landsat 8 OLI (Operational Land Imager)
Landsat 8 OLI (Operational Land Imager)Landsat 8 OLI (Operational Land Imager)
Landsat 8 OLI (Operational Land Imager)
Haris Khan
 
How to play with maps @ 20180321 Google sharing
How to play with maps @ 20180321 Google sharingHow to play with maps @ 20180321 Google sharing
How to play with maps @ 20180321 Google sharing
Yi Lin
 
Sentinel Satellites
Sentinel SatellitesSentinel Satellites
Sentinel Satellites
Sheikh Maryam
 
TexelTek - Andrew Levine - Hadoop World 2010
TexelTek - Andrew Levine - Hadoop World 2010TexelTek - Andrew Levine - Hadoop World 2010
TexelTek - Andrew Levine - Hadoop World 2010
Cloudera, Inc.
 
Goddard 2015: Erik Antonsson, Northrop Grumman
Goddard 2015: Erik Antonsson, Northrop GrummanGoddard 2015: Erik Antonsson, Northrop Grumman
Goddard 2015: Erik Antonsson, Northrop Grumman
American Astronautical Society
 
LANDSAT
LANDSATLANDSAT
Torusbern
TorusbernTorusbern
Torusbern
Stadler Michael
 
Satellite systems landsat 7 compatibility mode
Satellite systems landsat 7 compatibility modeSatellite systems landsat 7 compatibility mode
Satellite systems landsat 7 compatibility mode
Sabaragamuwa University of Sri Lanka
 
Integrating eo with official statistics using machine learning in mexico geo ...
Integrating eo with official statistics using machine learning in mexico geo ...Integrating eo with official statistics using machine learning in mexico geo ...
Integrating eo with official statistics using machine learning in mexico geo ...
Abel Alejandro Coronado Iruegas
 
Machine learning and Satellite Images
Machine learning and Satellite ImagesMachine learning and Satellite Images
Machine learning and Satellite Images
Abel Alejandro Coronado Iruegas
 
20041014 AIR-257: Satellite Detection of Aerosols Satellite Types
20041014 AIR-257: Satellite Detection of Aerosols Satellite Types20041014 AIR-257: Satellite Detection of Aerosols Satellite Types
20041014 AIR-257: Satellite Detection of Aerosols Satellite Types
Rudolf Husar
 
Landsat
LandsatLandsat
Landsat
HARITHANAIR15
 
Band Combination of Landsat 8 Earth-observing Satellite Images
Band Combination of Landsat 8 Earth-observing Satellite ImagesBand Combination of Landsat 8 Earth-observing Satellite Images
Band Combination of Landsat 8 Earth-observing Satellite Images
Kabir Uddin
 
GOOGLE EARTH INTRODUCTION
GOOGLE EARTH INTRODUCTIONGOOGLE EARTH INTRODUCTION
GOOGLE EARTH INTRODUCTION
Akshat Singh
 
Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...
Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...
Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...
senseFly
 
Landsat program
Landsat programLandsat program
Landsat program
Jenelyn Cadion
 
Sentinel 2
Sentinel 2Sentinel 2
Sentinel 2
Openmaps
 
Spot 7 satellite
Spot 7 satelliteSpot 7 satellite
Spot 7 satellite
Nimra Butt
 

What's hot (19)

RJW CCAE Course 1977-79
RJW CCAE Course 1977-79RJW CCAE Course 1977-79
RJW CCAE Course 1977-79
 
Landsat 8 OLI (Operational Land Imager)
Landsat 8 OLI (Operational Land Imager)Landsat 8 OLI (Operational Land Imager)
Landsat 8 OLI (Operational Land Imager)
 
How to play with maps @ 20180321 Google sharing
How to play with maps @ 20180321 Google sharingHow to play with maps @ 20180321 Google sharing
How to play with maps @ 20180321 Google sharing
 
Sentinel Satellites
Sentinel SatellitesSentinel Satellites
Sentinel Satellites
 
TexelTek - Andrew Levine - Hadoop World 2010
TexelTek - Andrew Levine - Hadoop World 2010TexelTek - Andrew Levine - Hadoop World 2010
TexelTek - Andrew Levine - Hadoop World 2010
 
Goddard 2015: Erik Antonsson, Northrop Grumman
Goddard 2015: Erik Antonsson, Northrop GrummanGoddard 2015: Erik Antonsson, Northrop Grumman
Goddard 2015: Erik Antonsson, Northrop Grumman
 
LANDSAT
LANDSATLANDSAT
LANDSAT
 
Torusbern
TorusbernTorusbern
Torusbern
 
Satellite systems landsat 7 compatibility mode
Satellite systems landsat 7 compatibility modeSatellite systems landsat 7 compatibility mode
Satellite systems landsat 7 compatibility mode
 
Integrating eo with official statistics using machine learning in mexico geo ...
Integrating eo with official statistics using machine learning in mexico geo ...Integrating eo with official statistics using machine learning in mexico geo ...
Integrating eo with official statistics using machine learning in mexico geo ...
 
Machine learning and Satellite Images
Machine learning and Satellite ImagesMachine learning and Satellite Images
Machine learning and Satellite Images
 
20041014 AIR-257: Satellite Detection of Aerosols Satellite Types
20041014 AIR-257: Satellite Detection of Aerosols Satellite Types20041014 AIR-257: Satellite Detection of Aerosols Satellite Types
20041014 AIR-257: Satellite Detection of Aerosols Satellite Types
 
Landsat
LandsatLandsat
Landsat
 
Band Combination of Landsat 8 Earth-observing Satellite Images
Band Combination of Landsat 8 Earth-observing Satellite ImagesBand Combination of Landsat 8 Earth-observing Satellite Images
Band Combination of Landsat 8 Earth-observing Satellite Images
 
GOOGLE EARTH INTRODUCTION
GOOGLE EARTH INTRODUCTIONGOOGLE EARTH INTRODUCTION
GOOGLE EARTH INTRODUCTION
 
Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...
Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...
Using senseFly Mapping Drones to Map Geomorphological Features in the Subanta...
 
Landsat program
Landsat programLandsat program
Landsat program
 
Sentinel 2
Sentinel 2Sentinel 2
Sentinel 2
 
Spot 7 satellite
Spot 7 satelliteSpot 7 satellite
Spot 7 satellite
 

Similar to Quanti-litative Revolution in GIS

Intelligent satellites
Intelligent satellitesIntelligent satellites
Intelligent satellites
Clifford Stone
 
25 Years of GRASS GIS
25 Years of GRASS GIS25 Years of GRASS GIS
25 Years of GRASS GIS
Markus Neteler
 
AstroCV: A computer vision library for Astronomy
AstroCV: A computer vision library for AstronomyAstroCV: A computer vision library for Astronomy
AstroCV: A computer vision library for Astronomy
Roberto Muñoz
 
Data collection
Data collectionData collection
Data collection
Malla Reddy University
 
Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...
Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...
Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...
Paul Cripps
 
Efficient data reduction and analysis of DECam images using multicore archite...
Efficient data reduction and analysis of DECam images using multicore archite...Efficient data reduction and analysis of DECam images using multicore archite...
Efficient data reduction and analysis of DECam images using multicore archite...
Roberto Muñoz
 
The role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected societyThe role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected society
Maria Antonia Brovelli
 
The role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected societyThe role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected society
Maria Antonia Brovelli
 
The role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected societyThe role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected society
Maria Antonia Brovelli
 
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Codiax
 
Astronomical Data Processing on the LSST Scale with Apache Spark
Astronomical Data Processing on the LSST Scale with Apache SparkAstronomical Data Processing on the LSST Scale with Apache Spark
Astronomical Data Processing on the LSST Scale with Apache Spark
Databricks
 
RemoteSensing_DeepLearning_v2.pptx
RemoteSensing_DeepLearning_v2.pptxRemoteSensing_DeepLearning_v2.pptx
RemoteSensing_DeepLearning_v2.pptx
Elise Colin
 
Geoscience satellite image processing
Geoscience satellite image processingGeoscience satellite image processing
Geoscience satellite image processing
gaurav jain
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
Fatima891926
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
safayetmim1
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
vikramvsu
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
GodwinKingNyamador
 
In sar 1-1-2011
In sar 1-1-2011In sar 1-1-2011
In sar 1-1-2011
ashrafrateb1985
 
Applications of AI in the geospatial domain
Applications of AI in the geospatial domainApplications of AI in the geospatial domain
Applications of AI in the geospatial domain
Erik Van Der Zee
 
OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...
OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...
OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...
BigDataExpo
 

Similar to Quanti-litative Revolution in GIS (20)

Intelligent satellites
Intelligent satellitesIntelligent satellites
Intelligent satellites
 
25 Years of GRASS GIS
25 Years of GRASS GIS25 Years of GRASS GIS
25 Years of GRASS GIS
 
AstroCV: A computer vision library for Astronomy
AstroCV: A computer vision library for AstronomyAstroCV: A computer vision library for Astronomy
AstroCV: A computer vision library for Astronomy
 
Data collection
Data collectionData collection
Data collection
 
Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...
Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...
Laser-beams, spacecraft and archaeology; recent approaches to the recording, ...
 
Efficient data reduction and analysis of DECam images using multicore archite...
Efficient data reduction and analysis of DECam images using multicore archite...Efficient data reduction and analysis of DECam images using multicore archite...
Efficient data reduction and analysis of DECam images using multicore archite...
 
The role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected societyThe role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected society
 
The role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected societyThe role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected society
 
The role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected societyThe role of geospatial information in a hyper connected society
The role of geospatial information in a hyper connected society
 
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
Roelof Pieters (Overstory) – Tackling Forest Fires and Deforestation with Sat...
 
Astronomical Data Processing on the LSST Scale with Apache Spark
Astronomical Data Processing on the LSST Scale with Apache SparkAstronomical Data Processing on the LSST Scale with Apache Spark
Astronomical Data Processing on the LSST Scale with Apache Spark
 
RemoteSensing_DeepLearning_v2.pptx
RemoteSensing_DeepLearning_v2.pptxRemoteSensing_DeepLearning_v2.pptx
RemoteSensing_DeepLearning_v2.pptx
 
Geoscience satellite image processing
Geoscience satellite image processingGeoscience satellite image processing
Geoscience satellite image processing
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
 
GIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.pptGIS_Whirlwind_Tour.ppt
GIS_Whirlwind_Tour.ppt
 
In sar 1-1-2011
In sar 1-1-2011In sar 1-1-2011
In sar 1-1-2011
 
Applications of AI in the geospatial domain
Applications of AI in the geospatial domainApplications of AI in the geospatial domain
Applications of AI in the geospatial domain
 
OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...
OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...
OrangeNXT - High accuracy mapping from videos for efficient fiber optic cable...
 

More from Andy Petrella

Data Observability Best Pracices
Data Observability Best PracicesData Observability Best Pracices
Data Observability Best Pracices
Andy Petrella
 
How to Build a Global Data Mapping
How to Build a Global Data MappingHow to Build a Global Data Mapping
How to Build a Global Data Mapping
Andy Petrella
 
Interactive notebooks
Interactive notebooksInteractive notebooks
Interactive notebooks
Andy Petrella
 
Governance compliance
Governance   complianceGovernance   compliance
Governance compliance
Andy Petrella
 
Data science governance and GDPR
Data science governance and GDPRData science governance and GDPR
Data science governance and GDPR
Andy Petrella
 
Data science governance : what and how
Data science governance : what and howData science governance : what and how
Data science governance : what and how
Andy Petrella
 
Scala: the unpredicted lingua franca for data science
Scala: the unpredicted lingua franca  for data scienceScala: the unpredicted lingua franca  for data science
Scala: the unpredicted lingua franca for data science
Andy Petrella
 
Agile data science with scala
Agile data science with scalaAgile data science with scala
Agile data science with scala
Andy Petrella
 
Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...
Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...
Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...
Andy Petrella
 
What is a distributed data science pipeline. how with apache spark and friends.
What is a distributed data science pipeline. how with apache spark and friends.What is a distributed data science pipeline. how with apache spark and friends.
What is a distributed data science pipeline. how with apache spark and friends.
Andy Petrella
 
Towards a rebirth of data science (by Data Fellas)
Towards a rebirth of data science (by Data Fellas)Towards a rebirth of data science (by Data Fellas)
Towards a rebirth of data science (by Data Fellas)
Andy Petrella
 
Distributed machine learning 101 using apache spark from a browser devoxx.b...
Distributed machine learning 101 using apache spark from a browser   devoxx.b...Distributed machine learning 101 using apache spark from a browser   devoxx.b...
Distributed machine learning 101 using apache spark from a browser devoxx.b...
Andy Petrella
 
Spark Summit Europe: Share and analyse genomic data at scale
Spark Summit Europe: Share and analyse genomic data at scaleSpark Summit Europe: Share and analyse genomic data at scale
Spark Summit Europe: Share and analyse genomic data at scale
Andy Petrella
 
Leveraging mesos as the ultimate distributed data science platform
Leveraging mesos as the ultimate distributed data science platformLeveraging mesos as the ultimate distributed data science platform
Leveraging mesos as the ultimate distributed data science platform
Andy Petrella
 
Data Enthusiasts London: Scalable and Interoperable data services. Applied to...
Data Enthusiasts London: Scalable and Interoperable data services. Applied to...Data Enthusiasts London: Scalable and Interoperable data services. Applied to...
Data Enthusiasts London: Scalable and Interoperable data services. Applied to...
Andy Petrella
 
Spark meetup london share and analyse genomic data at scale with spark, adam...
Spark meetup london  share and analyse genomic data at scale with spark, adam...Spark meetup london  share and analyse genomic data at scale with spark, adam...
Spark meetup london share and analyse genomic data at scale with spark, adam...
Andy Petrella
 
Distributed machine learning 101 using apache spark from the browser
Distributed machine learning 101 using apache spark from the browserDistributed machine learning 101 using apache spark from the browser
Distributed machine learning 101 using apache spark from the browser
Andy Petrella
 
Liège créative: Open Science
Liège créative: Open ScienceLiège créative: Open Science
Liège créative: Open Science
Andy Petrella
 
BioBankCloud: Machine Learning on Genomics + GA4GH @ Med at Scale
BioBankCloud: Machine Learning on Genomics + GA4GH  @ Med at ScaleBioBankCloud: Machine Learning on Genomics + GA4GH  @ Med at Scale
BioBankCloud: Machine Learning on Genomics + GA4GH @ Med at Scale
Andy Petrella
 
What is Distributed Computing, Why we use Apache Spark
What is Distributed Computing, Why we use Apache SparkWhat is Distributed Computing, Why we use Apache Spark
What is Distributed Computing, Why we use Apache Spark
Andy Petrella
 

More from Andy Petrella (20)

Data Observability Best Pracices
Data Observability Best PracicesData Observability Best Pracices
Data Observability Best Pracices
 
How to Build a Global Data Mapping
How to Build a Global Data MappingHow to Build a Global Data Mapping
How to Build a Global Data Mapping
 
Interactive notebooks
Interactive notebooksInteractive notebooks
Interactive notebooks
 
Governance compliance
Governance   complianceGovernance   compliance
Governance compliance
 
Data science governance and GDPR
Data science governance and GDPRData science governance and GDPR
Data science governance and GDPR
 
Data science governance : what and how
Data science governance : what and howData science governance : what and how
Data science governance : what and how
 
Scala: the unpredicted lingua franca for data science
Scala: the unpredicted lingua franca  for data scienceScala: the unpredicted lingua franca  for data science
Scala: the unpredicted lingua franca for data science
 
Agile data science with scala
Agile data science with scalaAgile data science with scala
Agile data science with scala
 
Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...
Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...
Agile data science: Distributed, Interactive, Integrated, Semantic, Micro Ser...
 
What is a distributed data science pipeline. how with apache spark and friends.
What is a distributed data science pipeline. how with apache spark and friends.What is a distributed data science pipeline. how with apache spark and friends.
What is a distributed data science pipeline. how with apache spark and friends.
 
Towards a rebirth of data science (by Data Fellas)
Towards a rebirth of data science (by Data Fellas)Towards a rebirth of data science (by Data Fellas)
Towards a rebirth of data science (by Data Fellas)
 
Distributed machine learning 101 using apache spark from a browser devoxx.b...
Distributed machine learning 101 using apache spark from a browser   devoxx.b...Distributed machine learning 101 using apache spark from a browser   devoxx.b...
Distributed machine learning 101 using apache spark from a browser devoxx.b...
 
Spark Summit Europe: Share and analyse genomic data at scale
Spark Summit Europe: Share and analyse genomic data at scaleSpark Summit Europe: Share and analyse genomic data at scale
Spark Summit Europe: Share and analyse genomic data at scale
 
Leveraging mesos as the ultimate distributed data science platform
Leveraging mesos as the ultimate distributed data science platformLeveraging mesos as the ultimate distributed data science platform
Leveraging mesos as the ultimate distributed data science platform
 
Data Enthusiasts London: Scalable and Interoperable data services. Applied to...
Data Enthusiasts London: Scalable and Interoperable data services. Applied to...Data Enthusiasts London: Scalable and Interoperable data services. Applied to...
Data Enthusiasts London: Scalable and Interoperable data services. Applied to...
 
Spark meetup london share and analyse genomic data at scale with spark, adam...
Spark meetup london  share and analyse genomic data at scale with spark, adam...Spark meetup london  share and analyse genomic data at scale with spark, adam...
Spark meetup london share and analyse genomic data at scale with spark, adam...
 
Distributed machine learning 101 using apache spark from the browser
Distributed machine learning 101 using apache spark from the browserDistributed machine learning 101 using apache spark from the browser
Distributed machine learning 101 using apache spark from the browser
 
Liège créative: Open Science
Liège créative: Open ScienceLiège créative: Open Science
Liège créative: Open Science
 
BioBankCloud: Machine Learning on Genomics + GA4GH @ Med at Scale
BioBankCloud: Machine Learning on Genomics + GA4GH  @ Med at ScaleBioBankCloud: Machine Learning on Genomics + GA4GH  @ Med at Scale
BioBankCloud: Machine Learning on Genomics + GA4GH @ Med at Scale
 
What is Distributed Computing, Why we use Apache Spark
What is Distributed Computing, Why we use Apache SparkWhat is Distributed Computing, Why we use Apache Spark
What is Distributed Computing, Why we use Apache Spark
 

Recently uploaded

Automation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI AutomationAutomation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI Automation
UiPathCommunity
 
Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...
Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...
Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...
manji sharman06
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
AlexanderRichford
 
How to Optimize Call Monitoring: Automate QA and Elevate Customer Experience
How to Optimize Call Monitoring: Automate QA and Elevate Customer ExperienceHow to Optimize Call Monitoring: Automate QA and Elevate Customer Experience
How to Optimize Call Monitoring: Automate QA and Elevate Customer Experience
Aggregage
 
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdfLee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
leebarnesutopia
 
Supplier Sourcing Presentation - Gay De La Cruz.pdf
Supplier Sourcing Presentation - Gay De La Cruz.pdfSupplier Sourcing Presentation - Gay De La Cruz.pdf
Supplier Sourcing Presentation - Gay De La Cruz.pdf
gaydlc2513
 
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
zjhamm304
 
CTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database MigrationCTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database Migration
ScyllaDB
 
The "Zen" of Python Exemplars - OTel Community Day
The "Zen" of Python Exemplars - OTel Community DayThe "Zen" of Python Exemplars - OTel Community Day
The "Zen" of Python Exemplars - OTel Community Day
Paige Cruz
 
Product Listing Optimization Presentation - Gay De La Cruz.pdf
Product Listing Optimization Presentation - Gay De La Cruz.pdfProduct Listing Optimization Presentation - Gay De La Cruz.pdf
Product Listing Optimization Presentation - Gay De La Cruz.pdf
gaydlc2513
 
Chapter 5 - Managing Test Activities V4.0
Chapter 5 - Managing Test Activities V4.0Chapter 5 - Managing Test Activities V4.0
Chapter 5 - Managing Test Activities V4.0
Neeraj Kumar Singh
 
EverHost AI Review: Empowering Websites with Limitless Possibilities through ...
EverHost AI Review: Empowering Websites with Limitless Possibilities through ...EverHost AI Review: Empowering Websites with Limitless Possibilities through ...
EverHost AI Review: Empowering Websites with Limitless Possibilities through ...
SOFTTECHHUB
 
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
anilsa9823
 
ScyllaDB Topology on Raft: An Inside Look
ScyllaDB Topology on Raft: An Inside LookScyllaDB Topology on Raft: An Inside Look
ScyllaDB Topology on Raft: An Inside Look
ScyllaDB
 
Chapter 6 - Test Tools Considerations V4.0
Chapter 6 - Test Tools Considerations V4.0Chapter 6 - Test Tools Considerations V4.0
Chapter 6 - Test Tools Considerations V4.0
Neeraj Kumar Singh
 
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - MydbopsMySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
Mydbops
 
Elasticity vs. State? Exploring Kafka Streams Cassandra State Store
Elasticity vs. State? Exploring Kafka Streams Cassandra State StoreElasticity vs. State? Exploring Kafka Streams Cassandra State Store
Elasticity vs. State? Exploring Kafka Streams Cassandra State Store
ScyllaDB
 
Fuxnet [EN] .pdf
Fuxnet [EN]                                   .pdfFuxnet [EN]                                   .pdf
Fuxnet [EN] .pdf
Overkill Security
 
Chapter 1 - Fundamentals of Testing V4.0
Chapter 1 - Fundamentals of Testing V4.0Chapter 1 - Fundamentals of Testing V4.0
Chapter 1 - Fundamentals of Testing V4.0
Neeraj Kumar Singh
 
APJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes WebinarAPJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes Webinar
ThousandEyes
 

Recently uploaded (20)

Automation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI AutomationAutomation Student Developers Session 3: Introduction to UI Automation
Automation Student Developers Session 3: Introduction to UI Automation
 
Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...
Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...
Call Girls Chandigarh🔥7023059433🔥Agency Profile Escorts in Chandigarh Availab...
 
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
QR Secure: A Hybrid Approach Using Machine Learning and Security Validation F...
 
How to Optimize Call Monitoring: Automate QA and Elevate Customer Experience
How to Optimize Call Monitoring: Automate QA and Elevate Customer ExperienceHow to Optimize Call Monitoring: Automate QA and Elevate Customer Experience
How to Optimize Call Monitoring: Automate QA and Elevate Customer Experience
 
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdfLee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
Lee Barnes - Path to Becoming an Effective Test Automation Engineer.pdf
 
Supplier Sourcing Presentation - Gay De La Cruz.pdf
Supplier Sourcing Presentation - Gay De La Cruz.pdfSupplier Sourcing Presentation - Gay De La Cruz.pdf
Supplier Sourcing Presentation - Gay De La Cruz.pdf
 
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...QA or the Highway - Component Testing: Bridging the gap between frontend appl...
QA or the Highway - Component Testing: Bridging the gap between frontend appl...
 
CTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database MigrationCTO Insights: Steering a High-Stakes Database Migration
CTO Insights: Steering a High-Stakes Database Migration
 
The "Zen" of Python Exemplars - OTel Community Day
The "Zen" of Python Exemplars - OTel Community DayThe "Zen" of Python Exemplars - OTel Community Day
The "Zen" of Python Exemplars - OTel Community Day
 
Product Listing Optimization Presentation - Gay De La Cruz.pdf
Product Listing Optimization Presentation - Gay De La Cruz.pdfProduct Listing Optimization Presentation - Gay De La Cruz.pdf
Product Listing Optimization Presentation - Gay De La Cruz.pdf
 
Chapter 5 - Managing Test Activities V4.0
Chapter 5 - Managing Test Activities V4.0Chapter 5 - Managing Test Activities V4.0
Chapter 5 - Managing Test Activities V4.0
 
EverHost AI Review: Empowering Websites with Limitless Possibilities through ...
EverHost AI Review: Empowering Websites with Limitless Possibilities through ...EverHost AI Review: Empowering Websites with Limitless Possibilities through ...
EverHost AI Review: Empowering Websites with Limitless Possibilities through ...
 
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
Call Girls Chennai ☎️ +91-7426014248 😍 Chennai Call Girl Beauty Girls Chennai...
 
ScyllaDB Topology on Raft: An Inside Look
ScyllaDB Topology on Raft: An Inside LookScyllaDB Topology on Raft: An Inside Look
ScyllaDB Topology on Raft: An Inside Look
 
Chapter 6 - Test Tools Considerations V4.0
Chapter 6 - Test Tools Considerations V4.0Chapter 6 - Test Tools Considerations V4.0
Chapter 6 - Test Tools Considerations V4.0
 
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - MydbopsMySQL InnoDB Storage Engine: Deep Dive - Mydbops
MySQL InnoDB Storage Engine: Deep Dive - Mydbops
 
Elasticity vs. State? Exploring Kafka Streams Cassandra State Store
Elasticity vs. State? Exploring Kafka Streams Cassandra State StoreElasticity vs. State? Exploring Kafka Streams Cassandra State Store
Elasticity vs. State? Exploring Kafka Streams Cassandra State Store
 
Fuxnet [EN] .pdf
Fuxnet [EN]                                   .pdfFuxnet [EN]                                   .pdf
Fuxnet [EN] .pdf
 
Chapter 1 - Fundamentals of Testing V4.0
Chapter 1 - Fundamentals of Testing V4.0Chapter 1 - Fundamentals of Testing V4.0
Chapter 1 - Fundamentals of Testing V4.0
 
APJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes WebinarAPJC Introduction to ThousandEyes Webinar
APJC Introduction to ThousandEyes Webinar
 

Quanti-litative Revolution in GIS

  • 2. @Noootsab Pre-NextLab Licence in Maths, ULg Licence in Computer Sciences, ULg Geospatial specialization, ULg Many years in GIS (Ionic Software and its mutations) Always in data management and semantic New technologies enthusiast NextLab age Project in for the SPW Project in for Virdata Wrote a about Play! 2 evangelist (OKFN, ...), speaker Distributed + Distributed expert co-founder | organizer And the list goes on... and on...
  • 5. Raster vulgus: Big Fat MultiBand Images SPOT (see later) IKONOS (greek: image) LANDSAT ALOS QuickBird: resolution 64cm → 2m44cm Vector vulgus... nah, vector Feature extraction Landmeters (rare) Field surveying ~GPS (GNS)
  • 7. thus, Users were Govs! Oh yeah, researchers as well... huh!? wait! Okay, very feeeew privates
  • 8. in consequence, Analyses were Performed by experimented folks... ... or nerds
  • 9. finally, Tools were... You don't even know them! ESRI, Oracle Spatial, OGC, RedSpider (yeah), ...
  • 10. Qualitative GIS "Started" around 2000 Actually, not really before 2010
  • 11. GIS Revolution Induce theories from data The river has flooded on 3km The river will flood if it rains more than...
  • 12. New producers Google, 4², OSM, GPS old: Mappy, Michelin, ...
  • 13. New Users Devs, Lambda Billioooooons
  • 14. Analyses Routing, Accurate GWR¹, ... Disaster prediction, flood prevention, crash probability, ... ¹Geospatial Weight Regression
  • 15. Tools? User friendly and/or Open Source OSM GeoServer OpenLayers Google Maps
  • 16. Quantilitative GIS Coined by @Noootsab^^
  • 17. WTF?!
  • 18. Rasters today (f.i. Spot7) Red Green Blue + Near Infra Red Bands One shot: 60x60km (3.600 sq km) Takes 3.600.000 sq km of geodata per DAY Resolution 2 satellites at and 2 others at Revolution: 110 minutes 26 days to complete the geoid (all pieces of crap covered) 1 single f*****g file for a 60x60km tile is worth up to
  • 19. Vector (mostly position) everywhere and everytime Twitter, Facebook, ... Foursquare, Instagram Waze Google (in its whole) Connected Devices
  • 20. Presidente Model-Driven Deductive Top-Down Quantitative Lagged Time GIS Putsch Commandante Data-Driven Inductive Bottom-Up Qualitative Real Time Marcelino Data Lake Machine Learning Variety Value Velocity VOLUME? It was there for ages!
  • 21. Who, What, How You thought I was joking, huh!
  • 22. Socrata Evan Chan using Spark Customers have point data (many millions of rows) PostGIS: point-in-polygon and other does Partitioning point data in (tiling, Z-curve) Partitions into for quick analysis Adding to Spark for speeding up
  • 23. Azavea Rob Emanuele on Geotrellis Run of climate data against daily temperature and precipitation data out to 2009 Create suitability maps over high-res raster layers spanning the for Urban Forestry Modeling. GeoTrellis is providing with geospatial capabilities. Ingest, mosaic and pyramid raster data into for fast (sub-500ms) tile fetching
  • 24. Snips Rand Hindi in his Labs Tranquilien: seating availability in public transport RiskContext: Determining the risk of bicycle and car Using technologies that can scale linearly (Akka, Scala) Thanks to the bottom up of the architecture, the clusters keeps crunching data in a resilient manner
  • 25. Done! Thx & cu on Twitter @noootsab @NextLab_be
  翻译: