Learn the best practices for using large data sources, and the software and tools being used to parallelize geospatial tasks!
Course Description
Did you know that you can leverage parallel processing using your desktop computer?
If you are moving into a territory in your GIS career where the amount of data you are using prevents you from doing your job effectively, this course is for you. We'll focus on the best practices for using large data sources and the new offering by Esri and open-source tools to parallelize geospatial tasks. Esri's GeoAnalytics Desktop tools and Postgres/PostGIS provide a parallel processing framework for GIS analysis using your existing PC. Most PCs today have 8 or more processing cores (CPUs). The use of Apache Spark in GeoAnalytics Desktop and the use of worker processes in Postgres turns your desktop PC system into a mini high-performance computing lab. The tools are so well integrated in ArcGIS Pro that they operate in the same way as other geoprocessing tools in ArcGIS. And, while Postgres requires a little more thought, the flexibility it offers provides exceptional speed for handling large data analysis projects.
While parallel processing tools exist, they may be severely ineffective unless you properly utilize the hardware, software, and data on your computer. This class will introduce you not only to the actual features in GeoAnalytics Desktop and Postgres, but also some of the best practices when working with hardware, software, and data. Some of the topics we'll address include:
- hardware considerations for working with large spatial data.
- classes of databases to store large spatial data.
- working with different coordinate systems with large spatial data.
- indexing strategies for improving the speed of database searches.
- formatting GIS data to improve spatial analysis.
You will have an opportunity to not only learn about the theoretical topics of large spatial data analysis, but you'll perform hands-on activities to test the processes yourself. This is the perfect course to get you ready for working with large amounts of spatial and non-spatial data.
As an added bonus, this class will also demonstrate all of the concepts using Manifold GIS. Manifold is a lower-cost GIS software package that is designed for use in a parallel processing environment.
Course curriculum
-
01
-
What the workshop is about
FREE PREVIEW -
Downloads
-
A short demonstration on parallel processing
-
The three V's of data analytics
-
-
02
-
Hardware considerations
-
Local vs. distributed processing
-
-
03
-
Available tools
-
Hands on activity: Overlay in ArcGIS Pro with and without Geoanalytics Desktop
-
Hands on activity: Postgres and PostGIS
-
Hands on activity: Manifold GIS
-
-
04
-
A quick overview of parallel processing with Postgres and PostGIS
-
Overview of important parallel processing definitions in Postgres
-
Walkthrough of fine-tuning Postgres for parallel processing
-
-
05
-
Classes of databases
-
Coordinate Systems
-
Hands on activity: ArcGIS on-the-fly transformation vs. same coordinate system
-
Hands on activity: Postgres on-the-fly transformation vs. same coordinate system
-
Hands on activity: Manifold on-the-fly transformation vs. same coordinate system
-
Αttribute data indexing
-
Hands on activity: ArcGIS Pro search on an indexed field vs. a non-indexed field
-
Hands on activity: Postgres search on an indexed field vs. a non-indexed field
-
Subdividing large polygons to increase efficiency: when more is less
-
Access GeoAnalytics Desktop Tools: the GUI, Model Builder, and Python
-
Access Postgres/PostGIS Parallel Tools: QGIS DB Manager
-
What will you learn?
-
What is parallel processing
-
Hardware considerations for leveraging parallel processing
-
Parallel processing with ArcGIS Pro, Postgres/PostGIS and Manifold GIS
-
Best practices for data preparation
-
What is data indexing
Student Profile?
-
Under/post graduate students
-
Professionals and Companies
-
Master students and PhD candidates
-
Researchers and Academics
About your Instructor
Arthur Lembo
Professor