Course Description

Welcome to Web Scraping and Mapping Dam Levels in Python. In this course you will be exposed to multiple technologies, and topics such as: Web Scraping ETL, Python Django Programming, Web Mapping, and Data Visualization. You will combine each of these topics and technologies to create an end-to-end GIS web application.
Start building a web GIS application now!

What will you learn?

  • You will learn how to apply web scraping to collect dam level data from a website.

  • You will then build a model, that you will use to plot the dam level data on a map using leaflet.

  • You will learn how to use the Django Template Engine instead of Ajax, to pass data from the back-end to the front-end.

  • You will learn how to build a spatial database using PostgreSQL.

  • You will also learn how to build a small dashboard that floats over your map, which will contain graphs that will visualize your model.

GEO Premium

Access our ENTIRE content. Not just courses. We provide you with courses, tools and data to start learning and advance your skills.

Learn More

Course curriculum

  • 01

    Introduction

  • 02

    Building a Spatial Database

    • Lesson 2: Installing PostgreSQL and PostGIS

    • Lesson 3: Creating the Database
  • 03

    Creating a Django Python Application

    • Lesson 4: Installing Django in a Python virtual environment

    • Lesson 5: Installing the ATOM IDE
  • 04

    Writing the Django Server-side code

    • Lesson 6: Creating the Django Base Project

    • Lesson 7: Adding the Database Configuration to settings.py file

    • Lesson 8: Creating a Model in models.py
  • 05

    Web Scraping and ETL

    • Lesson 9: Extracting Data from the Web

    • Lesson 10: Cleaning and Transforming the Data Part 1

    • Lesson 11: Cleaning and Transforming the Data Part 2

    • Lesson 12: Loading the Data into the Model
  • 06

    Building the Django Front-end

    • Lesson 13: Adding the Web Tile Service Link in settings.py

    • Lesson 14: Reading from the Model and Creating a GeoJSON Dataset

    • Lesson 15: Adding Template Files the HTML files

    • Lesson 16: Adding a Layout and the Base Map
  • 07

    Data Visualization

    • Lesson 17: Plotting Circle Markers

    • Lesson 18: Creating a Sliding Sidebar

    • Lesson 19: Creating a Doughnut Chart

    • Lesson 20: Creating a Multi-Bar Bar Chart

    • Lesson 21: Creating a KPI

Pricing

About your Instructor

Data Engineer and business intelligence consultant with an academic background in Bsc computer science and around 5 years of experience in IT. Involved in multiple projects ranging from Business Intelligence, Software Engineering, IoT and Big data analytics. Expertise are in building data processing pipelines in the Hadoop and Cloud ecosystems and software development. My career started as an embedded software engineer writing firmware for integrated microchips, then moved on as an ERDAS APOLLO developer at geo data design a hexagon geospatial partner. Am now a consultant at one of the top business intelligence consultancies helping clients build data warehouses, data lakes, cloud data processing pipelines and machine learning pipelines. The technologies I use to accomplish client requirements range from Hadoop, Amazon S3, Python, Django, Apache Spark, MSBI, Microsoft Azure, SQL Server Data Tools, Talend and Elastic MapReduce.

Edwin Bomela

Data Engineer and business intelligence consultant

Some more information

  • Certificates of Completion

    After you successfully finish the course, you can claim your Certificate of Completion with NO extra cost! You can add it to your CV, LinkedIn profile etc

  • Available at any time! Study at your best time

    We know hard it is to acquire new skills. All our courses are self paced.

  • Online and always accessible

    Even when you finish the course and you get your certificate, you will still have access to course contents! Every time an Instructor makes an update you will be notified and be able to watch it for FREE