This course focuses on one of SQL Server 2019’s most impactful features—Big Data Clusters. You will learn about data virtualization and data lakes for this complete artificial intelligence (AI) and machine learning (ML) platform within the SQL Server database engine. You will be shown how to use Big Data Clusters to combine large volumes of streaming data for analysis along with data stored in a traditional database. For instance, you can stream large volumes of data from Apache Spark in real-time while executing Transact-SQL queries to bring in relevant additional data from your corporate, SQL Server database. This course provides everything necessary to get started working with Big Data Clusters in SQL Server 2019. You will learn about the architectural foundations that are made up from Kubernetes, Spark, HDFS, and SQL Server on Linux. You will be shown how to configure and deploy Big Data Clusters.  You will be ready to use and unveil the full potential of SQL Server 2019: combining different types of data spread across widely disparate sources into a single view that is useful for business intelligence and machine learning analysis.

  • What a Big Data Cluster is
  • How to deploy BDC
  • How to analyze large volumes of data directly from SQL Server
  • How to analyze large volumes of data via Apache Spark
  • How to manage data stored in HDFS from SQL Server as if it were relational data
  • How to implement advanced analytics solutions through machine learning
  • How to expose different data sources as a single logical source using data virtualization
This course is intended for data engineers, data scientists, data architects, and database administrators who want to employ data virtualization and big data analytics in their environments.
0
Course Videos
0
Duration (hrs)
0
Test Questions
0
Course Completion Certificate

Module 1: What are Big Data Clusters?

  • 1.1 Introduction
  • 1.2 Linux, PolyBase, and Active Directory
  • 1.3 Scenarios

Module 2: Big Data Cluster Architecture

  • 2.1 Introduction
  • 2.2 Docker
  • 2.3 Kubernetes
  • 2.4 Hadoop and Spark
  • 2.5 Components
  • 2.6 Endpoints

Module 3: Deployment of Big Data Clusters

  • 3.1 Introduction
  • 3.2 Install Prerequisites
  • 3.3 Deploy Kubernetes
  • 3.4 Deploy BDC
  • 3.5 Monitor and Verify Deployment

Module 4: Loading and Querying Data in Big Data Clusters

  • 4.1 Introduction
  • 4.2 HDFS with Curl
  • 4.3 Loading Data with T-SQL
  • 4.4 Virtualizing Data
  • 4.5 Restoring a Database

Module 5: Working with Spark in Big Data Clusters

  • 5.1 Introduction
  • 5.2 What is Spark
  • 5.3 Submitting Spark Jobs
  • 5.4 Running Spark Jobs via Notebooks
  • 5.5 Transforming CSV
  • 5.6 Spark-SQL
  • 5.7 Spark to SQL ETL

Module 6: Machine Learning on Big Data Clusters

  • 6.1 Introduction
  • 6.2 Machine Learning Services
  • 6.3 Using MLeap
  • 6.4 Using Python
  • 6.5 Using R

Module 7: Create and Consume Big Data Cluster Apps

  • 7.1 Introduction
  • 7.2 Deploying, Running, Consuming, and Monitoring an App
  • 7.3 Python Example – Deploy with azdata and Monitoring
  • 7.4 R Example – Deploy with VS Code and Consume with Postman
  • 7.5 MLeap Example – Create a yaml file
  • 7.6 SSIS Example – Implement scheduled execution of a DB backup

Module 8: Maintenance of Big Data Clusters

  • 8.1 Introduction
  • 8.2 Monitoring
  • 8.3 Managing and Automation
  • 8.4 Course Wrap Up