AWS Glue - The Complete Masterclass

Master building complete AWS Glue ETL Pipelines, Glue Data Quality, Glue Data Brew along with other AWS resources

What you'll learn
Understanding of AWS Glue Data Catalog and creating AWS Glue Database, Glue Tables and Crawlers
Using AWS Glue Studio, creating the ETL pipeline along with scheduled triggers, conditional triggers and glue workflow
KMS, IAM Role, SNS, S3 and other associated AWS resources associated with Glue. Understanding and creation of all the resources
Understanding of AWS Glue Data Quality and creating the associated Glue ETL pipeline
Understanding AWS Glue Data Brew , creating the recipe, project and job to curate the dataset
Understanding the AWS Glue streaming, creating the stream using the Python shell job and load the stream using the Spark streaming
Different ways AWS Glue job can fail and debugging the failure and fix
Creating the AWS resources for AWS Glue Pipeline using the AWS console and cloudformation

Requirements
Understanding of ETL concepts
AWS account to perform all the labs
No cloud experience is required

Description
Learn the latest in AWS Glue - And learn to use it with other AWS resources.

In this growing world of data and growing cloud computing, it is necessary to have the core competency in cloud ETL tool also. AWS Glue come with the in built Spark support, Data Quality and data curation using Data brew. The top technology, finance and insurance companies like JPMC, Vanguard, BCBS, Amazon, Capital One, Capgemini, FINRA and more are all using AWS Glue to run their ETL on PetaBytes scale of data everyday.

AWS Glue provides server less and scalable ETL solution where scripts can be written in Python, Spark and currently using Ray. It also provides the visual drag and drop options to create the ETL pipelines. As now more and more companies are migrating to cloud it has caused an explosion in demand for this skill! With the mastery of AWS Glue, you now have the ability to quickly become one of the most knowledgeable people in the job market!

This course will teach the basics in AWS Glue Data Catalog, AWS Glue Studio, AWS resources such as IAM, SNS, KMS, CloudFormation, CloudWatch and continuing on to learning how to use AWS Glue to build ETL solution for the organization! Once we've done that we'll go through how to use the Glue Data Quality, Glue Streaming and Glue Data Brew ETL pipelines. All along the way you'll have multiple labs to create all the resources and ETL pipelines using AWS console and CloudFormation templates that you put you right into a real world situation where you need to use your new skills to solve a real problem!

If you're ready to jump into the data engineering world of AWS Glue, this is the course for you!



Who this course is for:
Data Engineer, ETL Developer, Data warehouse developer or BI Develper who is moving from on premised to AWS cloud for ETL
Data Scientists who want to understand the Glue ETL concepts and curate the data
Software Development Engineer who wants to do ETL in the AWS cloud