Microsoft Azure Data Engineering (DP-203) – 2 Design and Develop Data Processing

MP4 | Video: h264, 1280×720 | Audio: AAC, 44.1 KHz, 2 Ch
Skill Level: Intermediate | Genre: eLearning | Language: English + srt | Duration: 46m | Size: 110 MB
Are you preparing for the Microsoft Azure Data Engineering (DP-203) exam, or seeking a better understanding of how to design and develop data processing? This course, the second in a series, can help you. Noah Gift, founder of Pragmatic A.I. Labs and a Python Software Foundation Fellow, covers how to design and develop data processing with Azure. Noah shows you how to use Apache Spark, Data Factory, and Databricks to ingest and transform data in Azure. He goes over data cleaning and common data transformation tasks, then dives into batch processing solutions. After explaining how to integrate Jupyter/Python notebooks into your data pipeline, Noah discusses stream processing, the differences between stream and batch processing, and using the Azure Data Factory solution to manage your batches and pipelines.