Descriptions
Spark Streaming – Stream Processing in Lakehouse – PySpark, Master Spark Structured Streaming using Python (PySpark) on Azure Databricks Cloud with a comprehensive, end-to-end project. In this hands-on course, you will learn real-time stream processing concepts, Spark Structured Streaming APIs, architecture, and integrating streaming sources and sinks like Apache Kafka and Delta Lake.
Throughout the course, you will explore stateless and stateful transformations, windowing aggregates, watermarking, state cleanup, and streaming joins. You will also gain practical experience with Azure Databricks, Unity Catalog, and CI/CD pipelines, concluding with a capstone project building a production-ready streaming application in a Medallion Lakehouse architecture.
What you’ll learn
- Real-time Stream Processing Concepts
- Spark Structured Streaming APIs and Architecture
- Working with Streaming Sources and Sinks
- Kafka for Data Engineers
- Working With Kafka Source and Integrating Spark with Kafka
- State-less and State-full Streaming Transformations
- Windowing Aggregates using Spark Stream
- Watermarking and State Cleanup
- Streaming Joins and Aggregation
- Handling Memory Problems with Streaming Joins
- Working with Azure Databricks
- Capstone Project – Streaming application in Lakehouse
Who this course is for
- Software Engineers and Architects who are willing to design and develop Big Data Engineering Projects using Apache Spark and Databricks Cloud
- Programmers and developers who are aspiring to grow and learn Data Engineering using Apache Spark and Databricks Cloud
Specificatoin of Spark Streaming – Stream Processing in Lakehouse – PySpark
- Publisher : Udemy
- Teacher : Prashant Kumar Pandey , Learning Journal
- Language : English
- Level : Intermediate
- Number of Course : 108
- Duration : 22 hours and 23 minutes
Content of Spark Streaming – Stream Processing in Lakehouse – PySpark
Requirements
- Spark Fundamentals and exposure to Spark Dataframe APIs
- Programming Knowledge Using Python Programming Language
Pictures
Sample Clip
Installation Guide
Extract the files and watch with your favorite player
Subtitle : English
Quality: 720
Download Links
Password file(s): www.downloadly.ir
File size
12.15 GB