Skip to main content

Data Pipelines and Stream Processing

Real-time data management



MSDS 442-DL Data Pipelines and Stream Processing.

This application engineering and analytics course introduces stream processing and the end-to-end data pipeline. Real-time data sources include electronic monitoring of continuous processes, observing digital communications and social interaction, and tracing the movement of goods through production lines, warehouses, and distribution channels. The course demonstrates a stream-processing technology stack designed for high throughput and low latency. Students analyze business transactions and processes, event logs, workflows, and consumer behavior. They learn about operations, logistics, and supply chain management. This is a case study and project-based course with a strong programming component. Prerequisites: (1) MSDS 420-DL Database Systems or CIS 417 Database Systems Design and Implementation and (2) MSDS 422-DL Practical Machine Learning or CIS 435 Practical Data Science Using Machine Learning.

Back to main page for Data Engineering.