Skip to content

Developed a fault-tolerant pipeline with Airflow to scrape Redfin listings, using Kafka for event-driven ingestion and Spark for real-time processing, ensuring scalable and low-latency housing market analytics.

Notifications You must be signed in to change notification settings

svc98/Real_Estate_Webscrape_Stream

About

Developed a fault-tolerant pipeline with Airflow to scrape Redfin listings, using Kafka for event-driven ingestion and Spark for real-time processing, ensuring scalable and low-latency housing market analytics.

Topics

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published