Learning how to build event streaming solutions with Microsoft Azure Event Hubs, Microsoft Fabric Event Streams, and any Apache Kafka compatible server and service is more interesting when you have real time data sources to work with.
This repo contains command line tools, written in Python, that can be used to retrieve real-time streaming data and related reference data from various APIs, and then routing the data to Apache Kafka compatible endpoints.
For each tool, there is a corresponding, pre-built (Docker-) container image
that you can pull and use instantly from this repo's container registry. There
are also pre-built templates for easily deploying the containers as an Azure
Container Instance (ACI), either feeding data into an Azure Event Hub or an
Fabric Event Stream custom endpoint. The container images will work with any
Apache Kafka compatible server or service, as long as you provide required
information. The supported authentication scheme for the Kafka endpoint is
SASL/PLAIN.
The sources are organized by domain below. Each entry links to the container documentation, and the README in each project directory has full details. There are 87 containers in total.
| Source | Coverage | README | Container | Build |
|---|---|---|---|---|
| BAFU Hydro | Switzerland (~300 stations, FOEN) | 📖 | 🐳 | |
| Canada ECCC Water Office | Canada (~2,100 hydrometric stations, WSC) | 📖 | 🐳 | |
| CDEC Reservoirs | California (~2,600 stations, DWR) | 📖 | 🐳 | |
| CHMI Hydro | Czech Republic (CHMU) | 📖 | 🐳 | |
| German Waters | Germany (12 state portals, ~2,724 stations) | 📖 | 🐳 | |
| Hub’Eau Hydrometrie | France (~6,300 stations) | 📖 | 🐳 | |
| IMGW Hydro | Poland (IMGW-PIB) | 📖 | 🐳 | |
| Ireland OPW Water Level | Ireland (~500 OPW hydrometric stations) | 📖 | 🐳 | |
| Nepal BIPAD Hydrology | Nepal (Himalayan river basins, BIPAD) | 📖 | 🐳 | |
| NOAA Tides and Currents | United States (~3,000 stations) | 📖 | 🐳 |  |
| NOAA NDBC | United States (buoy observations) | 📖 | 🐳 | |
| King County Marine | Washington State / Puget Sound (current raw buoy and mooring telemetry) | 📖 | 🐳 | |
| NVE Hydro | Norway (NVE) | 📖 | 🐳 | |
| Pegelonline | Germany (federal waterways, ~3,000 stations) | 📖 | 🐳 |  |
| RWS Waterwebservices | Netherlands (~785 stations) | 📖 | 🐳 | |
| SMHI Hydro | Sweden (SMHI) | 📖 | 🐳 | |
| SNOTEL Snow | Western US & Alaska (~900 snowpack stations, NRCS) | 📖 | 🐳 | |
| SYKE Hydro | Finland (SYKE) | 📖 | 🐳 | |
| UK EA Flood Monitoring | England (~4,000 stations) | 📖 | 🐳 | |
| USGS Instantaneous Values | United States (~1.5M stations) | 📖 | 🐳 |  |
| USGS NWIS Water Quality | United States (~3,000 sites, continuous WQ sensors) | 📖 | 🐳 | |
| Waterinfo VMM | Belgium / Flanders (~1,785 stations) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| AviationWeather.gov | Global (METAR, SIGMET advisories) | 📖 | 🐳 | |
|
| Blitzortung | Global (community lightning strokes, seconds latency) | 📖 | 🐳 | |
|
| BOM Australia | Australia (~8 capital city airports, half-hourly obs) | 📖 | 🐳 | |
|
| DWD | Germany (~1,450 stations, observations and CAP alerts) | 📖 | 🐳 | |
|
| DWD Pollenflug | Germany (daily pollen forecasts, 27 regions) | 📖 | 🐳 | |
|
| Environment Canada | Canada (~963 SWOB stations, hourly obs) | 📖 | 🐳 | |
|
| GeoSphere Austria | Austria (~280 TAWES stations, 10-min obs) | 📖 | 🐳 | |
|
| HKO Hong Kong | Hong Kong (27 temp stations, 18 rainfall districts) | 📖 | 🐳 | |
|
| JMA Japan | Japan (weather bulletins, warnings, forecasts) | 📖 | 🐳 | |
|
| Meteoalarm | Europe (37 countries, severe weather warnings) | 📖 | 🐳 | |
|
| NOAA NWS | United States (weather alerts, CAP) | 📖 | 🐳 | |
|
| NWS Forecast Zones | United States (configurable land and marine forecast zones; Puget Sound defaults) | 📖 | 🐳 | |
|
| NWS CAP Alerts | United States (active alerts via api.weather.gov) | 📖 | 🐳 | |
|
| NOAA GOES / SWPC | Global (space weather, solar wind, K-index) | 📖 | 🐳 | |
|
| Singapore NEA | Singapore (62 weather stations + 5 air-quality regions) | 📖 | 🐳 | |
|
| SMHI Weather | Sweden (~232 stations, hourly obs) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build |
|---|---|---|---|---|
| Canada AQHI | Canada (community AQHI observations and forecasts) | 📖 | 🐳 | |
| Defra AURN | United Kingdom (300+ monitoring locations, hourly pollutants) | 📖 | 🐳 | |
| FMI Finland | Finland (hourly air quality observations via FMI WFS) | 📖 | 🐳 | |
| GIOŚ Poland | Poland (~250 stations, hourly pollutants + AQI) | 📖 | 🐳 | |
| Hong Kong EPD AQHI | Hong Kong (18 AQHI stations, hourly health index readings) | 📖 | 🐳 | |
| IRCELINE Belgium | Belgium (station, timeseries, and hourly observations) | 📖 | 🐳 | |
| LAQN London | London, UK (site metadata, species, hourly measurements, Daily AQI) | 📖 | 🐳 | |
| Luchtmeetnet Netherlands | Netherlands (station measurements, components, and LKI index) | 📖 | 🐳 | |
| EPA UV Index | United States (city-scoped hourly and daily UV forecasts) | 📖 | 🐳 | |
| Sensor.Community | Global (citizen air sensors, PM and climate readings) | 📖 | 🐳 | |
| Singapore NEA Air Quality | Singapore (regional PSI and PM2.5 readings) | 📖 | 🐳 | |
| UBA AirData | Germany (stations, pollutant components, hourly measures) | 📖 | 🐳 | |
| Wallonia ISSeP | Belgium / Wallonia (low-cost air quality sensors) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build |
|---|---|---|---|---|
| Australian Wildfires | Australia (NSW, QLD, VIC bushfire incidents) | 📖 | 🐳 | |
| EAWS ALBINA Avalanche | European Alps (daily avalanche bulletins, CAAMLv6) | 📖 | 🐳 | |
| GDACS | Global (earthquakes, floods, cyclones, volcanoes, droughts) | 📖 | 🐳 | |
| INPE DETER Brazil | Brazil (Amazon & Cerrado deforestation alerts) | 📖 | 🐳 | |
| NIFC USA Wildfires | United States (active wildfire incidents, NIFC) | 📖 | 🐳 | |
| NINA/BBK | Germany (MOWAS, KATWARN, BIWAPP, DWD, LHP, Police) | 📖 | 🐳 | |
| PTWC Tsunami | Pacific and Atlantic (NOAA tsunami bulletins) | 📖 | 🐳 | |
| Seattle Fire 911 | Seattle, Washington (real-time fire dispatch incidents) | 📖 | 🐳 | |
| USGS Earthquakes | Global (seismic events) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| BfS ODL | Germany (~1,700 stations, hourly gamma dose rate) | 📖 | 🐳 | |
|
| EURDEP Radiation | Europe (~5,500 stations, 39 countries, gamma dose) | 📖 | 🐳 | |
|
| USGS Geomagnetism | United States (14 observatories, 1-min geomagnetic field) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| AISStream | Global (AIS via WebSocket, ~200 km from shore) | 📖 | 🐳 | |
|
| Digitraffic Maritime | Finland / Baltic Sea (AIS via MQTT) | 📖 | 🐳 | |
|
| Kystverket AIS | Norway / Svalbard (raw TCP AIS, ~34 msg/s) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| Mode-S | Local (ADS-B via dump1090 receivers) | 📖 | 🐳 | |
|
| VATSIM | Global (virtual aviation network, pilots & controllers) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| Autobahn | Germany (roadworks, warnings, closures, webcams) | 📖 | 🐳 | |
|
| Digitraffic Road | Finland (TMS sensors, road weather, traffic messages) | 📖 | 🐳 | |
|
| French Road Traffic | France (national road network, DATEX II) | 📖 | 🐳 | |
|
| GTFS Realtime | Global (1,000+ transit agencies, vehicles, trips, alerts) | 📖 | 🐳 |  |
|
| Madrid Traffic | Madrid, Spain (~4,000 sensors, Informo) | 📖 | 🐳 | |
|
| NDW Netherlands Traffic | Netherlands (national road traffic, DATEX II) | 📖 | 🐳 | |
|
| NDW Road Traffic | Netherlands (speed, travel time, DRIP, MSI, situations, DATEX II v3) | 📖 | 🐳 | |
|
| Nextbus | North America (public transit arrivals) | 📖 | — | — | |
| Paris Bicycle Counters | Paris (~141 counting stations, hourly counts) | 📖 | 🐳 | |
|
| Seattle Street Closures | Seattle, Washington (permit-driven street closure windows) | 📖 | 🐳 | |
|
| US CBP Border Wait | US-Canada & US-Mexico borders (~81 ports of entry) | 📖 | 🐳 | |
|
| WSDOT | Washington State (~1,000 traffic flow sensors, LOS readings) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| Entur Norway | Norway (national real-time transit, SIRI ET/VM/SX) | 📖 | 🐳 | |
|
| iRail | Belgium (~600 NMBS/SNCB stations, departures, delays) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build |
|---|---|---|---|---|
| Xceed | Europe (clubs, bars, parties, festivals — event schedules and ticket-state signals) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| Carbon Intensity UK | United Kingdom (national grid carbon intensity) | 📖 | 🐳 | |
|
| Elexon BMRS | Great Britain (electricity market, generation, demand) | 📖 | 🐳 | |
|
| Energi Data Service | Denmark (power system, spot prices, CO₂) | 📖 | 🐳 | |
|
| Energy-Charts | Europe (40+ countries, electricity generation & prices) | 📖 | 🐳 | |
|
| ENTSO-E | Europe (electricity generation, prices, load, flows) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| Bluesky Firehose | Global (posts, likes, reposts, follows) | 📖 | 🐳 |  |
|
| OpenStreetMap Diffs | Global (OSM minutely replication diffs) | 📖 | 🐳 | |
|
| RSS Feeds | Any (configurable RSS/Atom feed URLs or OPML files) | 📖 | 🐳 |  |
|
| Wikimedia EventStreams | Global (Wikipedia, Wikidata, Commons recent changes) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build |
|---|---|---|---|---|
| Billetto | Europe (DK, GB, DE, SE, NO, FI, BE, AT, IE – ticketed events) | 📖 | 🐳 | |
| Ticketmaster | Global (concerts, sports, theater, arts, and other live public events) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| GraceDB | Global (LIGO/Virgo/KAGRA gravitational wave candidates) | 📖 | 🐳 | |
| Source | Coverage | README | Container | Build | Deploy |
|---|---|---|---|---|---|
| Fienta | Europe (ticketed public events with sale-status signals) | 📖 | 🐳 | |
Projects with checked-in xreg manifests regenerate their producer clients with
xrcg generate. Use xrcg 0.10.1; the checked-in producer output and the
key-aware Kafka producer behavior now relied on by the repo are generated with
that version. Each project’s generate_producer.ps1 script uses the checked-in
manifest as the source of truth, validates the xrcg version up front, and
refreshes the generated client package from that definition.
Detailed descriptions of each data source, its API, update frequency, and configuration options are in the per-project README files linked in the tables above.
BAFU Hydro -- Swiss Federal Office for the Environment (BAFU/FOEN) hydrological monitoring network. Forwards water level, discharge, and temperature observations from approximately 300 stations.
Canada ECCC Water Office -- Environment and Climate Change Canada (ECCC) Water Survey of Canada. Real-time water level and discharge from approximately 2,100 hydrometric stations across all Canadian provinces and territories, updated every 5 minutes via OGC API Features.
CDEC Reservoirs -- California Data Exchange Center (CDEC). Real-time reservoir storage, elevation, inflow, and outflow from over 2,600 stations operated by the Department of Water Resources.
CHMI Hydro -- Czech Hydrometeorological Institute. Real-time water level, discharge, and temperature. Polled every 10 minutes.
German Waters -- Aggregates water level and discharge data from 12 German state open data portals (~2,724 stations). Polled every 15 minutes.
Hub’Eau Hydrometrie -- French Hub’Eau Hydrométrie API, covering ~6,300 stations across France.
IMGW Hydro -- Polish Institute of Meteorology and Water Management (IMGW-PIB). Polled every 10 minutes.
Ireland OPW Water Level -- Ireland Office of Public Works (OPW) hydrometric stations via waterlevel.ie. Real-time water level, temperature, and voltage data. Polled every 15 minutes.
Nepal BIPAD Hydrology -- Nepal BIPAD Portal river monitoring network. Real-time water level data from Himalayan river basins. Polled every 10 minutes.
NOAA Tides and Currents -- NOAA NOS water level and current data for over 3,000 US stations. Updated every 6 minutes.
NOAA NDBC -- National Data Buoy Center buoy observations across the United States. Polled every 5 minutes.
King County Marine -- Current raw buoy and mooring telemetry from King County marine monitoring datasets. Emits station reference events plus normalized water-quality readings for the active marine datasets.
NVE Hydro -- Norwegian Water Resources and Energy Directorate (NVE). Water level and discharge observations. Requires a free API key.
Pegelonline -- German Federal Waterways and Shipping Administration (WSV). Over 3,000 stations, updated every 15 minutes.
RWS Waterwebservices -- Dutch Rijkswaterstaat water level data from ~785 stations. Polled every 10 minutes.
SMHI Hydro -- Swedish Meteorological and Hydrological Institute (SMHI). Discharge data for hundreds of stations. Polled every 15 minutes.
SNOTEL Snow -- USDA NRCS SNOTEL (SNOwpack TELemetry) network. Hourly snow water equivalent, snow depth, temperature, and precipitation from over 900 sites in the western US and Alaska.
SYKE Hydro -- Finnish Environment Institute (SYKE). Water level and discharge observations.
UK EA Flood Monitoring -- UK Environment Agency. ~4,000 stations across England. Polled every 15 minutes.
USGS Instantaneous Values -- USGS water quality and quantity data for over 1.5 million US stations. Updated every 15 minutes.
USGS NWIS Water Quality -- USGS National Water Information System continuous water quality sensors. Dissolved oxygen, pH, temperature, conductance, turbidity, and nitrate from over 3,000 monitoring sites.
Waterinfo VMM -- Belgian Waterinfo.be KIWIS API, ~1,785 stations across Flanders. Polled every 15 minutes.
AviationWeather.gov -- NOAA Aviation Weather Center. METAR observations, SIGMET advisories, and station reference data from aviationweather.gov. Polled every 5 minutes.
Blitzortung -- Public LightningMaps / Blitzortung live websocket feed with global lightning strokes, typically delivered within seconds of occurrence.
BOM Australia -- Australian Bureau of Meteorology. Half-hourly weather observations from capital city airports: temperature, wind, pressure, humidity, rainfall, cloud cover, visibility.
DWD -- German Weather Service. ~1,450 stations with 10-minute observations (temperature, precipitation, wind) plus CAP weather alerts.
DWD Pollenflug -- Deutscher Wetterdienst pollen forecasts for 27 German regions. Daily forecasts with today/tomorrow/day-after-tomorrow danger levels for 8 pollen types.
Environment Canada -- Environment and Climate Change Canada (ECCC). ~963 SWOB stations via OGC API with hourly temperature, humidity, dew point, pressure, wind, and precipitation.
GeoSphere Austria -- GeoSphere Austria (formerly ZAMG) TAWES automatic weather stations. 10-minute observations including temperature, humidity, wind, pressure, precipitation, and sunshine duration from approximately 280 stations.
HKO Hong Kong -- Hong Kong Observatory. 27 temperature stations, 18 rainfall districts, humidity, and UV index. Updated hourly.
JMA Japan -- Japan Meteorological Agency weather bulletins. Forecasts, warnings, advisories, and risk notifications from the JMA Atom XML feeds.
Meteoalarm -- EUMETNET Meteoalarm. Severe weather warnings aggregated from 37 European national meteorological services.
NOAA NWS -- National Weather Service active weather alerts across the United States. Polled every 60 seconds.
NWS CAP Alerts -- US National Weather Service active alerts via the api.weather.gov GeoJSON endpoint with SAME/UGC geocodes and VTEC codes.
NOAA GOES / SWPC -- NOAA Space Weather Prediction Center. Space weather alerts, planetary K-index, and solar wind data. Polled every 60 seconds.
Singapore NEA -- National Environment Agency of Singapore. 62 weather stations with temperature, rainfall, wind speed, wind direction, 2-hour area forecasts, and regional PSI/PM2.5 air-quality readings.
SMHI Weather -- Swedish Meteorological and Hydrological Institute (SMHI). ~232 stations with hourly temperature, wind gust, dew point, pressure, humidity, and precipitation.
Canada AQHI -- Environment and Climate Change Canada. Community-keyed AQHI reference data, current observations, and public forecast periods across all provinces and territories.
Defra AURN -- UK Defra Automatic Urban and Rural Network. Station reference data, pollutant timeseries metadata, and hourly observations from the public SOS API.
FMI Finland -- Finnish Meteorological Institute air-quality WFS feed. Station reference records plus hourly aggregated pollutant and AQI observations.
GIOŚ Poland -- Polish Chief Inspectorate of Environmental Protection (GIOŚ). Station and sensor reference data, hourly pollutant measurements, and air quality index values from approximately 250 monitoring stations.
Hong Kong EPD AQHI -- Hong Kong Environmental Protection Department AQHI feed. Station reference events and the latest AQHI reading per station from the public 24-hour XML feed.
IRCELINE Belgium -- Belgian IRCELINE SOS API. Station metadata, pollutant timeseries metadata, and hourly observations with BelAQI context on the timeseries records.
LAQN London -- King’s College London LAQN API. Monitoring sites, pollutant species metadata, hourly measurements, and Daily Air Quality Index bulletin records for London.
Luchtmeetnet Netherlands -- Dutch Luchtmeetnet open API. Station and component reference data, hourly station measurements, and Dutch LKI air-quality-index readings.
EPA UV Index -- United States EPA Envirofacts UV forecast service. Location-keyed hourly and daily UV forecast events for configured city/state pairs.
Sensor.Community -- Sensor.Community public JSON sensor feeds. Sensor reference metadata plus particulate and climate sensor readings from the community network worldwide.
Singapore NEA Air Quality -- The Singapore NEA bridge also publishes regional air-quality reference data, PSI readings, and PM2.5 readings alongside the existing weather feed.
UBA AirData -- German Umweltbundesamt air-data API. Station reference records, pollutant component catalog events, and hourly measurements from the federal monitoring network.
Wallonia ISSeP -- Wallonia ISSeP (Institut Scientifique de Service Public) low-cost air quality sensor network across Wallonia, Belgium. Sensor reference data and near-real-time observations.
Australian Wildfires -- Aggregated bushfire incident data from NSW Rural Fire Service, Queensland Fire and Emergency Services, and Victoria’s Country Fire Authority. Normalized fire incident events.
EAWS ALBINA Avalanche -- European Avalanche Warning Services (EAWS) ALBINA system. Daily avalanche danger bulletins in CAAMLv6 standard for the European Alps (Tirol, South Tyrol, Trentino). Five danger levels with aspect/elevation detail.
GDACS -- Global Disaster Alert and Coordination System. Earthquake, tropical cyclone, flood, volcano, flash flood, and drought alerts from the GDACS RSS feed.
INPE DETER Brazil -- INPE TerraBrasilis DETER real-time deforestation detection system. Deforestation alerts for the Amazon and Cerrado biomes with area, coordinates, and satellite data.
NIFC USA Wildfires -- National Interagency Fire Center (NIFC) active wildfire incident data from the ArcGIS Feature Service. Incident name, location, acres burned, containment percentage, and discovery date.
NINA/BBK -- German Federal Office of Civil Protection (BBK) NINA warning system. Aggregates warnings from six providers: MOWAS (federal), KATWARN, BIWAPP, DWD, LHP (flood centers), and Police.
PTWC Tsunami -- NOAA National Tsunami Warning Center (NTWC) and Pacific Tsunami Warning Center (PTWC). Tsunami bulletins from two Atom XML feeds covering the Pacific, Atlantic, and Caribbean.
Seattle Fire 911 -- Seattle Open Data real-time Fire 911 calls feed. Incident-keyed dispatch events with address and published coordinates.
USGS Earthquakes -- Real-time earthquake events from the USGS GeoJSON feeds with deduplication. Polled every 60 seconds.
BfS ODL -- German Federal Office for Radiation Protection (BfS) ODL ambient gamma dose rate monitoring network. Approximately 1,700 stationary probes measuring hourly averaged gamma dose rates in µSv/h, with cosmic and terrestrial decomposition. Open WFS data interface, no auth. Polled hourly.
EURDEP Radiation -- European Radiological Data Exchange Platform (EURDEP). Ambient gamma dose rate monitoring from approximately 5,500 stations across 39 European countries. Hourly averages in µSv/h.
USGS Geomagnetism -- USGS Geomagnetism Program. 1-minute geomagnetic field variation data (H, D, Z, F components) from 14 US observatories.
AISStream -- AISStream.io WebSocket API. Real-time AIS vessel tracking from ships worldwide (~200 km from shore). Publishes 23 AIS message types. Requires API key. The free service can be unreliable.
Digitraffic Maritime -- Finland’s Digitraffic Marine MQTT stream. AIS vessel positions and metadata from the Finnish coastal zone and Baltic Sea. ~35 messages/second. Open data (CC 4.0 BY).
Kystverket AIS -- Norwegian Coastal Administration raw TCP AIS stream. NMEA sentences from 50+ stations covering the Norwegian economic zone, Svalbard, and Jan Mayen. ~34 messages/second (~2.9M/day).
Mode-S -- ADS-B aircraft position and telemetry data from dump1090 receivers. Polled every 60 seconds.
VATSIM -- VATSIM virtual aviation network live data feed. Pilot positions, controller positions, ATIS, pre-files, and network status from the VATSIM v3 JSON feed.
Autobahn -- German Autobahn API. Roadworks, warnings, closures, parking areas, charging stations, and webcams. Uses ETags and local state to detect changes.
Digitraffic Road -- Finland’s Digitraffic Road MQTT stream. TMS sensor readings (vehicle counts and speeds from 500+ stations), road weather measurements (350+ stations), traffic messages, and maintenance vehicle tracking. Open data (CC 4.0 BY).
French Road Traffic -- French national road traffic data via DATEX II from Bison Futé (tipi.bison-fute.gouv.fr). Traffic flow measurements (~1,000 sites with vehicle counts and speeds) and road events (~300 situations including accidents, roadworks, and restrictions). Polled every 6 minutes.
GTFS Realtime -- GTFS and GTFS-RT data from 1,000+ public transport agencies worldwide. Vehicle positions, trip updates, and alerts. MTA feeds alone produce over 50 GB/day.
Madrid Traffic -- Madrid Informo traffic sensor API. Real-time readings from approximately 4,000 sensors across Madrid’s road network including the M-30 ring motorway. Updated every 5 minutes.
NDW Netherlands Traffic -- Dutch NDW (Nationaal Dataportaal Wegverkeer) DATEX II traffic data. Speed, travel time, and traffic situations from the national road network.
Nextbus -- Public transit arrivals from the Nextbus service.
Paris Bicycle Counters -- Paris Open Data bicycle counting stations. Hourly bicycle counts from 141 permanent counting stations across Paris with counter location reference data.
Seattle Street Closures -- Seattle Open Data street closure schedule feed. Permit-keyed closure windows with street segments, dates, and serialized geometry snapshots.
US CBP Border Wait -- US Customs and Border Protection border wait times. Real-time delay data for approximately 81 land border ports of entry along the US-Canada and US-Mexico borders.
WSDOT -- Washington State DOT traffic flow data from approximately 1,000 inductive loop sensors across five regions. Level of Service readings updated every 90 seconds. Requires a free API access code.
iRail -- Belgian railway real-time data from the iRail API. Station metadata and departure boards for approximately 600 NMBS/SNCB stations, including delays, platform assignments, cancellations, and occupancy. No authentication. Rate-limited to 3 requests/second; full cycle ~3–4 minutes.
Xceed -- Xceed Open Event API. European nightlife and
live-entertainment events including clubs, bars, parties, and festivals. Emits
event reference data (schedule, venue, cover image) and admission telemetry
(per-tier ticket-availability signals including isSoldOut and isSalesClosed).
No authentication required. Polled every 5 minutes by default.
Carbon Intensity UK -- National Grid ESO Carbon Intensity API. National carbon intensity (gCO₂/kWh forecast and actual) and fuel-mix generation percentages for 10 fuel types. Polled every 30 minutes.
Elexon BMRS -- Elexon Balancing Mechanism Reporting Service. GB electricity generation mix, demand outturn, system frequency, and interconnector flows. Settlement-period-keyed data from the BMRS API.
Energi Data Service -- Energinet Energi Data Service. Danish power system snapshots (CO₂, solar, wind, exchange flows) and day-ahead spot prices per bidding zone.
Energy-Charts -- Fraunhofer ISE Energy-Charts API. Electricity generation, prices, and grid carbon signals for 40+ European countries. CC BY 4.0 open data.
ENTSO-E -- European electricity market data from the ENTSO-E Transparency Platform. Generation output, day-ahead prices, load, forecasts, installed capacity, reservoir filling, and cross-border flows.
Bluesky Firehose -- Bluesky AT Protocol firehose. Posts, likes, reposts, follows, blocks, and profile updates. Supports selective filtering and cursor management for resumable streaming.
OpenStreetMap Diffs -- OpenStreetMap minutely replication diffs. Every node, way, and relation create/modify/delete from the OSM replication feed as individual CloudEvents.
RSS Feeds -- Configurable RSS/Atom feed poller. Supports feed URLs or OPML files. Only forwards new items.
Wikimedia EventStreams -- Wikimedia’s public recentchange stream for edits, page creations, and log actions across Wikipedia, Wikidata, Commons, and sister projects.
Billetto -- Billetto pan-European event-discovery platform. Polls the public events API for new and updated ticketed events across Denmark, the United Kingdom, Germany, Sweden, Norway, Finland, Belgium, Austria, and Ireland. Emits event schedule, venue, organizer, pricing, and ticket availability as CloudEvents keyed by stable Billetto event ID.
GraceDB -- LIGO/Virgo/KAGRA GraceDB gravitational wave candidate event database. Superevent alerts including chirp mass, false alarm rate, classification probabilities, and sky localization data.
Fienta -- European public event ticketing platform
(Estonia, Latvia, Lithuania, and other European markets). Emits full event
reference data including name, location, organizer, and schedule, plus
sale-status change telemetry (onSale, soldOut, notOnSale, saleEnded)
whenever a public event's ticket status changes. Polling the Fienta public REST
API requires no authentication.
Forza Motorsport PC -- Racing game telemetry bridge (separate repository). Captures UDP telemetry from Forza Motorsport games and forwards to Event Hubs or Fabric Event Streams. Binary release available.