Skip to content

Latest commit

 

History

History
64 lines (50 loc) · 1.51 KB

README.md

File metadata and controls

64 lines (50 loc) · 1.51 KB
Raw

Groovy Transformation Functions

In this recipe we'll learn how to use Groovy transformation functions to ingest events from Kafka.

Pinot Version 0.9.3
Schema config/schema.json
Table Config config/table.json

This is the code for the following recipe: https://dev.startree.ai/docs/pinot/recipes/groovy-transformation-functions

Clone this repository and navigate to this recipe:

git clone [email protected]:startreedata/pinot-recipes.git
cd pinot-recipes/recipes/groovy-transformation-functions

Spin up a Pinot cluster using Docker Compose:

docker-compose up

Open another tab to add the events table:

docker run \
   --network groovy \
   -v $PWD/config:/config \
   apachepinot/pinot:1.0.0 AddTable \
     -schemaFile /config/schema.json \
     -tableConfigFile /config/table.json \
     -controllerHost "pinot-controller-groovy" \
    -exec

Add events into Kafka:

printf '{"timestamp": "2019-10-09 21:25:25", "payload": {"firstName": "James", "lastName": "Smith", "before": {"id": 2}, "after": { "id": 3}}}
{"timestamp": "2019-10-10 21:33:25", "payload": {"firstName": "John", "lastName": "Gates", "before": {"id": 2}}}\n' |
kcat -P -b localhost:9092 -t events

Navigate to http://localhost:9000/#/query and run the following query:

select * 
from events 
limit 10