Skip to content

Kafka Producer and Consumer for streaming real time tweets and storing it in ElasticSearch database. Also includes a module with sample code for using Consumer and Producer API.

Notifications You must be signed in to change notification settings

vinitshah24/Kafka-Twitter-Streaming

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Kafka Twitter Streaming App

  • Kafka Producer to stream the live tweets and feed it into the Kafka cluster.
  • Kafka Consumer to consume the data from Kafka and store it into the ElasticSearch database.

Instructions

Start Zookeeper

zookeeper-server-start config\zookeeper.properties

Start Kafka Server

kafka-server-start config\server.properties

Start ElasticSearch Server

elasticsearch

Create Kafka Topic

kafka-topics --zookeeper 127.0.0.1:2181 --topic twitterApp --create --partitions 6 --replication-factor 1

About

Kafka Producer and Consumer for streaming real time tweets and storing it in ElasticSearch database. Also includes a module with sample code for using Consumer and Producer API.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published