Skip to content

Cloudera Storm Parcel and CSD to install and manage a Storm cluster using Cloudera Manager UI

License

Notifications You must be signed in to change notification settings

linkshare/cdh-storm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Storm Parcel and CSD for Cloudera's CDH 5

This Storm Parcel and CSD greatly simplifies setting up a Storm cluster on your Cloudera cluster.

Table of Contents

Table of Contents generated with DocToc

Installation

1. Install the CSD

  1. Download the latest CSD release from this repository (alternatively, you can build it using the maven command "mvn assembly:assembly" and use the jar compiled in target folder)
  2. Upload the CSD jar to your Cloudera Manager node, place it in /opt/cloudera/csd/
  3. Restart cloudera-scm-manager on Clouder Manager node:
service cloudera-scm-server restart

2. Downloading and Distributing Storm Parcel

  1. Clone this git repository (you do not need to clone it inside your Cloudera cluster)
  2. Setup a quick HTTP server to serve as cloudera repository, the HTTP server will need to serve the "parcel" directory:
cd parcel
python -m SimpleHTTPServer
  1. Go to your Cloudera Manager: http://x.x.x.x:7180 and login with your admin credentials
  2. Click on the parcels icon on the top right corner (next to the search bar)
  3. Click on "Edit Settings"
  4. Add a new value in "Remote Parcel Repository URLs", enter the IP address for the machine on which you just setup your HTTP server, for example: http://x.x.x.x:8000
  5. Save your changes and go back to Parcels page by clicking on the Parcels icon on the top right corner (next to the search bar)
  6. Click on "Check for New Parcels"
  7. You should see "STORM" parcel in the list. Download it, then distribute it and activate it
  8. You will be prompted to restart your cluster, click "Restart". Once that's done, you will need to restart "Cloudera Management Service" manually as well
  9. Now you should be able to simply add your new Storm service through CM. (click on the little arrow next your cluster name and click "Add Service", follow the wizard instructions)

About

Cloudera Storm Parcel and CSD to install and manage a Storm cluster using Cloudera Manager UI

Resources

License

Stars

Watchers

Forks

Packages

No packages published