Skip to content
This repository has been archived by the owner on Jun 16, 2023. It is now read-only.

How to Install

Jump to bottom
longdafeng edited this page Oct 24, 2014 · 12 revisions

Installation Steps

  • Download released package from Downloads
  • Deploy Zookeeper cluster
  • Install Python 2.6
  • Install JDK
  • Install JStorm
  • Install zeroMq & JZMQ (optional)
  • Deploy web UI
  • Start JStorm cluster

Deploy Zookeeper cluster

Deploy JStorm cluster

Install python 2.6

If the python version in current system is 2.4 or higher, please skip this section.

You can also use https://github.com/utahta/pythonbrew to install python

> curl-kL http://xrl.us/pythonbrewinstall | bash -s $HOME/.pythonbrew/etc/bashrc && source $HOME/.pythonbrew/etc/bashrc
pythonbrew install 2.6.7
pythonbrew switch 2.6.7

Install java

Note that, if the current OS is 64-bit, please install 64-bit jdk; and if OS is a 32-bit system, then download one jdk for 32 bit.

Install JStorm

Take jstorm-0.9.6.zip as an example

unzip jstorm-0.9.6.1.zip
vi ~/.bashrc

export JSTORM_HOME=/XXXXX/XXXX
export PATH=$PATH:$JSTORM_HOME/bin

vi $JSTORM_HOME/conf/storm.yaml Please refer to JStorm Configuration for more details.

Run following commands on the node where the jar packages will be submitted.

#mkdir ~/.jstorm

#cp –f $JSTORM_HOME/conf/storm.yaml ~/.jstorm

Install JStorm Web UI

Note: Web UI can run on the node different from the Nimbus node.

Download tomcat 7.x (take apache-tomcat-7.0.37 as an example)

mkdir ~/.jstorm 
cp -f $JSTORM_HOME/conf/storm.yaml ~/.jstorm
tar -xzf apache-tomcat-7.0.37.tar.gz
cd apache-tomcat-7.0.37
cd webapps
cp $JSTORM_HOME/jstorm-ui-0.9.6.1.war ./
mv ROOT ROOT.old
ln -s jstorm-ui-0.6.1 ROOT
cd ../bin
./startup.sh

Install zeromq

From JStorm 0.9.0, the default RPC framework is Netty, if JStorm only use netty, zeromq doesn't need to be installed.

wget http://download.zeromq.org/zeromq-2.1.7.tar.gz
tar zxf zeromq-2.1.7.tar.gz
cd zeromq-2.1.7
./configure
make
sudo make install
sudo ldconfig

If you do not have root privileges, or the current user does not have sudo privileges, please execute "./configure --prefix=/home/xxxxx" replace "./configure", /home/xxxx is the installation target directory.

Install Jzmq

git clone git://github.com/nathanmarz/jzmq.git
cd jzmq
./autogen.sh
./configure
make
make install

If you do not have root privileges, or the current user does not have sudo privileges, execute "./configure --prefix=/home/xxxxx" to replace "./configure", /home/xxxx is the installation target directory.

Start JStorm

  • Run "nohup jstorm nimbus &" in the nimbus node, view $JSTORM_HOME/logs/nimbus.log to check if any errors.
  • Run "nohup jstorm supervisor >/dev/null 2>&1 &" in the supervisor node, and keep an eye on $JSTORM_HOME/logs/supervisor.log to check if any errors.
  • There is another script to start nimbus and supervisor, please refer to $JSTORM_HOME/bin/start.sh
Clone this wiki locally