Monitoring Apache Storm using JConsole

When you setup a storm cluster in a production environment it is important to monitor performance and resource usage of storm components to make sure that your cluster is working smoothly without issues.

This post will guide you to enable JMX and monitor storm components using JConsole.

Mainly there are two nodes to monitor in a storm cluster

• Nimbus Node
• Supervisor Node

Configure Nimbus Node 

Open storm.yaml file located at Nimbus_HOME>/conf/ directory and add below configurations.

• Here I will be enabling JMX at port 9997. You can specify a preferred port here.
• Add the host name of nimbus node

nimbus.childopts: "-Xmx1024m -Dcom.sun.management.jxmremote 
-Dcom.sun.management.jmxremote.local.only=false 
-Dcom.sun.management.jmxremote.authenticate=false 
-Dcom.sun.management.jmxremote.ssl=false 
-Dcom.sun.management.jmxremote.port=9997 
-Djava.rmi.server.hostname=192.168.22.231"

Start storm nimbus using below command

./storm nimbus

Configure Supervisor Node

Open storm.yaml file located at Supervisor_HOME>/conf/ directory and add below configurations.

• Here I will be enabling JMX at port 9998. You can specify a preferred port here.
• Add the host name of supervisor node

supervisor.childopts: "-Xmx1024m -Dcom.sun.management.jxmremote 
 -Dcom.sun.management.jmxremote.local.only=false 
 -Dcom.sun.management.jmxremote.authenticate=false
 -Dcom.sun.management.jmxremote.ssl=false
 -Dcom.sun.management.jmxremote.port=9998
 -Djava.rmi.server.hostname=192.168.22.232"

Start storm supervisor using below command

./storm supervisor

Using JConsole

Open a terminal and type 'jconsole' to open JConsole. To monitor storm nimbus and supervisor running on remote serves you have to select 'Remote Process' and provide the ip and port of the server.

After you connect to JConsole, you might get a message as below. Click 'Insecure' to connect to the servers.

 

Upon successful connection to the storm servers, performance and resource usage can be monitored through JConsole.