Storm Workers Test

Topologies execute across one or more worker processes. Each worker process is a physical JVM and executes a subset of all the tasks for the topology. For example, if the combined parallelism of the topology is 300 and 50 workers are allocated, then each worker will execute 6 tasks (as threads within the worker).

A topology runs in a distributed manner, on multiple worker nodes. Storm spreads the tasks evenly on all the worker nodes. The worker node’s role is to listen for jobs and start or stop the processes whenever a new job arrives.

This test reports the number of executors and the assigned memory in the worker node. It also monitors the uptime of worker node before users start complaining.

Target of the test : Apache Storm

Agent deploying the test : An internal/remote agent

Outputs of the test : One set of results for each Worker in the target Apache Storm.

Configurable parameters for the test
Parameter	Description
Test period	How often should the test be executed.
Host	The IP address of the target server that is being monitored.
Port	The port number through which the Apache Storm communicates. The default port is 8080.
SSL	By default, the SSL flag is set to No, indicating that the target Apache Storm is not SSL-enabled by default. To enable the test to connect to an SSL-enabled Apache Storm, set the SSL flag to Yes.
DD Frequency	Refers to the frequency with which detailed diagnosis measures are to be generated for this test. The default is 1:1. This indicates that, by default, detailed measures will be generated every time this test runs, and also every time the test detects a problem. You can modify this frequency, if you so desire. Also, if you intend to disable the detailed diagnosis capability for this test, you can do so by specifying none against DD frequency.
Detailed Diagnosis	To make diagnosis more efficient and accurate, the eG Enterprise embeds an optional detailed diagnostic capability. With this capability, the eG agents can be configured to run detailed, more elaborate tests as and when specific problems are detected. To enable the detailed diagnosis capability of this test for a particular server, choose the On option. To disable the capability, click on the Off option. The option to selectively enable/disable the detailed diagnosis capability will be available only if the following conditions are fulfilled: The eG manager license should allow the detailed diagnosis capability Both the normal and abnormal frequencies configured for the detailed diagnosis measures should not be 0.

Measurements made by the test
Measurement	Description	Measurement Unit	Interpretation
Total executors	Indicates the total number of executors in workers node.	Number
Assigned memory on heap	Indicates the size of assigned heap memory for workers node.	MB	As a rule of thumb, there should be enough heap memory to address data processing. If the heap memory is high, then it leads to garbage collection.
Assigned memory off heap	Indicates the size of assigned memory off-heap for workers node.	MB	If there is no off -heap memory, then you will be unable to perform the data processing. To avoid this, it would be good practice to allocate adequate off-heap memory.
Assigned CPU core	Indicates the number of assigned CPU core for workers node.	Number
Uptime	Indicates the time period that the worker node has been up since the last time this test ran.	Hrs/Mins/Secs	The accuracy of this metric is dependent on the measurement period - the smaller the measurement period, greater the accuracy.