AWS MSK Broker Memory Test

Using this test, administrators can proactively measure the memory usage of each cluster in AWS Managed Service Kafka server, and judge whether/not adequate free memory is available on the cluster of the target AWS MSK server. By detecting a potential memory contention on the cluster of the target server at the earliest, administrators can easily avert slowdowns or potential outages of the server.

This test reports how well the target AWS MSK server uses the physical, buffer and cached memory allocated to it, and leads administrators to abnormal memory usage patterns (if any).

Target of the test : AWS Managed Service Kafka

Agent deploying the test : A remote agent

Outputs of the test : One set of results for each cluster executing in the target AWS Managed Service Kafka server.

Configurable parameters for the test
Parameter Description

Test Period

How often should the test be executed.

Host

The IP address of the AWS Managed Service Kafka Broker that is being monitored.

Port

Specify the port number at which the specified HOST listens. By default, this is NULL.

AWS Default Region

This test uses AWS CLI to interact with AWS Managed Service Kafka and pull relevant metrics. To enable the test to connect to AWS, you need to configure the test with the name of the region to which all requests for metrics should be routed, by default. Specify the name of this AWS Default Region, here.

AWS Access Key ID, AWS Secret Access Key and Confirm Password

To monitor AWS Managed Service Kafka, the eG agent has to be configured with the access key and secret key of a user with a valid AWS account. For this purpose, we recommend that you create a special user on the AWS cloud, obtain the access and secret keys of this user, and configure this test with these keys. The procedure for this has been detailed in the Obtaining an Access key and Secret key topic. Make sure you reconfirm the access and secret keys you provide here by retyping it in the corresponding Confirm Password text box.

Timeout Seconds

Specify the maximum duration (in seconds) for which the test will wait for a response from the server. The default is 10 seconds.

Measurements made by the test
Measurement Description Measurement Unit Interpretation

Memory buffered

Indicates the size of buffered memory for the broker.

MB

 

Memory cached

Indicates the size of cached memory for the broker.

MB

 

Memory free

Indicates the size of memory that is free and available for the broker.

MB

 

Memory heap after garbage collection

Indicates the total heap memory available after garbage collection.

MB

 

Memory used

Indicates the size of memory that is in use for the broker.

MB

A low value is desired for this measure.