Amazon Kinesis Data Streams is used to collect and process large streams of data records in real-time.
You can create data-processing applications, known as Kinesis Data Streams applications. A typical Kinesis Data Streams application reads data from a data stream as data records. These applications can use the Kinesis Client Library and run on Amazon EC2 instances.
You can:
- Send the processed records to dashboards.
- Use the record to generate alerts.
- Dynamically change pricing and advertising strategies.
- Send data to a variety of other AWS services.
Use the AWS public cloud integration to discover and collect metrics against the AWS service.
External reference
What Is Amazon Kinesis Data Streams?
Setup
To set up the AWS integration and discover the AWS services (Kinesis and Shard), go to AWS Integration Discovery Profile and select Kinesis.
Event support
CloudTrail event support
- Not Supported
CloudWatch alarm support
- Supported
- Configurable in OpsRamp AWS Integration Discovery Profile.
Supported metrics
Standard metrics
| OpsRamp Metric | AWS Metric | Metric Display Name | Unit | Aggregation Type |
|---|---|---|---|---|
| aws_kinesis_PutRecord_Bytes Number of bytes put to the Amazon Kinesis stream using PutRecord over the specified time period. | PutRecord.Bytes | PutRecord.Bytes | Bytes | Sum |
| aws_kinesis_PutRecord_Latency Time taken per PutRecord operation, measured over the specified time period. | PutRecord.Latency | PutRecord.Latency | ms | Average |
| aws_kinesis_PutRecord_Success Number of successful PutRecord operations per Amazon Kinesis stream, measured over the specified time period. | PutRecord.Success | PutRecord.Success | Count | Sum |
| aws_kinesis_PutRecords_Bytes Number of bytes put to the Amazon Kinesis stream using PutRecords over the specified time period. | PutRecord.Bytes | PutRecords.Bytes | Bytes | Sum |
| aws_kinesis_PutRecords_Latency Time taken per PutRecords operation, measured over the specified time period. | PutRecords.Latency | PutRecords.Latency | ms | Average |
| aws_kinesis_PutRecords_Records Number of successful records in a PutRecords operation per Amazon Kinesis stream, measured over the specified time period. | PutRecords.Records | PutRecords.Records | Count | Average |
| aws_kinesis_PutRecords_Success Number of successful PutRecords operations per Amazon Kinesis stream, measured over the specified time period. | PutRecords.Success | PutRecords.Success | Count | Sum |
| aws_kinesis_IncomingBytes Number of bytes successfully put to the Amazon Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords. | IncomingBytes | IncomingBytes | Bytes | Sum |
| aws_kinesis_IncomingRecords Number of records successfully put to the Amazon Kinesis stream over the specified time period. This metric includes record counts from PutRecord and PutRecords. | IncomingRecords | IncomingRecords | Count | Sum |
| aws_kinesis_GetRecords_Bytes Number of bytes retrieved from the stream, measured over the specified time period. | GetRecords.Bytes | GetRecords.Bytes | Bytes | Sum |
| aws_kinesis_GetRecords_IteratorAgeMilliseconds Age of the last record in all GetRecords calls made against a stream, measured over the specified time period. Age is the difference between the current time and when the last record of a GetRecords call was written to the stream. Maximum statistic represents the oldest record consumed over the specified time period, while Minimum represents the newest record. | GetRecords.IteratorAgeMilliseconds | GetRecords.IteratorAgeMilliseconds | ms | Average |
| aws_kinesis_GetRecords_Latency Time taken per GetRecords operation, measured over the specified time period. | GetRecords.Latency | GetRecords.Latency | ms | Average |
| aws_kinesis_GetRecords_Success Number of successful GetRecords operations per stream, measured over the specified time period. | GetRecords.Success | GetRecords.Success | Count | Average |
| aws_kinesis_GetRecords_Records Number of records retrieved from the shard, measured over the specified time period. | Get Records Records | Get Records Records | Count | Sum |
| aws_kinesis_ReadProvisionedThroughputExceeded Number of GetRecords calls throttled for the stream over the specified time period. | ReadProvisionedThroughputExceeded | Read Provisioned Throughput Exceeded | Count | Average |
| aws_kinesis_WriteProvisionedThroughputExceeded Number of records rejected due to throttling for the stream over the specified time period. | WriteProvisionedThroughputExceeded | Write Provisioned Throughput Exceeded | Count | Average |
Shard metrics
| OpsRamp Metric | AWS Metric | Metric Display Name | Unit | Aggregation Type |
|---|---|---|---|---|
| aws_kinesis_IncomingBytes Number of bytes successfully put to the Amazon Kinesis stream over the specified time period. This metric includes bytes from PutRecord and PutRecords. | IncomingBytes | IncomingBytes | Bytes | Sum |
| aws_kinesis_IncomingRecords Number of records successfully put to the Amazon Kinesis stream over the specified time period. This metric includes record counts from PutRecord and PutRecords. | IncomingRecords | IncomingRecords | Count | Sum |
| aws_kinesis_ReadProvisionedThroughputExceeded Number of GetRecords calls throttled for the stream over the specified time period. | ReadProvisionedThroughputExceeded | Read Provisioned Throughput Exceeded | Count | Average |
| aws_kinesis_WriteProvisionedThroughputExceeded Number of records rejected due to throttling for the stream over the specified time period. | WriteProvisionedThroughputExceeded | Write Provisioned Throughput Exceeded | Count | Average |
| aws_kinesis_IteratorAgeMilliseconds The age of the last record in all GetRecords calls made against a shard, measured over the specified time period. | IteratorAgeMilliseconds | Iterator Age Milliseconds | Milliseconds | Average |
| aws_kinesis_OutgoingBytes Number of bytes retrieved from the shard, measured over the specified time period. | OutgoingBytes | Outgoing Bytes | Bytes | Sum |
| aws_kinesis_OutgoingRecords Number of records retrieved from the shard, measured over the specified time period. | OutgoingRecords | Outgoing Records | Count | Sum |