Elastic Collector Profile (Beta)

Detailed video of configuring the Elastic Collector Profile

Note

To enable this feature, please contact our HPE OpsRamp support team to activate the feature flag.

The Elastic Collector Profile is a dynamic resource management system designed to optimize the registration and operation of gateways with the OpsRamp cloud. Unlike default management profiles, elastic collector profiles enable systems to handle applications and integrations with a high number of resources by:

Scaling Up and Scaling Down: Dynamically adjusting the number of profiles to accommodate varying resource demands.
Rebalancing Resources: Distributing resources across dynamically created profiles (replica profiles) to ensure efficient load distribution and system stability.

This document outlines the design, functionality, and benefits of elastic management profiles, highlighting their role in enabling scalable and efficient resource management.

Feature Insight

	Scaleup	Scaledown	Rebalance
Purpose	Expand collector capacity by adding replicas	Reduce the number of replicas when resource utilization is low	Manually redistribute resources if automatic redistribution fails after Scaleup
Key Features	Automatic Deployment of replicas when triggereds Auto-Registration & Redistribution of resources Sequential Scaling	Deletion of the last deployed replica Resource Redistribution Cluster Optimization by releasing CPU and memory	Redistribute resources evenly across all replicas Ensures all replicas, including Master, have balanced resources
Use cases	Handling large-scale resources when a single replica is overloaded	When system resource utilization (CPU, memory) is consistently low and and minimal workload per replica	When automatic load balancing fails, requiring manual intervention to ensure efficient distribution
Key Action	Deploys new replicas and redistributes resources	Removes the last replica and redistributes resources	Ensures even resource distribution across replicas

What is importance of Elastic Collector Profiles?

The standard collector profiles are following limitations which are well address using Elastic.

Overburdened Profiles: A single management profile cannot efficiently handle all resources, leading to performance bottlenecks.
Lack of Scalability: Default profiles cannot scale dynamically to accommodate fluctuating resource requirements.

Elastic collector profiles overcome above limitations by introducing scaling and load balancing using below features:

Scale-Up and Scale-Down Operations:
- When the number of resources exceeds the capacity of a single collector profile:
  - Scale-Up: A new replica profile is dynamically created to handle the additional resources, with resources evenly distributed across the original profile and the newly created replica profile.
- During periods of low demand:
  - Scale-Down: Unused replica profiles are deleted, and their resources are redistributed.
Dynamic Resource Rebalancing:
- Resources attached to the gateway collector profiles are redistributed across all active profiles (master and replica).
- Rebalancing ensures:
  - No single profile is overburdened.
  - Optimal utilization of system resources.

Elastic Collector Profile Limitations

Existing collector profiles profiles with standard type cannot be upgraded as elastic.
Only the NextGen Gateway will support elastic profiles.