Supported Target Versions
Validated on VMware vSAN 7.0, and 8.0

Introduction

VMware vSAN is a software-defined, enterprise storage solution that supports hyper-converged infrastructure (HCI) systems. vSAN is fully integrated with VMware vSphere, as a distributed layer of software within the ESXi hypervisor.

Polycom studio 2

Monitoring Use cases

  • Enable end to end visibility of full HCI Stack
  • Achieve through combination of vSphere, vSAN monitoring all through VMware vCenter
  • Monitor Capacity and Performance metrics for VMware vSAN.
  • Monitoring templates can be applied on Cluster, Host and VirtualMachines.

Prerequisites

  • Should have vCenter Server installed. vCenter Server is used to manage vSAN.
  • A minimum of three ESXi hosts are required. The maximum number of ESXi hosts that can use vSAN are eight.
  • ESXi hosts must be of version 5.5 or higher.
  • A dedicated vSAN network is required. 1Gbps network can be used, but 10Gbps network is recommended, with two NICs for fault tolerance purposes.
  • All ESXi hosts with local storage must have at least one SSD and one hard disk.
  • The SSDs must make up at least 10 percent of the total amount of storage.
  • vCenter should have at least one cluster.
  • Required VMware type credentials with Read Only role.
  • Cluster discovery is mandatory for vSAN component discovery in OpsRamp portal.
    Notes:
    • Not every host in a vSAN cluster needs to have local storage in order to take advantage of vSAN storage resources.
    • Hosts without storage are used to compute resources.
    • After you enable vSAN on a cluster, a single vSAN datastore is created. This datastore uses storage from every ESXi host in the vSAN cluster and contains all VM files.

Hierarchy of vSAN

  — cluster
    — host
      — virtual machine

Configure vSAN

Overview of the steps required to configure Virtual SAN (vSAN) in your vSphere environment:

  1. Create a dedicated VMkernel network for vSAN.
    Notes:
    • The network has to be accessible by all ESXi hosts.
    • 1 Gbps network can be used, however, 10 Gbps network is recommended, with two NICs for fault-tolerance purposes.
  2. Create a vSAN cluster.
    Note: When creating a cluster using vSphere Web Client, the vSAN option is available:
Polycom studio 2
  1. The vSAN cluster can be configured in two modes:
    • Automatic mode – to create a vSAN datastore all local disks are claimed by vSAN.
    • Manual mode – manually select disks to add to the vSAN datastore.

      Notes:
    • If you configure the vSAN cluster in Automatic mode, all ESXi hosts are scanned for empty disks that are then configured for vSAN.
    • If you configure the vSAN cluster in Manual mode, you need to create disk groups for vSAN.

Features of VMware vSAN

The features of VMware vSAN depends greatly on the kind of license but includes the following:

  • Supports storage policy based management (SPBM) for automated management of storage profiles.
  • Supports software defined data at rest encryption, preventing unauthorized access of data at rest.
  • A cluster can include 2 to 64 nodes.
  • Offers stretched clusters wherein more than one virtualization host server can be used in the same setup for higher security and availability.
  • A cluster supports deduplication (eliminating duplicating copies of the same data), compressing data, and erasure coding (protecting data by breaking it down into sectors), ensuring efficient storage management and security.
  • Offers support for storage quality of service (QoS), which enables administrators to limit the number of input-output operations per second (IOPS) consumed by specific VMs.
  • VMware vSAN 7.0 update two incorporates the following new features:
    • HCI Mesh Updates:
      vSAN clusters can share storage capacity with non HCI Sphere clusters and adopt HCI without having to scale computing resources and storage or replace existing servers. Licensing HCI Mesh deployment for vSAN clusters or vSAN clusters sharing storage requires vSAN Enterprise or Enterprise Plus Licenses.
    • Simplified File Services:
      File Services backup of file shares is simplified using APIs that allow backup and recovery software vendors to integrate with vSAN file services. The new API enables backup software to track new data and add scalability enhancements to files.

Integration Mechanism

  • Using VMware vSAN management SDK for python to gather storage usage and performance statistics for a vSAN Cluster.
  • Use NativeBridgeService from Gateway to connect and execute the python script.
  • In Inventory, vSAN entities (Disks) are mapped as components to existing vCenter resources (Hosts).

Integration Configuration

  1. From All Clients, select a client.
  2. Go to Setup > Account.
  3. Select the Integrations and Apps tab.
  4. The Installed Integrations page, where all the installed applications are displayed.
    Note: If there are no installed applications, it will navigate to the Available Integrations and Apps page.
  5. Click + ADD on the Installed Integrations page. The Available Integrations and Apps page displays all the available applications along with the newly created application with the version.
    Note: You can even search for the application using the search option available. Also you can use the All Categories option to search.
NetApp Solidfire
  1. Click ADD in VMware. In the vCenter Plug-ins Configurations section the vSAN checkbox needs to be enabled.
  • Discover physical components of vSAN.
    • Disks
  • Discovered vSAN Disks can be seen under Infrastructure
    → vCenter → vSAN Components → vCenter → DataCenter → Cluster -> vSAN Components → vCenter → DataCenter → Cluster -> Host → vSAN Components.
NetApp Solidfire

Below are the health icon status

Health Icon ColorHealth Icon StatusDescription
GreenGoodThe health of the object is normal.
YellowWarningThe object is experiencing some problems.
RedCriticalThe object is either not functioning properly or will stop functioning soon.
  • Click Disk Name to see disk attributes.
    Notes:
    • If isSSD is True, disk is SSD.
    • If isSSD is False, disk is HDD.
    • If the Capacity Attribute value is None, we display 0MB.
    • When the Rebalance Result Status is None, we do not get fullness. Fullness Above Threshold, Variance and DataToMoveB attribute values.
NetApp Solidfire
  • Navigate to Infrastructure → vCenter → DataCenter → Cluster → Attributes → vSAN to view discovered vSAN Cluster Attributes.
NetApp Solidfire
  • vSAN Components on Cluster
NetApp Solidfire
  • Navigate to Infrastructure → vCenter → DataCenter → Cluster → Host → Attributes → vSAN to view discovered vSAN Host Attributes.
NetApp Solidfire
  • vSAN Components on Hosts
NetApp Solidfire

Monitoring metrics and Templates

Template NameMonitor NameMetric NameUnitVersionDescription
VMware vSAN VirtualMachine PerformanceVMware vSAN VirtualMachine Performancevmware_vsan_virtual_machine_iopsReadnumberVMware vSAN 7.0Virtual machine read IOPS.
vmware_vsan_virtual_machine_iopsWritenumberVMware vSAN 7.0Virtual machine write IOPS.
vmware_vsan_virtual_machine_throughputReadrate_bytesVMware vSAN 7.0Virtual machine read throughput.
vmware_vsan_virtual_machine_throughputWriterate_bytesVMware vSAN 7.0Virtual machine write throughput.
vmware_vsan_virtual_machine_latencyReadtime_msVMware vSAN 7.0Virtual machine read latency.
vmware_vsan_virtual_machine_latencyWritetime_msVMware vSAN 7.0Virtual machine write latency.
VMware vSAN Host Network PerformanceVMware vSAN Host Network Performancevmware_vsan_host_net _rxThroughputrate_bytesVMware vSAN 7.0Host throughput inbound of all VMkernel network adapters enabled vSAN traffic.
vmware_vsan_host_net _txThroughputrate_bytesVMware vSAN 7.0Host throughput outbound of all VMkernel network adapters enabled vSAN traffic.
vmware_vsan_host_net _rxPacketsnumberVMware vSAN 7.0Host network inbound packets per second of all VMkernel network adapters enabled vSAN traffic.
vmware_vsan_host_net _txPacketsnumberVMware vSAN 7.0Host network outbound packets per second of all VMkernel network adapters enabled vSAN traffic.
vmware_vsan_host_net _rxPacketsLossRatepermilleVMware vSAN 7.0Percentage of host inbound packets loss rate of all VMkernel network adapters enabled vSAN traffic.
vmware_vsan_host_net _txPacketsLossRatepermilleVMware vSAN 7.0Percentage of host outbound packets loss rate of all VMkernel network adapters enabled vSAN traffic.
VMware vSAN Host Cache Disk PerformanceVMware vSAN Host Cache Disk Performancevmware_vsan_host_cache_disk_iopsDevReadnumberVMware vSAN 7.0vSAN disk physical/firmware layer read IOPS.
vmware_vsan_host_cache_disk_iopsDevWritenumberVMware vSAN 7.0vSAN disk physical/firmware layer write IOPS.
vmware_vsan_host_cache_disk_throughputDevReadrate_bytesVMware vSAN 7.0vSAN disk physical/firmware layer read throughput.
vmware_vsan_host_cache_disk_throughputDevWriterate_bytesVMware vSAN 7.0vSAN disk physical/firmware layer write throughput.
vmware_vsan_host_cache_disk_latencyDevReadtime_msVMware vSAN 7.0vSAN disk physical/firmware layer read latency.
vmware_vsan_host_cache_disk_latencyDevWritetime_msVMware vSAN 7.0vSAN disk physical/firmware layer write latency.
vmware_vsan_host_cache_disk_latencyDevGAvgtime_msVMware vSAN 7.0vSAN disk Guest IO latency (total latency).
vmware_vsan_host_cache_disk_latencyDevDAvgtime_msVMware vSAN 7.0vSAN disk IO device latency (from HBA to backend storage).
VMware vSAN Host Capacity Disk PerformanceVMware vSAN Host Capacity Disk Performancevmware_vsan_host_capacity_disk_iopsDevReadnumberVMware vSAN 7.0vSAN disk physical/firmware layer read IOPS.
vmware_vsan_host_capacity_disk_iopsDevWritenumberVMware vSAN 7.0vSAN disk physical/firmware layer write IOPS.
vmware_vsan_host_capacity_disk_throughputDevReadrate_bytesVMware vSAN 7.0vSAN disk physical/firmware layer read throughput.
vmware_vsan_host_capacity_disk_throughputDevWriterate_bytesVMware vSAN 7.0vSAN disk physical/firmware layer write throughput.
vmware_vsan_host_capacity_disk_latencyDevReadtime_msVMware vSAN 7.0vSAN disk physical/firmware layer read latency.
vmware_vsan_host_capacity_disk_latencyDevWritetime_msVMware vSAN 7.0vSAN disk physical/firmware layer write latency.
vmware_vsan_host_capacity_disk_latencyDevGAvgtime_msVMware vSAN 7.0vSAN disk Guest IO latency (total latency).
vmware_vsan_host_capacity_disk_latencyDevDAvgtime_msVMware vSAN 7.0vSAN disk IO device latency (from HBA to backend storage).
vmware_vsan_host_capacity_disk_iopsReadnumberVMware vSAN 7.0Disk vSAN layer reads IOPS.
vmware_vsan_host_capacity_disk_iopsWritenumberVMware vSAN 7.0Disk vSAN layer writes IOPS.
vmware_vsan_host_capacity_disk_latencyReadtime_msVMware vSAN 7.0Disk vSAN layer read latency.
vmware_vsan_host_capacity_disk_latencyWritetime_msVMware vSAN 7.0Disk vSAN layer write latency.
VMware vSAN Cluster Virtual Disk PerformanceVMware vSAN Cluster Virtual Disk Performancevmware_vsan_virtual_disk_iopsLimitnumberVMware vSAN 7.0The applied IOPS limit.
vmware_vsan_virtual_disk_NIOPSnumberVMware vSAN 7.0This shows IOPS that are represented using a weighted size of 32KB by default. This means that a 64KB read or write operation represents two normalized IO. The weighted size is a configurable parameter.
vmware_vsan_virtual_disk_NIOPSDelayednumberVMware vSAN 7.0This is the IOPS for normalized IOs that are delayed.
VMware vSAN Cluster PerformanceVMware vSAN Cluster Performancevmware_vsan_cluster_capacity_global_freeCapacityBBytesVMware vSAN 7.0The amount of free Virtual SAN capacity in bytes
vmware_vsan_cluster_capacity_global_totalCapacityBBytesVMware vSAN 7.0The total Virtual SAN capacity in bytes.
vmware_vsan_cluster_capacity_summary_usedBBytesVMware vSAN 7.0The amount of Virtual SAN capacity being used in bytes.
vmware_vsan_cluster_capacity_other_usedBytesVMware vSAN 7.0The amount of Virtual SAN capacity being used in bytes
vmware_vsan_cluster_backend_congestioncountVMware vSAN 7.0vSAN cluster congestion for the vSAN backend.
vmware_vsan_cluster_backend_iopsReadcountVMware vSAN 7.0vSAN cluster reads IOPS for the vSAN backend.
vmware_vsan_cluster_backend_iopsWritecountVMware vSAN 7.0vSAN cluster writes IOPS for the vSAN backend.
vmware_vsan_cluster_backend_latencyAvgReadMilliSecondsVMware vSAN 7.0vSAN cluster average read latency for the vSAN backend.
vmware_vsan_cluster_backend_latencyAvgWriteMilliSecondsVMware vSAN 7.0vSAN cluster average write latency for the vSAN backend.
vmware_vsan_cluster_backend_oiocountVMware vSAN 7.0vSAN cluster outstanding I/O for the vSAN backend.
vmware_vsan_cluster_backend_throughputReadBytesVMware vSAN 7.0vSAN cluster read throughput for the vSAN backend.
vmware_vsan_cluster_backend_throughputWriteBytesVMware vSAN 7.0vSAN cluster write throughput for the vSAN backend.
vmware_vsan_cluster_client_congestioncountVMware vSAN 7.0Congestions of I/Os generated by all vSAN clients in the cluster, such as virtual machines, stats object, etc.
vmware_vsan_cluster_client_iopsReadcountVMware vSAN 7.0Read IOPS consumed by all vSAN clients in the cluster, such as virtual machines, stats object, etc.
vmware_vsan_cluster_client_iopsWritecountVMware vSAN 7.0Write IOPS consumed by all vSAN clients in the cluster, such as virtual machines, stats object, etc.
vmware_vsan_cluster_client_latencyAvgReadMilliSecondsVMware vSAN 7.0Average read latency of I/Os generated by all vSAN clients in the cluster, such as virtual machines, stats object, etc.
vmware_vsan_cluster_client_latencyAvgWriteMilliSecondsVMware vSAN 7.0Average write latency of I/Os generated by all vSAN clients in the cluster, such as virtual machines, stats object, etc.
vmware_vsan_cluster_client_latencyAvgWritecountVMware vSAN 7.0Outstanding I/O from all vSAN clients in the cluster, such as virtual machines, stats object, etc.
vmware_vsan_cluster_client_throughputReadBytesVMware vSAN 7.0Read throughput consumed by all vSAN clients in the cluster, such as virtual machines, stats object, etc.
vmware_vsan_cluster_client_throughputWriteBytesVMware vSAN 7.0Read throughput consumed by all vSAN clients in the cluster, such as virtual machines, stats object, etc.
VMware vSAN Cluster DiskGroup PerformanceVMware vSAN Cluster DiskGroup Performancevmware_vsan_cluster_disk_group_compCongestioncountVMware vSAN 7.0vSAN disk group Comp-congestion.
vmware_vsan_cluster_disk_group_iopsCongestioncountVMware vSAN 7.0vSAN disk group IOPS-congestions.
vmware_vsan_cluster_disk_group_logCongestioncountVMware vSAN 7.0vSAN disk group Log-congestions.
vmware_vsan_cluster_disk_group_memCongestioncountVMware vSAN 7.0vSAN disk group Mem-congestions.
vmware_vsan_cluster_disk_group_slabCongestioncountVMware vSAN 7.0vSAN disk group Slab-congestions.
vmware_vsan_cluster_disk_group_ssdBytesDrainedbytesVMware vSAN 7.0vSAN disk group SSD-congestions.
vmware_vsan_cluster_disk_group_iopsReadcountVMware vSAN 7.0vSAN disk group (cache tier disk) front end read IOPS, including RC read misses.
vmware_vsan_cluster_disk_group_iopsWritecountVMware vSAN 7.0vSAN disk group (cache tier disk) front end write IOPS.
vmware_vsan_cluster_disk_group_latencyAvgReadmillisecondsVMware vSAN 7.0vSAN disk group (cache tier disk) front end read latency.
vmware_vsan_cluster_disk_group_latencyAvgWritemillisecondsVMware vSAN 7.0vSAN disk group (cache tier disk) front end write latency.
vmware_vsan_cluster_disk_group_rcHitRatepercentageVMware vSAN 7.0vSAN disk group (cache tier disk) Read Cache hit rate.
vmware_vsan_cluster_disk_group_throughputReadbytesVMware vSAN 7.0vSAN disk group (cache tier disk) front end read throughput.
vmware_vsan_cluster_disk_group_throughputWritebytesVMware vSAN 7.0vSAN disk group (cache tier disk) front end write throughput.
VMware vSAN Host Backend and Client PerformanceVMware vSAN Host Backend and Client Performancevmware_vsan_host_backend_congestioncountVMware vSAN 7.0vSAN host congestions for the vSAN backend.
vmware_vsan_host_backend_iopsReadcountVMware vSAN 7.0vSAN host read IOPS for the vSAN backend.
vmware_vsan_host_backend_iopsWritecountVMware vSAN 7.0vSAN host write IOPS for the vSAN backend.
vmware_vsan_host_backend_latencyAvgReadmillisecondsVMware vSAN 7.0vSAN host read I/O average latency for the vSAN backend.
vmware_vsan_host_backend_latencyAvgWritemillisecondsVMware vSAN 7.0vSAN host write I/O average latency for the vSAN backend.
vmware_vsan_host_backend_oiocountVMware vSAN 7.0vSAN host outstanding I/O for the vSAN backend.
vmware_vsan_host_backend_iopsResyncReadcountVMware vSAN 7.0vSAN host read IOPS of resync traffic, including policy change, repair, maintenance mode / evacuation and rebalance from resyncing objects in the perspective of vSAN backend.
vmware_vsan_host_backend_iopsRecWritecountVMware vSAN 7.0vSAN host recovery write IOPS in the perspective of vSAN backend.
vmware_vsan_host_backend_throughputReadbytesVMware vSAN 7.0vSAN host read throughput for the vSAN backend.
vmware_vsan_host_backend_throughputWritebytesVMware vSAN 7.0vSAN host write throughput for the vSAN backend.
vmware_vsan_host_client_congestioncountVMware vSAN 7.0Congestions of I/Os generated by all vSAN clients in the host, such as virtual machines, stats object, etc.
vmware_vsan_host_client_iopsReadcountVMware vSAN 7.0Read IOPS consumed by all vSAN clients in the host, such as virtual machines, stats object, etc.
vmware_vsan_host_client_iopsWritecountVMware vSAN 7.0Write IOPS consumed by all vSAN clients in the host, such as virtual machines, stats object, etc.
vmware_vsan_host_client_latencyAvgReadmillisecondsVMware vSAN 7.0Average read latency of I/Os generated by all vSAN clients in the host, such as virtual machines, stats object, etc.
vmware_vsan_host_client_latencyAvgWritemillisecondsVMware vSAN 7.0Average write latency of I/Os generated by all vSAN clients in the host, such as virtual machines, stats object, etc.
vmware_vsan_host_client_oiocountVMware vSAN 7.0Outstanding I/O from all vSAN clients in the host, such as virtual machines, stats object, etc.
vmware_vsan_host_client_throughputReadbytesVMware vSAN 7.0Read throughput consumed by all vSAN clients in the host, such as virtual machines, stats object, etc.
vmware_vsan_host_client_throughputWritebytesVMware vSAN 7.0Write throughput consumed by all vSAN clients in the host, such as virtual machines, stats object, etc.
VMware vSAN Host Disk PerformanceVMware vSAN Host Disk Performancevmware_vsan_host_disk_summaryHealthEnumerated Map 0 red 1 green 2 yellow 3 NoneVMware vSAN 7.0The overall health status of the disk. It is the aggregated health status for the disk operational health, disk congestion health, disk metadata health, disk capacity health, disk component limit health, and disk dedup usage health. The status is reported as one of the following values: 1) green: Good. The health of the object is normal. 2) yellow: Warning. The object is experiencing some problems. 3) red: Critical. The object is either not functioning properly or will stop functioning soon.
vmware_vsan_host_disk_capacityHealthEnumerated Map 0 red 1 green 2 yellow 3 NoneVMware vSAN 7.0The disk capacity health status
vmware_vsan_host_disk_operationalHealthEnumerated Map 0 red 1 green 2 yellow 3 NoneVMware vSAN 7.0The disk operational health status. The status is reported as one of the following values: 1) green: Good. The health of the object is normal. 2) yellow: Warning. The object is experiencing some problems. 3) red: Critical. The object is either not functioning properly or will stop functioning soon.

Debug to verify vSan response

Below mentiond command is to verify whether you are receiving vSAN response or not:

python3 /opt/gateway/vprobe/scripts/vsan/vsaninventory.py -s <vCenterIp> -u <userName> -p <passWord> -c <clusterName> --inventory