This page outlines the system requirements for running various Metoro components in your environment.

There are three main components which run in your Kubernetes cluster:

  1. The node agent - Runs on each node in your Kubernetes cluster
  2. The exporter - Runs multiple replicas depending on load, scales with horizontal pod autoscaler
  3. The redis cache - One replica per cluster

Each component has specific resource requirements as detailed below. All requirements are approximate and assume a relatively up to date cpu. Testing is perfomed on AWS M5 instances running on a Skylake 8175M.

The node agents resource requirements scale with several factors, primarily:

  • The number of requests being made to / from the node agent
  • The number of logs being collected

At a minimum, each node agent requires:

  • 0.05 cores
  • 100Mi memory

For each additional:

  • 1000 requests/second: +0.2 cores CPU, +0.2GB memory, +0.1MB/s network
  • 1000 logs/second: +0.05 cores CPU, +0.1GB memory, +0.1MB/s network

Resource Scaling Table

Requests per secondLogs per secondCPU (cores)Memory (GB)Network (MB/s)
100010000.250.30.2
200020000.50.60.4
300030000.750.90.6
400040001.01.20.8
500050001.251.51.0

These requirements are approximate and may vary based on:

  • Number of containers being monitored
  • Types of metrics being collected
  • Frequency of metric collection
  • Network conditions
  • Size of individual log lines

​
Example Cluster Configuration

For a cluster with:

  • 100 nodes
  • 1000 requests per second per node
  • 1000 logs per second per node

The resources required are:

  • 100 node agents: 0.25 cores, 0.3GB memory, 0.2MB/s network per node
  • 1 cluster exporter: Processing 100k traces/second, 100k logs/second across all nodes
    • Total: 7 cores, 20GB memory, 20MB/s network (split across N replicas)
  • 1 redis cache: 50m cores, 20Mi memory

Total cluster resources required

  • 32 cores CPU
  • 50GB memory
  • 40MB/s network

​
Default Resource Requests

The default resource requests for the node-agent are:

  • 0.3 cores, 300Mi memory

The default resource requests for the exporter are:

  • 1 core, 2GB memory

You should tune these requests to meet your specific needs.

Was this page helpful?

Getting StartedMetoro Architecture