Configure High Load Mode

Use High Load Mode to scale the Web service for environments with high concurrent user traffic. When enabled, each Web service instance can handle up to 500 concurrent requests. Before enabling it, make sure your deployment meets the RAM and database requirements described in this article, then follow the steps for your installation type.

TABLE OF CONTENTS:

  1. Requirements
    1. RAM Requirements for Web Service
    2. Database Configuration Requirements
  2. Enable High Load Mode

1. Requirements

1.1. RAM Requirements for Web Service

The Web service requires sufficient RAM to support high load mode. See the specs below for different deployment types. Note that these requirements apply to the Web service only; other services are unaffected.

NOTE: Each Web service supports up to 500 concurrent users. For Orchestrated Environments, the total capacity equals the number of Web services × 500. For example, 1 Web Master + 3 Web Slaves = 4 × 500 = 2,000 concurrent users.

Deployment TypeComponentRAM Requirements
Simple InstallWeb
10GB+
Orchestrated EnvironmentsWeb Master
15GB+
Orchestrated EnvironmentsWeb Slave (each)10GB+

1.2. Database Configuration Requirements

It is important to ensure that the database max_connections value is at least equal to the desired number of concurrent user requests per second. Ideally, the maximum connections number must also include 500–1000 reserve connections.

Example: For a target of 3,000 concurrent users per second, configure max_connections to 3,500–4,000.

2. Enable High Load Mode

High load mode can be enabled through:

Metric Insights Installer

Simple Install

To enable high load mode through the Metric Insights installer for Simple Install, run the installer with the --high-load option enabled.

Orchestrated Environments

For Orchestrated Environments:

  1. Edit the manifests for Web Master and Web Slave by setting HIGH_LOAD to true:
...
        env:
          ...
          - name: HIGH_LOAD
            value: "true"
          ...
  1. Redeploy the Web Master and Web Slave services.

MI Console

To enable high load mode through the MI Console, access MI Console > Advanced > Enable High load

  • See the description of the Advanced section for details.