Network Planning

The Swarm Cluster Services (SCS) server isolates Swarm within an internal network. The network is defined by both the IP address assigned to the interface on the SCS server connected to that network as well as the subnet defined for that network. The SCS server runs a DHCP service on the network for booting Swarm storage nodes up in the network.

The DHCP server allows the following IP addresses:

The DCHP server utilizes the following breakdown of the subnet:

Subnet Layout: | | | | | <- reserve lower -> | <--- DHCP/storage pool ---> | <- reserve upper -> | | | | | subnet broadcast address

Range Sizing

For most installations, the DHCP-managed range (the “middle” of the subnet) spans the majority of the network’s address space, with small or nonexistent lower or upper ranges. However, at least one of the lower or upper ranges must have a non-zero number of IP addresses set aside for it.

SCS Internal Interface

The Swarm-facing network interface on the SCS server acts as a contact point for all SCS services for the cluster (logging, PXE booting, NTP, etc.) and as a default network gateway. Select an appropriate static IP address cautiously for this interface. The IP address is often at the bottom of the lower range (but it is not required).

However, the IP address must be within either the upper or lower range; placing it outside of these ranges may conflict with the IP allocation.

Other Swarm Services

Gateway or Elasticsearch instances run for the Swarm cluster on the Swarm network. Their IP addresses are statically allocated in either the lower or upper reserved ranges.

Static IP Address Pool

If the Swarm deployment requires storage nodes to be given static IP addresses, then see https://perifery.atlassian.net/wiki/spaces/KB/pages/3118530607.

Other IP Addresses

Sometimes, the organizational policy represents that other services have access to the network while the Swarm network is private. The static IP addresses are provided to these services in either the lower or upper reserved ranges.

Swarm (Internal) Network MTU

If the MTU needs to be configured for the internal Swarm network, see https://perifery.atlassian.net/wiki/spaces/public/pages/1223491667/SCS+Administration#Swarm-(Internal)-Network-MTU.

Examples

Info

The concepts are similar to CSN network allocation, but some concepts have changed.

The below table represents the mapping of CSN concepts with SCS:

CSN

Swarm Cluster Services (SCS)

CSN

Swarm Cluster Services (SCS)

CSN IP address range

Lower and/or upper reserved IP address range

External applications IP address range

Lower and/or upper reserved IP address range

DHCP address range

Storage pool (DHCP ensures there are no conflicts with running storage node IP addresses)

Swarm Netboot address range

Storage pool

Small Network (/24)

Storage subnet

10.0.1.0/24

(255.255.255.0)

Set of all IP addresses

10.0.1.1 - 10.0.1.254

(254 addresses)

Platform Server's IP

10.0.1.1

(1 address)

Lower Reserved Range

10.0.1.1 - 10.0.1.32

(32 addresses)

Upper Reserved Range

N/A

(0 addresses)

IP addresses available for Storage nodes

10.0.1.33 - 10.0.1.254

(222 addresses)

Implications

  • 222 Storage nodes (size of storage pool) on the network

  • Up to 222 chassis can PXE boot simultaneously

Large Network (/16)

Storage subnet

10.0.0.0/16

(255.255.0.0)

Set of all IP addresses

10.0.0.1 - 10.0.255.254

(65,534 addresses)

Platform Server's IP

10.0.0.1

(1 address)

Lower Reserved Range

10.0.0.1 - 10.0.1.254

(510 addresses)

Upper Reserved Range

10.0.255.231 - 10.0.255.254

(24 addresses)

IP addresses available for Storage nodes

10.0.1.255 - 10.0.255.230

(65,000 addresses)

Implications

  • 65,000 Storage nodes (size of storage pool) on the network

  • Up to 65,000 chassis can PXE boot simultaneously

Podman Network Ranges

Podman sets up an internal network for containers to talk to each other. The range 10.88.0.0/16 is used internally for the podman network on SCS nodes and is reserved for container communication. If this IP range (or an overlapping IP address range) is used for normal network communications, conflicts occur and network traffic becomes unpredictable. Verify the IP range is not used outside of Swarm.

External Network Connectivity

Storage Cluster Connectivity

When the storage cluster needs to communicate outside of its network (replication feeds, for example), the SCS machine provides network address translation (NAT) to keep the internal network better shielded from external access.

HTTP Proxy

SCS does not support use of environment variables that govern the use of http proxies (http_proxy, https_proxy, etc.). If these variables are set on SCS, network communication will be disrupted.

 

© DataCore Software Corporation. · https://www.datacore.com · All rights reserved.