Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Moved the first section to the appendix
Table of Contents

Network tuning is beyond the scope of Swarm Storage, but it is an important part of the implementation. Contact DataCore for assistance with network tuning.

Linux networking is configured to optimize reliability by default, not performance, which becomes apparent with GbE adapters: the kernel’s send/receive buffers, TCP memory allocations, and packet backlog are generally too small. Tuning can significantly improve performance with gigabit Ethernet.

Info

Important

Run benchmarks on non-Swarm nodes in the network for best results, using tools such as FTP to perform data transfers to measure performance. After settings are optimized for non-Swarm systems in the network environment, apply those settings to the Swarm nodes in the cluster.

Intel includes a README for Linux outlining recommendations for each GbE controller. Refer to the documentation supplied by the manufacturer of the controller.

See Performance tuning: Intel 10-gigabit NIC, which incorporates the tuning recommendations cited in the Intel documentation.

Running Benchmarks

Info

Best practice

Change one setting at a time, running benchmarking tools (such as iperf and netperf) to determine the impact of the change. 

...

Swarm supports a limited number of tunable settings, such as buffer size.

Setting

Value

Type

Description

network.wmemMax

262144

int

Maximum value of wmem, ≥ 16384

network.rmemMax

262144

int

Maximum value of rmem, ≥ 87380

network.rxQueueLength

0

int

Value of ethtool -G ethX rx. 0 is unset, leaving kernel default

Technical Notes for Swarm Tuning

Out of scope

Network tuning is beyond the scope of Swarm Storage, but it is an important part of the implementation. Contact us if there are any questions related to network parameters you wish to change.

Linux networking is configured to optimize reliability by default, not performance, which may require adjustment for high-speed networking (beyond 1 Gb Ethernet): the kernel’s send/receive buffers, TCP memory allocations, and packet backlog are generally too small. Tuning can significantly improve performance with gigabit Ethernet.

Info

Important

Run benchmarks on non-Swarm nodes in the network for best results, using tools such as FTP to perform data transfers to measure performance. After settings are optimized for non-Swarm systems in the network environment, apply those settings to the Swarm nodes in the cluster.

Intel includes a README for Linux outlining recommendations for each GbE controller. Refer to the documentation supplied by the manufacturer of the controller.

See Performance tuning: Intel 10-gigabit NIC, which incorporates the tuning recommendations cited in the Intel documentation.

Child pages (Children Display)