Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel2
outlinefalse
typelist
printablefalse

...

  • Swarm Storage supports standard x86-64 CPUs (Intel, AMD)

  • Single or multiple sockets supported (and multi-core)

  • Recommend use of above CPUs that include AES New Instructions (AES-NI) support

    • Used by Swarm for improved performance of Encryption at Rest (EAR)

    • Most modern server processors include this as of 2010

Insert excerpt
Hardware Requirements for Storage
Hardware Requirements for Storage
nameCPU for Storage Node
nopaneltrue

Storage Memory

RAM per storage node for the following object capacities:

...

Info

Info

  • Memory required is a function of object count, object type, and data protection scheme chosen.

  • Larger clusters need additional memory for the Overlay Index or other features which may require additional resources.

...

  • Direct Attached

  • Controllers: SAS or SATA JBOD HBAs (SAS preferred)

  • “Hot plug” connector/backplane support

  • Disks: “Enterprise Grade”

    • Designed for 24x7 continuous duty cycles

    • Typically 5 years of warranty

    • Examples: Seagate “Exos”, Western Digital “Gold”

Storage Networking

Tip

Best Practice

Maintain the same network speed for all devices within the Swarm cluster; mixing speeds requires additional configuration to avoid performance problems.

...

Info

Info

Multiport network cards (two or more ports per card) are not truly redundant when considering failover for the storage hosts. Multiport NICs experience common failure modes which that can disconnect a Swarm host completely. A true An 'active-active' design includes the use of separate NICs in the storage hosts to meet the requirement.

...

  • Appropriate for functional design and testing

  • 3 or more nodes (chassis) in a cluster

  • Can be deployed as virtual machines (VMware guests)

  • Rule of thumb, minimum physical memory is 2 GB + (0.5 GB * number of volumes), but more memory improves cluster operation

...

Component

Platform Server

Elasticsearch

Content Gateway

SwarmFS

Purpose

Boot, monitor, manage Storage cluster

Query and list objects in Storage

Protocol and auth/auth gateway to Storage

NFS protocol gateway to Storage

CPU

x86-64 (multi-socket/core, 2 cores)

x86-64 (multi-socket/core)

x86-64 (multi-socket/core)

x86-64 (multi-socket/core, 4+ cores)

Memory

8 GB RAM

64 GB RAM per 1 billion distinct objects

4+ GB RAM

4+ GB RAM (16 GB recommended)

Drive

80+ GB (large clusters: more for logs)

1.5 TB per 1 billion distinct objects

4+ GB plus OS install footprint

40+ GB plus OS install footprint

Network

1 Gb Ethernet

1 Gb Ethernet

1 Gb Ethernet

1 Gb Ethernet (10 Gb heavy traffic)

Servers

1

3 to 4 (for redundancy and performance)

Scale to support client sessions

Scale to support client sessions

Virtualize

Yes (OVA available)

Yes

Yes

Yes

Notes


Assume full index of object metadata (custom metadata)


Scale RAM and CPU with concurrent writes

...