Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

...

Table of Contents
maxLevel2

New Features

Performance — This Performance: This release of Swarm Storage enhances both memory management and cluster performance:

  • Swarm cluster startup has been optimized to

    ensure

    guarantee the fastest sequencing. Now volume mounting must complete and the persistent settings must be processed before any needed recovery activities can commence. (SWAR-8911)

  • Swarm nodes shut down faster, allowing for quicker rebooting of Swarm clusters. (SWAR-8891)

  • Swarm nodes with limited physical memory can now respond better under high client loads. (SWAR-8870)

  • Swarm's memory management has been improved, which enables higher loads for client writes. (SWAR-8816)

Stability Stability: This release also includes changes that improve Swarm stability and administration:

  • Better handling of newly added hotplug volumes results in clients receiving fewer 503 Service Unavailable responses. (SWAR-8887)

  • HP cycles now cleanse all traces of removed volumes from the cluster, greatly reducing the chance that recovery

    could

    can be started erroneously for a volume

    that was

    already recovered. (SWAR-8836)

  • Reworking of cluster operations has reduced spurious "Cannot contact node" announcements during maintenance rebooting of multiple nodes. (SWAR-8848)

  • When secure logging (security.secureLogging) is enabled, Swarm removes more sensitive information from AUDIT-level messages. (SWAR-8790)

Additional Changes

These items are other changes, including those that come from testing and user feedback.

OSS Versions 

...

See Third-Party Components for 11.3

...

for the complete listing of packages and versions.

Fixed in 11.3.0

  • Drive light plug-in control is restored for hardware in mpt3sas enclosures, including Western Digital Ultrastar Serv60. (SWAR-8934)

  • For some feed statistics, feed accounting

...

  • resets and

...

  • requires a reboot to correct the statistic. (SWAR-8854)

Upgrade Impacts

Be sure to use Use the supported versions of Swarm components if you are on running an older version of Elasticsearch:

Elasticsearch 6.8.6

Swarm Storage 11.1 - 11.3

Gateway 6.3

SwarmFS 2.4

Recommended configuration.

Elasticsearch 5.6.12

Swarm Storage 10.0 - 11.3

Gateway 6.0 - 6.3

SwarmFS 2.4

Plan to migrate to Elasticsearch 6.
Support for earlier versions is ending.

Elasticsearch 2.3.3

Swarm Storage 9.6 - 11.3

Gateway 5.4

SwarmFS 2.1

These items are changes to the product function that may require operational or development changes for integrated applications. Address  Address the upgrade impacts for each of the versions since the one you are version currently running:

Excerpt

Impacts for 11.3

  • Upgrading

    Elasticsearch — You may use

    Elasticsearch: Use Elasticsearch 5.6.12/2.3.3 with Storage 11 if

    you cannot move

    moving to ES 6 immediately is not possible, but start

    your

    the migration now (see Migrating from Older Elasticsearch). Support for ES 5.6.12/2.3.3

    will end

    ends in a future release, and testing for 2.3.3 with Swarm 11 is discontinued.

     

Info

Important

:

Always upgrade Swarm Search and Metrics at the same time

that you

ES is upgrade

ES

. Do not run an ES 5 Search or Metrics Curator against ES 6.

  • Rolling

    upgrade —

    Upgrade: During a rolling upgrade from a version older than 11.1, the mixed state in Swarm versions among nodes

    might

    may cause errors in the Swarm UI (and in management API calls). Use the legacy Admin Console (port 90) to monitor the rolling upgrade. (SWAR-8716)

  • Settings

    changes — The

    Changes: The setting health.parallelWriteTimeout, which was disabled by default, now defaults to 1 month. It sets when to time out an uncompleted multipart upload, triggering clean up of the unused parts. Do not disable (0) if using SwarmFS. (SWAR-8902)

  • Encryption-at-

    rest —If you are about to upgrade

    Rest: If upgrading from Swarm 11.0 or earlier and

    you use

    encryption-at-rest is used, contact DataCore Support to

    ensure that you can smoothly

    verify a roll back to

    your

    the prior version is possible, if needed. (SWAR-8941)

  • Differences in scsp.forceLegacyNonce configuration depending on the version

    you're upgrading

    being upgraded from (SWAR-9020):

  • If

  • you are
  • currently running a Swarm Storage version prior to 11.1

  • ,
  • and upgrading to 11.1, 11.2, 11.3, 12.0 or 12.1:

    Before upgrading, set scsp.forceLegacyNonce=true in

  • your
  • the node.cfg file. After the upgrade, when the cluster is fully up, update scsp.forceLegacyNonce=false using swarmctl and change scsp.forceLegacyNonce=false in

  • your
  • the node.cfg file.

    If

  • you are
  • currently running a Swarm Storage version 11.1, 11.2, 11.3, 12.0 or 12.1 and upgrading to another version from that list:

    Before upgrading, verify

  • that
  • the scsp.forceLegacyNonce=false is in

  • your
  • the node.cfg file and verify using swarmctl that scsp.forceLegacyNonce=false in

  • your
  • the cluster.

Info
title

Use swarmctl to

check

Check or

change settings

Change Settings

Use 'swarmctl -C scsp.forceLegacyNonce' to check the value of scsp.forceLegacyNonce.

Use 'swarmctl -C scsp.forceLegacyNonce -V False' to set the value to false.

For more details, see https://support.cloud.caringo.com/tools/Tech-Support-Scripts-Bundle-swarmctl.pdf.

Insert excerpt
Swarm Storage 11.2 Release
Swarm Storage 11.2 Release
nopaneltrue

Insert excerpt
Swarm Storage 11.1 Release
Swarm Storage 11.1 Release
nopaneltrue

Insert excerpt
Swarm Storage 11.0 Release
Swarm Storage 11.0 Release
nopaneltrue

Insert excerpt
Swarm Storage 10.2 Release
Swarm Storage 10.2 Release
nopaneltrue

Insert excerpt
Swarm Storage 10.1 Release
Swarm Storage 10.1 Release
nopaneltrue

Insert excerpt
Swarm Storage 10.0 Release
Swarm Storage 10.0 Release
nopaneltrue

Watch Items and Known Issues

The following watch items are known:

  • Volumes newly formatted in Swarm 11.1, 11.2, or 11.3 to use encryption-at-rest cannot be downgraded to Swarm 11.0 or earlier without a special procedure to prevent data loss. Contact DataCore Support before any such downgrade with encrypted volumes. (SWAR-8941)

  • Infrequent WARNING messages, "Node/Volume entry not published due to lock contention (...); action will be retried," may appear in logs. Unless they are frequent, they may be ignored. (SWAR-8802)

  • If a node mounts an encrypted volume that is missing the encryption key in the configuration, the node

    will fail

    fails to mount all

    of the

    disks in the node. (SWAR-8762)

  • S3 Backup feeds do not

    yet

    backup logical objects

    larger

    greater than 5 GB. (SWAR-8554)

  • When restarting a cluster of virtual machines that are UEFI-booted (versus legacy BIOS), the chassis shut down but

    do

    does not come back up. (SWAR-8054)

  • With multipath-enabled hardware, the Swarm console Disk Volume Menu may erroneously show too many disks, having multiplied the actual disks in use by the number of possible paths to them. (SWAR-7248)

These are standing operational limitations:

  • If

    you downgrade

    downgrading from Swarm 11.0, CRITICAL errors may appear on

    your

    the feeds. To stop the errors, edit the existing feed definition names via the Swarm UI or legacy Admin Console. (SWAR-8543)

  • If

    you wipe your

    the Elasticsearch cluster is wiped, the Storage UI

    will show

    shows no NFS config. Contact DataCore Support for help repopulating

    your

    the SwarmFS config information. (SWAR-8007)

  • If

    you delete

    a bucket is deleted, any incomplete multipart upload into that bucket

    will leave its

    leaves the parts (unnamed streams) in the domain. To find and delete them, use the s3cmd utility (search the Support site for "s3cmd" for guidance). (SWAR-7690)

  • If you remove

    Removing subcluster assignments in the CSN UI

    , doing so

    creates invalid config parameters

    that will prevent

    preventing the unassigned nodes from booting. (SWAR-7675)

  • Logs showed the error "FEEDS WARNING: calcFeedInfo(etag=xxx)

    couldn't

    cannot find domain xxx, which is needed for a domains-specific replication feed". The root cause is fixed; if

    you received

    such warnings are received, contact DataCore Support so

    that your

    the issue can be resolved. (SWAR-7556)

  • If a feed is subject to a prolonged outage, a node reboot may be required for it to resume progress after the outage is cleared. If progress is not resolved after the reboot, contact DataCore Support. This has been resolved in 12.1.0 (SWAR-9062)

  • If Elasticsearch 6.8.6 blocks an index due to low disk space, this

    will have

    needs to be issued against each index (index_*, csmeter*, metrics*) in the read_only_allow_delete state. This is no longer an issue after upgrading to Swarm 12 / Elasticsearch 7 as it automatically unblocks when disk space frees up. (SWAR-8944)

    Code Block
    curl -i -XPUT "<ESSERVERIP>:9200/<INDEXNAME>/_settings" -d '{"index.blocks.read_only_allow_delete" : null}' -H "Content-Type: application/json"

Upgrading Swarm

Note these installation issues whenever when upgrading Swarm:

  • The elasticsearch-curator package may show an error during an upgrade, which is a known curator issue. Workaround: Reinstall the curator

    : yum reinstall

    . (SWAR-7439)

    Code Block
    yum reinstall elasticsearch-curator
    (SWAR-7439)
  • Do not install the Swarm Search RPM before installing Java. If Gateway startup fails with "Caringo script plugin is missing from indexer nodes", uninstall and reinstall the Swarm Search RPM. (SWAR-7688)

To Proceed to How to Upgrade Swarm to upgrade Swarm 9 or higher, proceed to How to Upgrade Swarm.

Info
title

Important

If you need Contact DataCore Support for guidance if needing to migrate from Swarm 8.x or earlier, contact Support for guidance.