Versions Compared

Version Old Version 34 New Version Current
Changes made by

Anjali Tyagi

Anjali Tyagi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel2
outlinefalse
typelist
printablefalse

New Features

  • Internode communication: Internode communication has been optimized for better load handling. (SWAR-10167)

  • Emergency Defragmentation: A new setting has been introduced to enable high-priority defragmentation without extra configurations. (SWAR-9276)

  • RPC Improvement: An exponential back-off is implemented in case of failed RPCs to help under heavy load conditions. (SWAR-10319)

  • SSD Trim Support: Swarm Storage nodes now support SAS and SATA -based SSDs. See also [DRAFT] Enhanced Configuring SSD Support with Automated TRIM Feature (SWAR-9883)

  • ES8 Support: Swarm now supports Elasticsearch (ES) 8 and later. (SWAR-9536)

New Settings

  • node.maxRPCPollsLost: Resolved Swarm node reboots under load by introducing node.maxRPCPollsLost to throttle on RPC status loss. (SWAR-10319)

  • disk.enforceEmergencyDefrag: Added the setting to enable high-priority defragmentation without additional configurations. (SWAR-9276)

  • cip.multicastThreads: Configured the number of CIP CFILTER worker threads dedicated to processing incoming multicast UDP messages. (SWAR-10167)

  • cip.emptyQueueCheckInterval: Introduced a setting to define the wait time (in ms) before verifying if the internode UDP message queue is empty for further processing. (SWAR-10167)

  • cip.maxQueueSize: Added a limit on the maximum size (in bytes) of the Unicast/Multicast queue for CIP CFILTER, recommended to be twice the value of cip.ReadBufferSize. (SWAR-10167)

  • cip.queueThrottleTimeout: Implemented a timeout setting (in ms) to delay attempts to push internode UDP messages into the queue when it reaches full capacity. (SWAR-10167)

  • cip.unicastThreads: Defined the number of CIP CFILTER worker threads handling incoming unicast UDP messages. (SWAR-10167)

See also [DRAFT] Settings Reference for more information.

New Headers

  • Castor-System-Delete-Marker-TmBorn: Returns the time born of a delete marker. (SWAR-10351)

  • Completion-Content-Length: Returns the size of the uploaded object upon Multipart Completion. (SWAR-10350)

  • Castor-System-Indexing-DocId: Returns the expected ES Document ID associated with the object. (SWAR-10370)

Fixed in 17.0

  • Default PDI Enablement: Per Domain Indexing (PDI) is enabled by default. (SWAR-10359)

  • Search Feed Deletion Improvement: Deleting a Search Feed created with search.perDomainIndex=True now removes all associated domain indices in Elasticsearch. Use the Storage UI for this, not the legacy port 90 console. (SWAR-10264)

  • Uninitialized / Used disks: DataCore recommends checking and formatting the disk before attaching it to a Swarm Storage Node to prevent potential data loss when hot-plugging partitioned, used, or unformatted disks/volumes. (SWAR-10206)

  • Memory Leak Fix: Fixed memory leak issue which occurred over time in the loaded cluster. (SWAR-10124)

  • Node Reboot During Heavy Load: Fixed an issue that caused Swarm Storage Nodes to reboot under heavy load due to SCSP process failures. (SWAR-10319)

  • Recovery Failure: Fixed an issue where volumes pending for mount were added to the recovery suspend list, causing no recovery. (SWAR-10061)

  • New API Schema fields: Added new API schema fields (usedMBytes, trappedMBytes, and usedSpaceMB). (SWAR-10400)

  • 409 Error Due to Full Volumes: Fixed an issue where Swarm kept trying to use full volumes and occasionally the retry failed with a 409 error under heavy load scenarios. (SWAR-10249)

  • False 404s: Fixed false 404s error that occurs sometimes in Swarm responses during heavy load situations. (SWAR-10120)

  • Port Overflow: Fixed a port overflow issue that occurred when a cluster remained up for an extended period, affecting new processes. (SWAR-10276)

  • Improved Health Report Handling: Health reports will now be sent without dmesg if it becomes unresponsive. (SWAR-10185)

Watch Items and Known Issues

The following watch items are known:

  • Customizations to an Elasticsearch 6.8.6 /etc/elasticsearch/elasticsearch.yml path.data and network.host fields will be lost when running the configuration script to upgrade to Elasticsearch 7 if the upgrade is incomplete. This can happen if the new Elasticsearch 7 rpm is not in the current directory and cannot be downloaded. Reapply your customizations as this will not affect upgrades starting with Elasticsearch 7.5.2. Users need to back up their customizations before running the upgrade script. (SWAR-9977)

Note

Caution

Contact DataCore Support if you are still using Elasticsearch 6.8.6.

...

To upgrade Swarm 9 or higher, proceed to How to Upgrade Swarm. For migration from Swarm 8.x or earlier, contact DataCore Support for guidance.

Info

Instructions for rpm v15.2 and above on CSN

The user must follow the below steps if using rpm version 15.2 or above on the CSN:

  1. Edit the /etc/caringo/netboot/netboot.cfg file on the CSN.

  2. Verify that the KernelOptions parameter includes the new maximum size for the ramdisk.

    Code Block
    kernelOptions = castor_net=active-backup: ramdisk_size=190000

    Use a space separator between “active-backup:” and ramdisk_size=190000 as used in the above command.

  3. Restart netboot.
    service netboot restart

Deprecation

  • The search.caseInsensitive is now deprecated and will be removed in a future release. (SWAR-10085)

  • The fields usedBytes, trappedBytes, and usedSpace are now deprecated and will be removed in future releases. (SWAR-10400)

OSS Versions

See [DRAFT] Third-Party Components for Storage 17.0 for the complete listing of packages and versions for this release.

...