Versions Compared

Old Version 9

changes.mady.by.user Anjali Tyagi

Saved on

compared with

New Version 10

changes.mady.by.user Anjali Tyagi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel2
outlinefalse
typelist
printablefalse

New Features

  • Elasticsearch Domain Based Indexing: Swarm 16.1.2 introduces cluster setting search.perDomainIndex. Set it True and lower search.numberOfShards before creating a new search feed to create a separate Elasticsearch index for each domain, rather than the default of storing all domains in a single index. This setting should only be enabled with the guidance of DataCore Support team. (SWAR-4452)

Gateway Version

This feature requires gateway v8.1.0 and above.

Info

Info

Because there are limits on the number of shards per Elasticsearch node, the number of domains the Swarm cluster will support is also limited.

Additional Changes

Changes include versions and fixes based on testing and user feedback.

OSS Versions

See [DRAFT] Third-Party Components for Storage 16.1.2 for the complete listing of packages and versions for this release.

Fixed in 16.1.2

  • From v16.1.2, feed statistics will neither be stuck nor spike on reboot. (SWAR-9720)

Watch Items and Known Issues

The following watch items are known:

  • Customizations to an Elasticsearch 6.8.6 /etc/elasticsearch/elasticsearch.yml path.data and network.host fields will be lost when running the configuration script to upgrade to Elasticsearch 7 if the upgrade does not complete. This can happen if the new Elasticsearch 7 rpm is not in the current directory and cannot be downloaded. Reapply your customizations as this will not affect upgrades starting with Elasticsearch 7.5.2. (SWAR-9977)

  • False 404s might be seen in the Swarm responses during heavy load situations. To mitigate this, please verify “cip.processes = 2”, and keep increasing the cip.queryMinimumTimeout value gradually until the 404 occurrences are reduced. (SWAR-10120)

  • When using search.perDomainIndex=True (under Support guidance), the number of supported domains is limited based on the number of data nodes in the Elasticsearch cluster and search.numberOfShards. For example, Five data nodes support 5x600 shards at search.numberOfShards=6; each domain requires 6x2 (primary and replica) shards. If more than 250 domains are created, new indices cannot be created resulting in the domain listing that returns a 503 ReaderUnavailableIndex. The castor.log will show errors EFD19, EIP15, and EIP02.
    For example, "Validation Failed: this action would add [6] shards, but the cluster currently has maximum [999]/[1000] normal open shards". Error reporting will be improved in a future release. (SWAR-10172)

Note

Caution

Contact DataCore Support if you are still using Elasticsearch 6.8.6.

...

To upgrade Swarm 9 or higher, proceed to How to Upgrade Swarm. For migration from Swarm 8.x or earlier, contact DataCore Support for guidance.

Info

Instructions for rpm v15.2 and above on CSN

The user must follow the below steps if using rpm version 15.2 or above on the CSN:

  1. Edit the /etc/caringo/netboot/netboot.cfg file on the CSN.

  2. Verify that the KernelOptions parameter includes the new maximum size for the ramdisk.

    Code Block
    kernelOptions = castor_net=active-backup: ramdisk_size=190000

    Use a space separator between “active-backup:” and ramdisk_size=190000 as used in the above command.

  3. Restart netboot.
    service netboot restart

Deprecation

  • The search.caseInsensitive is now deprecated and will be removed in a future release. (SWAR-10085)