Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info

Important

Enable this feature only with Swarm 15 and later versions; do not enable this feature with Swarm 14 and earlier versions.

Note

Multipart Write was previously referred to as Parallel Write; the functionality is the same.

With Multipart Write, you can upload parts Parts of a large object from multiple clients at the same time can be uploaded with Multipart Write. Multipart Write allow allows client applications to split a large file into multiple pieces, transfer the pieces concurrently to Swarm, and then request that Swarm combine the separately uploaded parts together as a single object, thereby minimizing the upload time.

Multipart write requires erasure coding (Erasure Coding EC). The health processor (HP) has the ability to can consolidate the segments of erasure-coded objects that have with sub-optimal segment usage, such as can happen when you do performing SCSP or S3 multipart writes of objects using small parts. We recommend DataCore recommends configuring clients to use 50MB-100MB 50MB–100MB parts. To enable consolidation, set Set the configuration setting, ec.segmentConsolidationFrequency, to 10 (recommended), which performs all consolidations over 20 HP cycles , if consolidation is needed.

Info

Tip

Every multipart write must be erasure-coded for upload; however, the HP converts it to a replicated object if the uploaded object does not meet the current policy for EC encoding, the HP converts it to a replicated object. To . Add a lifepoint to that effect to maintain erasure coding for the lifetime of the object, add a lifepoint to that effect.

...

.

Three distinct actions must be performed in this order to upload a large object in parts using multipart write, you must perform three distinct actions in this order:

  1. Initiate a multipart write.

  2. Upload or copy the parts.

  3. Complete or cancel the procedure.

...