/
Search Operations

Search Operations

Owned by Rumena Zlatkova (Deactivated)
Last updated: Jan 03, 2024 by Bala Harish A(AC)
2 min read

Search operations are an extremely powerful feature for locating content; they work on the metadata of the objects within the storage cluster. Searches use metadata matching constraints provided in the client request and return a list of objects that match those constraints.

Searches can take place across all objects within the domain or searches can be constrained to the context of a particular bucket. When full metadata search is enabled, you can use any custom metadata field value as a search constraint.

Best Practice

Do not apply a context filter redundantly in cases where Swarm filters by default, such as when searching for named objects in a bucket, buckets in a domain, or unnamed objects in a domain.

Performance Impact

Consider performance when designing searches spanning entire domains. context (domain and bucket) names are looked up from the contextid, so these domain-wide searches incur an additional performance penalty:

  • Retrieving the context field

  • Sorting on the context field

  • Filtering on the context field

Tip

Check the performance impact when sorting and filtering across an entire domain.

Search Examples

Unless otherwise noted all matching operations are string-based comparisons:

Searching within a domain
GET /?format=json&domain=myDomain &content-type=application/pdf
Searching within a bucket
GET /myBucket?format=json&domain=myDomain &content-type=application/pdf
Searching by multiple field matching
GET /?format=json&domain=myDomain &x-color-meta=red &content-type=image/png
Using fields= to return specific field names
GET /myBucket?format=json&domain=myDomain &fields=name,content-length

Enabling Case-Insensitive Search (name.lower)

You control case-sensitivity in your Elasticsearch queries by using the correct form of the name field:

  • name field: ES searches are case-sensitive, so searching FOO matches only FOO

  • name.lower field: ES searches are case-insensitive (as if all values are lowercase), so searching FOO matches FOO, Foo, foo

The Swarm search setting, search.caseInsensitive, is specific to SCSP queries, versus querying ES directly. When this is enabled, case-insensitive SCSP search queries are performed by default. (v9.0)

Swarm Setting

Effect

Swarm Setting

Effect

search.caseInsensitive = 1

All name-based searches use the name.lower field, so SCSP named searches are always case-insensitive.

search.caseInsensitive = 0

All name-based searches use the name field, and is case-sensitive.

Important

Custom metadata values are always indexed to be only case-sensitive or case-insensitive, depending on the value of search.caseInsensitive. If an index is built with the wrong setting, you must change the setting and build a new index.

Using Content-Length

The content-length field for objects is recognized as a numeric field and supports equality, less-than-equal-to, and greater-than-equal-to matching operators.

Tip

Use ">=" or "=>" and "<=" or "=<".

Using content-length
GET /?format=json&domain=myDomain&content-length=1024  GET /?format=json&domain=myDomain&content-length<=1024  GET /?format=json&domain=myDomain&content-length>=1024

Important

The Content-MD5 metadata field cannot be used as a search constraint, either alone or with other fields. Use it only in the output fields for a search.

Related content

© DataCore Software Corporation. · https://www.datacore.com · All rights reserved.