Most use cases for Swarm involve ingesting petabytes of unstructured data, such as image, video, and document files, which must be secured, preserved, searched, and retrieved on demand.
Active Archive — video : Video evidence, medical imaging, and cultural media
Cloud — cloud : Cloud services and , hosting (multi-tenant) , and backup to the cloud
Content Delivery — social : Social media (millions of photos per day), streaming video (millions of videos), and content publishing (millions of images)
Big Data — evidence : Evidence analysis, medical insurance records and analysis, IoT/M2M and analytics
Compliance— legal : Legal documents, court materials, and digital evidence
Swarm supports many usage scenarios based on four fundamental access methods:
Direct Access | Native (SCSP API) | |
---|
Web Access | Content Gateway (S3 API) | Data in the object store is presented via web browser (Content UI) S3 endpoint is provided Support for actions such as upload, download, and browse Back-end access to the object store are native API calls
|
---|
File Protocol Gateway | SwarmFS (to Native SCSP) | Provides translation of traditional file protocols (such as NFS and SMB) to object storage protocols Usually translates to object store native API Used as a “drop box” target for clients/applications coded to work with traditional filers Advanced protocol gateway support for manipulation of metadata, in addition to data via traditional utilities (such as shell sessions) Placement into object store supports alternate access methods (SCSP or S3) and metadata queries, listings, and collections
|
---|
Automated Tiering | FileFly | Application/agent integration (native API integration) Agents exist on data sources (such as filers) Relationship between local file reference and data stored at object tier is maintained by agent software Data is moved from local to object tier based on policy (scheduled or ad hoc) Retrieval of data when client requests access is automatic and transparent
|
---|
These are common architectures for object storage:
...
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126886462 |
---|
pageId | 2443807957 | custContentId | 3126886462 |
---|
lbox | 1 |
---|
diagramDisplayName | Use case - Archiving |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - Archiving |
---|
pCenter | 0 |
---|
width | 588 |
---|
links | |
---|
tbstyle | |
---|
height | 243 |
---|
|
Data tiering
Relocation of data from traditional filers to object storage
Scheduled tiering based on policy
Automated recall when an access request is made
Transparent access to the end user
“Cheap and deep” object-store tier to reduce filer expansion costs
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126951998 |
---|
pageId | 2443807957 | custContentId |
---|
3126951998 | lbox | 1 |
---|
diagramDisplayName | Use case - Data tiering |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - Data tiering |
---|
pCenter | 0 |
---|
width | 588 |
---|
links | |
---|
tbstyle | |
---|
height | 246 |
---|
|
...
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126951992 |
---|
pageId | 2443807957 |
---|
custContentId | 3126951992 |
---|
lbox | 1 |
---|
diagramDisplayName | Use case - FileFly Virtualization |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - FileFly Virtualization |
---|
pCenter | 0 |
---|
width | 633 |
---|
links | |
---|
tbstyle | |
---|
height | 403 |
---|
|
Remote replication and disaster recovery
Automated replication from a local object store to a remote object store
Data is usually populated in a local store, then replicated to remote/DR
“Hot” sites can also act as replication targets/DR for each other
Can be whole-site replication or policy based (per domain)
Varying complexity in replication topologies supported (site-to-site, M to N, single or bi-directional)
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126919224 |
---|
pageId | 2443807957 | custContentId | 3126919224 |
---|
lbox | 1 |
---|
diagramDisplayName | Use case - remote replication |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - remote replication |
---|
pCenter | 0 |
---|
width | 451 |
---|
links | |
---|
tbstyle | |
---|
height | 499 |
---|
|
...
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126919233 |
---|
pageId | 2443807957 | custContentId |
---|
3126919233 | lbox | 1 |
---|
diagramDisplayName | Use case - Dual site one interface |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - Dual site one interface |
---|
pCenter | 0 |
---|
width | 588 |
---|
links | |
---|
tbstyle | |
---|
height | 499 |
---|
|
...
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126820922 |
---|
pageId | 2443807957 |
---|
custContentId | 3126820922 |
---|
lbox | 1 |
---|
diagramDisplayName | Use case - Dual site dual interface |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - Dual site dual interface |
---|
pCenter | 0 |
---|
width | 622 |
---|
links | |
---|
tbstyle | |
---|
height | 467 |
---|
|
Managed service (“Storage as a Service”)
Storage protocol endpoints made available to service subscribers
Support for multiple RESTful access protocols
SSL/TLS
Provides authentication and authorization
Allows for metering and billing
Supports quota control
Multi-tenancy (individuals, business organizations, business units)
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126755370 |
---|
pageId | 2443807957 | custContentId |
---|
3126755370 | lbox | 1 |
---|
diagramDisplayName | Use case - Managed service SaaS |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - Managed service SaaS |
---|
pCenter | 0 |
---|
width | 588 |
---|
links | |
---|
tbstyle | |
---|
height | 499 |
---|
|
Hybrid Cloud (local storage with Cloud)
Local object store integrated with a cloud service endpoint (such as Azure)
“Copy to Cloud” for backup and/or publication of data
“Retrieve from Cloud” for data recovery
Lower CapEx when meeting backup/replication/DR requirements
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3127017544 |
---|
pageId | 2443807957 | custContentId | 3127017544 |
---|
lbox | 1 |
---|
diagramDisplayName | Use case - hybrid cloud |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - hybrid cloud |
---|
pCenter | 0 |
---|
width | 611 |
---|
links | |
---|
tbstyle | |
---|
height | 398 |
---|
|
Drawio |
---|
zoom | 1 |
---|
simple | 0 |
---|
inComment | 0 |
---|
custContentId | 3126951986 |
---|
pageId | 2443807957 | custContentId | 3126951986 |
---|
lbox | 1 |
---|
diagramDisplayName | Use case - Hybrid cloud dual |
---|
contentVer | 1 |
---|
revision | 2 |
---|
baseUrl | https://perifery.atlassian.net/wiki |
---|
diagramName | Use case - Hybrid cloud dual |
---|
pCenter | 0 |
---|
width | 652 |
---|
links | |
---|
tbstyle | |
---|
height | 515 |
---|
|
...