{"type":"doc","content":[{"type":"extension","attrs":{"layout":"default","extensionType":"com.atlassian.confluence.macro.core","extensionKey":"toc","parameters":{"macroParams":{"minLevel":{"value":"1"},"maxLevel":{"value":"2"},"outline":{"value":"false"},"_parentId":{"value":"2443825886"},"type":{"value":"list"},"printable":{"value":"false"}},"macroMetadata":{"macroId":{"value":"8f77ed30-8353-4e73-9977-5941eb1544cb"},"schemaVersion":{"value":"1"},"title":"Table of Contents"}},"localId":"bc5085a4-2aae-4e7b-9dc9-dddd0ac31177"}},{"type":"heading","attrs":{"level":1},"content":[{"text":"1 Introduction","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"1.1 What is Caringo FileFly?","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo FileFly is a heterogeneous Data Management System. It automates and manages the movement of data from primary storage locations to Caringo Swarm or CloudScaler object storage.","type":"text"},{"type":"hardBreak"},{"text":"Files are ","type":"text"},{"text":"migrated","type":"text","marks":[{"type":"em"}]},{"text":" from primary storage locations to the object store. Files are ","type":"text"},{"text":"demigrated","type":"text","marks":[{"type":"em"}]},{"text":" transparently when accessed by a user or application. FileFly also provides a range of Disaster Recovery options.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"1.1.0.1 What is Migration?","type":"text"}]},{"type":"paragraph","content":[{"text":"From a technical perspective, file migration can be summarized as follows: first, the file content and corresponding metadata are copied to secondary storage as an MWI file/object. Next, the original file is marked as a 'stub' and truncated to zero ","type":"text"},{"text":"physical","type":"text","marks":[{"type":"em"}]},{"text":" size (while retaining the original ","type":"text"},{"text":"logical","type":"text","marks":[{"type":"em"}]},{"text":" size for the benefit of users and the correct operation of applications). The resulting stub file will remain on primary storage in this state until such time as a user or application requests access to the file content, at which point the data will be automatically returned to primary storage.","type":"text"},{"type":"hardBreak"},{"text":"Each stub encapsulates the location of the corresponding MWI data on secondary storage, without the need for a database or other centralized component.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"1.2 Conventions used in this Book","type":"text"}]},{"type":"paragraph","content":[{"text":"References to ","type":"text"},{"text":"labels, values and literals","type":"text","marks":[{"type":"strong"}]},{"text":" in the software are in ","type":"text"},{"text":"'quoted italics'","type":"text","marks":[{"type":"em"}]},{"text":".","type":"text"},{"type":"hardBreak"},{"text":"References to ","type":"text"},{"text":"actions","type":"text","marks":[{"type":"strong"}]},{"text":", such as clicking buttons, are in ","type":"text"},{"text":"bold","type":"text","marks":[{"type":"strong"}]},{"text":".","type":"text"},{"type":"hardBreak"},{"text":"References to ","type":"text"},{"text":"commands and text typed in","type":"text","marks":[{"type":"strong"}]},{"text":" are in fixed font.","type":"text"},{"type":"hardBreak"},{"text":"Notes are denoted: ","type":"text"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" This is a note.","type":"text"},{"type":"hardBreak"},{"text":"Important notes are denoted: ","type":"text"},{"text":"Important: Important point here.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"1.3 System Components","type":"text"}]},{"type":"paragraph","content":[{"text":"Figure 1.1 provides an overview of a FileFly system. All communication between FileFly components is secured with Transport Layer Security (TLS). The individual components are described below.","type":"text"},{"type":"hardBreak"},{"type":"hardBreak"},{"text":" ","type":"text"},{"type":"inlineExtension","attrs":{"extensionType":"com.atlassian.confluence.migration","extensionKey":"inline-media-image","parameters":{"width":"560","id":"ea41d455-2d02-4a26-a50a-a5ad75c24173","collection":"contentId-2443825886","height":"429"}}},{"type":"hardBreak"},{"text":"Figure 1.1: FileFly System Overview","type":"text","marks":[{"type":"em"}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"1.3.0.1 Caringo FileFly Admin Portal","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly Admin Portal is the system's policy manager. It provides a centralized web-based configuration interface and is responsible for task scheduling, policy simulation, server monitoring, and file reporting. It lies outside the data path for file transfers.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"1.3.0.2 Caringo FileFly Agent","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo FileFly Agent performs file operations as directed by Admin Portal Policies. FileFly Agent is also responsible for retrieving file data from secondary storage upon user/application access.","type":"text"},{"type":"hardBreak"},{"text":"File operations include migration and demigration, as well as a range of operations to assist disaster recovery. Data is streamed directly between agents and storage without any intermediary staging on disk.","type":"text"},{"type":"hardBreak"},{"text":"When installed in a Gateway configuration, FileFly Agent does not allow migration of files from that server.","type":"text"},{"type":"hardBreak"},{"text":"Optionally, Gateways can be configured for High-Availability (HA).","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"1.3.0.3 Caringo FileFly FPolicy Server","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly FPolicy Server provides migration support for NetApp filers via the NetApp FPolicy protocol. This component is the equivalent of Caringo FileFly Agent for NetApp filers.","type":"text"},{"type":"hardBreak"},{"text":"FileFly FPolicy Server may also be configured for High-Availability (HA).","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"1.3.0.4 Caringo FileFly DrTool","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo FileFly DrTool is an additional application that assists in Disaster Recovery scenarios.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"2 Deployment","type":"text"}]},{"type":"paragraph","content":[{"text":"This chapter will cover:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Installing Caringo FileFly Tools","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Installing Caringo FileFly Agent on file servers","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Installing Caringo FileFly Gateways as required","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Getting started with FileFly policies","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Production readiness","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Refer to these instructions during initial deployment and when adding new components. For upgrade instructions, please refer to Chapter 8 instead.","type":"text"}]},{"type":"paragraph","content":[{"text":"For further details and usage instructions for each platform, refer to Chapter 4.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"2.1 DNS Best Practice","type":"text"}]},{"type":"paragraph","content":[{"text":"In a production deployment, Fully Qualified Domain Names (FQDNs) should always be used in preference to bare IP addresses.","type":"text"}]},{"type":"paragraph","content":[{"text":"Storage locations in Caringo FileFly are referred to by URI. Relationships between files must be maintained over a long period of time. It is therefore advisable to take steps to ensure that the FQDNs used in these URIs are valid long-term, even as individual server roles are changed or consolidated.","type":"text"}]},{"type":"paragraph","content":[{"text":"Create DNS aliases for each logical storage role for each server. For example, use different DNS aliases when storing your finance department's data as opposed to your engineering department's data – even if they initially reside on the same server.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"2.2 Installing FileFly Tools","type":"text"}]},{"type":"paragraph","content":[{"text":"The Caringo FileFly Tools package consists of the FileFly Admin Portal and the FileFly DrTool application. The FileFly Admin Portal provides central management of policy execution while the FileFly DrTool is used in disaster recovery situations.","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly Tools must be installed before any other components.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.2.1 System Requirements","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A ","type":"text"},{"text":"dedicated","type":"text","marks":[{"type":"strong"}]},{"text":" server with a supported operating system:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2016","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2012 R2 (Apr 2014 update rollup)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2012","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2008 R2 SP1","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Minimum 4GB RAM","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Minimum 2GB disk space for log files","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Active clock synchronization (e.g. via NTP)","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Internet Explorer 11 or higher (possibly on a separate workstation) will be required to access the FileFly Admin Portal web interface.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.2.2 Setup","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run Caringo FileFly Tools.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions on screen","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"After completing the installation process, FileFly Tools must be configured via the Admin Portal web interface. The FileFly Admin Portal will be opened automatically and can be found later via the Start Menu.","type":"text"}]},{"type":"paragraph","content":[{"text":"The interface will lead you through the process for installing your license.","type":"text"}]},{"type":"paragraph","content":[{"text":"For production licensed installations, a 'Backup & Scrub Grace Period' setup page will be displayed. Please read the text carefully and set the minimum grace period as appropriate and after consulting with your backup plan – see also §7.2. This value may be revised later via the ","type":"text"},{"text":"'Settings'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"2.3 Installing FileFly Agents","type":"text"}]},{"type":"paragraph","content":[{"text":"Once FileFly Tools installation is complete, proceed to install Caringo FileFly Agents as described below. FileFly Agents perform file operations as directed by Admin Portal Policies. Also, in the case of user/application initiated demigration, agents retrieve the file data from secondary storage autonomously.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.3.1 FileFly Agent Server Roles","type":"text"}]},{"type":"paragraph","content":[{"text":"Each FileFly Agent server may fulfill one of two roles, selected at installation time.","type":"text"}]},{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'FileFly Agent for migration'","type":"text","marks":[{"type":"em"}]},{"text":" role, an agent assists the operating system to migrate and demigrate files. It is ","type":"text"},{"text":"essential","type":"text","marks":[{"type":"strong"}]},{"text":" for the agent to be installed on all machines from which files will be migrated.","type":"text"}]},{"type":"paragraph","content":[{"text":"In the Gateway role, the agent provides access to CloudScaler and Swarm destinations.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.3.2 High-Availability Gateway Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"A high-availability gateway configuration is recommended. Such FileFly Gateways must be activated as 'High-Availability FileFly Gateways'.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.3.2.1 High-Availability Gateway DNS Setup","type":"text"}]},{"type":"paragraph","content":[{"text":"At least two FileFly Gateways are required for High-Availability.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add each FileFly Gateway server to DNS","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a single alias that maps to each of the IP addresses","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Use this alias in FileFly destination URIs, never individual nodes","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Example:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gw-1.example.com → 192.168.0.1","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gw-2.example.com → 192.168.0.2","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gw.example.com → 192.168.0.1, 192.168.0.2","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The servers that form the High-Availability Gateway cluster must NOT be members of a Windows failover cluster.","type":"text"},{"type":"hardBreak"},{"text":"For further DNS recommendations, refer to §2.1.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.3.3 Installing Caringo FileFly Agent for Windows Servers","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.3.3.1 System Requirements","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Supported Windows Server operating system:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2016","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2012 R2 (Apr 2014 update rollup)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2012","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2008 R2 SP1","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Minimum 4GB RAM","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Minimum 2GB disk space for log files","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Active clock synchronization (e.g. via NTP)","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" When installed in the Gateway role, a ","type":"text"},{"text":"dedicated","type":"text","marks":[{"type":"strong"}]},{"text":" server is required, unless it is to be co-located on the FileFly Tools server. When co-locating, create separate DNS aliases to refer to the Gateway and the FileFly Admin Portal web interface.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.3.3.2 Setup","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Agent.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select install location","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select migration or Gateway role as appropriate, refer to §2.3.1","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If installing a FileFly Gateway, select the desired plugins","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions to activate the agent via FileFly Admin Portal","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.3.3.3 Activation","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If no clustering is required, activate as a ","type":"text"},{"text":"'Standalone Server'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If installing the FileFly Gateway for High-Availability, activate as a High-Availability FileFly Gateway","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If the server is part of a Windows failover cluster, and this clustered resource is to be used as a FileFly Source, activate as a Windows failover cluster node","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"For further information see §5.3.1.","type":"text"},{"type":"hardBreak"},{"text":"Important: If any type of clustering is used, ensure that FileFly Agent for Windows is installed on ALL cluster nodes.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.3.4 Installing Caringo FileFly FPolicy Server for NetApp Filers","type":"text"}]},{"type":"paragraph","content":[{"text":"A Caringo FileFly FPolicy Server provides migration support for one or more NetApp Filers through the FPolicy protocol. This component is the equivalent of Caringo FileFly Agent for NetApp Filers. Typically FileFly FPolicy Servers are installed in a high-availability configuration.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.3.4.1 System Requirements","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A ","type":"text"},{"text":"dedicated","type":"text","marks":[{"type":"strong"}]},{"text":" server with a supported operating system:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2016","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2012 R2 (Apr 2014 update rollup)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2012","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2008 R2 SP1","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Minimum 4GB RAM","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Minimum 2GB disk space for log files","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Active clock synchronization (e.g. via NTP)","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.3.4.2 Setup","type":"text"}]},{"type":"paragraph","content":[{"text":"Installation of the FileFly FPolicy Server software requires careful preparation of the NetApp Filer and the FileFly FPolicy Server machines. Instructions are provided in §4.2.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Legacy 7-Mode Filers require a different procedure at FileFly FPolicy Server installation time – see §4.3.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"2.4 Installing Config Tools","type":"text"}]},{"type":"paragraph","content":[{"text":"In addition to the components described above, it may also be necessary to install one or more Config Tools. Full details are provided where required for each storage platform in Chapter 4.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"2.5 Getting Started","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.5.1 Analyzing Volumes","type":"text"}]},{"type":"paragraph","content":[{"text":"Once the software has been installed, the first step in any new Caringo deployment is to analyze the characteristics of the primary storage volumes. The following steps describe how to generate file statistics reports for each volume.","type":"text"}]},{"type":"paragraph","content":[{"text":"In the FileFly Admin Portal web interface (see Chapter 5 for full documentation):","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create Sources for each volume to analyze","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a 'Gather Statistics' Policy and select all defined Sources","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Task for the 'Gather Statistics' Policy","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Quick Run","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click on the Task's name to run it immediately","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When the Task has finished, expand the details by clicking on the Task name under ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Go to Task","type":"text","marks":[{"type":"strong"}]},{"text":" to navigate to the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Access the report by clicking on ","type":"text"},{"text":"View Last Stats","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"paragraph","content":[{"text":"Pay particular attention to the 'Last Modified % by size' graph. This graph will help identify how much data would be affected by a migration policy based on the age of files.","type":"text"}]},{"type":"paragraph","content":[{"text":"Examine 'File types by size' to see if the data profile matches the expected usage of the volume.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.5.2 Preparing for Migration","type":"text"}]},{"type":"paragraph","content":[{"text":"Using the information from the reports, create tasks to migrate files:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Prepare a destination for migrated files – see Chapter 4","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Destination in FileFly Admin Portal","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Rule and a Migration Policy","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A typical rule might limit migrations to files modified more than six months ago – do not use an 'all files' rule","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To avoid unnecessary migration of active files, be conservative with your first Migration Policy","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Task for the new Policy","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For now, disable the schedule","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Save the task, then click on its name to open the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Simulate Now","type":"text","marks":[{"type":"strong"}]},{"text":" to run a Task simulation","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Examine the resultant reports (view the Task and click ","type":"text"},{"text":"View Last Stats","type":"text","marks":[{"type":"strong"}]},{"text":")","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"If the results of simulation differ from expectations, it may be necessary to modify the rules and re-run the simulation.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The simulation reports created above show details of the subset of files matched by the rules in the policies only.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Reports are generated for simulations only – a real Task run will log each file operation, but will not generate a statistics report.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.5.3 Running and Scheduling Migration","type":"text"}]},{"type":"paragraph","content":[{"text":"Use ","type":"text"},{"text":"Quick Run","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab to run the migration Task immediately.","type":"text"}]},{"type":"paragraph","content":[{"text":"Migration is typically performed periodically: configure a schedule on the migration Task's details page.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2.5.4 Next Steps","type":"text"}]},{"type":"paragraph","content":[{"text":"Chapter 3 describes all FileFly Policy Operations in detail and will help you to get the most out of FileFly.","type":"text"}]},{"type":"paragraph","content":[{"text":"The remainder of this chapter gives guidance on using FileFly in a production environment.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"2.6 Production Readiness Checklist","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.6.0.1 Backup","type":"text"}]},{"type":"paragraph","content":[{"text":"Refer to Chapter 6 for details of how to backup FileFly configuration.","type":"text"}]},{"type":"paragraph","content":[{"text":"Next, be sure to test that your backup and restore software respects stubs appropriately. Specifically:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Review the backup and restore procedures described in Chapter 7","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check backup software can backup stubs without triggering demigration","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check backup software restores stubs and that they can be demigrated","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"As an additional measure to increase the range of available restore options, schedule regular ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"em"}]},{"text":" Policies on your migration sources.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.6.0.2 Antivirus","type":"text"}]},{"type":"paragraph","content":[{"text":"Generally, antivirus software will not cause demigrations during normal file access. However, some antivirus software will demigrate files when performing scheduled file system scans.","type":"text"}]},{"type":"paragraph","content":[{"text":"Prior to production deployment, always check that installed antivirus software does not cause unwanted demigrations. Some software must be configured to skip offline files in order to avoid these inappropriate demigrations. Consult the antivirus software documentation for further details.","type":"text"}]},{"type":"paragraph","content":[{"text":"If the antivirus software does ","type":"text"},{"text":"not","type":"text","marks":[{"type":"em"}]},{"text":" provide an option to skip offline files during a scan, Caringo FileFly Agent may be configured to deny demigration rights to the antivirus software. Refer to §13.5 for more information.","type":"text"}]},{"type":"paragraph","content":[{"text":"It may be necessary for some antivirus products to exempt the Caringo FileFly Agent process from real-time protection (scan-on-access). For example, using Microsoft Security Essentials (MSE), it is necessary to add e.g. C:\\Program Files\\Caringo FileFly\\FileFly Agent\\\\mwi_clmb.exe to the 'Excluded Processes' list. Be sure to update the exclusion whenever FileFly is upgraded.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.6.0.3 Other System-wide Applications","type":"text"}]},{"type":"paragraph","content":[{"text":"Check for other applications that open all the files on the whole volume. Audit scheduled processes on the file server – if such processes cause unwanted demigration, it may be possible to block them (see §13.5).","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.6.0.4 Monitoring and Notification","type":"text"}]},{"type":"paragraph","content":[{"text":"To facilitate proactive monitoring, it is recommended to configure one or both of the following mechanisms:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Configure email notifications to monitor system health and Task activity – see §5.10","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enable syslog on agents – see §13.1","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"2.6.0.5 Platform Considerations","type":"text"}]},{"type":"paragraph","content":[{"text":"For further information on plaform-specific interoperability considerations, please refer to the appropriate sections of Chapter 4.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"2.7 Policy Tuning","type":"text"}]},{"type":"paragraph","content":[{"text":"Periodically re-assess file distribution and access behavior:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run 'Gather Statistics' Policies","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Examine reports","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Examine Server statistics – see §5.3","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For more detail, examine demigrates in file server agent.log files","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"Consider:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Are there unexpected peaks in demigration activity?","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Are there any file types that should not be migrated?","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Should different rules be applied to different file types?","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Is the Migration Policy migrating data that is regularly accessed?","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Are the Rules aggressive enough or too aggressive?","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"What is the data growth rate on primary and secondary storage?","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Are there subtrees on the source file system that should be addressed by separate policies or excluded from the source entirely?","type":"text"}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"3 Policy Operations","type":"text"}]},{"type":"paragraph","content":[{"text":"This chapter describes the various operations that may be performed on selected files by FileFly Admin Portal policies.","type":"text"}]},{"type":"paragraph","content":[{"text":"User interface operation is further detailed in Chapter 5.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.1 Gather Statistics Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Generate statistics report(s) for file sets at the selected Source(s). Optionally, include statistics by the file owner. By default, owner statistics are omitted which generally results in a faster policy run. Additionally, rules may be used to specify a subset of files on which to report rather than the whole source.","type":"text"}]},{"type":"paragraph","content":[{"text":"Statistics reports can be retrieved from FileFly Admin Portal – see §5.8.6.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"type":"inlineExtension","attrs":{"extensionType":"com.atlassian.confluence.macro.core","extensionKey":"anchor","parameters":{"macroParams":{"":{"value":"migrate-operation"},"legacyAnchorId":{"value":"FileFly3.2AdministrationGuide-migrate-operation"},"_parentId":{"value":"2443825886"}},"macroMetadata":{"macroId":{"value":"724e3e45-5463-48bc-97b9-2542aed15640"},"schemaVersion":{"value":"1"},"title":"Anchor"}},"localId":"693b1dbd-34be-4c0f-bd1a-c6d8cec59c8f"}},{"text":"3.2 Migrate Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s), Rule(s), Destination ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Migrate file data from selected Source(s) to a Destination. Stub files remain at the Source location as placeholders until files are demigrated. File content will be transparently demigrated (returned to primary storage) when accessed by a user or application. Stub files retain the original logical size and file metadata. Files containing no data will not be migrated. ","type":"text"}]},{"type":"paragraph","content":[{"text":"Each Migrate operation will be logged as a Migrate, Remigrate, or Quick-Remigrate.","type":"text"}]},{"type":"paragraph","content":[{"text":"A Remigrate is the same as a Migrate except it explicitly recognizes that a previous version of the file had been migrated in the past and that stored data pertaining to that previous version is no longer required and so is eligible for removal via a Scrub policy.","type":"text"}]},{"type":"paragraph","content":[{"text":"A Quick-Remigrate occurs when a file has been demigrated and NOT modified. In this case, it is not necessary to retransfer the data to secondary storage so the operation can be performed very quickly. Quick-remigration does ","type":"text"},{"text":"not change the secondary storage location","type":"text","marks":[{"type":"strong"}]},{"text":" of the migrated data.","type":"text"}]},{"type":"paragraph","content":[{"text":"Optionally, quick-remigration of files demigrated within a specified number of days may be skipped. This option can be used to avoid quick-remigrations occurring in an overly aggressive fashion.","type":"text"}]},{"type":"paragraph","content":[{"text":"Additionally, this policy may be configured to pause during the globally configured work hours.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.3 Quick-Remigrate Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s), Rule(s) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Quick-Remigrate demigrated files that do not require data transfer, enabling space to be reclaimed quickly. This operation acts only on files that have not been altered since the last migration.","type":"text"}]},{"type":"paragraph","content":[{"text":"Optionally, files demigrated within a specified number of days may be skipped. This option can be used to avoid quick-remigrations occurring in an overly aggressive fashion.","type":"text"}]},{"type":"paragraph","content":[{"text":"Additionally, this policy may be configured to pause during the globally configured work hours.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.4 Scrub Destination Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Destination (non-WORM) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Remove unnecessary stored file content from a migration destination. This is a maintenance policy that should be scheduled regularly to reclaim space.","type":"text"}]},{"type":"paragraph","content":[{"text":"A grace period must be specified which is sufficient to cover the time from when a backup is taken to when the restore and corresponding Post-Restore Revalidate policy would complete. The grace period effectively delays the removal of data sufficiently to accommodate the effects of restoring primary storage from backup to an earlier state.","type":"text"}]},{"type":"paragraph","content":[{"text":"Use of scrub is desirable to maximize storage efficiency. In order to also maximize performance benefits from quick-remigration, it is advisable to schedule migration / quick-remigration policies more frequently than the grace period.","type":"text"}]},{"type":"paragraph","content":[{"text":"To avoid interactions with migration policies, Scrub tasks are automatically paused while migration-related tasks are in progress.","type":"text"}]},{"type":"paragraph","content":[{"text":"Important: Source(s) MUST be backed up within the grace period","type":"text","marks":[{"type":"strong"}]},{"text":".","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.5 Post-Restore Revalidate Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Scan all stubs present on a given Source, revalidating the relationship between the stubs and the corresponding files on secondary storage. This operation is required following a restore from backup and should be performed on the ","type":"text"},{"text":"root","type":"text","marks":[{"type":"strong"}]},{"text":" of the restored source volume.","type":"text"}]},{"type":"paragraph","content":[{"text":"If ","type":"text"},{"text":"only","type":"text","marks":[{"type":"em"}]},{"text":" Write Once Read Many (WORM) destinations are in use, this policy is not required.","type":"text"}]},{"type":"paragraph","content":[{"text":"Important: This revalidation operation MUST be integrated into backup/restore procedures, see","type":"text","marks":[{"type":"strong"}]},{"text":" §","type":"text"},{"text":"7.2","type":"text","marks":[{"type":"strong"}]},{"text":".","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.6 Demigrate Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s), Rule(s) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Return migrated file content back to files on the selected Source(s). This is useful when a large batch of files must be demigrated in advance.","type":"text"}]},{"type":"paragraph","content":[{"text":"Prior to running a Demigrate policy, be sure that there is sufficient primary storage available to accommodate the demigrated data.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.7 Advanced Demigrate Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s), Rule(s) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Demigrates files with advanced options:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Disconnect files from destination","type":"text","marks":[{"type":"strong"}]},{"text":" – remove destination information from demigrated files (both files demigrated by this policy and files that have already been demigrated); it will no longer be possible to quick-remigrate these files","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A ","type":"text"},{"text":"Destination Filter","type":"text","marks":[{"type":"strong"}]},{"text":" may optionally be specified in order to demigrate/disconnect only files that were migrated to a particular destination","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"It is recommended that this operation be used only after consultation with a Caringo engineer. Prior to running an Advanced Demigrate policy, be sure that there is sufficient primary storage available to accommodate the demigrated data.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.8 Simple Premigrate Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s), Rule(s), Destination ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"},{"type":"hardBreak"},{"text":"Premigrate file data from selected Source(s) to a Destination in preparation for migration. Files on primary storage will not be converted to stubs until a Migrate or Quick-Remigrate Policy is run. Files containing no data will not be premigrated.","type":"text"}]},{"type":"paragraph","content":[{"text":"This can assist with:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a requirement to delay the stubbing process until secondary storage backup or replication has occurred","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"reduction of excessive demigrations while still allowing an aggressive Migration Policy.","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Premigration is, as the name suggests, intended to be followed by full migration / quick-remigration. If this is not done, a large number of files in the premigrated state may slow down further premigration policies, as the same files are rechecked each time.","type":"text"}]},{"type":"paragraph","content":[{"text":"By default, files already premigrated to another destination will be skipped when encountered during a premigrate policy.","type":"text"}]},{"type":"paragraph","content":[{"text":"This policy may also be configured to pause during the globally configured work hours.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Most deployments will not use this operation, but will use a combination of Migrate and Quick-Remigrate instead.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.9 Create DrTool File From Source Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s), Rule(s) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" no","type":"text"}]},{"type":"paragraph","content":[{"text":"Generate a disaster recovery file for Caringo FileFly DrTool by analyzing files at the selected Source(s). FileFly DrTool can use the generated file(s) to recover or update source files.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" DrTool files generated from ","type":"text"},{"text":"Source","type":"text","marks":[{"type":"em"}]},{"text":" will account for renames.","type":"text"}]},{"type":"paragraph","content":[{"text":"DrTool files can be retrieved from FileFly Admin Portal – see §5.8.7.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.10 Create DrTool File From Destination Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Destination ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" no","type":"text"}]},{"type":"paragraph","content":[{"text":"Generate a disaster recovery file for Caringo FileFly DrTool by reading the index and analyzing files at the selected Destination without reference to the associated primary storage files.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" DrTool files from ","type":"text"},{"text":"Destination","type":"text","marks":[{"type":"em"}]},{"text":" may not account for renames.","type":"text"}]},{"type":"paragraph","content":[{"text":"Important: It is strongly recommended to use","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"strong"},{"type":"em"}]},{"text":" ","type":"text"},{"text":"in preference where possible.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"3.11 Erase Cached Data Operation","type":"text"}]},{"type":"paragraph","content":[{"text":"Requires:","type":"text","marks":[{"type":"strong"}]},{"text":" Source(s), Rule(s) ","type":"text"},{"text":"Included in Community Edition:","type":"text","marks":[{"type":"strong"}]},{"text":" yes","type":"text"}]},{"type":"paragraph","content":[{"text":"Erases cached data associated with files by the ","type":"text"},{"text":"Partial Demigrate","type":"text","marks":[{"type":"em"}]},{"text":" feature (NetApp Sources only). ","type":"text"},{"text":"Important: The Erase Cached Data operation is not enabled by default. It must be enabled in the advanced section on the Admin Portal","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Settings'","type":"text","marks":[{"type":"strong"},{"type":"em"}]},{"text":" ","type":"text"},{"text":"page.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"4 Sources and Destinations","type":"text"}]},{"type":"paragraph","content":[{"text":"The following pages describe the characteristics of the Sources and Destinations supported by Caringo FileFly. Planning, setup, usage, and maintenance considerations are outlined for each storage platform.","type":"text"}]},{"type":"paragraph","content":[{"text":"IMPORTANT: Read any relevant sections of this chapter prior to deploying FileFly in a production environment.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.1 Microsoft Windows","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.1.1 Migration Support","type":"text"}]},{"type":"paragraph","content":[{"text":"Windows NTFS volumes may be used as migration sources. On Windows Server 2016, ReFS volumes are supported as migration sources.","type":"text"},{"type":"hardBreak"},{"text":"Windows stub files can be identified by the 'O' (Offline) attribute in Explorer. Depending on the version of Windows, files with this flag may be displayed with an overlay icon.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.1.2 Planning","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.2.1 Prerequisites","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A license that includes an appropriate entitlement for Windows","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"When creating a production deployment plan, please refer to §2.6.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.2.2 Cluster Support","type":"text"}]},{"type":"paragraph","content":[{"text":"Clustered volumes managed by Windows failover clusters are supported. However, the Cluster Shared Volume (CSVFS) feature is NOT supported. On Windows Server 2012 and above, when configuring a 'File Server' role in the Failover Cluster Manager, 'File Server for general use' is the only supported File Server Type. The 'Scale-Out File Server for application data' File Server Type is NOT supported.","type":"text"},{"type":"hardBreak"},{"text":"When using clustered volumes in FileFly URIs, ensure that the resource FQDN appropriate to the volume is specified rather than the FQDN of any individual node.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.1.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.3.1 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"See Installing FileFly Agent for Windows §2.3.3","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.1.4 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.4.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"win://{servername}/{drive letter}/[{path}]","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"servername – Server FQDN or Windows Failover File Server Resource FQDN","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"drive letter – Windows volume drive letter","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Examples:","type":"text"},{"type":"hardBreak"},{"text":"win://fs1.example.com/d/projects win://fs2.example.com/e/","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Share names and mapped drives are not supported.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.1.5 Interoperability","type":"text"}]},{"type":"paragraph","content":[{"text":"This section describes Windows-specific considerations only and should be read in conjunction with 2.6.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.5.1 Microsoft DFS Namespaces (DFSN)","type":"text"}]},{"type":"paragraph","content":[{"text":"DFSN is supported. FileFly Sources must be configured to access volumes on individual servers directly rather than through a DFS namespace. Users and applications may continue to access files and stubs via DFS namespaces as normal.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.5.2 Microsoft DFS Replication (DFSR)","type":"text"}]},{"type":"paragraph","content":[{"text":"DFSR is supported for:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2016","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2012 R2","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows Server 2008 R2","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"FileFly Agents must be installed (selecting the ","type":"text"},{"text":"migration","type":"text","marks":[{"type":"em"}]},{"text":" role during installation) on ","type":"text"},{"text":"EACH","type":"text","marks":[{"type":"strong"}]},{"text":" member server of a DFS Replication Group prior to running migration tasks on any of the group's Replication Folders.","type":"text"}]},{"type":"paragraph","content":[{"text":"If adding a new member server to an existing Replication Group where FileFly is already in use, FileFly Agent must be installed on the new server first.","type":"text"}]},{"type":"paragraph","content":[{"text":"When running policies on a Replicated Folder, sources should be defined such that each policy acts upon ","type":"text"},{"text":"only one","type":"text","marks":[{"type":"strong"}]},{"text":" replica. DFSR will replicate the changes to the other members as usual.","type":"text"}]},{"type":"paragraph","content":[{"text":"Read-only (one-way) replicated folders are NOT supported. However, read-only SMB shares can be used to prevent users from writing to a particular replica as an alternative.","type":"text"}]},{"type":"paragraph","content":[{"text":"Due to the way DFSR is implemented, care should be taken to avoid ","type":"text"},{"text":"writing","type":"text","marks":[{"type":"em"}]},{"text":" to stub files that are being concurrently accessed from another replica.","type":"text"}]},{"type":"paragraph","content":[{"text":"In the rare event that DFSR-replicated data is restored to a member from backup, ensure that DFSR services on all members are running and that replication is ","type":"text"},{"text":"fully up-to-date","type":"text","marks":[{"type":"strong"}]},{"text":" (check for the DFSR 'finished initial replication' Windows Event Log message), then run a Post-Restore Revalidate Policy using the same source used for migration.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.5.3 Retiring a DFSR Replica","type":"text"}]},{"type":"paragraph","content":[{"text":"Retiring a replica effectively creates two ","type":"text"},{"text":"independent","type":"text","marks":[{"type":"em"}]},{"text":" copies of each stub, without updating secondary storage. To avoid any potential loss of data:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Delete the contents of the retired replica (preferably by formatting the disk, or at least disable Stub Deletion Monitoring during the deletion)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run a Post-Restore Revalidate Policy on the remaining copy of the data","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"If it is strictly necessary to keep both, now independent, copies of the data and stubs, then run a Post-Restore Revalidate Policy on ","type":"text"},{"text":"both","type":"text","marks":[{"type":"strong"}]},{"text":" copies separately (not concurrently).","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.5.4 Preseeding a DFSR Replicated Folder Using Robocopy","type":"text"}]},{"type":"paragraph","content":[{"text":"The most common use of Robocopy with FileFly stubs is to preseed or stage initial synchronization. When performing such a preseeding operation:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"for new Replicated Folders, ensure that the 'Primary member' is set to be the original server, not the preseeded copy","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"both servers must have FileFly Agent installed ","type":"text"},{"text":"before","type":"text","marks":[{"type":"strong"}]},{"text":" preseeding","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"add a \"Process Exclusion\" to Windows Defender for robocopy.exe (allow a while for the setting to take effect)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"on the source server, preseed by running robocopy with the /b flag (to copy stubs as-is to the new server)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"once preseeding is complete and replication is ","type":"text"},{"text":"fully up-to-date","type":"text","marks":[{"type":"strong"}]},{"text":" (check for the DFSR 'finished initial replication' Windows Event Log message), it is recommended to run a Post-Restore Revalidate Policy on the original FileFly Source","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" If the process above is aborted, be sure to delete all preseeded files and stubs (preferably by formatting the disk, or at least disable Stub Deletion Monitoring during the deletion) and then run a Post-Restore Revalidate Policy on the original FileFly Source.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.5.5 Robocopy (Other Uses)","type":"text"}]},{"type":"paragraph","content":[{"text":"Robocopy will, by default, demigrate stubs as they are copied. This is the same behavior as Explorer copy-paste, xcopy, etc.","type":"text"}]},{"type":"paragraph","content":[{"text":"Robocopy with the /b flag (backup mode – must be performed as an administrator) will copy stubs as-is.","type":"text"}]},{"type":"paragraph","content":[{"text":"Robocopy /b is not recommended.","type":"text","marks":[{"type":"strong"}]},{"text":" If stubs ","type":"text"},{"text":"are","type":"text","marks":[{"type":"em"}]},{"text":" copied in this fashion, the following must be considered:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"for a copy from one server to another, both servers must have Caringo FileFly Agent installed","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"this operation is essentially a backup and restore in one step, and thus inappropriately duplicates stubs that are intended to be unique","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"after the duplication, one copy of the stubs should be deleted immediately","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"run a Post-Restore Revalidate policy on the remaining copy","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"this process will render the corresponding secondary storage files un-scrubbable, even after they are demigrated","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"to prevent Windows Defender triggering demigrations when the stubs are accessed in this fashion:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"always run the robocopy from the source end (the file server with the stubs)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"add a \"Process Exclusion\" to Windows Defender for robocopy.exe (allow a while for the setting to take effect)","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.5.6 Windows Data Deduplication","type":"text"}]},{"type":"paragraph","content":[{"text":"If a Windows source server is configured to use migration policies and Windows Data Deduplication, it should be noted that a given file can either be deduplicated or migrated, but not both at the same time. FileFly migration policies will automatically skip files that are already deduplicated. Windows skips FileFly stubs when deduplicating.","type":"text"}]},{"type":"paragraph","content":[{"text":"When using both technologies, it is recommended to configure Data Deduplication and Migration based on file type such that the most efficacious strategy is chosen for each type of file.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Microsoft's legacy Single Instance Storage (SIS) feature is not supported. Do not use SIS on the same server as Caringo FileFly Agent.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.5.7 Windows Shadow Copy","type":"text"}]},{"type":"paragraph","content":[{"text":"Windows Shadow Copy – also known as Volume Snapshot Service (VSS) – allows previous versions of files to be restored, e.g. from Windows Explorer. This mechanism cannot be used to restore a stub. Restore stubs from backup instead – see Chapter 7.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.1.6 Behavioral Notes","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.6.1 Junction Points & Symlinks","type":"text"}]},{"type":"paragraph","content":[{"text":"With the exception of volume mount points, junction points will be skipped during traversal of the file system. Symlinks are also skipped. This ensures that files are not seen – and thus acted upon – multiple times during a single execution of a given policy. If it is intended that a policy should apply to files within a directory referred to by a junction point, either ensure that the Source encompasses the real location at the junction point's destination, or specify the junction point itself as the Source.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.1.6.2 Mount-DiskImage","type":"text"}]},{"type":"paragraph","content":[{"text":"On Windows 8 or above, VHD and ISO images may be mounted as normal drives using the PowerShell Mount-DiskImage cmdlet. This functionality can also be accessed via the Explorer context menu for an image file.","type":"text"}]},{"type":"paragraph","content":[{"text":"A known limitation of this cmdlet is that it does not permit ","type":"text"},{"text":"sparse","type":"text","marks":[{"type":"em"}]},{"text":" files to be mounted (see Microsoft KB2993573). Since migrated image files are always sparse, they must be demigrated prior to mounting. This can be achieved either by copying the file or by removing the sparse flag with the following command:","type":"text"},{"type":"hardBreak"},{"text":"fsutil sparse setflag 0","type":"text","marks":[{"type":"em"}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.1.7 Stub Deletion Monitoring","type":"text"}]},{"type":"paragraph","content":[{"text":"On Windows, the FileFly Agent can monitor stub deletions to identify secondary storage files that are no longer referenced in order to maximize the usefulness of Scrub Policies. This feature extends not only to stubs that are directly deleted by the user, but also to other cases of stub file destruction such as overwriting a stub or renaming a different file over the top of a stub.","type":"text"},{"type":"hardBreak"},{"text":"Stub Deletion Monitoring is disabled by default. To enable it, please refer to §13.2.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.2 NetApp Filer (Cluster-mode)","type":"text"}]},{"type":"paragraph","content":[{"text":"This section describes support for 'Cluster-mode' NetApp Filers. For '7-mode' Filers (that is, 7.x Filers and 8.x Filers operating in '7-mode'), see §4.3.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.1 Migration Support","type":"text"}]},{"type":"paragraph","content":[{"text":"Migration support for sources on NetApp Vservers (Storage Virtual Machines) is provided via NetApp FPolicy. This requires the use of a Caringo FileFly FPolicy Server. Client demigrations can be triggered via SMB or NFS client access.","type":"text"}]},{"type":"paragraph","content":[{"text":"Please note that NetApp Filers currently support FPolicy for Vservers with FlexVol volumes but not Infinite volumes.","type":"text"}]},{"type":"paragraph","content":[{"text":"When accessed via SMB on a Windows client, NetApp stub files can be identified by the 'O' (Offline) attribute in Explorer. Files with this flag may be displayed with an overlay icon. The icon may vary depending on the version of Windows on the client workstation.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.2 Planning","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.2.1 Prerequisites","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"NetApp Filer(s) must be licensed for the particular protocol(s) to be used (FPolicy requires a CIFS license)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A FileFly license that includes an entitlement for FileFly NetApp FPolicy Server","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Caringo FileFly FPolicy Servers require ","type":"text"},{"text":"EXCLUSIVE","type":"text","marks":[{"type":"strong"}]},{"text":" use of SMB connections to their associated NetApp Vservers. This means Explorer windows must not be opened, drives must not be mapped, nor should any UNC paths to the filer be accessed from the FileFly FPolicy Server machine. Failure to observe this restriction will result in unpredictable FPolicy disconnections and interrupted service.","type":"text"},{"type":"hardBreak"},{"text":"When creating a production deployment plan, please refer to §2.6.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.2.2 Filer System Requirements","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo FileFly FPolicy Server requires that the Filer is running:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Data ONTAP version 9.0 – 9.4","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.2.3 Network","type":"text"}]},{"type":"paragraph","content":[{"text":"Each FileFly FPolicy Server should have exactly one IP address.","type":"text"}]},{"type":"paragraph","content":[{"text":"Place the FPolicy Servers on the same subnet and same switch as their corresponding Vservers to minimize latency.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.2.4 Antivirus Considerations","type":"text"}]},{"type":"paragraph","content":[{"text":"Ensure that Windows Defender or any other antivirus product installed on FileFly FPolicy Server machines is configured to ","type":"text"},{"text":"omit","type":"text","marks":[{"type":"strong"}]},{"text":" scanning/screening NetApp shares.","type":"text"}]},{"type":"paragraph","content":[{"text":"Antivirus access to NetApp files will interfere with the correct operation of the FileFly FPolicy Server software. Antivirus protection should still be provided on client machines and/or the NetApp Vservers themselves as normal.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.2.5 High-Availability for FileFly FPolicy Servers","type":"text"}]},{"type":"paragraph","content":[{"text":"It is strongly recommended to install Caringo FileFly FPolicy Servers in a High-Availability configuration. This configuration requires the installation of Caringo FileFly FPolicy Server on a group of machines which are addressed by a single FQDN. This provides High-Availability for migration and demigration operations on the associated Vservers.","type":"text"}]},{"type":"paragraph","content":[{"text":"Typically a pair of FileFly FPolicy Servers operating in HA will service all of the Vservers on a NetApp cluster.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The servers that form the High-Availability FileFly FPolicy Server configuration must ","type":"text"},{"text":"not","type":"text","marks":[{"type":"strong"}]},{"text":" be members of a Windows failover cluster.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.2.6 DNS Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"All Active Directory Servers, Caringo FileFly FPolicy Servers, and NetApp Filers, ","type":"text"},{"text":"must","type":"text","marks":[{"type":"strong"}]},{"text":" have both forward ","type":"text"},{"text":"and","type":"text","marks":[{"type":"strong"}]},{"text":" reverse records in DNS.","type":"text"},{"type":"hardBreak"},{"text":"All hostnames used in Filer and FileFly FPolicy Server configuration must be FQDNs.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.3.1 Setup Parameters","type":"text"}]},{"type":"paragraph","content":[{"text":"Before starting the installation the following parameters must be considered:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Management LIF IP Address: the address for management access to the ","type":"text"},{"text":"Vserver","type":"text","marks":[{"type":"strong"}]},{"text":" (not to be confused with cluster or node management addresses)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"CIFS Privileged User: a domain user for the exclusive use of FPolicy","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.3.2 Preparing Vserver Management Access","type":"text"}]},{"type":"paragraph","content":[{"text":"For each Vserver, ensure that 'Management Access' is allowed for at least one LIF. Check the LIF in OnCommand System Manager –- if Management Access is not enabled, either add access to an existing LIF or create a new LIF just for Management Access.","type":"text"},{"type":"hardBreak"},{"text":"Management authentication may be configured to use either passwords or client certificates. Management connections may be secured via TLS – this is mandatory when using certificate-based authentication.","type":"text"},{"type":"hardBreak"},{"text":"For password-based authentication:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the Vserver in OnCommand System Manager and navigate to Configuration → Security → Users","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add a user for Application ","type":"text"},{"text":"'ontapi'","type":"text","marks":[{"type":"em"}]},{"text":" with Role ","type":"text"},{"text":"'vsadmin'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Record the username and password for later use on the ","type":"text"},{"text":"'Management'","type":"text","marks":[{"type":"em"}]},{"text":" tab in Caringo FileFly NetApp Cluster-mode Config","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Alternatively, for certificate-based authentication:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a client certificate with common name ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Open a command line session to the ","type":"text"},{"text":"cluster","type":"text","marks":[{"type":"strong"}]},{"text":" management address","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Upload the ","type":"text"},{"text":"CA","type":"text","marks":[{"type":"em"}]},{"text":" Certificate (or the client certificate itself if self-signed):","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"security certificate install -type client-ca -vserver ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Paste the contents of the CA Certificate at the prompt","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"security login create -username -application ontapi -authmethod cert -role vsadmin -vserver ","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.3.3 Configuring CIFS Privileged Data Access","type":"text"}]},{"type":"paragraph","content":[{"text":"If it has not already been created, create the CIFS Privileged User on the domain. Each FileFly FPolicy Server will use the same CIFS Privileged User for all Vservers that it will manage.","type":"text"},{"type":"hardBreak"},{"text":"In OnCommand System Manager:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Navigate to the Vserver","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a new local 'Windows' group with ALL available privileges","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the CIFS Privileged User to this group","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Allow a few minutes for the change to take effect (or FileFly FPolicy Server operations may fail with access denied errors)","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.3.4 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"On each FileFly FPolicy Server machine:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Close any SMB sessions open to Vserver(s) before proceeding","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the CIFS Privileged User has the 'Log on as a service' privilege","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly NetApp FPolicy Server.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions to activate the installation as either a standalone server or High-Availability Caringo FileFly FPolicy Server","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.3.5 Installing ","type":"text"},{"text":"'Caringo FileFly NetApp Cluster-mode Config'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer: Caringo FileFly NetApp Cluster-mode Config.exe","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.3.6 Configuring Components","type":"text"}]},{"type":"paragraph","content":[{"text":"Run Caringo FileFly NetApp Cluster-mode Config.","type":"text"},{"type":"hardBreak"},{"text":"On the ","type":"text"},{"text":"'FPolicy Config'","type":"text","marks":[{"type":"em"}]},{"text":" tab:","type":"text"}]},{"type":"paragraph","content":[{"text":"Enter the FQDN used to register the FileFly FPolicy Server(s) in FileFly Admin Portal","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter the CIFS Privileged User","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Management'","type":"text","marks":[{"type":"em"}]},{"text":" tab:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Provide the credentials for management access (see above)","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Vservers'","type":"text","marks":[{"type":"em"}]},{"text":" tab:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Add…","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter the FQDN of the Vserver's Data Access LIF","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, enter the FQDN of a different LIF for Vserver Management","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If using TLS for Management, click ","type":"text"},{"text":"Get Server CA","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Apply to Filer","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"paragraph","content":[{"text":"Once the configuration is complete, click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":".","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.3.7 Apply Configuration to FileFly FPolicy Servers","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the netapp_clustered.cfg file has been copied to the correct location on all FileFly FPolicy Server machines","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\netapp_clustered.cfg","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the Caringo FileFly Agent service on each machine","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.4 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.4.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"netapp://{FPolicy Server}/{NetApp Vserver}/{SMB Share}/[{path}]","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"FPolicy Server – FQDN alias that points to all FileFly FileFly FPolicy Servers for the given Vserver","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"NetApp Vserver – FQDN of the Vserver's Data Access LIF","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"SMB Share – NetApp SMB share name","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Example:","type":"text"},{"type":"hardBreak"},{"text":"netapp://fpol-svrs.example.com/vs1.example.com/data/","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The chosen SMB share must be configured to ","type":"text"},{"text":"Hide","type":"text","marks":[{"type":"strong"}]},{"text":" symbolic links. If symbolic link support is required for other SMB clients, create a separate share just for FileFly traversal that does hide links.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.5 Snapshot Restore","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.5.1 Volume Restore","type":"text"}]},{"type":"paragraph","content":[{"text":"After an entire volume containing stubs is restored from snapshot, a Post-Restore Revalidate Policy must be run, as per the restore procedure described in Chapter 7.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.5.2 Individual Stub Restore","type":"text"}]},{"type":"paragraph","content":[{"text":"Users cannot perform self-service restoration of ","type":"text"},{"text":"stubs","type":"text","marks":[{"type":"em"}]},{"text":". However, an administrator may restore specific stubs or sets of stubs from snapshots by following the procedure outlined below. Be sure to provide this procedure to all administrators.","type":"text"},{"type":"hardBreak"},{"text":"IMPORTANT: The following instructions mandate the use of Robocopy specifically. Other tools, such as Windows Explorer copy or the","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Restore'","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"function in the Previous versions dialog, WILL NOT correctly restore stubs.","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"To restore one or more stubs from a snapshot-folder like:","type":"text"},{"type":"hardBreak"},{"text":"\\\\\\~snapshot\\\\","type":"text"},{"type":"hardBreak"},{"text":"to a restore folder on the ","type":"text"},{"text":"same Filer","type":"text","marks":[{"type":"em"}]},{"text":" like:","type":"text"},{"type":"hardBreak"},{"text":"\\\\\\\\","type":"text"},{"type":"hardBreak"},{"text":"perform the following steps:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Navigate to an FileFly FPolicy Server machine","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Open a command window","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"robocopy […] [/b]","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On a client machine (","type":"text"},{"text":"NOT","type":"text","marks":[{"type":"strong"}]},{"text":" the FileFly FPolicy Server), open ","type":"text"},{"text":"all","type":"text","marks":[{"type":"strong"}]},{"text":" of the restored file(s) or demigrate them using a Demigrate Policy","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check that the file(s) have demigrated correctly","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"IMPORTANT: Until the demigration above is performed, the restored stub(s) may occupy space for the full size of the file.","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"As with any other FileFly restore procedure, be sure to run a Post-Restore Revalidate Policy across the volume before the next Scrub – see Chapter 7.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.6 Interoperability","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.6.1 NDMP Backup","type":"text"}]},{"type":"paragraph","content":[{"text":"NDMP Backup products require ONTAP 9.2+ for interoperability with FileFly.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.6.2 Robocopy","type":"text"}]},{"type":"paragraph","content":[{"text":"Except when following the procedure in §4.2.5, Robocopy ","type":"text"},{"text":"must not","type":"text","marks":[{"type":"strong"}]},{"text":" be used with the /b (backup mode) switch when copying FileFly NetApp stubs.","type":"text"},{"type":"hardBreak"},{"text":"When in backup mode, robocopy attempts to copy stub files as-is rather than demigrating them as they are read. This behavior is not supported.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The /b switch requires Administrator privilege – it is not available to normal users.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.7 Behavioral Notes","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.7.1 Unix Symbolic Links","type":"text"}]},{"type":"paragraph","content":[{"text":"Unix Symbolic links (also known as symlinks or softlinks) may be created on a Filer via an NFS mount. Symbolic links will not be seen during FileFly Policy traversal of a NetApp file system (since only shares which hide symbolic links are supported for traversal). If it is intended that a policy should apply to files within a folder referred to by a symbolic link, ensure that the Source encompasses the real location at the link's destination. A Source URI may NOT point to a symbolic link – use the real folder that the link points to instead.","type":"text"},{"type":"hardBreak"},{"text":"Client-initiated demigrations via symbolic links will operate as expected.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.7.2 QTree and User Quotas","type":"text"}]},{"type":"paragraph","content":[{"text":"NetApp QTree and user quotas are measured in terms of ","type":"text"},{"text":"logical","type":"text","marks":[{"type":"em"}]},{"text":" file size. Thus, migrating files has no effect on quota usage.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.7.3 Snapshot Traversal","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly will automatically skip snapshot directories when traversing shares using the netapp scheme.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.8 Skipping Sparse Files","type":"text"}]},{"type":"paragraph","content":[{"text":"It is often undesirable to migrate files that are highly sparse since sparseness is not preserved by the migration process.","type":"text"},{"type":"hardBreak"},{"text":"To enable sparse files to be skipped during migration policies, navigate to the Admin Portal ","type":"text"},{"text":"'Settings Page'","type":"text","marks":[{"type":"em"}]},{"text":" and tick ","type":"text"},{"text":"'Enable sparse file skipping'","type":"text","marks":[{"type":"em"}]},{"text":".","type":"text"},{"type":"hardBreak"},{"text":"Skipping sparse files may then be configured per migration policy. On the ","type":"text"},{"text":"'Policy Details'","type":"text","marks":[{"type":"em"}]},{"text":" page for Migrate and Simple Premigrate operations, tick 'skip files more than 0% sparse'_ and adjust the percentage as required using the drop-down box.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.9 Advanced Configuration","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.9.1 Alternative Engine IP Addresses","type":"text"}]},{"type":"paragraph","content":[{"text":"Alternative engine IP addresses may be provided on the FileFly NetApp Cluster-mode Config ","type":"text"},{"text":"'Advanced'","type":"text","marks":[{"type":"em"}]},{"text":" tab if filer communication is to be performed on a different IP address than that used for Admin Portal to FPolicy Server communication. This allows each node to have two IP addresses. Care must be taken that ALL communication – in both directions – between filer and FileFly FPolicy Server node occurs using the ","type":"text"},{"text":"engine","type":"text","marks":[{"type":"strong"}]},{"text":" address.","type":"text"},{"type":"hardBreak"},{"text":"Ordinarily, one IP address per server is sufficient. Contact DataCore Support if an advanced network configuration is required.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.9.2 Cache First Block","type":"text"}]},{"type":"paragraph","content":[{"text":"When migrating files, the first block of the file may optionally be cached. This allows small reads to file headers to be completed immediately, without accessing secondary storage. By default this feature is disabled. This feature may be enabled on the ","type":"text"},{"text":"'Advanced'","type":"text","marks":[{"type":"em"}]},{"text":" tab. The ","type":"text"},{"text":"'Prefix size'","type":"text","marks":[{"type":"em"}]},{"text":" field allows the amount cached on disk after a migration to be tuned.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.2.10 Troubleshooting","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.10.1 Troubleshooting Management Login","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Open a command line session to the ","type":"text"},{"text":"cluster","type":"text","marks":[{"type":"strong"}]},{"text":" management address","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"security login show -vserver ","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"There should be an entry for the expected user for application ","type":"text"},{"text":"'ontapi'","type":"text","marks":[{"type":"em"}]},{"text":" with role ","type":"text"},{"text":"'vsadmin'","type":"text","marks":[{"type":"em"}]}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.10.2 Troubleshooting TLS Management Access","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Open a command line session to the ","type":"text"},{"text":"cluster","type":"text","marks":[{"type":"strong"}]},{"text":" management address","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"vserver context -vserver ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"security certificate show","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"There should be a ","type":"text"},{"text":"'server'","type":"text","marks":[{"type":"em"}]},{"text":" certificate for the Vserver management FQDN (NOT the bare hostname)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If using certificate-based authentication, there should be a ","type":"text"},{"text":"'client-ca'","type":"text","marks":[{"type":"em"}]},{"text":" entry","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"security ssl show","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"There should be an enabled entry for the Vserver management FQDN (NOT the bare hostname)","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.10.3 Troubleshooting Vserver Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"Vserver configuration can be validated using Caringo FileFly NetApp Cluster-mode Config.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Open the netapp_clustered.cfg in FileFly NetApp Cluster-mode Config","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Navigate to the ","type":"text"},{"text":"'Vservers'","type":"text","marks":[{"type":"em"}]},{"text":" tab","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select a Vserver","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Edit…","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Verify","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.2.10.4 Troubleshooting 'ERR_ADD_PRIVILEGED_SHARE_NOT_FOUND'","type":"text"}]},{"type":"paragraph","content":[{"text":"If the FileFly FPolicy Server reports privileged share is not found, there is a misconfiguration or SMB issue. Please attempt the following steps:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check all configurations using troubleshooting steps described above","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the FileFly FPolicy Server has no other SMB sessions to Vservers","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"run net use from Windows Command Prompt","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"remove all mapped drives","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Reboot the server","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Retry the failed operation","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check for new errors in agent.log","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.3 NetApp Filer (7-mode)","type":"text"}]},{"type":"paragraph","content":[{"text":"This section describes support for NetApp Filers 7.3 and above including 8.x Filers operating in '7-mode'. For version 9.x Filers and 8.x Filers running in 'Cluster-mode', see §4.2.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.1 Migration Support","type":"text"}]},{"type":"paragraph","content":[{"text":"Migration support for sources on NetApp Filers is provided via NetApp FPolicy. This requires the use of a Caringo FileFly FPolicy Server. FileFly supports the use of both physical Filers and vFilers as migration sources. Client demigrations can be triggered via SMB or NFS client access.","type":"text"},{"type":"hardBreak"},{"text":"When accessed via SMB on a Windows client, NetApp stub files can be identified by the 'O' (Offline) attribute in Explorer. Files with this flag will be displayed with an overlay icon. The icon may vary depending on the version of Windows on the client workstation.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.2 Planning","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.2.1 Prerequisites","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"NetApp Filer(s) must be licensed for the particular protocol(s) to be used (FPolicy requires a CIFS license)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A FileFly license that includes entitlement for NetApp filers","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Caringo FileFly FPolicy Servers require ","type":"text"},{"text":"EXCLUSIVE","type":"text","marks":[{"type":"strong"}]},{"text":" use of SMB connections to their associated NetApp filers/vFilers. This means Explorer windows must not be opened, drives must not be mapped, nor should any UNC paths to the filer be accessed from the FileFly FPolicy Server machine.","type":"text"},{"type":"hardBreak"},{"text":"Demigrations ","type":"text"},{"text":"cannot","type":"text","marks":[{"type":"strong"}]},{"text":" be triggered by applications running locally on the FileFly FPolicy Servers since the Filer ignores these requests. This is an FPolicy restriction.","type":"text"},{"type":"hardBreak"},{"text":"When creating a production deployment plan, please refer to §2.6.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.2.2 Filer System Requirements","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo FileFly FPolicy Server requires that the Filer is running Data ONTAP version 7.3 or above. Caringo recommends 7.3.6 or above.","type":"text"},{"type":"hardBreak"},{"text":"Important: Place the FileFly FPolicy Servers on the same subnet and same switch as the Filers that they will serve to minimize latency.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.2.3 Using the Filer on a Domain","type":"text"}]},{"type":"paragraph","content":[{"text":"If the NetApp Filer is joined to an Active Directory domain, check the following:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"All AD servers that the filer will communicate with are also DNS servers","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"DNS contains the _msdcs. subdomain (created automatically if DNS is set up as part of the Active Directory installation)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Only the Active Directory DNS servers should be provided to the filer (check /etc/resolv.conf on the filer to confirm)","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.2.4 High-Availability for FPolicy Servers","type":"text"}]},{"type":"paragraph","content":[{"text":"It is strongly recommended to install Caringo FileFly FPolicy Servers in a High-Availability configuration. This configuration requires the installation of Caringo FileFly FPolicy Server on a group of machines which are all addressed by a single FQDN. This provides High-Availability for migration and demigration operations on the associated filers.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.2.5 DNS Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"All Active Directory Servers, Caringo FileFly FPolicy Servers, and NetApp Filers, ","type":"text"},{"text":"must","type":"text","marks":[{"type":"strong"}]},{"text":" have both forward ","type":"text"},{"text":"and","type":"text","marks":[{"type":"strong"}]},{"text":" reverse records in DNS.","type":"text"},{"type":"hardBreak"},{"text":"All hostnames used in Filer and FileFly FPolicy Server configuration must be FQDNs.","type":"text"},{"type":"hardBreak"},{"text":"Incorrect DNS configuration or use of bare hostnames may lead to FileFly FPolicy Servers failing to register or disconnecting shortly after registration.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.2.6 Using SMB2","type":"text"}]},{"type":"paragraph","content":[{"text":"If the target filer is configured to use the SMB2 protocol:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure that both of the following NetApp options are enabled:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"cifs.smb2.enable","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"cifs.smb2.client.enable","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Using Local User Accounts to authenticate with the filer may cause connection issues, Active Directory domain authentication should be used instead","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.2.7 Unicode Filename Support","type":"text"}]},{"type":"paragraph","content":[{"text":"It is recommended that all volumes have UTF-8 support enabled (i.e. the volume language should be set to .UTF-8). Files with Unicode (non-ASCII) filenames cannot be accessed via NFS unless the UTF-8 option is enabled. To ensure maximal data accessibility, FileFly will mark any file that would not be demigratable via both NFS ","type":"text"},{"text":"and","type":"text","marks":[{"type":"em"}]},{"text":" SMB clients as 'Do Not Migrate'.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.3.1 Preinstallation Steps – NetApp Filers and vFilers","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enable HTTP servers","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the console on each NetApp filer/vFiler:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"options httpd.admin.enable on","type":"text"}]}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create and enable FPolicy filefly on each NetApp filer/vFiler","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The name filefly must be used for the FPolicy","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On the NetApp filer console:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"netapp> options fpolicy.enable on","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"netapp> fpolicy create filefly screen","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"netapp> fpolicy options filefly required on","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"netapp> fpolicy enable filefly","type":"text"}]}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a NetApp administrator account:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the console on each NetApp filer/vFiler:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"netapp> useradmin domainuser add -g administrators","type":"text"}]}]}]}]}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" If the Filer is not on a domain, then a local user account may be created instead.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.3.2 Preinstallation Steps – FileFly FPolicy Server Machine(s)","type":"text"}]},{"type":"paragraph","content":[{"text":"Ensure NetBIOS over TCP/IP is enabled to allow connections to and from the NetApp for FPolicy:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Determine which network interface(s) will be used to contact the filer(s)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Navigate to each Network interface's Properties dialog box","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select Internet Protocol Version 4 (TCP/IPv4) → Properties → Advanced…","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'WINS'","type":"text","marks":[{"type":"em"}]},{"text":" tab, select ","type":"text"},{"text":"'Enable NetBIOS over TCP/IP'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the server firewall is configured to allow incoming NetBIOS traffic from the filer – e.g. enable the ","type":"text"},{"text":"'File and Printer Sharing (NB-Session-In)'","type":"text","marks":[{"type":"em"}]},{"text":" rule in Windows Firewall","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.3.3 Installing Components","type":"text"}]},{"type":"paragraph","content":[{"text":"On each FileFly FPolicy Server machine:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly NetApp FPolicy Server.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select install location","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter the login credentials for an administrator user with the 'Log on as a service' privilege – this account MUST have the same username and password as an administrator-level account on the Filer","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions to activate the installation as either a ","type":"text"},{"text":"'Standalone Server'","type":"text","marks":[{"type":"em"}]},{"text":" or High-Availability Caringo FileFly FPolicy Server","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.3.4 Configuring Components","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit netapp.cfg in the Caringo FileFly FPolicy Server data directory (e.g. C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent):","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Set the netapp.filers property to a comma-delimited list of NetApp filer/vFiler FQDNs","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Open Services → Caringo FileFly Agent","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the service","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"When using a High-Availability configuration, be sure to use the same netapp.cfg across all nodes and restart each node's service.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.3.5 Cache First Block","type":"text"}]},{"type":"paragraph","content":[{"text":"When migrating files, the first block of the file may optionally be cached. This allows small reads to file headers to be completed immediately, without triggering a demigration from secondary storage. By default this feature is disabled. To enable it, set netapp.cacheFirstBlock to true in netapp.cfg.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.4 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.4.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"netapp://{FPolicy Server}/{NetApp Filer}/{SMB Share}/[{path}]","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"FPolicy Server – FQDN alias that points to all FileFly FileFly FPolicy Servers for the given Filer","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"NetApp Filer – FQDN of the Filer/vFiler","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"SMB Share – NetApp SMB share name (FPolicy requires the use of SMB)","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Example:","type":"text"},{"type":"hardBreak"},{"text":"netapp://fpol-svrs.example.com/netapp1.example.com/data/","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.5 Interoperability","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.5.1 Robocopy","type":"text"}]},{"type":"paragraph","content":[{"text":"Robocopy ","type":"text"},{"text":"must not","type":"text","marks":[{"type":"strong"}]},{"text":" be used with the /b (backup mode) switch when copying FileFly NetApp stubs.","type":"text"},{"type":"hardBreak"},{"text":"When in backup mode, robocopy attempts to copy stub files as-is rather than demigrating them as they are read. This behavior is not supported.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The /b switch requires Administrator privilege – it is not available to normal users.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.6 Behavioral Notes","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.6.1 Unix Symbolic Links","type":"text"}]},{"type":"paragraph","content":[{"text":"Unix Symbolic links (also known as symlinks or softlinks) may be created on a Filer via an NFS mount. Symbolic links will be skipped during traversal of a NetApp file system. This ensures that files are not seen – and thus acted upon – multiple times during a single execution of a given policy. If it is intended that a policy should apply to files within a folder referred to by a symbolic link, ensure that the Source encompasses the real location at the link's destination. A Source URI may NOT point to a symbolic link – use the real folder that the link points to instead.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.6.2 QTree and User Quotas","type":"text"}]},{"type":"paragraph","content":[{"text":"NetApp QTree and user quotas are measured in terms of ","type":"text"},{"text":"logical","type":"text","marks":[{"type":"em"}]},{"text":" file size. Thus, migrating files has no effect on quota usage.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.6.3 Snapshots","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly will automatically skip snapshot directories when traversing NetApp Filer volumes using the netapp scheme.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.3.6.4 SMB Usage","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo FileFly FPolicy Servers require ","type":"text"},{"text":"EXCLUSIVE","type":"text","marks":[{"type":"strong"}]},{"text":" use of SMB connections to their associated NetApp filers/vFilers. This means Explorer windows must not be opened, drives must not be mapped, nor should any UNC paths to the filer be accessed from the FileFly FPolicy Server machine. Failure to observe this restriction will result in unpredictable FPolicy disconnections and interrupted service.","type":"text"},{"type":"hardBreak"},{"text":"Demigrations ","type":"text"},{"text":"cannot","type":"text","marks":[{"type":"strong"}]},{"text":" be triggered by applications running directly on the FileFly FPolicy Servers since the Filer ignores these requests. This is an FPolicy restriction.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.7 Skipping Sparse Files","type":"text"}]},{"type":"paragraph","content":[{"text":"It is often undesirable to migrate files that are highly sparse since sparseness is not preserved by the migration process.","type":"text"},{"type":"hardBreak"},{"text":"To enable sparse files to be skipped during migration policies, navigate to the Admin Portal ","type":"text"},{"text":"'Settings Page'","type":"text","marks":[{"type":"em"}]},{"text":" and tick ","type":"text"},{"text":"'Enable sparse file skipping'","type":"text","marks":[{"type":"em"}]},{"text":". The sparse file skipping option for migration policies requires at least Data ONTAP version 7.3.6.","type":"text"},{"type":"hardBreak"},{"text":"Skipping sparse files may then be configured per migration policy. On the ","type":"text"},{"text":"'Policy Details'","type":"text","marks":[{"type":"em"}]},{"text":" page for Migrate and Simple Premigrate operations, tick 'skip files more than 0% sparse'_ and adjust the percentage as required using the drop-down box.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.3.8 Debug Status Monitoring","type":"text"}]},{"type":"paragraph","content":[{"text":"By default Caringo FileFly FPolicy Servers provide status information and statistics via a webpage located at ","type":"text"},{"text":"http://127.0.0.1:8000","type":"text","marks":[{"type":"link","attrs":{"href":"http://127.0.0.1:8000"}}]},{"text":" (accessible only from the FPolicy Server machine).","type":"text"},{"type":"hardBreak"},{"text":"To run the webserver on a different TCP port, set netapp.web.port in netapp.cfg to the desired port number. To disable the webserver, set netapp.web.enable to false.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.4 Caringo Swarm","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.4.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"The swarm scheme should only be used when accessing Swarm storage nodes directly.","type":"text"},{"type":"hardBreak"},{"text":"If accessing Swarm storage via a CloudScaler Gateway, the cloudscaler scheme must be used instead, see §4.5.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" FileFly software does ","type":"text"},{"text":"not","type":"text","marks":[{"type":"strong"}]},{"text":" support access to storage nodes via an SCSP Proxy.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.4.2 Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"Before proceeding with the installation, the following will be required:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Swarm 8 or above","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a license that includes an entitlement for Swarm","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.2.1 Firewall","type":"text"}]},{"type":"paragraph","content":[{"text":"The Swarm storage node port (TCP port 80 by default) must be allowed by any firewalls between the Caringo FileFly Swarm Plugin on the Caringo FileFly Gateway and the Swarm storage nodes. For further information regarding firewall configuration see Chapter 10.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.2.2 Domains and Endpoints","type":"text"}]},{"type":"paragraph","content":[{"text":"Swarm storage locations are accessed via a configured endpoint FQDN. Add several Swarm storage node IP addresses to DNS under a single endpoint FQDN (4-8 addresses are recommended). If Swarm domains are in use, the FQDN must be the name of the domain in which the FileFly data will be stored. If domains are NOT in use (i.e. data will be stored in the default cluster domain), it is ","type":"text"},{"text":"strongly","type":"text","marks":[{"type":"strong"}]},{"text":" recommended that the FQDN be the name of the cluster for best Swarm performance.","type":"text"},{"type":"hardBreak"},{"text":"When using multiple Swarm domains, ensure that each domain FQDN is added to DNS as described above.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.2.3 Buckets","type":"text"}]},{"type":"paragraph","content":[{"text":"Migrated files may be stored as either unnamed objects (accessed by UUID), or as named objects residing in a bucket. Bucket creation must be performed ahead of time, prior to configuring FileFly.","type":"text"},{"type":"hardBreak"},{"text":"FileFly Swarm Config will be used to create Destination URIs for use in the FileFly Admin Portal.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.4.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.3.1 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"To perform a fresh installation:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Agent.exe, select the FileFly Gateway role (see §2.3.3) and select FileFly Swarm Plugin on the ","type":"text"},{"text":"'Components'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Or, to add the FileFly Swarm Plugin to an existing FileFly Gateway or Agent:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for the Caringo FileFly Swarm Plugin: Caringo FileFly Swarm Plugin.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.3.2 Installing ","type":"text"},{"text":"'Caringo FileFly Swarm Config'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for Caringo FileFly Swarm Config: Caringo FileFly Swarm Config.exe","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.4.4 Plugin Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"Open ","type":"text"},{"text":"'Caringo FileFly Swarm Config'","type":"text","marks":[{"type":"em"}]},{"text":" and complete the following configuration steps.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.4.1 Create a FileFly Encryption Key","type":"text"}]},{"type":"paragraph","content":[{"text":"If encryption-at-rest is to be used to protect FileFly data on the destination, check ","type":"text"},{"text":"'Enable encryption'","type":"text","marks":[{"type":"em"}]},{"text":". An encryption key must be generated before FileFly can be used to store encrypted data on a Swarm migration destination. FileFly will encrypt all data migrated using the specified encryption key.","type":"text"},{"type":"hardBreak"},{"text":"During the encryption key creation process, a copy of the information entered will be printed and it will be strongly recommended that a copy of the swarm.cfg file is stored in a safe location.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Generate…","type":"text","marks":[{"type":"strong"}]},{"text":" in the ","type":"text"},{"text":"'FileFly Encryption'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Read the User Confirmation notice and click ","type":"text"},{"text":"Yes","type":"text","marks":[{"type":"strong"}]},{"text":" to continue","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep the suggested Key ID","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter a passphrase from which to generate a new encryption key, and click ","type":"text"},{"text":"OK","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"an Encryption Key Details page will be printed","type":"text","marks":[{"type":"em"}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When prompted, enter the ","type":"text"},{"text":"'Validation Code'","type":"text","marks":[{"type":"em"}]},{"text":" from the printed page","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.4.2 Set Metadata Options","type":"text"}]},{"type":"paragraph","content":[{"text":"Tick ","type":"text"},{"text":"'Include metadata HTTP headers'","type":"text","marks":[{"type":"em"}]},{"text":" to store per-file metadata with the destination objects, such as original filename and location, content-type, owner, and timestamps – see §4.4.7 for details. File extension to content-type mappings may be customized by editing the swarm-mimetypes file, found in C:\\Program Files\\Caringo FileFly\\data\\swarm.data\\.","type":"text"},{"type":"hardBreak"},{"text":"Also, tick ","type":"text"},{"text":"'Include Content-Disposition'","type":"text","marks":[{"type":"em"}]},{"text":" to include the original filename for use when downloading the target objects directly using a web browser.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.4.3 Create an Index","type":"text"}]},{"type":"paragraph","content":[{"text":"Swarm Destinations require an index to be created prior to use.","type":"text"},{"type":"hardBreak"},{"text":"In FileFly Swarm Config:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Create Index…","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Use the resultant URI to create a Destination in the FileFly Admin Portal","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Additional indexes can be added at a later date to further subdivide storage if required.","type":"text"},{"type":"hardBreak"},{"text":"Important: Each FileFly Admin Portal must have its own destination indexes; DO NOT share indexes across multiple FileFly implementations.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.4.4 Apply Configuration to FileFly Gateways","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" to save all changes. Changes will be saved to swarm.cfg","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Copy swarm.cfg to the correct location on all FileFly Gateway machines:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\swarm.cfg","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the Caringo FileFly Agent service on each machine","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.4.5 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.4.5.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The following is informational only, FileFly Swarm Config should always be used to prepare Swarm URIs.","type":"text"},{"type":"hardBreak"},{"text":"swarm://{gateway}/{endpoint}[:{port}]/?idx={index} swarm://{gateway}/{endpoint}[:{port}]/{bucket}[:{partition}]","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gateway – DNS alias for all Caringo Swarm Gateways","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"endpoint – FQDN of the Swarm endpoint","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"port – override the standard HTTP/HTTPS port","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"index – index UUID, as created by ","type":"text"},{"text":"FileFly Swarm Config","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"bucket – bucket in which to store named objects","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"partition – partition within bucket","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Examples:","type":"text"},{"type":"hardBreak"},{"text":"swarm://gw.example.com/data.example.com/?idx=968... swarm://gw.example.com/data.example.com/myBucket","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.4.6 Disaster Recovery Considerations","type":"text"}]},{"type":"paragraph","content":[{"text":"During migration, each newly migrated file is recorded in the corresponding index. The index may be used in disaster scenarios where:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"stubs have been lost, and","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a ","type":"text"},{"text":"Create DrTool File from Source","type":"text","marks":[{"type":"em"}]},{"text":" file is not available, and","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"no current backup of the stubs exists","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Index performance is optimized for migrations and demigrations, not for ","type":"text"},{"text":"Create DrTool File from Destination","type":"text","marks":[{"type":"em"}]},{"text":" policies.","type":"text"},{"type":"hardBreak"},{"text":"Create DrTool File from Source","type":"text","marks":[{"type":"em"}]},{"text":" policies are the recommended means to obtain a DrTool file for restoring stubs. This method provides better performance and the most up-to-date stub location information.","type":"text"},{"type":"hardBreak"},{"text":"It is recommended to regularly run ","type":"text"},{"text":"Create DrTool File from Source","type":"text","marks":[{"type":"em"}]},{"text":" policies following ","type":"text"},{"text":"Migration","type":"text","marks":[{"type":"em"}]},{"text":" policies.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.4.7 Swarm Metadata Headers","type":"text"}]},{"type":"paragraph","content":[{"text":"The following metadata fields are supported:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Alt-Meta-Name – the original source file's filename (excluding directory path)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Alt-Meta-Path – the original source file's directory path (excluding the filename) in a platform-independent manner such that '/' is used as the path separator and the path will start with '/', followed by drive/volume/share if appropriate, but not end with '/' (unless this path represents the root directory)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-FileFly-Meta-Partition – the Destination URI ","type":"text"},{"text":"partition","type":"text","marks":[{"type":"em"}]},{"text":" – if no partition is present, this header is omitted","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Host – the FQDN of the original source file's server","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Owner – the owner of the original source file in a format appropriate to the source system (e.g. DOMAIN\\username)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Modified – the ","type":"text"},{"text":"Last Modified","type":"text","marks":[{"type":"em"}]},{"text":" timestamp of the original source file at the time of migration in RFC3339 format","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Created – the ","type":"text"},{"text":"Created","type":"text","marks":[{"type":"em"}]},{"text":" timestamp of the original source file in RFC3339 format","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Attribs – a case-sensitive sequence of characters {AHRS} representing the original source file's file flags: ","type":"text"},{"text":"Archive","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"Hidden","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"Read-Only","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"System","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"all other characters are reserved for future use and should be ignored","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Content-Type – the MIME Type of the content, determined based on the file-extension of the original source filename","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Timestamps may be omitted if the source file timestamps are not set.","type":"text"},{"type":"hardBreak"},{"text":"Non-ASCII characters will be be stored using RFC2047 encoding, as described in the Swarm documentation. Swarm will decode these values prior to indexing in Elasticsearch.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.5 Caringo CloudScaler","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.5.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo CloudScaler provides a multi-tenanted object storage platform built upon Swarm storage nodes. The FileFly cloudScaler scheme must only be used when accessing the storage via CloudScaler. To store data on Swarm nodes directly, the swarm scheme must be used instead, see §4.4.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.5.2 Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"Before proceeding with the installation, the following will be required:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Cloud Gateway 3.0.0 or above","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Swarm 8 or above","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a license that includes an entitlement for CloudScaler","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.2.1 Firewall","type":"text"}]},{"type":"paragraph","content":[{"text":"The TCP port used to access the CloudScaler Gateway via HTTP or HTTPS (possibly by way of a load-balancer) must be allowed by any firewalls between the FileFly CloudScaler Plugin on the FileFly Gateway and the CloudScaler Gateway endpoints. For further information regarding firewall configuration see Chapter 10.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.2.2 Domains and Buckets","type":"text"}]},{"type":"paragraph","content":[{"text":"CloudScaler domain names used with FileFly must be valid FQDNs, which resolve to one or more Cloud Gateways.","type":"text"},{"type":"hardBreak"},{"text":"Migrated files may be stored as either unnamed objects (accessed by UUID), or as named objects residing in a bucket. Bucket creation must be performed ahead of time, prior to configuring FileFly.","type":"text"},{"type":"hardBreak"},{"text":"FileFly CloudScaler Config will assist in the creation of a Destination URI for use in the FileFly Admin Portal.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.2.3 Authentication","type":"text"}]},{"type":"paragraph","content":[{"text":"When using buckets, it is a requirement that the configured credentials for accessing the bucket are also permitted to perform HEAD requests at the root of the domain in order to obtain domain information. This must be considered when provisioning buckets.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.5.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.3.1 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"To perform a fresh installation:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Agent.exe, select the FileFly Gateway role (see §2.3.3) and select FileFly CloudScaler Plugin on the ","type":"text"},{"text":"'Components'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Or, to add the FileFly CloudScaler Plugin to an existing FileFly Gateway or Agent:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for the Caringo FileFly CloudScaler Plugin: Caringo FileFly CloudScaler Plugin.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.3.2 Installing ","type":"text"},{"text":"'Caringo FileFly CloudScaler Config'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for Caringo FileFly CloudScaler Config: Caringo FileFly CloudScaler Config.exe","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.5.4 Plugin Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"In ","type":"text"},{"text":"'Caringo FileFly CloudScaler Config'","type":"text","marks":[{"type":"em"}]},{"text":":","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check 'Use TLS' if the CloudScaler endpoint will be accessed via HTTPS","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, fill in the 'HTTP Proxy' section:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check ","type":"text"},{"text":"Use Proxy","type":"text","marks":[{"type":"strong"}]},{"text":" if a proxy is required to access the endpoint","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Avoid using a proxy for best performance","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"This feature is only supported for HTTPS endpoints","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter ","type":"text"},{"text":"'Host'","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"'Port'","type":"text","marks":[{"type":"em"}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Add…","type":"text","marks":[{"type":"strong"}]},{"text":" to add a new set of CloudScaler domain credentials","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If using named objects, supply the bucket name","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The bucket must already exist and be configured","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Specify the CloudScaler storage domain, username and password","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The domain must already exist and be configured","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.4.1 Create an Index","type":"text"}]},{"type":"paragraph","content":[{"text":"CloudScaler Destinations require an index to be created prior to use.","type":"text"},{"type":"hardBreak"},{"text":"In FileFly CloudScaler Config:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the domain in which to create the index","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Create Index…","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Use the resultant URI to create a Destination in the FileFly Admin Portal","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Additional indexes can be added at a later date to further subdivide storage if required.","type":"text"},{"type":"hardBreak"},{"text":"Important: Each FileFly Admin Portal must have its own destination indexes; DO NOT share indexes across multiple FileFly implementations.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.4.2 Create a FileFly Encryption Key","type":"text"}]},{"type":"paragraph","content":[{"text":"If encryption-at-rest is to be used to protect FileFly data on the destination, check ","type":"text"},{"text":"'Enable encryption'","type":"text","marks":[{"type":"em"}]},{"text":". An encryption key must be generated before FileFly can be used to store encrypted data on a CloudScaler migration destination. FileFly will encrypt all data migrated using the specified encryption key.","type":"text"},{"type":"hardBreak"},{"text":"During the encryption key creation process, a copy of the information entered will be printed and it will be strongly recommended that a copy of the cloudscaler.cfg file is stored in a safe location.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Generate…","type":"text","marks":[{"type":"strong"}]},{"text":" in the ","type":"text"},{"text":"'FileFly Encryption'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Read the User Confirmation notice and click ","type":"text"},{"text":"Yes","type":"text","marks":[{"type":"strong"}]},{"text":" to continue","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep the suggested Key ID","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter a passphrase from which to generate a new encryption key, and click ","type":"text"},{"text":"OK","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"an Encryption Key Details page will be printed","type":"text","marks":[{"type":"em"}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When prompted, enter the ","type":"text"},{"text":"'Validation Code'","type":"text","marks":[{"type":"em"}]},{"text":" from the printed page","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.4.3 Set Metadata Options","type":"text"}]},{"type":"paragraph","content":[{"text":"Tick ","type":"text"},{"text":"'Include metadata HTTP headers'","type":"text","marks":[{"type":"em"}]},{"text":" to store per-file metadata with the destination objects, such as original filename and location, content-type, owner and timestamps – see §4.5.7 for details. File extension to content-type mappings may be customized by editing the cloudscaler-mimetypes file, found in C:\\Program Files\\Caringo FileFly\\data\\cloudscaler.data\\.","type":"text"},{"type":"hardBreak"},{"text":"Also, tick ","type":"text"},{"text":"'Include Content-Disposition'","type":"text","marks":[{"type":"em"}]},{"text":" to include original filename for use when downloading the target objects directly using a web browser.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.4.4 Apply Configuration to FileFly Gateways","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" to save all changes. Changes will be saved to cloudscaler.cfg","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Copy cloudscaler.cfg to the correct location on all FileFly Gateway machines:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\cloudscaler.cfg","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the Caringo FileFly Agent service on each machine","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.5.5 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.5.5.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The following is informational only, FileFly CloudScaler Config should always be used to prepare CloudScaler URIs.","type":"text"},{"type":"hardBreak"},{"text":"cloudscaler://{gateway}/{endpoint}[:{port}]/?idx={index} cloudscaler://{gateway}/{endpoint}[:{port}]/{bucket}[:{partition}]","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gateway – DNS alias for all Caringo CloudScaler Gateways","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"endpoint – FQDN of the CloudScaler endpoint","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"port – override the standard HTTP/HTTPS port","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"index – index UUID, as created by ","type":"text"},{"text":"FileFly CloudScaler Config","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"bucket – bucket in which to store named objects","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"partition – partition within bucket","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Examples:","type":"text"},{"type":"hardBreak"},{"text":"cloudscaler://gw.example.com/data.example.com/?idx=968... cloudscaler://gw.example.com/data.example.com/myBucket","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.5.6 Disaster Recovery Considerations","type":"text"}]},{"type":"paragraph","content":[{"text":"During migration, each newly migrated file is recorded in the corresponding index. The index may be used in disaster scenarios where:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"stubs have been lost, and","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a ","type":"text"},{"text":"Create DrTool File from Source","type":"text","marks":[{"type":"em"}]},{"text":" file is not available, and","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"no current backup of the stubs exists","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Index performance is optimized for migrations and demigrations, not for ","type":"text"},{"text":"Create DrTool File from Destination","type":"text","marks":[{"type":"em"}]},{"text":" policies.","type":"text"},{"type":"hardBreak"},{"text":"Create DrTool File from Source","type":"text","marks":[{"type":"em"}]},{"text":" policies are the recommended means to obtain a DrTool file for restoring stubs. This method provides better performance and the most up-to-date stub location information.","type":"text"},{"type":"hardBreak"},{"text":"It is recommended to regularly run ","type":"text"},{"text":"Create DrTool File from Source","type":"text","marks":[{"type":"em"}]},{"text":" policies following ","type":"text"},{"text":"Migration","type":"text","marks":[{"type":"em"}]},{"text":" policies.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.5.7 Swarm Metadata Headers","type":"text"}]},{"type":"paragraph","content":[{"text":"The following metadata fields are supported:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Alt-Meta-Name – the original source file's filename (excluding directory path)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Alt-Meta-Path – the original source file's directory path (excluding the filename) in a platform-independent manner such that '/' is used as the path separator and the path will start with '/', followed by drive/volume/share if appropriate, but not end with '/' (unless this path represents the root directory)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-FileFly-Meta-Partition – the Destination URI ","type":"text"},{"text":"partition","type":"text","marks":[{"type":"em"}]},{"text":" – if no partition is present, this header is omitted","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Host – the FQDN of the original source file's server","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Owner – the owner of the original source file in a format appropriate to the source system (e.g. DOMAIN\\username)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Modified – the ","type":"text"},{"text":"Last Modified","type":"text","marks":[{"type":"em"}]},{"text":" timestamp of the original source file at the time of migration in RFC3339 format","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Created – the ","type":"text"},{"text":"Created","type":"text","marks":[{"type":"em"}]},{"text":" timestamp of the original source file in RFC3339 format","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"X-Source-Meta-Attribs – a case-sensitive sequence of characters {AHRS} representing the original source file's file flags: ","type":"text"},{"text":"Archive","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"Hidden","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"Read-Only","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"System","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"all other characters are reserved for future use and should be ignored","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Content-Type – the MIME Type of the content, determined based on the file-extension of the original source filename","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Timestamps may be omitted if the source file timestamps are not set.","type":"text"},{"type":"hardBreak"},{"text":"Non-ASCII characters will be stored using RFC2047 encoding, as described in the Swarm documentation. Swarm will decode these values prior to indexing in Elasticsearch.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.6 Amazon Simple Storage Service (S3)","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.6.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Amazon S3 may be used as a migration destination only.","type":"text"},{"type":"hardBreak"},{"text":"This section strictly pertains to ","type":"text"},{"text":"Amazon","type":"text","marks":[{"type":"em"}]},{"text":" S3. Other supported S3-compatible storage services/devices are documented in separate sections.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.6.2 Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"Before proceeding with the installation, the following will be required:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"an Amazon Web Services (AWS) Account","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a license that includes an entitlement for Amazon S3","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Dedicated buckets should be used for FileFly migration data. However, do not create any S3 buckets at this stage – this will be done later using Caringo FileFly S3 Config.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.2.1 Firewall","type":"text"}]},{"type":"paragraph","content":[{"text":"The HTTPS port (TCP port 443) must be allowed by any firewalls between the FileFly S3 Plugin on the Caringo FileFly Gateway and the internet.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.6.3 Storage Options","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly may be configured to use the following S3 features on a per-bucket basis.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.3.1 Transfer Acceleration","type":"text"}]},{"type":"paragraph","content":[{"text":"Transfer acceleration allows data to be uploaded via the fastest data center for your location, regardless of the actual location of the bucket.","type":"text"},{"type":"hardBreak"},{"text":"This option provides a way to upload data to a bucket in a remote AWS region while minimizing the adverse effects on migration policies that would otherwise be caused by the correspondingly higher latency of using the remote region.","type":"text"},{"type":"hardBreak"},{"text":"Additional AWS charges may apply for using transfer acceleration at upload time, but for archived data, these initial charges may be significantly outweighed by reduced storage costs in the target region. For further details, please consult AWS pricing.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.3.2 Infrequent Access Storage Class","type":"text"}]},{"type":"paragraph","content":[{"text":"This option allows eligible files to be uploaded ","type":"text"},{"text":"directly","type":"text","marks":[{"type":"em"}]},{"text":" into Infrequent Access Storage (STANDARD_IA) instead of the Standard storage class. This can dramatically reduce costs for infrequently accessed data.","type":"text"},{"type":"hardBreak"},{"text":"Please consult AWS pricing for further details.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.6.4 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.4.1 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"To perform a fresh installation:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Agent.exe, select the FileFly Gateway role (see §2.3.3) and select FileFly S3 Plugin on the ","type":"text"},{"text":"'Components'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Or, to add the FileFly S3 Plugin to an existing FileFly Gateway:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for the Caringo FileFly S3 Plugin: Caringo FileFly Amazon S3 Plugin.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.4.2 Installing ","type":"text"},{"text":"'Caringo FileFly S3 Config'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for Caringo FileFly S3 Config: Caringo FileFly Amazon S3 Config.exe","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.6.5 Plugin Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'Caringo FileFly S3 Config'","type":"text","marks":[{"type":"em"}]},{"text":" tool:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select ","type":"text"},{"text":"'Amazon AWS S3'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If required, fill in the ","type":"text"},{"text":"'HTTPS Proxy'","type":"text","marks":[{"type":"em"}]},{"text":" section (not recommended for performance reasons)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter your Amazon Web Services (AWS) account details","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select authentication ","type":"text"},{"text":"'Signature Type'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"AWS4-HMAC-256 is required for newer Amazon data centers","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"AWS2 may be faster – it is safe to try this first","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Manage Buckets…","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"New","type":"text","marks":[{"type":"strong"}]},{"text":" to create a new bucket","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Options","type":"text","marks":[{"type":"strong"}]},{"text":" to set storage options for the selected bucket (see §4.6.3)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To copy a URI to the clipboard for use in the Admin Portal Destination object:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"click ","type":"text"},{"text":"Get Migration URI","type":"text","marks":[{"type":"strong"}]},{"text":" to select a partition","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, check ","type":"text"},{"text":"'Allow Reduced Redundancy (via s3rr:// URIs)'","type":"text","marks":[{"type":"em"}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.5.1 Configure Encryption-at-Rest","type":"text"}]},{"type":"paragraph","content":[{"text":"All FileFly S3 traffic is encrypted ","type":"text"},{"text":"in transit","type":"text","marks":[{"type":"em"}]},{"text":" with TLS.","type":"text"},{"type":"hardBreak"},{"text":"If encryption-at-rest is to be used to protect data on the destination, check ","type":"text"},{"text":"'Enable encryption'","type":"text","marks":[{"type":"em"}]},{"text":". An encryption key must be generated before FileFly can be used to store encrypted data on an S3 migration destination. FileFly will encrypt all data migrated using the specified encryption key.","type":"text"},{"type":"hardBreak"},{"text":"During the encryption key creation process, a copy of the information entered will be printed and it will be strongly recommended that a copy of the s3.cfg file is stored in a safe location.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Generate…","type":"text","marks":[{"type":"strong"}]},{"text":" in the ","type":"text"},{"text":"'FileFly Encryption Key'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Read the User Confirmation notice and click ","type":"text"},{"text":"Yes","type":"text","marks":[{"type":"strong"}]},{"text":" to continue","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep the suggested Key ID","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter a passphrase from which to generate a new encryption key, and click ","type":"text"},{"text":"OK","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"an Encryption Key Details page will be printed","type":"text","marks":[{"type":"em"}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When prompted, enter the ","type":"text"},{"text":"'Validation Code'","type":"text","marks":[{"type":"em"}]},{"text":" from the printed page","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.5.2 Apply Configuration to Gateways","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" to save all changes. Changes will be saved to s3.cfg","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the s3.cfg file has been copied to the correct location on all Gateway machines:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\s3.cfg","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the Caringo FileFly Agent service on each Gateway machine","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.6.6 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.6.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The following is informational only, FileFly S3 Config should always be used to prepare S3 URIs.","type":"text"},{"type":"hardBreak"},{"text":"s3://{gateway}/{bucket}[:{partition}]","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gateway – DNS alias for all Caringo S3 Gateways","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"bucket – name of the S3 destination bucket","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"partition – an optional partition within the S3 bucket","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"If the partition does not already exist, it will be created when files are migrated. If a partition is not specified in the URI, the default partition will be used. It is not necessary to use multiple buckets to subdivide storage. Partitions are useful because ","type":"text"},{"text":"'Create DrTool File from Destination'","type":"text","marks":[{"type":"em"}]},{"text":" Policies are performed on partitions rather than whole buckets.","type":"text"},{"type":"hardBreak"},{"text":"Examples:","type":"text"},{"type":"hardBreak"},{"text":"s3://gateway.example.com/archive s3://gateway.example.com/archive:2007","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.6.7 Reduced Redundancy Storage","type":"text"}]},{"type":"paragraph","content":[{"text":"Reduced Redundancy Storage (RRS) is a slightly lower-cost Amazon S3 storage option (when compared to the S3 ","type":"text"},{"text":"Standard","type":"text","marks":[{"type":"em"}]},{"text":" storage class) where data is replicated fewer times. Care should be taken when assessing whether the lower durability of RRS is appropriate.","type":"text"},{"type":"hardBreak"},{"text":"Reduced Redundancy must be enabled via Caringo FileFly S3 Config, see §4.6.5.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.6.7.1 Reduced Redundancy URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"The s3rr scheme is not listed in the Admin Portal Destination Editor and must be entered manually. The URI format follows the same pattern as regular s3 URIs.","type":"text"},{"type":"hardBreak"},{"text":"s3rr://{gateway}/{bucket}[:{partition}]","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.7 Generic S3 Endpoint","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.7.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Other generic or third-party storage devices and services that support the Amazon S3 protocol may be addressed using the 'Generic S3 Endpoint' feature. Such endpoints may be used as migration destinations only.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.7.2 Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"Important: Prior to production deployment, please confirm with Caringo that the chosen device or service has been certified for compatibility to ensure that it will be covered by your support agreement.","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"Prerequisites:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"suitable S3 API credentials","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a license that includes entitlement for generic S3 endpoints","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Dedicated buckets should be used for FileFly migration data. However, do not create any S3 buckets at this stage – this will be done later using Caringo FileFly S3 Config.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.2.1 Firewall","type":"text"}]},{"type":"paragraph","content":[{"text":"The S3 port must be allowed by any firewalls between the FileFly S3 Plugin on the Caringo FileFly Gateway and the storage endpoint.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.2.2 Omit ISO date from path","type":"text"}]},{"type":"paragraph","content":[{"text":"Normally, when FileFly migrates a file to S3, a timestamp is included in each resulting S3 object key (name). ","type":"text"},{"text":"Amazon","type":"text","marks":[{"type":"em"}]},{"text":" S3 implements a flat, uniform keyspace – there is no concept of a directory structure within an Amazon storage bucket. However, some S3-compatible devices map the keyspace to an underlying directory structure or other non-uniform or hierarchical namespace. On such systems, the inclusion of the timestamp may result in excessive directory creation which may adversely impact performance and/or resource consumption. For such devices, use the ","type":"text"},{"text":"'Omit ISO date from path'","type":"text","marks":[{"type":"em"}]},{"text":" option to omit the timestamp.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.2.3 Virtual Host Access","type":"text"}]},{"type":"paragraph","content":[{"text":"The S3 protocol supports a virtual-host-style bucket access method, for example ","type":"text"},{"text":"https://bucket.s3.example.com","type":"text","marks":[{"type":"link","attrs":{"href":"https://bucket.s3.example.com"}}]},{"text":" rather than only ","type":"text"},{"text":"https://s3.example.com/bucket","type":"text","marks":[{"type":"link","attrs":{"href":"https://s3.example.com/bucket"}}]},{"text":". This facilitates connecting to a node in the correct region for the bucket, rather than requiring a redirect.","type":"text"},{"type":"hardBreak"},{"text":"Generally the ","type":"text"},{"text":"'Supports Virtual Host Access'","type":"text","marks":[{"type":"em"}]},{"text":" option should be enabled (the default) to ensure optimal performance and correct operation. However, if the generic S3 endpoint in question does not support this feature at all, Virtual Host Access may be disabled.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" when using Virtual Host Access in conjunction with HTTPS (recommended) it is important to ensure that the endpoint's TLS certificate has been created correctly. For example, if the endpoint FQDN is s3.example.com, the certificate must contain Subject Alternative Names (SANs) for both s3.example.com ","type":"text"},{"text":"and","type":"text","marks":[{"type":"strong"}]},{"text":" *.s3.example.com.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.7.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.3.1 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"To perform a fresh installation:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Agent.exe, select the FileFly Gateway role (see §2.3.3) and select FileFly S3 Plugin on the ","type":"text"},{"text":"'Components'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Or, to add the FileFly S3 Plugin to an existing FileFly Gateway:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for the Caringo FileFly S3 Plugin: Caringo FileFly Amazon S3 Plugin.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.3.2 Installing ","type":"text"},{"text":"'Caringo FileFly S3 Config'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for Caringo FileFly S3 Config: Caringo FileFly Amazon S3 Config.exe","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.7.4 Plugin Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'Caringo FileFly S3 Config'","type":"text","marks":[{"type":"em"}]},{"text":" tool:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select ","type":"text"},{"text":"'Generic S3 Endpoint'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter the Generic S3 target details","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If required, fill in the ","type":"text"},{"text":"'HTTPS Proxy'","type":"text","marks":[{"type":"em"}]},{"text":" section (not recommended for performance reasons)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter your S3 account details","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select authentication ","type":"text"},{"text":"'Signature Type'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Manage Buckets…","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"New","type":"text","marks":[{"type":"strong"}]},{"text":" to create a new bucket","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To copy a URI to the clipboard for use in the Admin Portal Destination object:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"click ","type":"text"},{"text":"Get Migration URI","type":"text","marks":[{"type":"strong"}]},{"text":" to select a partition","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.4.1 Configure Encryption-at-Rest","type":"text"}]},{"type":"paragraph","content":[{"text":"If HTTPS is enabled, all FileFly S3 traffic is encrypted ","type":"text"},{"text":"in transit","type":"text","marks":[{"type":"em"}]},{"text":" with TLS.","type":"text"},{"type":"hardBreak"},{"text":"If encryption-at-rest is to be used to protect data on the destination, check ","type":"text"},{"text":"'Enable encryption'","type":"text","marks":[{"type":"em"}]},{"text":". An encryption key must be generated before FileFly can be used to store encrypted data on an S3 migration destination. FileFly will encrypt all data migrated using the specified encryption key.","type":"text"},{"type":"hardBreak"},{"text":"During the encryption key creation process, a copy of the information entered will be printed and it will be strongly recommended that a copy of the s3generic.cfg file is stored in a safe location.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Generate…","type":"text","marks":[{"type":"strong"}]},{"text":" in the ","type":"text"},{"text":"'FileFly Encryption Key'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Read the User Confirmation notice and click ","type":"text"},{"text":"Yes","type":"text","marks":[{"type":"strong"}]},{"text":" to continue","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep the suggested Key ID","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter a passphrase from which to generate a new encryption key, and click ","type":"text"},{"text":"OK","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"an Encryption Key Details page will be printed","type":"text","marks":[{"type":"em"}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When prompted, enter the ","type":"text"},{"text":"'Validation Code'","type":"text","marks":[{"type":"em"}]},{"text":" from the printed page","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.4.2 Apply Configuration to Gateways","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" to save all changes. Changes will be saved to s3generic.cfg","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the s3generic.cfg file has been copied to the correct location on all Gateway machines:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\s3generic.cfg","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the Caringo FileFly Agent service on each Gateway machine","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.7.5 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.7.5.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The following is informational only, FileFly S3 Config should always be used to prepare S3 URIs.","type":"text"},{"type":"hardBreak"},{"text":"s3generic://{gateway}/{endpoint}/{bucket}[:{partition}]","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gateway – DNS alias for all Caringo S3 Gateways","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"endpoint – S3 target server FQDN","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"bucket – name of the S3 destination bucket","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"partition – an optional partition within the S3 bucket","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"If the partition does not already exist, it will be created when files are migrated. If a partition is not specified in the URI, the default partition will be used. It is not necessary to use multiple buckets to subdivide storage. Partitions are useful because ","type":"text"},{"text":"'Create DrTool File from Destination'","type":"text","marks":[{"type":"em"}]},{"text":" Policies are performed on partitions rather than whole buckets.","type":"text"},{"type":"hardBreak"},{"text":"Examples:","type":"text"},{"type":"hardBreak"},{"text":"s3generic://gateway.example.com/s3.example.com/archive s3generic://gateway.example.com/s3.example.com/archive:2017","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.8 Microsoft Azure Storage","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.8.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Microsoft Azure is used only as a migration destination with FileFly.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.8.2 Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"Before proceeding with the installation, the following will be required:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a Microsoft Azure Account","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a Storage Account within Azure – both General Purpose and Blob Storage (with Hot and Cool access tiers) account types are supported","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a FileFly license that includes an entitlement for Microsoft Azure","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.8.2.1 Firewall","type":"text"}]},{"type":"paragraph","content":[{"text":"The HTTPS port (TCP port 443) must be allowed by any firewalls between the Caringo FileFly Azure Plugin on the Caringo FileFly Gateway and the internet.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.8.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.8.3.1 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"To perform a fresh installation:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Agent.exe, select the FileFly Gateway role (see §2.3.3) and select FileFly Azure Plugin on the ","type":"text"},{"text":"'Components'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Or, to add the FileFly Azure Plugin to an existing FileFly Gateway:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for the Caringo FileFly Azure Plugin: Caringo FileFly Azure Plugin.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.8.3.2 Installing ","type":"text"},{"text":"'Caringo FileFly Azure Config'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for Caringo FileFly Azure Config: Caringo FileFly Azure Config.exe","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.8.4 Plugin Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'Caringo FileFly Azure Config'","type":"text","marks":[{"type":"em"}]},{"text":" tool:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add a new Azure Storage Account","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"provide Storage Account Name and Access Key","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"provide the Azure Storage endpoint (pre-filled with the default public endpoint)","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Get URI","type":"text","marks":[{"type":"strong"}]},{"text":":","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select ","type":"text"},{"text":"'Create new container…'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter the name of a new Blob Service container to be used ","type":"text"},{"text":"exclusively","type":"text","marks":[{"type":"strong"}]},{"text":" for FileFly data","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"An azure:// URI will be displayed and copied to the clipboard","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Paste the URI into an Admin Portal Destination, replacing the ","type":"text"},{"text":"gateway","type":"text","marks":[{"type":"em"}]},{"text":" part of the URI as required","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, fill in the ","type":"text"},{"text":"'Proxy'","type":"text","marks":[{"type":"em"}]},{"text":" section (not recommended for performance reasons)","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.8.4.1 Create a FileFly Encryption Key","type":"text"}]},{"type":"paragraph","content":[{"text":"If encryption-at-rest is to be used to protect FileFly data on the destination, check ","type":"text"},{"text":"'Enable encryption'","type":"text","marks":[{"type":"em"}]},{"text":". An encryption key must be generated before FileFly can be used to store encrypted data on a Microsoft Azure migration destination. FileFly will encrypt all data migrated using the specified encryption key.","type":"text"},{"type":"hardBreak"},{"text":"During the encryption key creation process, a copy of the information entered will be printed and it is strongly recommended that a copy of the azure.cfg file is stored in a safe location.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Generate…","type":"text","marks":[{"type":"strong"}]},{"text":" in the ","type":"text"},{"text":"'FileFly Encryption'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Read the User Confirmation notice and click ","type":"text"},{"text":"Yes","type":"text","marks":[{"type":"strong"}]},{"text":" to continue","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep the suggested Key ID","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter a passphrase from which to generate a new encryption key, and click ","type":"text"},{"text":"OK","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"an Encryption Key Details page will be printed","type":"text","marks":[{"type":"em"}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When prompted, enter the ","type":"text"},{"text":"'Validation Code'","type":"text","marks":[{"type":"em"}]},{"text":" from the printed page","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.8.4.2 Advanced Encryption Options","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Allow Unencrypted Filenames'","type":"text","marks":[{"type":"em"}]},{"text":" option greatly increases performance when creating DrTool files from an Azure Destination either via FileFly Admin Portal or FileFly DrTool. This is facilitated by recording stub filenames in Azure metadata in unencrypted form.","type":"text"},{"type":"hardBreak"},{"text":"Even when this option is enabled, stub filename information is still protected by TLS encryption ","type":"text"},{"text":"in transit","type":"text","marks":[{"type":"em"}]},{"text":" but is unencrypted at rest.","type":"text"},{"type":"hardBreak"},{"text":"File ","type":"text"},{"text":"content","type":"text","marks":[{"type":"em"}]},{"text":" is ","type":"text"},{"text":"always","type":"text","marks":[{"type":"strong"}]},{"text":" encrypted both in transit and at rest.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.8.4.3 Apply Configuration to Gateways","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" to save all changes. Changes will be saved to azure.cfg","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the azure.cfg file has been copied to the correct location on all Gateway machines:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\azure.cfg","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the Caringo FileFly Agent service on each Gateway machine","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.8.5 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.8.5.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The following is informational only, FileFly Azure Config should always be used to prepare Azure URIs.","type":"text"},{"type":"hardBreak"},{"text":"azure://{gateway}/{storage account}/{container}/","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gateway – DNS alias for all Caringo Azure Gateways","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"storage account – Storage Account name for which credentials have been configured","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"container – container to migrate files to","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Example:","type":"text"},{"type":"hardBreak"},{"text":"azure://gateway.example.com/myAccount/finance","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"4.9 Google Cloud Storage","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.9.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Google Cloud Storage is used only as a migration destination with FileFly.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.9.2 Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"Before proceeding with the installation, the following will be required:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a Google Account","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"a FileFly license that includes an entitlement for Google Cloud Storage","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.9.2.1 Firewall","type":"text"}]},{"type":"paragraph","content":[{"text":"The HTTPS port (TCP port 443) must be allowed by any firewalls between the Caringo FileFly Google Plugin on the Caringo FileFly Gateway and the internet.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.9.3 Setup","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.9.3.1 Installation","type":"text"}]},{"type":"paragraph","content":[{"text":"To perform a fresh installation:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Agent.exe, select the FileFly Gateway role (see §2.3.3) and select FileFly Google Plugin on the ","type":"text"},{"text":"'Components'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Or, to add the FileFly Google Plugin to an existing FileFly Gateway:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for the Caringo FileFly Google Plugin: Caringo FileFly Google Plugin.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the prompts to complete the installation","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.9.3.2 Installing ","type":"text"},{"text":"'Caringo FileFly Google Config'","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer for Caringo FileFly Google Config: Caringo FileFly Google Config.exe","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.9.4 Storage Bucket Preparation","type":"text"}]},{"type":"paragraph","content":[{"text":"Using the Google Cloud Platform web console, create a new Service Account in the desired project for the ","type":"text"},{"text":"exclusive","type":"text","marks":[{"type":"strong"}]},{"text":" use of FileFly. Create a P12 format private key for this Service Account. Record the Service Account ID (not the name) and store the downloaded private key file securely for use in later steps.","type":"text"},{"type":"hardBreak"},{"text":"Create a Storage Bucket ","type":"text"},{"text":"exclusively","type":"text","marks":[{"type":"strong"}]},{"text":" for FileFly data. Note that the 'Nearline' storage class is not recommended, due to poor performance for policies such as Scrub.","type":"text"},{"type":"hardBreak"},{"text":"For FileFly use, bucket names must:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"be 3-40 characters long","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"contain only lowercase letters, numbers and dashes ","type":"text"},{"type":"emoji","attrs":{"id":"atlassian-minus","text":":minus:","shortName":":minus:"}}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"not begin or end with a dash","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"not contain adjacent dashes","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Edit the bucket's permissions to add the new Service Account as a user with at least 'Writer' permission.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Multiple buckets may be used, possibly in different projects or accounts, to subdivide destination storage if desired.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.9.5 Plugin Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'Caringo FileFly Google Config'","type":"text","marks":[{"type":"em"}]},{"text":" tool:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Configure a new Google Storage Bucket","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"provide the Bucket Name and Service Account credentials","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Get URI","type":"text","marks":[{"type":"strong"}]},{"text":" to copy a URI to the clipboard for use in the Admin Portal Destination object","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"in FileFly Admin Portal, fill in the ","type":"text"},{"text":"gateway","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"partition","type":"text","marks":[{"type":"em"}]},{"text":" as required","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, fill in the ","type":"text"},{"text":"'Proxy'","type":"text","marks":[{"type":"em"}]},{"text":" section (not recommended for performance reasons)","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.9.5.1 Create a FileFly Encryption Key","type":"text"}]},{"type":"paragraph","content":[{"text":"If encryption-at-rest is to be used to protect FileFly data on the destination, check ","type":"text"},{"text":"'Enable encryption'","type":"text","marks":[{"type":"em"}]},{"text":". An encryption key must be generated before FileFly can be used to store encrypted data on a Google Cloud Storage migration destination. FileFly will encrypt all data migrated using the specified encryption key.","type":"text"},{"type":"hardBreak"},{"text":"During the encryption key creation process, a copy of the information entered will be printed and it is strongly recommended that a copy of the google.cfg file is stored in a safe location.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Generate…","type":"text","marks":[{"type":"strong"}]},{"text":" in the ","type":"text"},{"text":"'FileFly Encryption'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Read the User Confirmation notice and click ","type":"text"},{"text":"Yes","type":"text","marks":[{"type":"strong"}]},{"text":" to continue","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep the suggested Key ID","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter a passphrase from which to generate a new encryption key, and click ","type":"text"},{"text":"OK","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"an Encryption Key Details page will be printed","type":"text","marks":[{"type":"em"}]}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When prompted, enter the ","type":"text"},{"text":"'Validation Code'","type":"text","marks":[{"type":"em"}]},{"text":" from the printed page","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.9.5.2 Apply Configuration to Gateways","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" to save all changes. Changes will be saved to google.cfg","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure the google.cfg file has been copied to the correct location on all Gateway machines:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\google.cfg","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the Caringo FileFly Agent service on each Gateway machine","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4.9.6 Usage","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"4.9.6.1 URI Format","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The following is informational only, FileFly Google Config should always be used to prepare Google URIs.","type":"text"},{"type":"hardBreak"},{"text":"google://{gateway}/{bucket}[:{partition}]/","type":"text"},{"type":"hardBreak"},{"text":"Where:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"gateway – DNS alias for all Caringo Google Cloud Storage Gateways","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"bucket – bucket for which credentials have been configured","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"partition – partition within bucket","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Example:","type":"text"},{"type":"hardBreak"},{"text":"google://gateway.example.com/my-bucket:finance/","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"5 FileFly Admin Portal Reference","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Caringo FileFly Admin Portal is the web-based interface that provides central management of a FileFly deployment. It is installed as part of the FileFly Tools package.","type":"text"},{"type":"hardBreak"},{"text":"While the Admin Portal interface should be largely self-explanatory, this chapter is provided as a reference guide for completeness.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.1.0.1 Getting Started","type":"text"}]},{"type":"paragraph","content":[{"text":"Open Caringo FileFly Admin Portal from the Start Menu. The FileFly Admin Portal will open displaying the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab.","type":"text"},{"type":"hardBreak"},{"text":"The main FileFly Admin Portal page consists of seven tabs: the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, which displays a summary of the FileFly Admin Portal status and any running tasks, and a tab for each of the six types of objects described below.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.1.0.2 Servers","type":"text"}]},{"type":"paragraph","content":[{"text":"Servers are machines with activated agents – see §5.3. Status and health information for each Server is shown on the ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.1.0.3 Sources","type":"text"}]},{"type":"paragraph","content":[{"text":"Sources are volumes or folders upon which Policies may be applied (i.e., locations on the network from which files may be Migrated) – see §5.4.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.1.0.4 Destinations","type":"text"}]},{"type":"paragraph","content":[{"text":"Destinations are locations to which Policies write files (i.e., locations on the network to which files are Migrated) – see §5.5.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.1.0.5 Rules","type":"text"}]},{"type":"paragraph","content":[{"text":"Rules are used to filter the files at a Source location so that only the required subset of files is acted upon – see §5.6.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.1.0.6 Policies","type":"text"}]},{"type":"paragraph","content":[{"text":"Policies specify which operations to perform on which files. Policies bind Sources, Rules, and Destinations – see §5.7.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.1.0.7 Tasks","type":"text"}]},{"type":"paragraph","content":[{"text":"Tasks define schedules for Policy execution – see §5.8.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The Caringo FileFly Webapps service needs to run continuously in order to launch scheduled tasks.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.2 Overview Tab","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab displays a summary of the FileFly Admin Portal status and any running tasks as well as recent task history. Additionally, objects can be created using the ","type":"text"},{"text":"'Quick Links'","type":"text","marks":[{"type":"em"}]},{"text":" section. A ","type":"text"},{"text":"'Quick Run'","type":"text","marks":[{"type":"em"}]},{"text":" panel may be opened from the ","type":"text"},{"text":"'Quick Links'","type":"text","marks":[{"type":"em"}]},{"text":" section which allows Tasks to be run immediately.","type":"text"},{"type":"hardBreak"},{"text":"If there are warnings, they will be displayed in a panel below ","type":"text"},{"text":"'Quick Links'","type":"text","marks":[{"type":"em"}]},{"text":".","type":"text"},{"type":"hardBreak"},{"text":"On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab it is possible to:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"View the ","type":"text"},{"text":"Global Task Log","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Stop All Tasks","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Suspend/Start Scheduler","type":"text","marks":[{"type":"strong"}]},{"text":" to disable/enable scheduled Task execution","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click the name of a Task to reveal the details of the particular Task run","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Details","type":"text","marks":[{"type":"strong"}]},{"text":" to expand all running/recent Task details – see §5.9.1","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Clear","type":"text","marks":[{"type":"strong"}]},{"text":" the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Show/Hide Successful","type":"text","marks":[{"type":"strong"}]},{"text":" Tasks in the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"In a given Task run's details:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Go to Task","type":"text","marks":[{"type":"strong"}]},{"text":" to open the corresponding ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Go to log","type":"text","marks":[{"type":"strong"}]},{"text":" to open the corresponding Task run's ","type":"text"},{"text":"'Log Viewer'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Stop","type":"text","marks":[{"type":"strong"}]},{"text":" a running task","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.3 Servers","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab displays the installed and activated agents across the deployment of FileFly. Health information and recent demigration statistics are provided for each server or cluster node.","type":"text"},{"type":"hardBreak"},{"text":"Servers are added during the activation phase of the installation process. However, it is also possible to retire (and later reactivate) servers using the ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab, as described in the following sections.","type":"text"},{"type":"hardBreak"},{"text":"Servers and cluster nodes with errors will have their details automatically expanded, however, details for any server or cluster node can also be expanded by clicking on the relevant ","type":"text"},{"text":"Server address","type":"text","marks":[{"type":"strong"}]},{"text":" link or on the ","type":"text"},{"text":"Expand Details","type":"text","marks":[{"type":"strong"}]},{"text":" link at the top of the page.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.1 Adding a Server or Cluster","type":"text"}]},{"type":"paragraph","content":[{"text":"To add a new standalone server or the first node of a cluster:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Add New Server","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the appropriate server type from the server type drop-down","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions on the page to enter the appropriate FQDN for the server or cluster","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Next","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow any further instructions on the ","type":"text"},{"text":"'Confirm Server Address'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Next","type":"text","marks":[{"type":"strong"}]},{"text":" (or ","type":"text"},{"text":"Reactivate","type":"text","marks":[{"type":"strong"}]},{"text":" if the server has previously been activated)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For a new installation, enter the activation code displayed on the server and click ","type":"text"},{"text":"Activate","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" To add a new node to an existing cluster, refer to §5.3.4.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.2 Viewing/Editing Server or Cluster Details","type":"text"}]},{"type":"paragraph","content":[{"text":"Click on the name of any server or cluster to enter the ","type":"text"},{"text":"'Server Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"From this page, it is possible to update server comments, upgrade the server to a High-Availability cluster (after the relevant DNS changes have been made), or add nodes to an existing cluster.","type":"text"},{"type":"hardBreak"},{"text":"Additionally, statistics are displayed for various operations carried out on the selected server or cluster nodes. This information can be useful when monitoring and refining migration policies. This information may also be downloaded in CSV format.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.3 Configuring FileFly Agents","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Configure'","type":"text","marks":[{"type":"em"}]},{"text":" button on the ","type":"text"},{"text":"'Server Details'","type":"text","marks":[{"type":"em"}]},{"text":" page may be used to push configuration changes to FileFly Agents as described in Chapter 13.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.4 Adding a Cluster Node","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.3.4.1 Upgrade a Standalone Server to a HA Cluster","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Make any necessary DNS changes ","type":"text"},{"text":"first","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"ensure these changes have time to propagate","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Upgrade to HA Cluster","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the new cluster type from the drop-down list","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the address for the new node","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Next","type":"text","marks":[{"type":"strong"}]},{"text":" (or ","type":"text"},{"text":"Reactivate","type":"text","marks":[{"type":"strong"}]},{"text":" if the server has previously been activated)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For a new installation, enter the activation code displayed on the server and click ","type":"text"},{"text":"Activate","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.3.4.2 Add a Cluster Node to an Existing Cluster","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Add Cluster Node","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the address for the new node","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Next","type":"text","marks":[{"type":"strong"}]},{"text":" (or ","type":"text"},{"text":"Reactivate","type":"text","marks":[{"type":"strong"}]},{"text":" if the server has previously been activated)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For a new installation, enter the activation code displayed on the server and click ","type":"text"},{"text":"Activate","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.5 Retiring a Server or Cluster","type":"text"}]},{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Retire Server","type":"text","marks":[{"type":"strong"}]},{"text":" in the drop-down details for the server or cluster node of interest to retire a single server or cluster node. Click on the name of the cluster, then click ","type":"text"},{"text":"Retire Cluster","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Server Details'","type":"text","marks":[{"type":"em"}]},{"text":" page to retire an entire cluster.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.6 Reactivating a Server or Cluster","type":"text"}]},{"type":"paragraph","content":[{"text":"A server may be reactivated by following the same procedure as for adding a new server – see §5.3.1.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.7 Viewing System Statistics","type":"text"}]},{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"System Statistics","type":"text","marks":[{"type":"strong"}]},{"text":" to view operation statistics aggregated across all servers. Statistics can also be downloaded in CSV format.","type":"text"},{"type":"hardBreak"},{"text":"Statistics for individual servers can be seen on their ","type":"text"},{"text":"'Server Details'","type":"text","marks":[{"type":"em"}]},{"text":" pages.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.3.8 Upgrading Server Software","type":"text"}]},{"type":"paragraph","content":[{"text":"The system upgrade feature allows for remote servers to be updated automatically with minimal downtime. Click ","type":"text"},{"text":"Upgrade Servers","type":"text","marks":[{"type":"strong"}]},{"text":" to begin the System Upgrade process – see Chapter 8 for further details.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.4 Sources","type":"text"}]},{"type":"paragraph","content":[{"text":"Sources are volumes or folders to which Policies may be applied (i.e., locations on the network from which files may be Migrated).","type":"text"},{"type":"hardBreak"},{"text":"Sources can be grouped together by assigning a tag to them. Tags may denote department, server group, location, etc. Tagging provides an easy way to filter Sources which is particularly useful when there are a large number of Sources.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.4.1 Creating a Source","type":"text"}]},{"type":"paragraph","content":[{"text":"To create a Source:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Sources'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Create Source","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Name the Source and optionally enter a comment","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, tag the Source by either entering a new tag name or selecting an existing tag from the drop-down box","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a URI using the browser panel (see §5.4.5)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, select inclusions and exclusions – see §5.4.4","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" To exclude a directory from being actioned use a Rule. See Chapter 11.","type":"text"},{"type":"hardBreak"},{"text":"Tip:","type":"text","marks":[{"type":"strong"}]},{"text":" On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click on the ","type":"text"},{"text":"Create Source","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Quick Link'","type":"text","marks":[{"type":"em"}]},{"text":" to go directly to the ","type":"text"},{"text":"'Create Source'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.4.2 Listing Sources","type":"text"}]},{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Sources'","type":"text","marks":[{"type":"em"}]},{"text":" tab, Sources may be filtered by tag:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'[All] by tag' – displays all Sources grouped by their respective tag","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'[All] alphabetical' – displays all Sources alphabetically","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'tagname' – displays only the Sources with the given tag","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'[Untagged]' – displays only the untagged Sources","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"From the navigation bar:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a new Source – if a tag is currently selected, this will be the default for the new Source","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Show the full URIs of each of the displayed Sources","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Show the relationships that the displayed Sources have with Policies and Destinations","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.4.3 Viewing/Editing a Source","type":"text"}]},{"type":"paragraph","content":[{"text":"Click on the Source name on the ","type":"text"},{"text":"'Sources'","type":"text","marks":[{"type":"em"}]},{"text":" tab to display the ","type":"text"},{"text":"'Source Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"From the ","type":"text"},{"text":"'Source Details'","type":"text","marks":[{"type":"em"}]},{"text":" page:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the contents of the page as necessary and click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" when complete","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Delete","type":"text","marks":[{"type":"strong"}]},{"text":" to remove the Source","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.4.4 Directory Inclusions & Exclusions","type":"text"}]},{"type":"paragraph","content":[{"type":"inlineExtension","attrs":{"extensionType":"com.atlassian.confluence.migration","extensionKey":"inline-media-image","parameters":{"width":"560","id":"22003442-4bca-44ea-bf2d-a1bac4b22f27","collection":"contentId-2443825886","height":"301"}}},{"text":" ","type":"text"},{"type":"hardBreak"},{"text":"Within a given Source, individual directory subtrees may be included or excluded to provide greater control over which files are eligible for policy operations. Excluded directories will not be traversed.","type":"text"},{"type":"hardBreak"},{"text":"In the Source editor, once a URI has been entered/created, the directory tree may be expanded and explored in the ","type":"text"},{"text":"'Directory Inclusions & Exclusions'","type":"text","marks":[{"type":"em"}]},{"text":" panel (§5.1). By default, all directories will be ticked, marking them for inclusion.","type":"text"},{"type":"hardBreak"},{"text":"Branches of the tree are collapsed automatically as new branches are expanded. However, directories representing the top of an inclusion/exclusion remain visible even if the parent is collapsed.","type":"text"},{"type":"hardBreak"},{"text":"Ticking/unticking a directory will include/exclude that directory and its subdirectories recursively. Note that the root directory (the Source URI) may also be unticked.","type":"text"},{"type":"hardBreak"},{"text":"The ","type":"text"},{"text":"'other dirs'","type":"text","marks":[{"type":"em"}]},{"text":" entry represents both subdirectories that may be created in the future, as well as subdirectories not currently shown because their parent directories are collapsed.","type":"text"},{"type":"hardBreak"},{"text":"When a Source's inclusions and exclusions are edited at a later date, the ","type":"text"},{"text":"Validate and edit","type":"text","marks":[{"type":"strong"}]},{"text":" button must be clicked prior to modifying the contents of the panel. Validation verifies that directories specified for inclusion/exclusion still exist, and assists with maintaining the consistency of the configuration if they do not.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.4.5 Source URI Browser","type":"text"}]},{"type":"paragraph","content":[{"text":"The URI browser appears under the URI field. A URI can be created by typing directly into the URI field, or interactively by using the browser.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.5 Destinations","type":"text"}]},{"type":"paragraph","content":[{"text":"Destinations are storage locations that Policies may write files to (i.e., locations on the network to which files are Migrated).","type":"text"},{"type":"hardBreak"},{"text":"Like Sources, Destinations can be grouped together by assigning a tag to them. Tags may denote department, server group, location, etc. Tagging provides an easy way to filter Destinations which is particularly useful when there are a large number of Destinations.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.5.1 Creating a Destination","type":"text"}]},{"type":"paragraph","content":[{"text":"To create a Destination:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Destinations'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Create Destination","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Name the Destination and optionally enter a comment","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, tag the Destination by either entering a new tag name or selecting an existing tag from the drop-down box","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Enter a URI as directed","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Tip:","type":"text","marks":[{"type":"strong"}]},{"text":" On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click on the ","type":"text"},{"text":"Create Destination","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Quick Link'","type":"text","marks":[{"type":"em"}]},{"text":" to go directly to the ","type":"text"},{"text":"'Create Destination'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.5.1.1 Write Once Read Many (WORM)","type":"text"}]},{"type":"paragraph","content":[{"text":"The 'use Write Once Read Many (WORM) behavior for migration operations' checkbox turns on WORM behavior for the Destination.","type":"text"},{"type":"hardBreak"},{"text":"If a Destination is set to use this option, the Migrated file on secondary storage will not be modified when files are demigrated. Secondary storage space cannot be reclaimed.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.5.2 Listing Destinations","type":"text"}]},{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Destinations'","type":"text","marks":[{"type":"em"}]},{"text":" tab, Destinations may be filtered by tag:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'[All] by tag' – displays all Destinations grouped by their respective tag","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'[All] alphabetical' – displays all Destinations alphabetically","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'tagname' – displays only the Destinations with the given tag","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'[Untagged]' – displays only the untagged Destinations","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"From the navigation bar:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a new Destination – if a tag is currently selected, this will be the default for the new Destination","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Show the full URIs of each of the displayed Destinations","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.5.3 Viewing/Editing a Destination","type":"text"}]},{"type":"paragraph","content":[{"text":"Click on the Destination name on the ","type":"text"},{"text":"'Destinations'","type":"text","marks":[{"type":"em"}]},{"text":" tab to display the ","type":"text"},{"text":"'Destination Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"From the ","type":"text"},{"text":"'Destination Details'","type":"text","marks":[{"type":"em"}]},{"text":" page:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the contents of the page as necessary and click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" when complete","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Delete","type":"text","marks":[{"type":"strong"}]},{"text":" to remove the Destination","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.6 Rules","type":"text"}]},{"type":"paragraph","content":[{"text":"Rules are used to filter the files at a Source location so that only specific files are Migrated (e.g. Migrate only Microsoft Office files). A Simple Rule filters files based on file pattern matching and/or date matching, while a Compound Rule expresses a combination of multiple Simple Rules.","type":"text"},{"type":"hardBreak"},{"text":"Rules are applied to each file in the Source. If the Rule matches, the operation is performed on the file.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.1 Creating a Rule","type":"text"}]},{"type":"paragraph","content":[{"text":"To create a Rule:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Rules'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Create Rule","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Name the Rule and optionally enter a comment","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, to ","type":"text"},{"text":"omit","type":"text","marks":[{"type":"em"}]},{"text":" the files that match this Rule, check ","type":"text"},{"text":"Negate","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Complete the following as required:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'File Matching'","type":"text","marks":[{"type":"em"}]},{"text":" (see §5.6.4)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Date Matching'","type":"text","marks":[{"type":"em"}]},{"text":" (see §5.6.8)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Owner Matching'","type":"text","marks":[{"type":"em"}]},{"text":" (see §5.6.9)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Attribute State Matching'","type":"text","marks":[{"type":"em"}]},{"text":" (see §5.6.10)","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Creating a compound rule is detailed later, see §5.6.11.","type":"text"},{"type":"hardBreak"},{"text":"Tip:","type":"text","marks":[{"type":"strong"}]},{"text":" On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click on the ","type":"text"},{"text":"Create Rule","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Quick Link'","type":"text","marks":[{"type":"em"}]},{"text":" to go directly to the ","type":"text"},{"text":"'Create Rule'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.2 Listing Rules","type":"text"}]},{"type":"paragraph","content":[{"text":"Rules are listed on the ","type":"text"},{"text":"'Rules'","type":"text","marks":[{"type":"em"}]},{"text":" tab. From the navigation bar:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a new Rule","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a new Compound Rule","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Show the details of each of the displayed Rules","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.3 Viewing/Editing a Rule","type":"text"}]},{"type":"paragraph","content":[{"text":"Click on the Rule name on the ","type":"text"},{"text":"'Rules'","type":"text","marks":[{"type":"em"}]},{"text":" tab to display the ","type":"text"},{"text":"'Rule Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"From the ","type":"text"},{"text":"'Rule Details'","type":"text","marks":[{"type":"em"}]},{"text":" page:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the contents of the page as necessary and click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" when complete","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Delete","type":"text","marks":[{"type":"strong"}]},{"text":" to remove the Rule","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Rules that form part of another Rule (i.e., Compound Rules), or are included in a Policy, cannot be deleted. The Rule must be removed from the relevant object before it can be deleted.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.4 File Matching Block","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'File Matching'","type":"text","marks":[{"type":"em"}]},{"text":" block selects files by filename.","type":"text"},{"type":"hardBreak"},{"text":"The ","type":"text"},{"text":"'Patterns'","type":"text","marks":[{"type":"em"}]},{"text":" field takes a comma-separated list of patterns:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"wildcard patterns, e.g. *.doc (see §5.6.5)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"regular expressions, e.g. /2004-06-[0-9][0-9]\\.log/ (see §5.6.6)","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Notes:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"files match if any one of the patterns in the list match","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"all whitespace before and after each file pattern is ignored","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"patterns starting with '/' match the entire path from the Source URI","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"patterns NOT starting with '/' match files in any subtree","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"patterns are case-insensitive","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.5 Wildcard Matching","type":"text"}]},{"type":"paragraph","content":[{"text":"The following wildcards are accepted:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"? – matches one character (except '/')","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"* – matches zero or more characters (except '/')","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"** – matches zero or more characters, including '/'","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/**/ – matches ","type":"text"},{"text":"zero","type":"text","marks":[{"type":"em"}]},{"text":" or more directory components","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Commas must be escaped with a backslash.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.6.5.1 Examples of Supported Wildcard Matching:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"* – all filenames","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"*.doc – filenames ending with .doc","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"*.do? – filenames matching *.doc, *.dot, *.dop, etc. but not *.dope","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"???.* – filenames beginning with any three characters, followed by a period, followed by any number of characters","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"\\,","type":"text","marks":[{"type":"strong"}]},{"text":" – filenames containing a comma","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.6.5.2 Examples of Using * and ** in Wildcard Matching:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/","type":"text"},{"text":"/","type":"text","marks":[{"type":"strong"}]},{"text":".doc – matches *.doc in any directory name, but only one directory deep (matches /Docs/word.doc , but not /Docs/subdir/word.doc)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"public/** – matches all files recursively within ","type":"text"},{"text":"any","type":"text","marks":[{"type":"em"}]},{"text":" subdirectory named 'public'","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"public/*","type":"text"},{"text":"/","type":"text","marks":[{"type":"strong"}]},{"text":".pdf – matches all .pdf files recursively within ","type":"text"},{"text":"any","type":"text","marks":[{"type":"em"}]},{"text":" subdirectory named 'public'","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/home/","type":"text"},{"text":".archived/","type":"text","marks":[{"type":"strong"}]},{"text":"* – matches the contents of directories ending with '.archived' immediately located in the home directory","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/fred/*","type":"text"},{"text":"/doc/","type":"text","marks":[{"type":"strong"}]},{"text":".doc – matches *.doc in any doc directories that are part of the /fred/ tree (but only if the *.doc files are immediately within doc directories","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.6.5.3 Directory Exclusion Patterns","type":"text"}]},{"type":"paragraph","content":[{"text":"Wildcard patterns ending with '/**' match all files in a particular tree. When this kind of pattern is used to exclude directory trees, FileFly will automatically omit the traversal of these trees entirely. For large excluded trees, this can save considerable time.","type":"text"},{"type":"hardBreak"},{"text":"For other types of file and directory exclusion, please refer to §11.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.6 Regular Expression (Regex) Matching","type":"text"}]},{"type":"paragraph","content":[{"text":"More complex pattern matching can be achieved using regular expressions. Patterns in this format ","type":"text"},{"text":"must","type":"text","marks":[{"type":"strong"}]},{"text":" be enclosed in a pair of '/' characters. e.g. /[a-z].*/","type":"text"},{"type":"hardBreak"},{"text":"To assist with correctly matching file path components, the '/' character is ONLY matched if used explicitly. Specifically:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":". does NOT match the '/' char","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"the subpattern (.|/) is equivalent to the normal regex '.' (i.e. ALL characters)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"[","type":"text"},{"text":"abc] does NOT match '/' (i.e. it behaves like [","type":"text","marks":[{"type":"subsup","attrs":{"type":"sup"}}]},{"text":"/abc])","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'/' is matched only by a literal or a literal in a group (e.g. [/abc])","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Additionally,","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Commas must be escaped with a backslash","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Patterns are matched case-insensitively","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"It is recommended to avoid regex matching where wildcard matching is sufficient to improve readability.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.6.6.1 Examples of Regular Expression (Regex) Matching","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/.*/ – all filenames","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/.*\\.doc/ – filenames ending with .doc (notice the . is escaped with a backslash)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/.","type":"text"},{"text":"\\.doc/, /.","type":"text","marks":[{"type":"strong"}]},{"text":"\\.xls/ – filenames ending with .doc or .xls","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/~[w|$].*/ – filenames beginning with ~w or ~$ followed by zero or more characters, e.g. Office temporary files","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/.*\\.[0-9]{3}/ – filenames with an extension of three digits","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/[a-z][0-9]*/ – filenames consisting of a letter followed by zero or more digits","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"/[a-z][0-9]*\\.doc/ – as above except ending with .doc","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.6.6.2 Example of Combining Wildcard and Regex Matching","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":".log, /.","type":"text","marks":[{"type":"strong"}]},{"text":"\\.[0-9]{3}/","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"matches any files with a .log extension and also any files with a three-digit extension","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.7 Size Matching Block","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Size Matching'","type":"text","marks":[{"type":"em"}]},{"text":" block selects files by size.","type":"text"},{"type":"hardBreak"},{"text":"In the ","type":"text"},{"text":"'Min Size'","type":"text","marks":[{"type":"em"}]},{"text":" field, enter the minimum size of files to be matched. The file size units can be expressed in:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"bytes","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"kB (kilobytes), 1024 bytes","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"MB (megabytes), 1024 kB","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GB (gigabytes), 1024 MB","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Optionally, set the ","type":"text"},{"text":"'Max Size'","type":"text","marks":[{"type":"em"}]},{"text":" field to limit the size of files, check the ","type":"text"},{"text":"Max Size","type":"text","marks":[{"type":"strong"}]},{"text":" checkbox and select the maximum size for files.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.8 Date Matching Block","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Date Matching'","type":"text","marks":[{"type":"em"}]},{"text":" block selects files by date range or age.","type":"text"},{"type":"hardBreak"},{"text":"In the ","type":"text"},{"text":"'Date Matching'","type":"text","marks":[{"type":"em"}]},{"text":" block:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the property by which to match files","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Created' – the date and time the file was created","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Modified' – the date and time the file was last modified","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Accessed' – the date the file was last accessed","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Archived' – this option is currently unused","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the date element for the file property","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To include files after a particular date, check the ","type":"text"},{"text":"After","type":"text","marks":[{"type":"strong"}]},{"text":" checkbox and select a date.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To include files before a particular date, check the ","type":"text"},{"text":"Before","type":"text","marks":[{"type":"strong"}]},{"text":" checkbox and select a date.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To include files based on a particular age, check the ","type":"text"},{"text":"Age","type":"text","marks":[{"type":"strong"}]},{"text":" checkbox -","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"select if the age is ","type":"text"},{"text":"More than","type":"text","marks":[{"type":"strong"}]},{"text":" or ","type":"text"},{"text":"Less than","type":"text","marks":[{"type":"strong"}]},{"text":" the specified age","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"type a figure to indicate the age","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"select a time unit (Hours, Days, Weeks, Months, or Years)","type":"text"}]}]}]}]}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Matching on Accessed Date is not recommended as not all file servers will update this value and it may be modified by system-level software such as file indexers.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.9 Owner Matching Block","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Owner Matching'","type":"text","marks":[{"type":"em"}]},{"text":" block selects files by owner name.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Patterns'","type":"text","marks":[{"type":"em"}]},{"text":" field uses the same format as the ","type":"text"},{"text":"'File Matching Patterns'","type":"text","marks":[{"type":"em"}]},{"text":" field see §5.6.4","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows users are of the form domain\\username","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.10 Attribute State Matching Block","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Attribute State Matching'","type":"text","marks":[{"type":"em"}]},{"text":" block selects files by the following file attributes: ","type":"text"},{"text":"'Read-Only'","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"'Archive'","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"'System'","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"'Hidden'","type":"text","marks":[{"type":"em"}]},{"text":", ","type":"text"},{"text":"'Migrated'","type":"text","marks":[{"type":"em"}]},{"text":", and ","type":"text"},{"text":"'DoNotMigrate'","type":"text","marks":[{"type":"em"}]},{"text":".","type":"text"},{"type":"hardBreak"},{"text":"File attribute ","type":"text"},{"text":"'DoNotMigrate'","type":"text","marks":[{"type":"em"}]},{"text":" is set on files that FileFly has determined must not be migrated. FileFly does not migrate files with this attribute.","type":"text"},{"type":"hardBreak"},{"text":"Multiple attributes can be matched simultaneously; only files that meet all of the conditions will be selected.","type":"text"},{"type":"hardBreak"},{"text":"Example:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"to match all read-only files, set 'Read-Only' to ","type":"text"},{"text":"true","type":"text","marks":[{"type":"strong"}]},{"text":", and set all other attributes to ","type":"text"},{"text":"do not care","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.11 Creating a Compound Rule","type":"text"}]},{"type":"paragraph","content":[{"text":"To create a Compound Rule:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Rules'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Create Compound Rule","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Name the Rule and optionally enter a comment","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, to ","type":"text"},{"text":"omit","type":"text","marks":[{"type":"em"}]},{"text":" the files that match this Compound Rule, check ","type":"text"},{"text":"Negate","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click on the ","type":"text"},{"text":"'Combine logic'","type":"text","marks":[{"type":"em"}]},{"text":" drop-down box and choose the logic type (see Combine Logic §5.6.12)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Available'","type":"text","marks":[{"type":"em"}]},{"text":" box in the ","type":"text"},{"text":"'Rules'","type":"text","marks":[{"type":"em"}]},{"text":" section, select the names of the Rules to be combined into the Compound Rule, and click ","type":"text"},{"text":"Add","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To remove a Rule from the ","type":"text"},{"text":"'Selected'","type":"text","marks":[{"type":"em"}]},{"text":" box, select the Rule name and click ","type":"text"},{"text":"Remove","type":"text","marks":[{"type":"strong"}]}]}]}]}]}]},{"type":"paragraph","content":[{"text":"Tip:","type":"text","marks":[{"type":"strong"}]},{"text":" On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click on the ","type":"text"},{"text":"Create Compound Rule","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Quick Link'","type":"text","marks":[{"type":"em"}]},{"text":" to go directly to the ","type":"text"},{"text":"'Create Compound Rule'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.12 Rule Combine Logic","type":"text"}]},{"type":"paragraph","content":[{"text":"'Combine logic' refers to how the selected Rules are combined.","type":"text"},{"type":"hardBreak"},{"text":"When ","type":"text"},{"text":"'Filter (AND)'","type":"text","marks":[{"type":"em"}]},{"text":" is selected, all component Rules must match for a given file to be matched.","type":"text"},{"type":"hardBreak"},{"text":"When ","type":"text"},{"text":"'Alternative (OR)'","type":"text","marks":[{"type":"em"}]},{"text":" is selected at least one component Rule must match for a given file to be matched.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.6.13 Viewing/Editing a Compound Rule","type":"text"}]},{"type":"paragraph","content":[{"text":"Click on the Rule name on the ","type":"text"},{"text":"'Rules'","type":"text","marks":[{"type":"em"}]},{"text":" tab to display the ","type":"text"},{"text":"'Compound Rule Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"From the ","type":"text"},{"text":"'Compound Rule Details'","type":"text","marks":[{"type":"em"}]},{"text":" page it is possible to:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the contents of the page as necessary and click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" when complete","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Delete","type":"text","marks":[{"type":"strong"}]},{"text":" to remove this Compound Rule","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Rules that form part of another Rule (i.e., a Compound Rule), or are included in a Policy, cannot be deleted – otherwise the meaning of the Compound Rule or Policy could completely change, without becoming invalid. Such Rules must be removed from the relevant Compound Rule before they can be deleted.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.7 Policies","type":"text"}]},{"type":"paragraph","content":[{"text":"Policies define which operations to perform on which files. Policies traverse the files present on Sources, filter files of interest based on Rules, and apply an operation on each matched file.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.7.1 Creating a Policy","type":"text"}]},{"type":"paragraph","content":[{"text":"To create a Policy:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Policies'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Create Policy","type":"text","marks":[{"type":"strong"}]},{"text":". The ","type":"text"},{"text":"'Create Policy'","type":"text","marks":[{"type":"em"}]},{"text":" page will be displayed","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Name the Policy and optionally enter a comment","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the operation to perform for this Policy – see Chapter 3","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For Policies with Rules, a file must match ALL selected Rules for the operation to be performed","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Tip:","type":"text","marks":[{"type":"strong"}]},{"text":" On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click on the ","type":"text"},{"text":"Create Policy","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Quick Link'","type":"text","marks":[{"type":"em"}]},{"text":" to go directly to the ","type":"text"},{"text":"'Create Policy'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.7.2 Listing Policies","type":"text"}]},{"type":"paragraph","content":[{"text":"Policies are listed on the ","type":"text"},{"text":"'Policies'","type":"text","marks":[{"type":"em"}]},{"text":" tab. From the navigation bar:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a new Policy","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Show the Relationships each of the displayed Policies have with Sources, Destinations, and Tasks","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Create Task","type":"text","marks":[{"type":"strong"}]},{"text":" to create a Task for the particular Policy","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.7.3 Viewing/Editing a Policy","type":"text"}]},{"type":"paragraph","content":[{"text":"Click on the Policy name on the ","type":"text"},{"text":"'Policies'","type":"text","marks":[{"type":"em"}]},{"text":" tab to display the ","type":"text"},{"text":"'Policy Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"From the ","type":"text"},{"text":"'Policy Details'","type":"text","marks":[{"type":"em"}]},{"text":" page:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the contents of the page as necessary and click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" when complete","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Delete","type":"text","marks":[{"type":"strong"}]},{"text":" to remove the Policy","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.8 Tasks","type":"text"}]},{"type":"paragraph","content":[{"text":"Tasks schedule Policies for execution. Tasks are executed by the Caringo FileFly Webapps service. Tasks can be scheduled to run at specific times or can be run interactively via the ","type":"text"},{"text":"Run Now","type":"text","marks":[{"type":"strong"}]},{"text":" feature.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.8.1 Creating and Scheduling a Task","type":"text"}]},{"type":"paragraph","content":[{"text":"To create a ","type":"text"},{"text":"Task","type":"text","marks":[{"type":"em"}]},{"text":":","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"From the ","type":"text"},{"text":"'Tasks'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Create Task","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Name the Task and optionally enter a comment","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'Policies'","type":"text","marks":[{"type":"em"}]},{"text":" section, select Policies from the ","type":"text"},{"text":"'Available'","type":"text","marks":[{"type":"em"}]},{"text":" list using the ","type":"text"},{"text":"Add","type":"text","marks":[{"type":"strong"}]},{"text":"/","type":"text"},{"text":"Remove","type":"text","marks":[{"type":"strong"}]},{"text":" buttons","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the times to execute the Policies from the ","type":"text"},{"text":"'Schedule'","type":"text","marks":[{"type":"em"}]},{"text":" section","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, enable completion notification – see §5.9.3","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Tip:","type":"text","marks":[{"type":"strong"}]},{"text":" On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click on the ","type":"text"},{"text":"Create Task","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"'Quick Link'","type":"text","marks":[{"type":"em"}]},{"text":" to go directly to the ","type":"text"},{"text":"'Create Task'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.8.1.1 Defining a Schedule","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'Schedule'","type":"text","marks":[{"type":"em"}]},{"text":" section consists of various time selections to choose how often a Task will be executed.","type":"text"},{"type":"hardBreak"},{"text":"The ","type":"text"},{"text":"'Enable'","type":"text","marks":[{"type":"em"}]},{"text":" checkbox determines if the Task Schedule is enabled (useful if temporarily disabling the scheduled time due to system maintenance).","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" To disable all Tasks, click ","type":"text"},{"text":"Suspend Scheduler","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab.","type":"text"},{"type":"hardBreak"},{"text":"The available options in the ","type":"text"},{"text":"'Schedule'","type":"text","marks":[{"type":"em"}]},{"text":" section are:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Min'","type":"text","marks":[{"type":"em"}]},{"text":" – controls the minute of the hour the Task will run, and is between 00 and 55 (in 5-minute increments) in the graphical display.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The 'Time Spec' field allows integers up to 59, but will still operate in 5-minute increments.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If a number is input directly into the 'Time Spec' field that is not listed in the graphical display, e.g. 29, nothing will be highlighted in the Min field of the graphical display, however the item is still valid.","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Hour'","type":"text","marks":[{"type":"em"}]},{"text":" – controls the hour the Task will run, and is specified in the 24 hour clock; values must be between 0 and 23 (0 is midnight).","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Day'","type":"text","marks":[{"type":"em"}]},{"text":" – is the day of the month the Task will run, e.g., to run a Task on the 19th of each month, the Day would be 19.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'Month'","type":"text","marks":[{"type":"em"}]},{"text":" – is the month the Task will run (1 is January).","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"'DoW'","type":"text","marks":[{"type":"em"}]},{"text":" – is the Day of Week the Task will run. It can also be numeric (0-6) (Sunday to Saturday).","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.8.1.2 'Time Spec' Examples","type":"text"}]},{"type":"table","attrs":{"layout":"default","localId":"f6c95e29-e338-4f6e-a0d8-b6995a98c62f"},"content":[{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[214.0]},"content":[{"type":"paragraph","content":[{"text":"05 * * * *","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[546.0]},"content":[{"type":"paragraph","content":[{"text":"five minutes past every hour","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[214.0]},"content":[{"type":"paragraph","content":[{"text":"20 9 * * *","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[546.0]},"content":[{"type":"paragraph","content":[{"text":"daily at 9:20 am","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[214.0]},"content":[{"type":"paragraph","content":[{"text":"20 21 * * *","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[546.0]},"content":[{"type":"paragraph","content":[{"text":"daily at 9:20 pm","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[214.0]},"content":[{"type":"paragraph","content":[{"text":"00 5 * * 0","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[546.0]},"content":[{"type":"paragraph","content":[{"text":"5:00 am every Sunday","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[214.0]},"content":[{"type":"paragraph","content":[{"text":"45 4 5 * *","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[546.0]},"content":[{"type":"paragraph","content":[{"text":"4:45 am every 5th of the month","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[214.0]},"content":[{"type":"paragraph","content":[{"text":"00 * 21 07 *","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[546.0]},"content":[{"type":"paragraph","content":[{"text":"hourly on the 21st of July","type":"text"}]}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.8.2 Listing Tasks","type":"text"}]},{"type":"paragraph","content":[{"text":"Tasks are listed on the ","type":"text"},{"text":"'Tasks'","type":"text","marks":[{"type":"em"}]},{"text":" tab. From the navigation bar:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a new Task","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Show the Details of each of the displayed Tasks","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.8.3 Viewing/Editing a Task","type":"text"}]},{"type":"paragraph","content":[{"text":"Click on the Task name on the ","type":"text"},{"text":"'Tasks'","type":"text","marks":[{"type":"em"}]},{"text":" tab to display the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"From the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the contents of the page as necessary and click ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" when complete","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Delete","type":"text","marks":[{"type":"strong"}]},{"text":" to remove the Task","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Once a Task has been saved, additional options are available on the navigation bar of the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.8.4 Running a Task Immediately","type":"text"}]},{"type":"paragraph","content":[{"text":"Run a Task immediately rather than waiting for a scheduled time by clicking ","type":"text"},{"text":"Run Now","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page or via ","type":"text"},{"text":"Quick Run","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.8.5 Simulating a Task","type":"text"}]},{"type":"paragraph","content":[{"text":"Run a Task in simulate mode by clicking ","type":"text"},{"text":"Simulate Now","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page. In simulate mode, the Sources are examined to see which files match the Rules. The results are a statistics report (accessible from the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page) and a log file of which files matched.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.8.6 Viewing Statistics","type":"text"}]},{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"View Last Stats","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page to access the results of Policies that produce statistics reports (i.e. the 'Gather Statistics' operation or Simulations).","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.8.7 Downloading DrTool Files","type":"text"}]},{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Download DrTool Files","type":"text","marks":[{"type":"strong"}]},{"text":" on the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page to access the results of Policies that produce DrTool Files (i.e. the 'Create DrTool File From Destination' and 'Create DrTool File From Source' operations).","type":"text"},{"type":"hardBreak"},{"text":"The ","type":"text"},{"text":"'Download DrTool Files'","type":"text","marks":[{"type":"em"}]},{"text":" page also allows files from previous runs of the Task to be downloaded. To configure retention options for these files see §5.10.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.9 Task Execution","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.9.1 Monitoring Running Tasks","type":"text"}]},{"type":"paragraph","content":[{"text":"While a Task is running, its status is displayed in the ","type":"text"},{"text":"'Running Tasks'","type":"text","marks":[{"type":"em"}]},{"text":" section of the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab. When Tasks finish they are moved to the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]},{"text":" section.","type":"text"},{"type":"hardBreak"},{"text":"The following Task information is displayed:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Started/Ended","type":"text","marks":[{"type":"em"}]},{"text":" – the time the Task was started/finished","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"State","type":"text","marks":[{"type":"em"}]},{"text":" – the current status of a Task such as 'waiting to run', 'connecting to source', 'running', etc.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Files examined","type":"text","marks":[{"type":"em"}]},{"text":" – the total no. of files examined","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Directory count","type":"text","marks":[{"type":"em"}]},{"text":" – the total no. of directories examined","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Operations succeeded","type":"text","marks":[{"type":"em"}]},{"text":" – the no. of operations that have been successful","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Operations locked","type":"text","marks":[{"type":"em"}]},{"text":" – the no. of operations that have been omitted because the files were locked","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Operations failed","type":"text","marks":[{"type":"em"}]},{"text":" – the no. of operations that have failed","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Logs","type":"text","marks":[{"type":"em"}]},{"text":" – links to the logs generated by the Task run","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"The operation counts are updated in real-time as the task runs. Operations will automatically be executed in parallel, see §13.4 for more details.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The locked, skipped, and failed counts are not shown if they are zero.","type":"text"},{"type":"hardBreak"},{"text":"If multiple Tasks are scheduled to run simultaneously, the common elements are grouped in the ","type":"text"},{"text":"'Running Tasks'","type":"text","marks":[{"type":"em"}]},{"text":" section and the Tasks are run together using a single traversal of the file system.","type":"text"},{"type":"hardBreak"},{"text":"When a Task has finished running, summary information for the Task is displayed in the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]},{"text":" section on the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, and details of the Task are listed in the log file.","type":"text"},{"type":"hardBreak"},{"text":"Tip:","type":"text","marks":[{"type":"strong"}]},{"text":" click the Task name next to the log links in the expanded view of a running or finished task to jump straight to the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page to access statistics, DrTool files, etc.","type":"text"},{"type":"hardBreak"},{"text":"FileFly Admin Portal can also be configured to send a summary of recent Task activity by email, see §5.10.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.9.2 Accessing Logs","type":"text"}]},{"type":"paragraph","content":[{"text":"Tasks in the ","type":"text"},{"text":"'Running Tasks'","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]},{"text":" sections can be expanded to reveal more detail about each Task. Click ","type":"text"},{"text":"Details","type":"text","marks":[{"type":"strong"}]},{"text":" next to either section to expand all, or click on the individual Task name to expand them individually.","type":"text"},{"type":"hardBreak"},{"text":"While a Task is running, view the log information by clicking ","type":"text"},{"text":"Go to log","type":"text","marks":[{"type":"strong"}]},{"text":" to open the ","type":"text"},{"text":"'Log Viewer'","type":"text","marks":[{"type":"em"}]},{"text":". Use this to troubleshoot any errors that arise during the Task run. These logs are also accessible by expanding the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]},{"text":" section after the Task has completed.","type":"text"},{"type":"hardBreak"},{"text":"The ","type":"text"},{"text":"'Log Viewer'","type":"text","marks":[{"type":"em"}]},{"text":" page displays relevant log information about Tasks. By default, the ","type":"text"},{"text":"'Log Viewer'","type":"text","marks":[{"type":"em"}]},{"text":" displays entries from the logs relevant to this Task only. The path and filename of the log file are shown beneath the main box.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Show All Entries","type":"text","marks":[{"type":"strong"}]},{"text":" to display all entries in this log file","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Download","type":"text","marks":[{"type":"strong"}]},{"text":" to save a copy of the log","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.9.3 Completion Notification","type":"text"}]},{"type":"paragraph","content":[{"text":"When a Task finishes running, regardless of whether it succeeds or fails, a completion notification email may be sent as a convenience to the administrator. This notification email contains summary information similar to that available in the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]},{"text":" section of the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab.","type":"text"},{"type":"hardBreak"},{"text":"To use this feature, email settings must be configured beforehand – see §5.10. Notifications for a given task may then be enabled either by:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"checking the notify option on the ","type":"text"},{"text":"'Task Details'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"clicking ","type":"text"},{"text":"Request completion notification","type":"text","marks":[{"type":"strong"}]},{"text":" on a task in the ","type":"text"},{"text":"'Running Tasks'","type":"text","marks":[{"type":"em"}]},{"text":" section of the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.10 Settings Page","type":"text"}]},{"type":"paragraph","content":[{"text":"From any tab, click the settings icon in the top right corner to access the ","type":"text"},{"text":"'Settings'","type":"text","marks":[{"type":"em"}]},{"text":" page.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Admin Portal settings can be returned to default values using the ","type":"text"},{"text":"Defaults","type":"text","marks":[{"type":"strong"}]},{"text":" button.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.0.1 License Details","type":"text"}]},{"type":"paragraph","content":[{"text":"The License Details section shows the identity, type, and expiry details for the currently active license.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Install New License…","type":"text","marks":[{"type":"strong"}]},{"text":" to install a new license","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Quota Details…","type":"text","marks":[{"type":"strong"}]},{"text":" to examine advanced license quota details (this can be used to troubleshoot server entitlement problems)","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.0.2 Web Proxy","type":"text"}]},{"type":"paragraph","content":[{"text":"If the installed license requires access to the Global Licensing Service, a web proxy must be configured if a direct internet connection is unavailable.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.0.3 Administration Credentials","type":"text"}]},{"type":"paragraph","content":[{"text":"This section allows the password for the Admin Portal administrative user to be changed.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.0.4 Email Notification","type":"text"}]},{"type":"paragraph","content":[{"text":"It is strongly recommended that the email notification feature be configured to send email alerts of critical conditions to a system administrator. Additionally, a daily or weekly summary of FileFly task activity and system health should be scheduled. Adjust the Operation Time Limit to control how long FileFly Admin Portal will wait before notifying the administrator of a file operation that is taking an unexpectedly long time to complete.","type":"text"},{"type":"hardBreak"},{"text":"Fill in the required SMTP details. Only a single address may be provided in the To field; to send to multiple users, send to a mailing list instead. It is advisable to provide an address that is specific to the FileFly Admin Portal in the From field. The From address does not necessarily have to correspond to a real email account, since the FileFly Admin Portal will never accept incoming email.","type":"text"},{"type":"hardBreak"},{"text":"The SMTP server may optionally be contacted over TLS. If the server presents an untrusted TLS certificate, the ","type":"text"},{"text":"'Allow untrusted certs for TLS'","type":"text","marks":[{"type":"em"}]},{"text":" checkbox may be used to force the connection anyway.","type":"text"},{"type":"hardBreak"},{"text":"The email notification feature supports optional authentication using the 'Plain' authentication method.","type":"text"},{"type":"hardBreak"},{"text":"The ","type":"text"},{"text":"Test Email","type":"text","marks":[{"type":"strong"}]},{"text":" button allows these settings to be tested prior to the scheduled time. Once configured, any error encountered when sending an email notification will be displayed in the warnings box on the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.0.5 Configuration Backup","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Schedule: ","type":"text"},{"text":"day","type":"text","marks":[{"type":"em"}]},{"text":" and ","type":"text"},{"text":"hour","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Schedule a weekly backup of FileFly Admin Portal configuration","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A daily backup can be performed by selecting ","type":"text"},{"text":"'Every day'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is 1am each Monday","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" backups","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Sets the number of backup file rotations to keep","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is 4 backups","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Backup Files: ","type":"text"},{"text":"read-only list","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Dated backup files currently available on the system","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"Force Backup Now","type":"text","marks":[{"type":"strong"}]},{"text":" button allows a backup of the current configuration to be taken without waiting for the next scheduled backup time.","type":"text"},{"type":"hardBreak"},{"text":"Please refer to §6.2 for further information.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.0.6 Work Hours","type":"text"}]},{"type":"paragraph","content":[{"text":"Specify work hours and work days which may be used by migration policies to pause migration activity during the busy work period.","type":"text"},{"type":"hardBreak"},{"text":"Individual policies may then be configured to pause during work hours – see §5.7 for supported operations.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.0.7 Backup & Scrub Grace Period","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Minimum Grace: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Sets a global minimum scrub grace period to act as a safeguard","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"Please read the text carefully and set the minimum grace period as appropriate after consulting with your backup plan. It is strongly recommended to review this setting following changes to your backup plan. For example, if backups are kept for 30 days, the grace period should be at least 35 days (allowing 5 days for restoration). See also Chapter 7.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5.10.1 Advanced Settings","type":"text"}]},{"type":"paragraph","content":[{"text":"The following settings should not normally require adjustment. It is advisable to consult with a support engineer before changing these values.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.1.1 Recent Task History","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Display: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" tasks","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Sets the maximum number of Tasks displayed in the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is 40 tasks","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Max: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" days","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Sets the maximum number of days to display Tasks in the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is 10 days","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Min: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" minutes","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Sets the minimum number of minutes Tasks remain in the ","type":"text"},{"text":"'Recent Task History'","type":"text","marks":[{"type":"em"}]},{"text":" (even if maximum number of Tasks is exceeded)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is 60 minutes","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.1.2 Performance","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Threads: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The maximum number of threads to use for file walking","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is 32 threads","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Throttle: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" files examined per second per thread","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restricts the rate at which files are examined by FileFly (per second per thread) during a Task execution","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is an arbitrarily high number which 'disables' throttling","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.1.3 Logging","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Log Size: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" MB","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Sets the size at which log files are rotated","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is 5 MB","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.1.4 Network","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"TCP Port: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Sets the port that Caringo FileFly Admin Portal contacts Caringo FileFly Agent on","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Default value is port 4604","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"5.10.1.5 DrTool File Retention","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep at least: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" files","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"controls the minimum number of rotations of DrTool files that will be retained","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Keep for at least: ","type":"text"},{"text":"n","type":"text","marks":[{"type":"em"}]},{"text":" days","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"controls the minimum age at which rotated DrTool files will be considered eligible for removal","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.11 About Page","type":"text"}]},{"type":"paragraph","content":[{"text":"From any tab, click the about icon in the top right corner to access the ","type":"text"},{"text":"'About'","type":"text","marks":[{"type":"em"}]},{"text":" page. This page contains information about the FileFly Tools installation, including file locations and memory usage information.","type":"text"},{"type":"hardBreak"},{"text":"The page also enables the generation of a support.zip file containing your encrypted system configuration and licensing state. DataCore Support may request this file to assist in troubleshooting any configuration or licensing issues.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"5.12 Service Probe","type":"text"}]},{"type":"paragraph","content":[{"text":"To remotely test whether the Caringo FileFly Webapps service is responding, perform an HTTP GET request on the following resource:","type":"text"},{"type":"hardBreak"},{"text":"https://:/ffap/probe","type":"text"},{"type":"hardBreak"},{"text":"For example, to probe with curl:","type":"text"},{"type":"hardBreak"},{"text":"curl -i -k 'https://server.example.com:8080/ffap/probe'","type":"text"},{"type":"hardBreak"},{"text":"The service will respond with 200 OK.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"6 Configuration Backup","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"6.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"This chapter describes how to backup Caringo FileFly configuration (for primary and secondary storage backup considerations, see Chapter 7).","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"6.2 Backing Up FileFly Tools","type":"text"}]},{"type":"paragraph","content":[{"text":"Backing up the Caringo FileFly Tools configuration will preserve policy configuration and server registrations as configured in the FileFly Admin Portal.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"6.2.0.1 Backup Process","type":"text"}]},{"type":"paragraph","content":[{"text":"Configuration backup can be scheduled on the Admin Portal's ","type":"text"},{"text":"'Settings'","type":"text","marks":[{"type":"em"}]},{"text":" page – see §5.10. A default schedule is created at installation time to backup configuration once a week.","type":"text"},{"type":"hardBreak"},{"text":"Configuration backup files include:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Policy configuration","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Server registrations","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"DrTool files","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Settings from the Admin Portal ","type":"text"},{"text":"'Settings'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Settings specified when FileFly Tools was installed","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"It is recommended that these backup files are retrieved and stored ","type":"text"},{"text":"securely","type":"text","marks":[{"type":"strong"}]},{"text":" as part of your overall backup plan. These backup files can be found at:","type":"text"},{"type":"hardBreak"},{"text":"C:\\Program Files\\Caringo FileFly\\data\\AdminPortal\\configBackups","type":"text"},{"type":"hardBreak"},{"text":"Additionally, log files may be backed up from:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\logs\\AdminPortal\\","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\logs\\DrTool\\","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"6.2.0.2 Restore Process","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Ensure that the server to be restored and has the same FQDN as the original server","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"If present, uninstall Caringo FileFly Tools","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the installer: Caringo FileFly Tools.exe","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"use the same version that was used to generate the backup file","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Installation Type'","type":"text","marks":[{"type":"em"}]},{"text":" page, select ","type":"text"},{"text":"'Restore from Backup'","type":"text","marks":[{"type":"em"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Choose the backup zip file and follow the instructions","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally, log files may be restored from server backups to:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\logs\\AdminPortal\\","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\logs\\DrTool\\","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"6.3 Backing Up FileFly Agent / FileFly FPolicy Server","type":"text"}]},{"type":"paragraph","content":[{"text":"Backing up the Caringo FileFly Agent configuration on each server will allow for easier redeployment of agents in the event of a disaster.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"6.3.1 Windows","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"6.3.1.1 Backup Process","type":"text"}]},{"type":"paragraph","content":[{"text":"On each Caringo FileFly Agent and FileFly FPolicy Server machine backup the entire installation directory.","type":"text"},{"type":"hardBreak"},{"text":"e.g. C:\\Program Files\\Caringo FileFly\\","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"6.3.1.2 Restore Process","type":"text"}]},{"type":"paragraph","content":[{"text":"On each replacement server:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Install the same version of Caringo FileFly Agent or FileFly FPolicy Server as normal (see §2.3.3)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Stop the ","type":"text"},{"text":"'Caringo FileFly Agent'","type":"text","marks":[{"type":"em"}]},{"text":" service","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restore the contents of the following directories from backup:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"C:\\Program Files\\Caringo FileFly\\logs\\FileFly Agent\\","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the ","type":"text"},{"text":"'Caringo FileFly Agent'","type":"text","marks":[{"type":"em"}]},{"text":" service","type":"text"}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"7 Storage Backup","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"7.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"Each stub on primary storage is linked to a corresponding MWI file on secondary storage. During the normal process of migration and demigration, the relationship between the stub and MWI file is maintained.","type":"text"},{"type":"hardBreak"},{"text":"The recommendations below ensure that the consistency of this relationship is maintained even after files are restored from the backup.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"7.2 Backup Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"Ensure that the restoration of stubs is included as part of your backup & restore test regimen.","type":"text"},{"type":"hardBreak"},{"text":"When using Scrub policies, ensure the Scrub grace period is sufficient to cover the time from when a backup is taken to when the restore ","type":"text"},{"text":"and","type":"text","marks":[{"type":"em"}]},{"text":" Post-Restore Revalidate steps are completed (see below).","type":"text"},{"type":"hardBreak"},{"text":"It is ","type":"text"},{"text":"strongly","type":"text","marks":[{"type":"strong"}]},{"text":" recommended to set the global ","type":"text"},{"text":"minimum","type":"text","marks":[{"type":"em"}]},{"text":" grace period accordingly to guard against the accidental creation of scrub policies with insufficient grace. To update this setting, see §5.10.","type":"text"},{"type":"hardBreak"},{"text":"Important: It will","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"NOT","type":"text","marks":[{"type":"strong"},{"type":"em"}]},{"text":" ","type":"text"},{"text":"be possible to safely restore stubs from a backup set taken more than one grace period ago.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"7.2.1 Additional Planning","type":"text"}]},{"type":"paragraph","content":[{"text":"To complement standard backup and recovery solutions, and to allow the widest range of recovery options, it is recommended to schedule a ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"em"}]},{"text":" Policy to run after each migration.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"7.3 Restore Process","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Suspend the scheduler in FileFly Admin Portal","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restore the primary volume","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run a ","type":"text"},{"text":"'Post-Restore Revalidate'","type":"text","marks":[{"type":"em"}]},{"text":" policy against the primary volume","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"To guarantee all stubs are revalidated, run this policy against the ","type":"text"},{"text":"entire","type":"text","marks":[{"type":"strong"}]},{"text":" primary volume, NOT against the migration source","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"This policy is not required when ","type":"text"},{"text":"only","type":"text","marks":[{"type":"em"}]},{"text":" WORM destinations are in use","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the scheduler in FileFly Admin Portal","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"If restoring the primary volume to a different server (a server with a different FQDN), the following preparatory steps will also be required:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab, retire the old server (unless it is still in use for other volumes)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Install FileFly Agent on the new server","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Update Admin Portal Sources as required to refer to the FQDN of the new server","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Perform the restore process as above","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"7.4 Platform-specific Considerations","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"7.4.1 Windows","type":"text"}]},{"type":"paragraph","content":[{"text":"Most enterprise Windows backup software will respect the Offline flag. Refer to the backup software user guide for options regarding Offline files.","type":"text"},{"type":"hardBreak"},{"text":"When testing backup software configuration, test that backup of stubs does not cause unwanted demigration.","type":"text"},{"type":"hardBreak"},{"text":"Additional backup testing may be required if Stub Deletion Monitoring is required. Please refer to §13.2 for more details.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"7.4.2 NetApp Filers","type":"text"}]},{"type":"paragraph","content":[{"text":"Please consult §4.2.5 for information regarding snapshot restore on Cluster-mode NetApp Filers.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"8 System Upgrade","type":"text"}]},{"type":"paragraph","content":[{"text":"When a FileFly deployment is upgraded from a previous version, FileFly Tools must always be upgraded first, followed by ","type":"text"},{"text":"all","type":"text","marks":[{"type":"em"}]},{"text":" FileFly Agent and FileFly FPolicy Server components. Any installed plugins will be upgraded automatically during FileFly Agent upgrade.","type":"text"},{"type":"hardBreak"},{"text":"All components must be upgraded to the same version unless otherwise specified.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"8.1 Upgrade Procedure","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On the Admin Portal ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Suspend Scheduler","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run the Caringo FileFly Tools.exe installer","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Upgrade all FileFly Agents and FileFly FPolicy Servers (see §8.2)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Resolve any warnings displayed on the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"On the ","type":"text"},{"text":"'Overview'","type":"text","marks":[{"type":"em"}]},{"text":" tab, click ","type":"text"},{"text":"Start Scheduler","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"8.2 Automated Server Upgrade","type":"text"}]},{"type":"paragraph","content":[{"text":"Where possible, it is advisable to upgrade FileFly Agents and FileFly FPolicy Servers using the automated upgrade feature. This can be accessed from the Admin Portal ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab by clicking ","type":"text"},{"text":"Upgrade Servers","type":"text","marks":[{"type":"strong"}]},{"text":".","type":"text"},{"type":"hardBreak"},{"text":"The automated process transfers installers to each server and performs the upgrades in parallel to minimize downtime. If a server fails or is offline during the upgrade, manually upgrade it later. Once the automated upgrade procedure is finalized, the ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab will update to display the health of the upgraded servers.","type":"text"},{"type":"hardBreak"},{"text":"Automated upgrade is available for Windows FileFly Agents and FileFly FPolicy Servers.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"8.3 Manual Server Upgrade","type":"text"}]},{"type":"paragraph","content":[{"text":"Follow the instructions appropriate for the platform of each server as described below. Plugins and configuration will be updated automatically.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"8.3.1 FileFly Agent for Windows","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run Caringo FileFly Agent.exe and follow the instructions","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check the Admin Portal ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab for warnings","type":"text"}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"8.3.2 FileFly NetApp FPolicy Server","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run Caringo FileFly NetApp FPolicy Server.exe and follow the instructions","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check the Admin Portal ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab for warnings","type":"text"}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"9 Disaster Recovery","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.1 Introduction","type":"text"}]},{"type":"paragraph","content":[{"text":"The FileFly DrTool application allows for the recovery of files where normal backup and restore procedures have failed. Storage backup recommendations and considerations are covered in Chapter 7.","type":"text"},{"type":"hardBreak"},{"text":"It is recommended to regularly run a ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"em"}]},{"text":" Policy to generate an up-to-date list of source–destination mappings.","type":"text"},{"type":"hardBreak"},{"text":"FileFly DrTool is installed as part of Caringo FileFly Tools.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" ","type":"text"},{"text":"Community Edition","type":"text","marks":[{"type":"em"}]},{"text":" licenses do not include FileFly DrTool functionality.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.2 DrTool Files","type":"text"}]},{"type":"paragraph","content":[{"text":"DrTool files are normally generated by running ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"em"}]},{"text":" Policies in FileFly Admin Portal. To open a file previously generated by FileFly Admin Portal:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Open Caringo FileFly DrTool from the Start Menu","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Navigate to File → Open From FileFly Admin Portal…→ DrTool File From Source","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select a DrTool file to open","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.3 Filtering Results","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"9.3.1 Creating a Filter","type":"text"}]},{"type":"paragraph","content":[{"text":"In FileFly DrTool, click ","type":"text"},{"text":"Filter","type":"text","marks":[{"type":"strong"}]},{"text":" to filter results by source file properties. Filter options are described below.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" When a Filter is applied, ","type":"text"},{"text":"Save","type":"text","marks":[{"type":"strong"}]},{"text":" only saves the filtered results.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.3.1.1 Scheme Pattern","type":"text"}]},{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'Scheme Pattern'","type":"text","marks":[{"type":"em"}]},{"text":" field, use the name of the Scheme only (e.g. win, not win:// or win://servername ). This field may be left blank to return results for all schemes.","type":"text"},{"type":"hardBreak"},{"text":"This field matches against the scheme section of a URI:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"{scheme}","type":"text","marks":[{"type":"strong"}]},{"text":"://{servername}/[{path}]","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.3.1.2 Server Pattern","type":"text"}]},{"type":"paragraph","content":[{"text":"In the ","type":"text"},{"text":"'Server Pattern'","type":"text","marks":[{"type":"em"}]},{"text":" field, use the full server name or a wildcard expression.","type":"text"},{"type":"hardBreak"},{"text":"This field matches against the servername section of a URI:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"{scheme}://","type":"text"},{"text":"{servername}","type":"text","marks":[{"type":"strong"}]},{"text":"/[{path}]","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Examples:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"server65.example.com – will match only the specified server","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"*.finance.example.com – will match all servers in the 'finance' subdomain","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.3.1.3 File Pattern","type":"text"}]},{"type":"paragraph","content":[{"text":"The ","type":"text"},{"text":"'File Pattern'","type":"text","marks":[{"type":"em"}]},{"text":" field will match either filenames only (and search within all directories) or filenames qualified with directory paths in the same manner as filename patterns in FileFly Admin Portal Rules – see §5.6.4.","type":"text"},{"type":"hardBreak"},{"text":"For the purposes of file pattern matching, the top-level directory is considered to be the top level of the entire URI path. This may be different from the top-level of the original Source URI.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"9.3.2 Using the Analyze Button","type":"text"}]},{"type":"paragraph","content":[{"text":"Analyze assists in creating simple filters.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Analyze","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Analyze will display a breakdown by scheme, server, and file type","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select a subset of the results by making a selection in each column","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click ","type":"text"},{"text":"Filter","type":"text","marks":[{"type":"strong"}]},{"text":" to create a filter based on the selection","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.4 Recovering Files","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.4.0.1 Selected Files","type":"text"}]},{"type":"paragraph","content":[{"text":"To recover files interactively:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Select the results for which files will be recovered","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click Edit → Recover File…","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.4.0.2 All Files","type":"text"}]},{"type":"paragraph","content":[{"text":"All files may be recovered either as a batch process using the command line (see §9.7) or interactively as follows:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Click Edit → Recover All Files…","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Missing folders will be recreated as required to contain the recovered files. However, these folders will not have ACLs applied to them so care should be taken when recreating folder structures in sensitive areas.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.5 Recovering Files to a New Location","type":"text"}]},{"type":"paragraph","content":[{"text":"When recovering to a new location, always use an up-to-date DrTool file generated by a ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"em"}]},{"text":" Policy.","type":"text"},{"type":"hardBreak"},{"text":"To rewrite source file URIs to the new location, use the -csu command line option to update the prefix of each URI. Once these URI substitutions have been applied (and checked in the GUI) files may be recovered as previously outlined. The -csu option is further detailed in §9.7.","type":"text"},{"type":"hardBreak"},{"text":"Important: DO NOT create stubs in a new location and then continue to use the old location. To avoid incorrect reference counts, only one set of stubs should exist at any given time.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.6 Updating Sources to Reflect Destination URI Change","type":"text"}]},{"type":"paragraph","content":[{"text":"In FileFly DrTool, source files may be updated to reflect a destination URI change through use of the -cmu command line option – detailed in §9.7.","type":"text"},{"type":"hardBreak"},{"text":"To apply the destination URI substitution to ","type":"text"},{"text":"existing","type":"text","marks":[{"type":"em"}]},{"text":" files on the source, select ","type":"text"},{"text":"'Update All Source Files…'","type":"text","marks":[{"type":"em"}]},{"text":" from the Edit menu. When given the option, elect to update substituted entries only.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" This operation must always be performed using an up-to-date DrTool file generated by a ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"em"}]},{"text":" Policy.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.7 Using FileFly DrTool from the Command Line","type":"text"}]},{"type":"paragraph","content":[{"text":"Important: DO NOT create stubs in a new location and then continue to use the old location. To avoid incorrect reference counts, only one set of stubs should exist at any given time.","type":"text","marks":[{"type":"strong"}]},{"type":"hardBreak"},{"text":"Use an ","type":"text"},{"text":"Administrator","type":"text","marks":[{"type":"strong"}]},{"text":" command prompt. By default DrTool is located in:","type":"text"},{"type":"hardBreak"},{"text":"C:\\Program Files\\Caringo FileFly\\AdminTools\\DrTool\\","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.7.0.1 Interactive Usage:","type":"text"}]},{"type":"paragraph","content":[{"text":"DrTool [DrTool file] [extra options]","type":"text"},{"type":"hardBreak"},{"text":"Opens the FileFly DrTool in interactive (GUI) mode with the desired options and optionally opens a DrTool file.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.7.0.2 Batch Usage","type":"text"}]},{"type":"paragraph","content":[{"text":"DrTool [ ] []","type":"text"},{"type":"hardBreak"},{"text":"Run the FileFly DrTool without a GUI to perform a batch operation on all entries in the input file.","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" The DrTool file provided as input is usually created by saving (possibly filtered) results to the hard disk from the interactive DrTool GUI.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.7.0.3 Command Line Options","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"operation – is either:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"-recoverFiles","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"-updateSource","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"if combined with -cmu, only matching entries will be updated","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"-updateSourceAll","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"all entries will be updated, even when -cmu is specified","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"if operation is omitted, the GUI will be opened with any supplied options","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"DrTool file – the file to open","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"options (related to the operation are):","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"-csu {from} {to} – to change Source URI prefix, this option can be specified multiple times","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"-cmu {from} {to} – to change Migrated URI prefix, this option can be specified multiple times","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.7.0.4 Examples:","type":"text"}]},{"type":"paragraph","content":[{"text":"All the following examples are run from the FileFly DrTool directory.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"DrTool -recoverFiles result.txt – recover all files from the result.txt file","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"DrTool -updateSource result.txt -cmu swarm://oldfqdn/ swarm://newfqdn/ – update existing files to point to a new storage location","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"DrTool -recoverFiles result.txt -csu win://old1/ win://new1/ -csu win://old2/ win://new2/ -cmu swarm://oldfqdn/ swarm://newfqdn/ – recover files to different servers and update the secondary storage location simultaneously","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"9.8 Querying a Destination","type":"text"}]},{"type":"paragraph","content":[{"text":"While it is strongly recommended to obtain DrTool files from a ","type":"text"},{"text":"'Create DrTool File From Source'","type":"text","marks":[{"type":"em"}]},{"text":" Policy, where this has been overlooked it is possible to obtain DrTool files from the destination. However, some changes in the source file system, such as renames and deletions, may not be reflected in these results.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"9.8.0.1 Querying the Destination from FileFly Admin Portal","type":"text"}]},{"type":"paragraph","content":[{"text":"Run a ","type":"text"},{"text":"'Create DrTool File From Destination'","type":"text","marks":[{"type":"em"}]},{"text":" Policy, see §3.9.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"10 Network Ports","type":"text"}]},{"type":"paragraph","content":[{"text":"The default ports required for FileFly operation are listed below.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"10.1 FileFly Tools","type":"text"}]},{"type":"paragraph","content":[{"text":"The following ports must be free before installing FileFly Tools:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"8080 (Admin Portal web interface – configurable during installation)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"8005","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"The following ports are used for outgoing connections:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"4604-4609 (inclusive)","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Any firewall should be configured to allow incoming and outgoing communication on the above ports.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"10.2 FileFly Agent / FileFly FPolicy Server","type":"text"}]},{"type":"paragraph","content":[{"text":"The following ports must be free before installing FileFly server components:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"4604-4609 (inclusive)","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Any firewall should be configured to allow incoming and outgoing communication on the above ports.","type":"text"},{"type":"hardBreak"},{"text":"For 7-mode FileFly FPolicy Servers, the firewall should also allow incoming NetBIOS traffic, e.g. enable the ","type":"text"},{"text":"'File and Printer Sharing (NB-Session-In)'","type":"text","marks":[{"type":"em"}]},{"text":" rule in Windows Firewall.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"10.2.0.1 Other Ports","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly plugins may require other ports to be opened in any firewalls to access secondary storage from FileFly Gateway machines.","type":"text"},{"type":"hardBreak"},{"text":"Please consult specific device or service documentation for further information.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"11 File and Directory Exclusion Examples","type":"text"}]},{"type":"paragraph","content":[{"text":"The examples in this appendix illustrate some common scenarios where specific directories need to be excluded from policies.","type":"text"},{"type":"hardBreak"},{"text":"Consider the following Policy:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Name: Migrate Home Directories","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Operation: Migrate","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Rule: 'all files modified more than 6 months ago'","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Source URI: win://fileserver1.example.com/e/Home","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"The three scenarios below demonstrate how to add exclusions to this Policy.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"11.1 Excluding Known Directories","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"11.1.0.1 Exclude Wilma's 'Personal' directory","type":"text"}]},{"type":"paragraph","content":[{"text":"Excluding directories at fixed locations is most easily achieved using the ","type":"text"},{"text":"'Directory Inclusions & Exclusions'","type":"text","marks":[{"type":"em"}]},{"text":" panel in the Source editor – see §5.4.4.","type":"text"},{"type":"hardBreak"},{"text":"The example of excluding Wilma's 'Personal' directory can be accomplished by unticking that directory, as shown in §11.1.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"11.2 Complex Exclusions","type":"text"}]},{"type":"paragraph","content":[{"text":"The following examples illustrate the exclusion of files using patterns that match path as well as filename.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"11.2.0.1 Exclude all PDF files in ","type":"text"},{"text":"any","type":"text","marks":[{"type":"em"}]},{"text":" DOC directory","type":"text"}]},{"type":"paragraph","content":[{"text":"Since this example calls for the exclusion of an arbitrary number of DOC directories within the Source tree, the Source's ","type":"text"},{"text":"'Directory Inclusions & Exclusions'","type":"text","marks":[{"type":"em"}]},{"text":" panel is insufficient to describe the exclusions.","type":"text"},{"type":"hardBreak"},{"text":"Instead, a Rule can be created that will exclude all PDF files in all directories named 'DOC' (and subdirectories thereof) at any location in the directory tree. In this case, each 'DOC' directory will still be traversed, since files that are ","type":"text"},{"text":"not","type":"text","marks":[{"type":"em"}]},{"text":" PDFs must still be processed.","type":"text"},{"type":"hardBreak"},{"text":"Applying this to the example Policy:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Rule to match PDF files within a 'DOC' directory","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Rule (See §5.6)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check the Negate box","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"In the File Matching section, enter: DOC/*","type":"text"},{"text":"/","type":"text","marks":[{"type":"strong"}]},{"text":".pdf (See §5.6.4)","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Note that there is no leading '/'","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Save the Rule","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add this Rule to the Policy","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the policy (see §5.7.3)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the Rule created in step 1; the selected Rules for the policy will now be 'all files modified more than 6 months ago' ","type":"text"},{"text":"AND","type":"text","marks":[{"type":"em"}]},{"text":" the newly created exclusion Rule","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Save the policy","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"11.2.0.2 Exclude PDF files in users' 'DOC' directories (but not the Home level 'DOC' directory)","type":"text"}]},{"type":"paragraph","content":[{"text":"As in the previous example, this scenario calls for a Rule rather than an exclusion in the Source.","type":"text"},{"type":"hardBreak"},{"text":"This Rule will exclude PDF files in all users' 'DOC' directories (and subdirectories thereof). Note that this will not exclude PDF files in the '/DOC' or '/Wilma//DOC' directories. Each 'DOC' directory will still be traversed, since files that are ","type":"text"},{"text":"not","type":"text","marks":[{"type":"em"}]},{"text":" PDFs still be processed.","type":"text"},{"type":"hardBreak"},{"text":"Applying this to the example Policy:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Rule to match PDF files within a 'DOC' directory that is one directory deep in the Source.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Create a Rule (See §5.6)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Check the Negate box","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"In the File Matching section, enter: /","type":"text"},{"text":"/DOC//","type":"text","marks":[{"type":"strong"}]},{"text":".pdf §5.6.4)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Save the Rule","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add this Rule to the 'Migrate Home Directories' policy","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Edit the policy (see §5.7.3)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Add the Rule created in step 1; the selected Rules for the policy will now be 'all files modified more than 6 months ago' ","type":"text"},{"text":"AND","type":"text","marks":[{"type":"em"}]},{"text":" the newly created exclusion Rule","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Save the policy","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":" ","type":"text"},{"type":"inlineExtension","attrs":{"extensionType":"com.atlassian.confluence.migration","extensionKey":"inline-media-image","parameters":{"width":"560","id":"fb05a26d-46ed-4312-881a-975d793aa470","collection":"contentId-2443825886","height":"286"}}},{"type":"hardBreak"},{"text":"Using a Source exclusion","type":"text","marks":[{"type":"em"}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"12 Admin Portal Security Configuration","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"12.1 Updating the Admin Portal TLS Certificate","type":"text"}]},{"type":"paragraph","content":[{"text":"If the FileFly Admin Portal was configured for secured remote access (HTTPS) at install time, the webserver TLS certificate may be updated using the following procedure:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Navigate to C:\\Program Files\\Caringo FileFly\\AdminTools\\","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run Update Webserver Certificate","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Provide a PKCS#12 certificate and private key pair","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Important: the new certificate MUST appropriately match the original Admin Portal FQDN specified at install time.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"12.2 Password Reset","type":"text"}]},{"type":"paragraph","content":[{"text":"Normally, the administration password is changed on the ","type":"text"},{"text":"'Settings'","type":"text","marks":[{"type":"em"}]},{"text":" page as needed – see §5.10.","type":"text"},{"type":"hardBreak"},{"text":"However, should the system administrator ","type":"text"},{"text":"forget","type":"text","marks":[{"type":"em"}]},{"text":" the username or password entirely, the credentials may be reset as follows:","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Navigate to C:\\Program Files\\Caringo FileFly\\AdminTools\\","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Run Reset Web Password","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions to provide new credentials","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" if FileFly Admin Portal has been configured to use LDAP for authentication (e.g. to use Active Directory login), then passwords should be changed/reset by the directory administrator – this section applies only to local credentials configured during installation.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"12.3 Authentication with Active Directory","type":"text"}]},{"type":"paragraph","content":[{"text":"Active Directory authentication is configured during installation of FileFly Tools.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"12.4 Authentication with eDirectory","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"12.4.0.1 Installing the CA Certificate","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Export the LDAP server's ","type":"text"},{"text":"SSL CertificateDNS","type":"text","marks":[{"type":"em"}]},{"text":" object's ","type":"text"},{"text":"Trusted Root Certificate","type":"text","marks":[{"type":"strong"}]},{"text":" (without the private key) in Base64 format to a file","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Install the certificate in the ","type":"text"},{"text":"Local Computer's","type":"text","marks":[{"type":"strong"}]},{"text":" Trusted Root Certification Authorities store","type":"text"}]}]}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"12.4.0.2 Configuring FileFly Admin Portal","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"In a text editor, open C:\\Program Files\\Caringo FileFly\\AdminTools\\Tomcat\\conf\\server.xml","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Follow the instructions in the server.xml comments to configure the JNDIRealm for eDirectory","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Restart the ","type":"text"},{"text":"'Caringo FileFly Webapps'","type":"text","marks":[{"type":"em"}]},{"text":" service","type":"text"}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"13 Advanced FileFly Agent Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly Agents may be configured on a per-server basis via FileFly Admin Portal. Navigate to the ","type":"text"},{"text":"'Servers'","type":"text","marks":[{"type":"em"}]},{"text":" tab and click on the name of the cluster or standalone server to be configured, then click ","type":"text"},{"text":"'Configure'","type":"text","marks":[{"type":"em"}]},{"text":".","type":"text"},{"type":"hardBreak"},{"text":"When the configuration options are saved, a new ff_agent.cfg file is pushed to the target server to be loaded on the next service restart. In the case of a cluster, all nodes will receive the same updated configuration. The service may be restarted through the Admin Portal interface.","type":"text"},{"type":"hardBreak"},{"text":"The ff_agent.cfg file resides in the following location:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Windows: C:\\Program Files\\Caringo FileFly\\data\\FileFly Agent\\","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"13.1 Syslog Configuration","type":"text"}]},{"type":"paragraph","content":[{"text":"FileFly can be configured to send UDP syslog messages in addition to the standard file-based logging functionality. Syslog output is not enabled by default.","type":"text"}]},{"type":"table","attrs":{"layout":"default","localId":"c125e641-3618-4f1a-aa34-2dd9296e597c"},"content":[{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[183.0]},"content":[{"type":"paragraph","content":[{"text":"Parameter","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[577.0]},"content":[{"type":"paragraph","content":[{"text":"Description","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[183.0]},"content":[{"type":"paragraph","content":[{"text":"Severity Threshold","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[577.0]},"content":[{"type":"paragraph","content":[{"text":"the severity below which messages will be suppressed","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[183.0]},"content":[{"type":"paragraph","content":[{"text":"Format","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[577.0]},"content":[{"type":"paragraph","content":[{"text":"RFC5424 and RFC3164 formats are both supported","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[183.0]},"content":[{"type":"paragraph","content":[{"text":"Facility","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[577.0]},"content":[{"type":"paragraph","content":[{"text":"the syslog facility (to assist in filtering)","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[183.0]},"content":[{"type":"paragraph","content":[{"text":"IP/FQDN","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[577.0]},"content":[{"type":"paragraph","content":[{"text":"the host or broadcast address to which messages will be sent","type":"text"}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[183.0]},"content":[{"type":"paragraph","content":[{"text":"Port","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1,"colwidth":[577.0]},"content":[{"type":"paragraph","content":[{"text":"the syslog port","type":"text"}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"13.2 Stub Deletion Monitoring","type":"text"}]},{"type":"paragraph","content":[{"text":"As described in §4.1.7, on Windows file systems, FileFly can monitor stub deletion events in order to make corresponding secondary storage files eligible for removal using Scrub Policies.","type":"text"},{"type":"hardBreak"},{"text":"This feature is not enabled by default. It must be enabled on a per-volume basis either by specifying volume GUIDs (preferred) or drive letters. Volume GUIDs may be determined by running the Windows mountvol command or powershell Get-WmiObject -Class win32_volume. For Windows clustered volumes, the cluster volume ","type":"text"},{"text":"must","type":"text","marks":[{"type":"strong"}]},{"text":" be specified using a volume GUID.","type":"text"}]},{"type":"paragraph","content":[{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" This feature should not be configured to monitor events on backup ","type":"text"},{"text":"destination","type":"text","marks":[{"type":"em"}]},{"text":" volumes. In particular, some basic backup tools such as Windows Server Backup copy individual files to VHDX backup volumes in a manner which is not supported and so such volumes ","type":"text"},{"text":"must not","type":"text","marks":[{"type":"strong"}]},{"text":" be configured for Stub Deletion Monitoring. Of course, deletions may still be monitored on source data volumes.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"13.3 Logging and Debug Options","type":"text"}]},{"type":"paragraph","content":[{"text":"Log location and rotation options may be adjusted if required. Debug mode may impact performance and should ","type":"text"},{"text":"only","type":"text","marks":[{"type":"strong"}]},{"text":" be enabled following advice from DataCore Support.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"13.4 Parallelization Tuning Parameters","type":"text"}]},{"type":"paragraph","content":[{"text":"When a Policy is executed on a Source, operations will automatically be executed in parallel. The following parameters can be adjusted:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Max Slots","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The maximum number of operations that may be performed in parallel on behalf of a ","type":"text"},{"text":"single","type":"text","marks":[{"type":"em"}]},{"text":" policy for a given Source (default: 8)","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Worker Thread Count","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The total number of operations that may be performed in parallel across ","type":"text"},{"text":"all","type":"text","marks":[{"type":"em"}]},{"text":" policies on this agent (default: 32)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"This does not limit the number of policies which may be run in parallel, operations are queued if necessary","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"Important: take care if adjusting these parameters – over-parallelization may result in lower throughput.","type":"text","marks":[{"type":"strong"}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"13.5 Demigration Blocking","type":"text"}]},{"type":"paragraph","content":[{"text":"Applications may be denied the right to demigrate stubs. Such an application – specified either by application binary name or full path – will be unable to access a stub and demigrate the file contents (an error will be returned to the application instead).","type":"text"},{"type":"hardBreak"},{"text":"Note:","type":"text","marks":[{"type":"strong"}]},{"text":" Only local applications (applications running directly on the file server) may be blocked.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"14 Troubleshooting","type":"text"}]},{"type":"paragraph","content":[{"text":"Before contacting DataCore Support, please review log files for error messages.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"14.1 Log Files","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"14.1.0.1 FileFly Agent Logs","type":"text"}]},{"type":"paragraph","content":[{"text":"Location: C:\\Program Files\\Caringo FileFly\\logs\\FileFly Agent","type":"text"},{"type":"hardBreak"},{"text":"There are two types of FileFly Agent log file. The agent.log contains all FileFly Agent messages, including startup, shutdown, and error information, as well as details of each individual file operation (migrate, demigrate, etc.). Use this log to determine which operations have been performed on which files and to check any errors that may have occurred.","type":"text"},{"type":"hardBreak"},{"text":"The messages.log contains a subset of the FileFly Agent messages, related to startup, shutdown, critical events, and system-wide notifications. This log is often most useful to troubleshoot configuration issues.","type":"text"},{"type":"hardBreak"},{"text":"Log messages in both logs are prefixed with a timestamp and thread tag. The thread tag (e.g. ) can be used to distinguish messages from concurrent threads of activity.","type":"text"},{"type":"hardBreak"},{"text":"Log files are regularly rotated to keep the size of individual log files manageable. Old rotations are compressed as gzip (.gz) files, and can be read using many common tools such as 7-zip, WinZip, or zless. To adjust logging parameters, including how much storage to allow for log files before removing old rotations, see §13.3.","type":"text"},{"type":"hardBreak"},{"text":"Log information for operations performed as the result of an Admin Portal Policy will also be available via the web interface.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"14.1.0.2 Admin Portal Logs","type":"text"}]},{"type":"paragraph","content":[{"text":"Location: C:\\Program Files\\Caringo FileFly\\logs\\AdminPortal","type":"text"},{"type":"hardBreak"},{"text":"Normally Admin Portal logs are accessed through the web interface. If the logs available in the interface have been rotated, consult this directory to find the older logs.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"14.1.0.3 DrTool Logs","type":"text"}]},{"type":"paragraph","content":[{"text":"Location: C:\\Program Files\\Caringo FileFly\\logs\\DrTool","type":"text"},{"type":"hardBreak"},{"text":"FileFly DrTool operations such as recovering files are logged in this location. FileFly DrTool will provide the exact name of the log file in the interface.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"14.2 Interpreting Errors","type":"text"}]},{"type":"paragraph","content":[{"text":"Logged errors are typically recorded in an 'error tree' format which enables user-diagnosis of errors / issues in the environment or configuration, as well as providing sufficient detail for further investigation by support engineers if necessary.","type":"text"},{"type":"hardBreak"},{"text":"Error trees are structured to show WHAT failed, and WHY, at various levels of detail. This section provides a rough guide to extracting the salient features from an error tree.","type":"text"},{"type":"hardBreak"},{"text":"Each numbered line consists of the following fields:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"WHAT failed – e.g. a migration operation failed","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"WHY the failure occurred – the '[ERR_ADD…]' code","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"optionally, extra DETAILS about the failure – e.g. the path to a file","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"As can be seen in the example below, most lines only have a WHAT component, as the reason is further explained by the following line.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"14.2.0.1 A Simple Error","type":"text"}]},{"type":"paragraph","content":[{"text":"ERROR demigrate win://server.test/G/source/data.dat [0] ERR_DMAGENT_DEMIGRATE_FAILED [] [] [1] ERR_DMMIGRATESUPPORTWIN_DEMIGRATE_FAILED [] [] [2] ERR_DMAGENT_DEMIGRATEIMP_FAILED [] [] [3] ERR_DMAGENT_COPYDATA_FAILED [] [] [4] ERR_DMSTREAMWIN_WRITE_FAILED [ERR_ADD_DISK_FULL] [112: There is not enough space on the disk (or a quota has been reached).]","type":"text"},{"type":"hardBreak"},{"text":"To expand the error above into English:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"demigration failed for the file: win://server.test/G/source/data.dat","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"because copying the data failed","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"because one of the writes failed with a disk full error","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"the full text of the Windows error (112) is provided","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"So, G: drive on server.test is full (or a quota has been reached).","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"14.2.0.2 Errors with Multiple Branches","type":"text"}]},{"type":"paragraph","content":[{"text":"Some errors result in further action being taken which may itself fail. Errors with multiple branches are used to convey this to the administrator. Consider an error with the following structure:","type":"text"},{"type":"hardBreak"},{"text":"[0] ERR... [1] ERR... [2] ERR... [3] ERR... [4] ERR... [5] ERR... [6] ERR... [3] ERR... [4] ERR... [5] ERR...","type":"text"},{"type":"hardBreak"},{"text":"Whatever ultimately went wrong in line 6 caused the operation in question to fail. However, the function at line 2 chose to take further action following the error – possibly to recover from the original error or to clean up after it. This action also failed, the details of which are given by the additional errors in lines 3, 4, and 5 at the end.","type":"text"}]},{"type":"heading","attrs":{"level":4},"content":[{"text":"14.2.0.3 Check the Last Line First","type":"text"}]},{"type":"paragraph","content":[{"text":"For many errors, the most salient details are to be found in the last line of the error tree (or the last line of the first branch of the error tree). Consider the following last line:","type":"text"},{"type":"hardBreak"},{"text":"[11] ERR_DMSOCKETUTIL_GETROUNDROBINCONNECTEDSOCKET_FAILED [ERR_ADD_COULD_NOT_RESOLVE_HOSTNAME] [host was [svr1279.example.com]]","type":"text"},{"type":"hardBreak"},{"text":"It is fairly clear that this error represents a failure to resolve the server hostname svr1279.example.com. As with any other software, the administrator's next steps will include checking the spelling of the DNS name, the server's DNS configuration, and whether the hostname is indeed present in DNS.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"14.3 Contacting Support","type":"text"}]},{"type":"paragraph","content":[{"text":"If an issue cannot be resolved after reviewing the logs, contact DataCore Support at: ","type":"text"},{"text":"https://datacore.custhelp.com/","type":"text","marks":[{"type":"link","attrs":{"href":"https://datacore.custhelp.com/"}}]},{"type":"hardBreak"},{"text":"Include the following information in any support request (where possible):","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"A description of the issue – be sure to include:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"how long the issue has been present","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"how regularly the issue occurs","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"any changes made to the environment or configuration","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"any specific circumstances which trigger the issue","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"does the issue occur for a particular file and/or server?","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Caringo FileFly version","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Swarm and CloudScaler versions","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Operating System(s)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"fltmc instances command output from migration source servers","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Saved system info (.NFO) from msinfo32.exe","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Plugins in use","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Source and Destination URIs","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Applicable Log Files","type":"text","marks":[{"type":"strong"}]}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"see §14.1 for log locations","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"include Admin Portal logs","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"include source agent logs","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"include destination/gateway agent logs","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"include ","type":"text"},{"text":"all","type":"text","marks":[{"type":"strong"}]},{"text":" nodes in each agent cluster","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"zip the entire log folders wherever possible","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Generate a system configuration file","type":"text","marks":[{"type":"strong"}]},{"text":" (support.zip) by clicking the link on the Admin Portal ","type":"text"},{"text":"'About'","type":"text","marks":[{"type":"em"}]},{"text":" page","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Any other error messages – include screenshots if necessary","type":"text"}]}]}]},{"type":"paragraph","content":[{"text":"Important: Failure to include all relevant details will delay the resolution of your issue.","type":"text","marks":[{"type":"strong"}]}]}],"version":1}

Browser not supported