Chapter 3 - Understanding Spectra Advanced Bucket Management Concepts
Goals of Advanced Bucket Management
Topic
Single Copy on Nearline Disk and Tape
Single Copy on Nearline Disk and Dual Copy on
Tape
G
OALS OF
A
DVANCED
B
UCKET
M
ANAGEMENT
The BlackPearl system provides an S3 front end interface to disk, tape and cloud storage.
The BlackPearl Advanced Bucket Management (ABM) feature automates many aspects of
deep storage including policy based multiple copies on diverse media types without the
need for expensive middleware to operate the libraries and stream data to tape drives. The
BlackPearl system delivers seamless data management enabling infinite retention, seamless
growth, and unlimited retrieval of data for as low as pennies per Gigabyte.
S
PECTRA
S3 O
VERVIEW
The BlackPearl Converged Storage System allows data to move seamlessly into deep storage
in a way not previously possible. Spectra S3 is the first native REST-based interface to deep
storage which enables easy archiving of large amounts of bulk data. It enables users to
deploy tape, nearline disk, and online disk storage that is cost effective, easy to manage,
and scalable to exabytes of data.
Spectra S3 utilizes the standard Amazon S3 operations plus additional operations
specifically designed to optimize the transport of data objects to and from deep storage. The
additional operations define the job so that the BlackPearl system interacts with the objects
efficiently and define the data policy to customize where and for how long specific data is
stored.
The first of these additional operations is called START BULK PUT. It is an HTTP PUT
operation that provides the BlackPearl system with information about the objects that the
client wants to send as a single job for storing on tape. The Create Bulk Put command is
sent with a payload that is made up of a list of object names and corresponding object sizes.
This information allows the BlackPearl system to plan the initial storage of the objects in its
cache, and how it will store the data on tape. The response to the Create Bulk Put command
is a specifically ordered list of how the BlackPearl system wants those files (objects) sent.
November 2020
User Guide-BlackPearl Converged Storage System
- 67 -