A Celeste system is a reliable, highly distributed file storage system scaling upwards of 1025 bytes of read/write storage.
Files stored in Celeste are mutable, with the usual read/write semantics of files.
Files in Celeste are versioned, and have audit trails.
Celeste addresses the support of a variety of ways to handle data storage, such as various levels of reliability, various modes of data delivery upon read, and various modes of caching across the system. Celeste reliability is achieved by distributing multiple copies of fragments of the original file across a heterogeneous collection of networked storage elements ("cells"), wherein cells are separated from other cells by anti-correlated attributes continually measured and interpreted dynamically. By caching the replicas of stored file fragments across cells with a low correlation of attributes, the reliability of the system as experienced by clients is increased.
As the system calculates the correlated attributes between cells, it dynamically re-balances itself by moving the file fragment replicas in order to achieve the reliability goal for each stored file. Celeste operates in an environment where the connectivity between cells can be intermittent, where the underlying network is unsecure, and where individual cells can fail in an unpredicted (even malicious) manner. Celeste dynamically optimizes the storage allocation to reduce overall latency and bandwidth consumption as clients access stored files.
Celeste continues to operate normally despite a portion of the overall number of cells being unavailable. Whether from whole cell or network failures or network partitioning, the fractioned Celeste can continue to operate (sometimes at lesser functionality).
Celeste system supports the notion of private storage in which client applications can sequester portions of the storage media at certain times to allow them to manage data independently of Celeste.
Stored files in Celeste have fundamental provisions for securing data, including access and capability control, and compartmentalization.
Celeste ensures persistence of files, including prior versions, and provides an audit trail for every file modification. | 