Tiered Storage
Hazelcast’s Tiered Storage feature offers an extension to Hazelcast map which allows you to store a larger data set than available memory.
Currently, the Tiered Storage feature is available to our customers who already have a Hazelcast Enterprise license. Starting with Hazelcast 5.2, this feature will become a separately licensed feature, i.e., you will need a new license. |
What Can You Do with Tiered Storage?
Have fewer Hazelcast members for large maps. For example, for a map with 1 TB of data, you’ll need ten Hazelcast members if all data is kept in memory and each member has 100 GB of data. Tiered Storage allows you to split the data between memory and disks, which requires fewer cluster members depending on how the data is distributed.
How Does Tiered Storage Work?
Tiered Storage uses the following:
-
An in-memory index to allow faster access to map entries.
-
A special memory manager to decide which entries to store in the memory tier or the disk tier. If a map entry is not accessed for some time, it gets flushed to the disk. If a map is frequently accessed, it stays in memory.
Not Yet Supported
-
Data recovery from persisted data: When a Hazelcast member has Tiered Storage enabled and it fails or shuts down, you are not able to use the local device files of Tiered Storage for data recovery. Data recovery will be supported in the future releases.
-
Map indexes: You cannot yet create indexes for maps that are configured to use Tiered Storage.
-
Dynamic configuration: You cannot yet add Tiered Storage configuration to a map at runtime.