Hazelcast’s Tiered Storage feature offers an extension to Hazelcast map which allows you to store a larger data set than available memory.
|Currently, the Tiered Storage feature is available to our customers who already have a Hazelcast Enterprise license. Starting with Hazelcast 5.2, this feature will become a separately licensed feature, i.e., you will need a new license.
Have fewer Hazelcast members for large maps. For example, for a map with 1 TB of data, you’ll need ten Hazelcast members if all data is kept in memory and each member has 100 GB of data. Tiered Storage allows you to split the data between memory and disks, which requires fewer cluster members depending on how the data is distributed.
Tiered Storage uses the following:
An in-memory index to allow faster access to map entries.
A special memory manager to decide which entries to store in the memory tier or the disk tier. If a map entry is not accessed for some time, it gets flushed to the disk. If a map is frequently accessed, it stays in memory.
Data recovery from persisted data: When a Hazelcast member has Tiered Storage enabled and it fails or shuts down, you are not able to use the local device files of Tiered Storage for data recovery. Data recovery will be supported in the future releases.
Map indexes: You cannot yet create indexes for maps that are configured to use Tiered Storage.
Dynamic configuration: You cannot yet add Tiered Storage configuration to a map at runtime.