Dynamically Adding Data Structure Configuration on a Cluster
Dynamic configuration allows you to temporarily change the configuration of some data structures at runtime. This option is useful if you want to reconfigure a data structure without having to shut down cluster members.
To configure a data structure at runtime, you can use either a Hazelcast client or the member API. When you submit a dynamic configuration to a member, it is propagated across all cluster members as well as those that may join the cluster later.
To add a configuration dynamically, you must invoke the
add*Config() method on the Hazelcast instance’s configuration object.
Config config = new Config(); MapConfig mapConfig = new MapConfig("sessions"); config.addMapConfig(mapConfig); HazelcastInstance instance = Hazelcast.newHazelcastInstance(config); MapConfig noBackupsMap = new MapConfig("dont-backup").setBackupCount(0); instance.getConfig().addMapConfig(noBackupsMap);
HazelcastInstance client = HazelcastClient.newHazelcastClient(); MapConfig mCfg = new MapConfig("test"); mCfg.setTimeToLiveSeconds(15); client.getConfig().addMapConfig(mCfg); HazelcastClient.shutdownAll();
|Dynamic configurations are not persisted, thus they are lost when a cluster restarts. This feature will be improved in future releases of Hazelcast IMDG.|
Dynamic configuration elements must be fully configured before the invocation
add*Config() method. At that point, the configuration object is delivered
to every member of the cluster and added to each member’s dynamic configuration,
so mutating the configuration object after the
add*Config() invocation does not have
Handling Partial Propagation
Because dynamic configurations are propagated across all cluster
members, failures may occur due to conditions such as timeout and network partition.
The configuration propagation mechanism internally retries adding the configuration
whenever a membership change is detected. However if an exception is thrown from the
add*Config() method, the configuration may have been partially propagated to some
cluster members and adding the configuration should be retried by the user.
Unsupported Configuration Methods
Dynamic configuration is supported for all
add*Config() methods except the following:
SplitBrainProtectionConfig: A new split-brain protection configuration cannot be dynamically added but other configuration can reference split-brain protections configured in the existing static configuration.
WanReplicationConfig: A new WAN replication configuration cannot be dynamically added, however existing static ones can be referenced from other configurations, e.g., a new dynamic
MapConfigmay include a
WanReplicationRefto a statically configured WAN replication.
ListenerConfig: Listeners can be instead added at runtime via other API such as
Handling Configuration Conflicts
Attempting to add a dynamic configuration, when a static configuration for
the same element already exists, throws
InvalidConfigurationException. For example,
assuming we start a member with the following fragment in
<hazelcast> ... <map name="sessions"> ... </map> ... </hazelcast>
Then adding a dynamic configuration for a map with the name
HazelcastInstance instance = Hazelcast.newHazelcastInstance(); MapConfig sessionsMapConfig = new MapConfig("sessions"); // this will throw ConfigurationException: instance.getConfig().addMapConfig(sessionsMapConfig);
When attempting to add dynamic configuration for an element for which dynamic
configuration has already been added, then if a configuration conflict is detected
InvalidConfigurationException is thrown. For example:
HazelcastInstance instance = Hazelcast.newHazelcastInstance(); MapConfig sessionsMapConfig = new MapConfig("sessions").setBackupCount(0); instance.getConfig().addMapConfig(sessionsMapConfig); MapConfig sessionsWithBackup = new MapConfig("sessions").setBackupCount(1); // throws ConfigurationException because the new MapConfig conflicts with existing one instance.getConfig().addMapConfig(sessionsWithBackup); MapConfig sessionsWithoutBackup = new MapConfig("sessions").setBackupCount(0); // does not throw exception: new dynamic config is equal to existing dynamic config of same name instance.getConfig().addMapConfig(sessionsWithoutBackup);
To ignore conflicts between dynamic configurations, set the
hazelcast.dynamicconfig.ignore.conflicts system property to
Dynamic Data Structure Configuration and User Customizations
Dynamic configuration may reference
user customizations such as a user-provided
MapLoader implementation referenced
MapConfig. User customizations can be usually configured using either of the following:
by specifying a class or factory class name, e.g.,
MapStoreConfig.setClassName, and letting the Hazelcast members instantiate the object
by providing an existing instance, e.g.,
When dynamically adding new a data structure configuration with user customizations, take the following considerations into account:
For the user customizations submitted as a class name or factory class name, the referenced classes are resolved lazily. Therefore, they should be either already on each member’s local classpath or resolvable via user code deployment.
When the user customizations are submitted as instances (or similarly factory instances), the instances themselves have to be serializable. This is because the entire configuration needs to be sent over the network to all cluster members, and their classes have to be available on each member’s local classpath.