System Properties

Description

Specifies whether to run the aggregation accumulation for multiple entries in parallel. Each Hazelcast IMDG member executes the accumulation stage of an aggregation using a single thread by default. In most cases it is useful to do it in parallel.

Controls the maximum timeout in milliseconds to wait for an invocation space to be available. The value needs to be equal to or larger than 0.

Enable back pressure.

The maximum number of concurrent invocations per partition.

Used when back pressure is enabled. The larger the sync window value, the less frequent an asynchronous backup is converted to a sync backup.

Specifies whether the cache invalidation event batch sending is enabled or not.

Defines the maximum number of cache invalidation events to be drained and sent to the event listeners in a batch.

Defines cache invalidation event batch sending frequency in seconds.

Period, in milliseconds, to check if a client is still part of the cluster.

Timeout duration to decide if a client is still part of the cluster. If a member cannot find any connection to a client in the cluster, it cleans up the local resources that are owned by that client.

Time after which the member assumes the client is dead and closes its connections to the client.

Client protocol message size limit (in bytes) for unverified connections. I.e. maximal length of the client authentication message.

Number of threads that the client engine has available for processing requests that are blocking, e.g., transactions. When not set, it is set as the value of core size * 20.

Number of threads to process query requests coming from the clients. Default count is the number of cores multiplied by 1.

Maximum number of threads to process non-partition-aware client requests, like map.size(), executor tasks, etc. Default count is the number of cores multiplied by 20.

Timeout to connect all other cluster members when a member is joining to a cluster.

Minimum interval in milliseconds to consider a connection error as critical.

Maximum I/O error count before disconnecting from a member.

Specifies whether the automatic cluster version upgrading is enabled.

When set to a value greater than 1, automatic upgrading waits to reach that cluster size to proceed.

Output directory of the diagnostic log files.

Property needed for concurrency detection so that write through can be done correctly. This property sets the time window, in milliseconds, between the concurrency detection and its notification. Normally in a concurrent system, the window keeps sliding forward so it always remains concurrent. Setting it too high effectively disables the optimization because once a concurrency is detected it will keep that way. Setting it too low could lead to suboptimal performance because the system will try write through and other optimizations even though the system is concurrent.

Specifies whether diagnostics tool is enabled or not for the cluster.

Optional prefix for the diagnostics log file.

Frequency of scanning all the pending invocations in seconds. 0 means the Invocations plugin for diagnostics tool is disabled.

Threshold period, in seconds, that makes an invocation to be considered as slow.

Allowed count of diagnostic files within each roll.

Size of each diagnostic file to be rolled.

Maximum allowed deviation for a member-to-member heartbeats.

Period for which the MemberHeartbeats plugin of the diagnostics tool runs. 0 means this plugin is disabled.

Frequency, in seconds, at which the cluster information is dumped to the diagnostics log file.

Frequency, in seconds, at which the Metrics plugin dumps information to the diagnostics log file.

Maximum allowed deviation for a member-to-member operation heartbeats.

Period, in seconds, for which the OperationHeartbeats plugin of the diagnostics tool runs. 0 means this plugin is disabled.

Period, in seconds, for which the PendingInvocations plugin of the diagnostics tool runs. 0 means this plugin is disabled.

Period, in seconds, for which the SlowOperations plugin of the diagnostics tool runs. 0 means this plugin is disabled.

Period, in seconds, for which the StoreLatency plugin of the diagnostics tool runs. 0 means this plugin is disabled.

Period, in seconds, for resetting the statistics for the StoreLatency plugin of the diagnostics tool.

Specifies whether the SystemLog plugin of the diagnostics tool is enabled or not.

Specifies whether the SystemLog plugin collects information about partition migrations.

Enables/disables the Discovery SPI lookup over the old native implementations. See Discovery SPI for more information.

Enable use of public IP address in member discovery with Discovery SPI. If you set this property to true in your source cluster, please make sure you have set the public addresses for your target members since they will be discovered using their public addresses. Otherwise, they cannot be discovered. See the Public Address section.

When it is set to true, IMDG does not check if the added dynamic configuration conflicts with an existing dynamic configuration. Existing dynamic configuration is not replaced. Note that, this property is not meant to ignore the conflicts between static configuration and dynamic configuration. If the added dynamic configuration exists in the static configuration of the member, it will throw an exception regardless this property.

Hazelcast IMDG Enterprise license key.

Capacity of internal event queue.

Timeout to enqueue events to event queue.

To prevent overloading of the outbound connections, once in a while an event is made synchronous by wrapping it in a dummy operation and waiting for a dummy response. This causes the outbound write queue of the connection to get drained. This timeout configures the maximum amount of waiting time for this response. Setting it to a too low value can lead to an uncontrolled growth of the outbound write queue of the connection.

Number of event handler threads.

Maximum wait in seconds during graceful shutdown.

Specifies whether the global concurrent High-Density Memory Store indexes are enabled or not.

Health monitoring logging interval in seconds. NOTE: For detailed information on the health monitoring tool, along with this and the following health monitoring related system properties, see the Health Check and Monitoring section.

Health monitoring log level. When SILENT, logs are printed only when values exceed some predefined threshold. When NOISY, logs are always printed periodically. Set OFF to turn off completely.

When the health monitoring level is SILENT, logs are printed only when the CPU usage exceeds this threshold.

When the health monitoring level is SILENT, logs are printed only when the memory usage exceeds this threshold.

Type of the heartbeat failure detector. See the Failure Detector Configuration section.

Heartbeat send interval in seconds.

If enabled and is able to fetch memory statistics via Java’s OperatingSystemMXBean, it checks whether there is enough free physical memory for the requested number of bytes. If the free memory checker is disabled (false), acts as if the check is succeeded.

Percentage of the free memory space that is required by a hot restart.

If enabled and when a problem occurs during enabling XML External Entity (XXE) protection, then the problem is ignored and only a warning message is logged.

This property should only be used as a last resort. Hazelcast uses the XXE protection by setting respective XML processor properties. These properties are supported in modern XML processors, e.g., the default one available in Java. An old processor on the classpath, such as Xerces and Xalan, may miss the support and throw an exception during enabling the XXE protection. Setting this system property to true allows ignoring such exceptions.

Defines the behavior for index copying on index read/write. See the Copying Indexes section.

Used to override the cluster version to use while an IMDG instance is not member of a cluster yet. The cluster version assumed before joining a cluster may affect the serialization format of the cluster discovery. The default is to use the member’s codebase version. You may need to override it for your member to join a cluster running on a previous cluster version.

Initial expected cluster size to wait before member to start completely.

Initial time in seconds to wait before member to start completely.

Count of scannable partitions in each run of the background expiration task. No default value exists. It is dynamically calculated against the partition count or partition thread count.

Scannable percentage of the entries in the maps' partitions in each run of the background expiration task.

Interval, in seconds, at which the background expiration task is going to run.

Timeout for a partition of a map. Its default value is 1000000 nanoseconds (1 ms). It puts an upper limit for execution of a background expiry operations to prevent the high CPU usages when a partition’s size grows.

If missed invalidation count is bigger than this value, relevant cached data is made unreachable.

Period for which the cluster members are scanned to compare generated invalidation events with the received ones from Near Cache.

Maximum number of retries for an invocation. After threshold is reached, the invocation is assumed as failed.

Pause time between each retry cycle of an invocation in milliseconds.

Interval in seconds between IOBalancer executions.

Number of socket input threads.

Number of socket output threads.

Number of threads performing socket input and socket output. If, for example, the default value (3) is used, it means there are 3 threads performing input and 3 threads performing output (6 threads in total).

Optimization that allows sending of packets over the network to be done on the calling thread if the conditions are right. This can reduce the latency and increase the performance for low threaded environments.

Type of the JCache provider. Values can be client or server.

Enable JMX agent.

It is an overrider property for the default server socket listener’s IP address. If this property is set, then this is the address where the server socket is bound to.

It is an overrider property for the default public address to be advertised to other cluster members and clients.

All locks which are acquired without an explicit lease time use this value (in seconds) as the lease time. When you want to set an explicit lease time for your locks, you cannot set it to a longer time than this value.

Specifies whether the cluster name, IP and version should be included in all log messages.

Name of logging framework type to send logging events.

Notify entry listeners with predicates on map entry updates with events that match entry, update or exit from predicate value space.

Delays expiration of backup map entries by the defined amount. This may be useful to prevent some cases where an entry might be observed on the primary replica (partition owner) but not on the backup replica. For instance, when running an entry processor on both primary and backup replicas.

Maximum number of IMap entries Hazelcast will evict during a single eviction cycle. Eviction cycle is triggered by a map mutation. Typically it is fine to evict at most a single entry. However, when you insert values in a loop, each iteration doubles the entry size. In this situation more than just a single entry should be evicted.

Count of the IMap entries in the entry set formed by random samplings from which Hazelcast chooses to remove the optimal entry during an IMap eviction.

If the collected invalidations do not reach the configured batch size, a background process sends them at this interval.

Enable or disable batching. When it is set to false, all invalidations are sent immediately.

Maximum number of invalidations in a batch.

Maximum size of the key batch sent to the partition owners for value loading and the maximum size of a key batch for which values are loaded in a single partition.

Maximum number of keys read into memory at a time. This is a per-member limit to prevent OutOfMemoryError when multiple maps are tried to load concurrently from the same member.

Scheduler delay for map tasks those are executed on backup members.

Maximum write-behind queue capacity per member. It is the total of all write-behind queue sizes in a member including backups. Its maximum value is Integer.MAX_VALUE. The value of this property is taken into account only if the write-coalescing element of the Map Store configuration is false. See here for the description of the write-coalescing element.

Split-brain merge timeout for a specific target.

Join timeout, maximum time to try to join before giving.

Maximum timeout of heartbeat in seconds for a member to assume it is dead.

Maximum wait time before join operation. This is an upper limit on the cluster’s pre-join phase duration. The pre-join phase starts when the master receives the first join request, and ends after no new members have tried to join for hazelcast.wait.seconds.before.join seconds, or after this upper limit elapsed (whichever comes first). Once the pre-join phase ends, the master moves into the join phase, during which it will only admit members that have already tried joining during the pre-join phase and are still trying to. Once the join phase is complete, the master will again start admitting new members.

Number of threads that the Management Center service has available for processing the operations sent from the connected Management Center instance.

Management Center maximum visible slow operations count.

Interval at which master member publishes a member list.

Defines whether the Moby naming should be used for generating instance names when they are not provided by user. Moby name is a short human-readable name consisting of a randomly chosen adjective and the surname of a famous person. If set to true, a Moby name is generated. Otherwise, a name that is concatenation of a static prefix, number and cluster name is provided.

Initial run delay of split-brain/merge process in seconds.

Run interval of split-brain/merge process in seconds.

Frequency, in seconds, of the metrics collection cycle. Note that the preferred way for controlling this setting is Metrics Configuration.

Specifies whether collecting metrics from the distributed data structures is enabled.

Enables collecting debug metrics if set to true, disables it otherwise. Note that this can be set with system property only.

Enables the metrics collection if set to true, disables it otherwise. Note that the preferred way for controlling this setting is Metrics Configuration.

Enables buffering the collected metrics for Management Center if set to true, disables it otherwise. Note that the preferred way for controlling this setting is Metrics Configuration.

Duration, in seconds, that the metrics are retained for Management Center. Note that the preferred way for controlling this setting is Metrics Configuration.

Enables exposing the collected metrics over JMX if set to true, disables it otherwise. Note that the preferred way for controlling this setting is Metrics Configuration.

Interval, in seconds, at which the network statistics (bytes sent and received) are re-calculated and published. It is valid only when advanced networking is used.

Controls whether more strict checks upon BIND requests towards a cluster member are applied. The checks mainly validate the remote BIND request against the remote address as found in the socket. By default they are disabled, to avoid connectivity issues when deployed under NAT’ed infrastructure.

Maximum time a caller to wait for backup responses of an operation. After this timeout, operation response is returned to the caller even no backup response is received.

Timeout to wait for a response when a remote call is sent, in milliseconds.

When enabled, an operation fails with IndeterminateOperationStateException, if it does not receive backup acks in time with respect to backup configuration of its data structure, or the member which owns primary replica of the target partition leaves the cluster.

Number of generic operation handler threads for each Hazelcast member. Its default value is the maximum of 2 and processor count / 2.

Number of priority generic operation handler threads per member. Having at least 1 priority generic operation thread helps to improve cluster stability since a lot of cluster operations are generic priority operations and they should get executed as soon as possible. If there is a dedicated generic operation thread then these operations don’t get delayed because the generic threads are busy executing regular user operations. So unless memory consumption is an issue, make sure there is at least 1 thread.

Number of threads the process responses. The default value gives stable and good performance. If set to 0, the response threads are bypassed and the response handling is done on the IO threads. Under certain conditions this can give a higher throughput.

Specifies whether the response thread for internal operations on the member side are blocked or not. If you use block (the default value) the thread is blocked and need to be notified which can cause a reduction in the performance. If you use backoff there is no blocking. By enabling the backoff mode and depending on your use case, you can get a 5-10% performance improvement. However, keep in mind that this increases the CPU utilization. We recommend you to use backoff with care and if you have a tool for measuring your cluster’s performance.

Number of partition based operation handler threads for each Hazelcast member. Its default value is the maximum of 2 and count of available processors.

Timeout, in seconds, to stop the execution of resolution algorithm when needed, in the case of lots of possible random network disconnections especially in the large clusters.

When the master (oldest member in the cluster) receives a heartbeat problem report from another member, it first waits for a number of heartbeat rounds to allow other members to report their problems, if there is any. This property sets the number of these rounds.

Interval for syncing backup replicas in seconds.

Total partition count.

Maximum number of partition migrations to be executed concurrently on a member. Member can be either source or target of the migration. Having too much parallelization can increase the heap memory usage and overload the network during a partition rebalance. Having less parallelization can increase the total migration completion time. The default value, 10, is fine for most of the setups.

Maximum number of parallel partition backup replication operations per member. When a partition backup ownership changes or a backup inconsistency is detected, the members start to sync their backup partitions. This parameter limits the maximum running replication operations in parallel. The default value, which is the value of hazelcast.partition.max.parallel.migrations, is fine for most of the setups.

When enabled, which is the default behavior, partitions are migrated/replicated in small fragments instead of one big chunk. Migrating partitions in fragments reduces pressure on the memory and network since smaller packets are created in the memory and sent through the network. Note that it can increase the migration time to complete.

Interval to run partition migration tasks in seconds.

Hazelcast allows read operations to be performed while a partition is being migrated. This can lead to stale reads for some scenarios. You can disable stale read operations by setting this system property’s value to "true". Its default value is "false", meaning that stale reads are allowed.

Timeout for partition migration tasks in seconds.

Interval for publishing partition table periodically to all cluster members in seconds.

Class name implementing com.hazelcast.core.PartitioningStrategy, which defines key to partition mapping.

Enable or disable the sending of phone home data to Hazelcast’s phone home server.

Prefer IPv4 network interface when picking a local address.

Maximum value of local partitions to trigger local pre-check for Predicates#alwaysTrue() query operations on maps.

Type of the query optimizer. For optimizations based on static rules, set the value to RULES. To disable the optimization, set the value to NONE.

Each Hazelcast member evaluates query predicates using a single thread by default. In most cases, the overhead of inter-thread communications overweight can benefit from parallel execution. When you have a large dataset and/or slow predicate, you may benefit from parallel predicate evaluations. Set to true if you are using slow predicates or have > 100,000s entries per member.

Result size limit for query operations on maps. This value defines the maximum number of returned elements for a single query result. If a query exceeds this number of elements, a QueryResultSizeExceededException is thrown. Its default value is -1, meaning it is disabled.

Version of the Hazelcast serialization. Accepted values are between 1 and the highest supported serialization version.

Enables/disables Hazelcast IMDG shutdownhook thread. When it is disabled, this thread terminates the Hazelcast instance without waiting to shutdown gracefully.

Specifies the behavior when JVM is exiting while the Hazelcast instance is still running. It has two values: TERMINATE and GRACEFUL. The former one terminates the Hazelcast instance immediately. The latter, GRACEFUL, initiates the graceful shutdown which can significantly slow down the JVM exit process, but it tries to retain data safety. Note that you should always shutdown Hazelcast explicitly via using the method HazelcastInstance.shutdown(). It’s not recommended to rely on the shutdown hook, this is a last-effort measure.

Enables/disables the SlowOperationDetector.

Purge interval for slow operation logs.

Defines the retention time of invocations in slow operation logs. If an invocation is older than this value, it is purged from the log to prevent unlimited memory usage. When all invocations are purged from a log, the log itself is deleted.

Defines if the stacktraces of slow operations are logged in the log file. Stack traces are always reported to the Management Center, but by default, they are not printed to keep the log size small.

Defines a threshold above which a running operation in OperationService is considered to be slow. These operations log a warning and are shown in the Management Center with detailed information, e.g., stacktrace.

Bind both server-socket and client-sockets to any local interface.

Specifies whether the byte buffers used in the socket should be a direct byte buffer (true) or a regular one (false). When it is set to true, Hazelcast internally uses the method ByteBuffer.allocateDirect (instead of ByteBuffer.allocate) which makes use of the off-heap and may skip the memory copying when performing socket I/O operations. See here for more information.

Bind client socket to an interface when connecting to a remote server socket. When set to false, client socket is not bound to any interface.

Bind client-sockets to any local interface. If not set, hazelcast.socket.bind.any is used as the default.

Hazelcast creates all connections with receive buffer size set according to the hazelcast.socket.receive.buffer.size. When it detects a connection opened by a client, then it adjusts the receive buffer size according to this property. It is in kilobytes and its default value is -1.

Hazelcast creates all connections with send buffer size set according to the hazelcast.socket.send.buffer.size. When it detects a connection opened by a client, then it adjusts the send buffer size according to this property. It is in kilobytes and its default value is -1.

Socket connection timeout in seconds. Socket.connect() is blocked until either connection is established or connection is refused or this timeout passes. Default is 0, means infinite.

Socket set keep alive (SO_KEEPALIVE).

Set socket SO_LINGER option.

Socket set TCP no delay.

Socket receive buffer (SO_RCVBUF) size in KB. If you have a very fast network, e.g., 10gbit) and/or you have large entries, then you may benefit from increasing sender/receiver buffer sizes. Use this property and the next one below tune the size.

Socket send buffer (SO_SNDBUF) size in KB.

Bind server-socket to any local interface. If not set, hazelcast.socket.bind.any is used as the default.

The number of incremental ports, starting with the port number defined in the network configuration, that is used to connect to a host (which is defined without a port in TCP/IP member list while a member is searching for a cluster).

Wait time before join operation. This time establishes a pre-join phase time window for newcomer members to make their first join requests. Once hazelcast.wait.seconds.before.join elapses since the last first-timer join request (i.e., where the member hasn’t made any previous join request), or the pre-join phase has lasted for hazelcast.max.wait.seconds.before.join seconds, the phase ends and the master starts forming the cluster.