Connector Guides
Hazelcast comes out of the box with many different connectors for accessing data in a variety of platforms. These connectors are configured to read and write data in the most efficient way for their respective system. Explore the available connectors and choose one for your use case.
You can use connectors as either sources or sinks. Sources allow Hazelcast to read data from them either for queries or as part of a larger data pipeline. Sinks allow Hazelcast to write data such as query results to them.
Processing Guarantees
Some connectors support streaming, in which case they will have either an at-least-once or exactly-once processing guarantee.
Connectors that do not support streaming do not have any processing guarantees. Instead, during intermittent failures, you must restart any queries or jobs that use these connectors.
Connectors for SQL
You can use the followng connectors in SQL by configuring them in the CREATE MAPPING statement.
Sources
| Connector | Module | Batch/Streaming | Processing guarantee |
|---|---|---|---|
hazelcast-jet-kafka |
streaming |
exactly-once |
|
Depends on the file format and/or storage system. |
Depends on the storage system. |
Depends on the storage system. |
|
hazelcast-sql |
batch |
N/A |
|
hazelcast-sql |
batch |
N/A |
Connectors for the Jet API
The Jet API supports more connectors than SQL.
Sources
| Connector | Module | Batch/Streaming | Processing guarantee |
|---|---|---|---|
|
batch |
N/A |
|
|
streaming |
at-least-once |
|
|
batch |
N/A |
|
|
batch |
N/A |
|
|
batch |
N/A |
|
|
streaming |
exactly-once |
|
|
streaming |
exactly-once |
|
|
streaming |
exactly-once |
|
|
streaming |
exactly-once |
|
|
streaming |
N/A |
|
|
streaming |
exactly-once |
|
|
batch |
N/A |
|
|
batch |
N/A |
|
|
streaming |
exactly-once |
|
|
batch |
N/A |
|
|
streaming |
none |
|
|
batch |
N/A |
|
|
streaming |
none |
|
|
batch |
N/A |
|
|
streaming |
exactly-once |
|
|
batch |
N/A |
|
|
batch |
N/A |
|
|
streaming |
exactly-once |
|
|
streaming |
none |
|
|
batch |
N/A |
|
|
streaming |
none |
Sinks
| Connector | Module | Batch/Streaming | Processing Guarantee |
|---|---|---|---|
|
batch |
N/A |
|
|
streaming |
at-least-once |
|
|
streaming |
at-least-once |
|
|
streaming |
at-least-once |
|
|
batch |
N/A |
|
|
streaming |
exactly-once |
|
|
streaming |
at-least-once |
|
|
streaming |
at-least-once |
|
|
batch |
N/A |
|
|
streaming |
at-least-once |
|
|
streaming |
exactly-once |
|
|
streaming |
exactly-once |
|
|
streaming |
exactly-once |
|
|
streaming |
exactly-once |
|
|
batch |
N/A |
|
|
streaming |
at-least-once |
|
|
streaming |
at-least-once |
|
|
streaming |
at-least-once |
|
|
streaming |
at-least-once |
