If Apache Iggy is useful to you, give it a star on GitHubStar apache/iggy
Apache Iggy
ConnectorsSources
These are the docs for Apache Iggy 0.8, kept for reference and no longer updated. Server 0.9.0 changed the wire protocol, so 0.8 clients and servers do not work with 0.9.0. Read the current docs.

Random Source

Generate random messages into Iggy streams for testing, benchmarking and verifying a connector pipeline.

The random source connector generates random messages and sends them to Iggy streams. This is useful for testing, benchmarking, and verifying that your connector pipeline is working correctly without needing an external data source.

Configuration

type = "source"
key = "random-source"
enabled = true
version = 1
name = "Random Source"
path = "/path/to/libiggy_connector_random_source.so"
verbose = false

[[streams]]
stream = "my-stream"
topic = "my-topic"
schema = "json"
batch_length = 100
linger_time = "100ms"

[plugin_config]
interval = "100ms"
max_count = 1_000_000
messages_range = [1, 10]
payload_size = 256

Plugin config options

OptionTypeDefaultDescription
intervalstring"1s"Delay before each message generation cycle
max_countusizeunlimitedStop producing after this many messages in total; omit for unlimited
messages_range[u32, u32][10, 50]Min (inclusive) / max (exclusive) messages per batch (random within range)
payload_sizeu32100Number of random characters in the text field of each message

Setting max_count = 0 stops production immediately (the connector produces zero messages). To generate messages without a limit, leave the key out.

The connector persists the total number of produced messages as its state, so max_count is enforced across runtime restarts.

On this page