18 Commits
Author SHA1 Message Date
Mustafa Akın 1526f77225 Merge branch 'master' into index-format 2020-04-10 16:06:30 +03:00
Dmitriy Kononov d3bb915de0 adding ssl verification mode option 2020-04-01 22:46:40 +06:00
Mustafa Akın 0f470b5af2 Merge pull request #20 from shikloshi/pubsub-sink
Adding gcloud pubsub sink
2020-02-07 13:34:58 +11:00
Mustafa Akin 8c7101d463 Fixed the inner field serialization bug, added test for array serialization 2020-02-07 11:54:59 +11:00
shikloshi 09627aed0b adding config to pubsub sink object 2020-02-03 09:54:10 +02:00
shikloshi 651a8a9b0b Updating documentation with pubsub 2020-02-03 09:51:41 +02:00
shikloshi ad043f7145 adding pubsub sink 2020-02-03 09:44:31 +02:00
Aaron Brodersen bbb985f8c9 Add indexFormat field for date formatted indices
Date formatted index names are a common pattern in Elastic setups. This
commit as a config field to specify a string pattern for index names.
The pattern is searched for sequenences inside {curly braces} and passes
any text found plus the current time through the Go time formatting function.
2020-01-24 11:38:38 -06:00
aseker 7defd7d073 layout list fix 2020-01-17 17:10:20 +03:00
aseker 208a261d93 Annotations added to involved object 2020-01-10 15:58:05 +03:00
Mustafa Akın aca4ca6dd9 Merge pull request #11 from mdemierre/feature/close-sinks
engine: Implement clean closing of sinks
2019-12-22 20:33:50 +03:00
Marc Demierre 106e78ae0e engine: Implement clean closing of sinks
Before the change, the engine didn't call the `Close()` method of the
sinks. This is needed in some cases, i.e when a sink implementation is
buffered.

This change adds a `Close()` method to the registry that
will signal sinks to exit and wait for all sinks to exit before
returning. This is then used in the engine stop logic.

In the channel-based registry, the closing of all sinks is done in
parallel (using a `sync.WaitGroup`). In the sync registry, sinks are
closed sequentially.

Fixes issue #10
2019-12-15 21:56:37 +01:00
Marc Demierre 8c5d1871db sink: Implement basic Kafka sink
This new sink adds basic support for Kafka, using `sarama.SyncProducer`.

It allows minimal configuration to make it useful:

- Topic
- Broker List
- TLS settings

The layout transformations are supported in the same way as for kinesis.

Implements issue #6.
2019-12-15 14:00:00 +01:00
Mustafa Akin 45cf57c7f9 Modified README and fixed minor bugs 2019-12-09 14:09:26 +03:00
Mustafa Akin b146fbb507 Added testing pipeline, deployment and configuration docs 2019-12-08 21:05:51 +03:00
Mustafa Akin b78cf2d997 Add Slack, SQS, SNS outputs. Batching skeleton is implemented but not used in sinks 2019-12-01 16:26:31 +03:00
Mustafa Akin c4726c1a72 Opsgenie output is added, some minor fixes 2019-11-21 10:30:33 -08:00
Mustafa Akin 1fc04d5570 Initial commit, working tests 2019-10-29 00:03:31 +03:00