paulmataruso/goflow2
1
0
Fork 0
mirror of https://github.com/openobserve/goflow2.git synced 2025-11-02 13:03:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

Kafka: enable compression (#128)

Browse Source 
Co-authored-by: Arun Cherla <kcherla@gmail.com>
This commit is contained in:
Louis
2022-10-08 14:17:18 -07:00
committed by GitHub
parent 7801c6a273
commit 3734d83954
2 changed files with 40 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@@ -150,6 +150,14 @@ To partition the feed (any field of the protobuf is available), the following op
-format.hash=SamplerAddress,DstAS
```
By default, compression is disabled when sending data to Kafka.
To change the kafka compression type of the producer side configure the following option:
```
-transport.kafka.compression.type=gzip
```
The list of codecs is available in the [Sarama documentation](https://pkg.go.dev/github.com/Shopify/sarama#CompressionCodec).
By default, the collector will listen for IPFIX/NetFlow V9 on port 2055
and sFlow on port 6343.
To change the sockets binding, you can set the `-listen` argument and a URI