FluentBit output to Azure Event Hub using kafka

Worked for me using fluentbit kafka output to Azure EventHub

_td-agent-bit.conf_

“`

[INPUT]

  Name                tail

  Path                xxx.log

  Refresh_Interval    10

[OUTPUT]

  Name        kafka

  Match      *

  brokers    xxx.xxx.windows.net:9093

  topics      xxx

  rdkafka.security.protocol  SASL_SSL

  rdkafka.sasl.username      $ConnectionString

  rdkafka.sasl.password      Endpoint=sb://xxx.xxx.windows.net/;SharedAccessKeyName=xxx;SharedAccessKey=xxx

  rdkafka.sasl.mechanism      PLAIN

[OUTPUT]

  name  stdout

  match *

“`

Inside docker container (MUST HAVE or broker down/ssl fail)

_docker-compose.yml_

“`

version: “3.7”

services:

  fluent-bit:

    image: fluent/fluent-bit:1.6.2

    container_name: fluentbit

    restart: always

    volumes:

      – ./td-agent-bit.conf:/fluent-bit/etc/fluent-bit.conf

      – ./xxx.log:/fluent-bit/etc/xxx.log:ro

“`

49 Comments

Leave a Reply

Your email address will not be published.