[Feature]: Fluent-bit log shipping #3430
Description
Problem
At the moment, there are integrations for GCP and AWS-native (CloudWatch) logging, but no option for those who are running their own logging stacks such as fluent-bit.
Solution
I propose adding a new "batteries-included" mode which includes reading from ES, and a ship-only mode which just sends logs without the ability to read (because you would typically have Kibana anyway).
The most popular logging backend seems to be Elasticsearch / Opensearch, but it would be good to support Loki in the future.
Workaround
If you manage the infrastructure by using the Kubernetes backend, this is technically unnecessary.
Would you like to help us implement this feature by sending a PR?
Yes