MLE-25068: Support more configuration for log collection

[pengzhouml]

No description provided.

[Copilot]

Pull Request Overview

This PR enhances the log collection configuration system by allowing users to provide custom Fluent Bit configurations for inputs, filters, and parsers in addition to the previously supported outputs. The main goal is to provide more flexibility in log collection configuration while maintaining backward compatibility with default configurations.

Key changes:

• Refactored YAML indentation processing logic into a reusable normalizeYAMLIndentation function
• Added support for custom Inputs, Filters, and Parsers configuration fields
• Removed the default Loki output configuration from the CRD schema

Reviewed Changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
pkg/k8sutil/configmap.go	Extracted indentation logic into normalizeYAMLIndentation function and added conditional support for custom inputs, filters, and parsers configurations
api/v1/common_types.go	Added new Filters, Inputs, and Parsers string fields to LogCollection struct; removed default value annotation from Outputs field
config/crd/bases/marklogic.progress.com_marklogicgroups.yaml	Updated CRD schema to include new filters, inputs, and parsers fields; removed default Loki output configuration
config/crd/bases/marklogic.progress.com_marklogicclusters.yaml	Updated CRD schema to include new filters, inputs, and parsers fields; removed default Loki output configuration
charts/marklogic-operator-kubernetes/templates/marklogicgroup-crd.yaml	Updated Helm chart CRD template to include new fields and removed default output configuration
charts/marklogic-operator-kubernetes/templates/marklogiccluster-crd.yaml	Updated Helm chart CRD template to include new fields and removed default output configuration

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[rwinieski]

Hi Peng,

Don't we need to update the sample file to reflect the yaml format?

[pengzhouml]

Hi Peng,

Don't we need to update the sample file to reflect the yaml format?

I've created another story dedicated to update the samples file