[CLOUDP-352109] Run MCK E2E tests against OCI published helm chart #509

viveksinghggits · 2025-10-08T15:48:31Z

Summary

As part of our work to move towards OCI compatible container registries for our helm chart, we are also planning to run our E2E tests against the helm chart that we publish to OCI. This will make sure that we are testing in our E2E what we are providing to our customers.
As part of this effort we have already raised a PR that starts publishing our helm chart to the OCI container registry during dev/staging workflows.
This PR goes and changes our E2E tests to start consuming the helm chart from OCI registry instead of the local helm chart repo.

Proof of Work

Successful CI on this PR.
I also ran the test e2e_replica_set_migration locally and it was successful. The logs are here.

Checklist

Have you linked a jira ticket and/or is the ticket in the title?
Have you checked whether your jira ticket required DOCSP changes?
Have you added changelog file?
- use skip-changelog label if not needed
- refer to Changelog files and Release Notes section in CONTRIBUTING.md for more details

github-actions · 2025-10-17T12:20:30Z

⚠️ (this preview might not be accurate if the PR is not rebased on current master branch)

MCK 1.6.0 Release Notes

New Features

MongoDBCommunity: Added support to configure custom cluster domain via newly introduced spec.clusterDomain resource field. If spec.clusterDomain is not set, environment variable CLUSTER_DOMAIN is used as cluster domain. If the environment variable CLUSTER_DOMAIN is also not set, operator falls back to cluster.local as default cluster domain.
Helm Chart: Introduced two new helm fields operator.podSecurityContext and operator.securityContext that can be used to configure securityContext for Operator deployment through Helm Chart.

Bug Fixes

Fixed parsing of the customEnvVars Helm value when values contain = characters.

1. Move file from scripts to scripts/relese 2. call python files from .sh files so that we can use build_scenario env var

1. Move figuring out of chart dir from helm.py to other places to Operator() and _install_multi_cluster_operator 2. Run precommit

…not provided and chart is not meko or mck

MaciejKaras · 2025-10-22T09:08:49Z

scripts/release/oci_chart_info.py

+
+
+def main():
+    build_scenario = os.environ.get("BUILD_SCENARIO")


Let's not hide the dependency on "BUILD_SCENARIO" env var here and pass it directly as cmd flag.

MaciejKaras · 2025-10-22T09:11:19Z

scripts/evergreen/e2e/single_e2e.sh

        helm_params+=("--set" "omDebugHttp=true")
    fi

+    if [[ -n "${helm_oci_regisry:-}" ]]; then


are those values optional or should be expected to be present?

these values must be set for evergreen patches but will not be set for local tests. we are trying to run the tests image here that we don't do when we run the tests locally so we should be good in always expecting this to be set.

If that is the case we should fail in case they are missing and not omit setting them up, right?

Yes, that's right. I will make the change.

MaciejKaras · 2025-10-22T09:17:21Z

docker/mongodb-kubernetes-tests/tests/conftest.py

+        non_semver_custom_operator_version = os.environ.get(OPERATOR_VERSION_ENV_VAR_NAME)
+        # when we publish the helm chart we append `0.0.0+` in the chart version, details are
+        # here https://docs.google.com/document/d/1eJ8iKsI0libbpcJakGjxcPfbrTn8lmcZDbQH1UqMR_g/edit?tab=t.gg5ble8qlesq
+        custom_operator_version = f"0.0.0+{non_semver_custom_operator_version}"


this will not work when testing against released version which uses semantic version i.e. when we run e2e smoke tests after publishing images to production

thanks for mentioning this, I missed testing smoke tests while implementing this.

MaciejKaras · 2025-10-22T09:18:33Z

docker/mongodb-kubernetes-tests/kubetester/operator.py

+        # if operator_version is not specified and we are not installing the MCK or MEKO chart
+        # it would mean we want to install OCI published helm chart. Figure out respective version,
+        # it is set in env var `OPERATOR_VERSION` based on build_scenario.
+        if not operator_version and helm_chart_path not in (


I see this code in two places, it would make sense to encapsulate it in method

MaciejKaras · 2025-10-22T10:07:13Z

docker/mongodb-kubernetes-tests/kubetester/operator.py

        helm_args: Optional[Dict] = None,
        helm_options: Optional[List[str]] = None,
-        helm_chart_path: Optional[str] = "helm_chart",
+        helm_chart_path: Optional[str] = None,


q: how can we instruct this function to use local helm charts for local tests? Ideally we should be able to set this somewhere in the context files and override it by default locally, for example by specifying it in local-defaults-context.

Yes, that's the plan. I am working on the change that will make sure that we are able to run the tests locally. Will push the changes soon.

viveksinghggits requested a review from a team as a code owner October 8, 2025 15:48

viveksinghggits requested review from MaciejKaras and fealebenpae and removed request for a team October 8, 2025 15:48

viveksinghggits marked this pull request as draft October 8, 2025 15:48

viveksinghggits added the skip-changelog Use this label in Pull Request to not require new changelog entry file label Oct 8, 2025

viveksinghggits force-pushed the publish-chart-oci-prpatches branch from 9bd1970 to 5f0938b Compare October 8, 2025 15:50

viveksinghggits force-pushed the e2e-tests-on-published-chart branch from 9d6699b to 4ad79ae Compare October 8, 2025 15:51

viveksinghggits force-pushed the publish-chart-oci-prpatches branch from 5f0938b to 1b61956 Compare October 10, 2025 14:28

viveksinghggits force-pushed the e2e-tests-on-published-chart branch from 4ad79ae to 9394e7c Compare October 10, 2025 14:44

MaciejKaras removed their request for review October 10, 2025 14:58

viveksinghggits force-pushed the publish-chart-oci-prpatches branch from e885549 to 92d2fe6 Compare October 14, 2025 08:22

viveksinghggits force-pushed the e2e-tests-on-published-chart branch 2 times, most recently from 464fc81 to 5d55e9f Compare October 15, 2025 14:43

viveksinghggits changed the title ~~E2e tests on published chart~~ Run MCK E2E tests against OCI published helm chart instead of local chart Oct 17, 2025

viveksinghggits changed the title ~~Run MCK E2E tests against OCI published helm chart instead of local chart~~ [CLOUDP-352109] Run MCK E2E tests against OCI published helm chart Oct 17, 2025

Base automatically changed from publish-chart-oci-prpatches to master October 17, 2025 11:34

viveksinghggits force-pushed the e2e-tests-on-published-chart branch from b485e0c to e81238f Compare October 17, 2025 12:19

viveksinghggits marked this pull request as ready for review October 17, 2025 13:48

viveksinghggits requested review from MaciejKaras and lsierant October 17, 2025 13:48

viveksinghggits added 8 commits October 21, 2025 20:20

Publish helm chart to OCI registry for PR patches

dfbc534

Consume build_scenario via build_info for registry repo and other info

982c77d

Run precommit

0daaf61

Address review comments

4c753fc

1. Move file from scripts to scripts/relese 2. call python files from .sh files so that we can use build_scenario env var

Publish helm chart to OCI registry for PR patches

8b511e5

Install published helm chart instead of local one, during E2E

4f50441

Don't copy entire helm_chart dir, just copy CRDs

087e06a

Delete not needed file

cb2a8d2

viveksinghggits added 8 commits October 21, 2025 20:20

Start installing chart from OCI registry in E2E

b1162ec

Add newline

8a50020

Refactor

c04e43a

1. Move figuring out of chart dir from helm.py to other places to Operator() and _install_multi_cluster_operator 2. Run precommit

Add 0.0.0 while forming chart version

4132fc6

Fix e2e_meko_mck_upgrade by using OCI version only when version is …

82bf02e

…not provided and chart is not meko or mck

Run precommit

6e641ce

Fix CRDs not found issue by installing CRD from correct path

e96e180

Refactor a little, make consts etc

93f3e12

MaciejKaras reviewed Oct 22, 2025

View reviewed changes

viveksinghggits added 2 commits October 22, 2025 17:18

Make sure local e2es use local helm chart

eb65be5

Run precommit

5cb41a0

viveksinghggits force-pushed the e2e-tests-on-published-chart branch from e2a0c99 to 5cb41a0 Compare October 22, 2025 15:19

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[CLOUDP-352109] Run MCK E2E tests against OCI published helm chart #509

[CLOUDP-352109] Run MCK E2E tests against OCI published helm chart #509

viveksinghggits commented Oct 8, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Oct 17, 2025

Uh oh!

MaciejKaras Oct 22, 2025

Uh oh!

MaciejKaras Oct 22, 2025

Uh oh!

viveksinghggits Oct 22, 2025

Uh oh!

MaciejKaras Oct 22, 2025

Uh oh!

viveksinghggits Oct 22, 2025

Uh oh!

MaciejKaras Oct 22, 2025

Uh oh!

viveksinghggits Oct 22, 2025

Uh oh!

MaciejKaras Oct 22, 2025

Uh oh!

MaciejKaras Oct 22, 2025

Uh oh!

viveksinghggits Oct 22, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants



		def main():
		build_scenario = os.environ.get("BUILD_SCENARIO")

[CLOUDP-352109] Run MCK E2E tests against OCI published helm chart #509

Are you sure you want to change the base?

[CLOUDP-352109] Run MCK E2E tests against OCI published helm chart #509

Conversation

viveksinghggits commented Oct 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Proof of Work

Checklist

Uh oh!

github-actions bot commented Oct 17, 2025

MCK 1.6.0 Release Notes

New Features

Bug Fixes

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

viveksinghggits commented Oct 8, 2025 •

edited

Loading