Skip to content

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Nov 9, 2025

🤖 Automated Test Weight Update

This PR updates test weights based on recent CI runs to improve batch balancing.

📊 Summary

Test Type Old Total New Total Change # Tests
Cypress 53.1 min 50.3 min -5.4% 89 → 97
Pytest 72.4 min 74.8 min +3.4% 325 → 334

🔍 Cypress - Significant Changes (>10% or >10s)

13 tests with significant duration changes

🟢 containers/containers.js

  • Old: 6.3s → New: 4.6s (-1.8s, -27.7%)

🟢 auto_completeV2/v2_auto_complete.js

  • Old: 18.2s → New: 14.3s (-3.8s, -21.2%)

🟢 task_runs/task_runs.js

  • Old: 14.0s → New: 11.2s (-2.8s, -20.0%)

🟢 lineageV2/v2_lineage_column_level.js

  • Old: 9.1s → New: 7.3s (-1.8s, -19.7%)

🟢 domainsV2/v2_domains.js

  • Old: 6.6s → New: 5.6s (-1.0s, -15.8%)

🟢 mutations/deprecations.js

  • Old: 11.4s → New: 9.6s (-1.8s, -15.7%)

🟢 ingestionV2/sources.js

  • Old: 118.6s → New: 101.5s (-17.1s, -14.5%)

🔴 manage_tags/manage_tags.js

  • Old: 8.9s → New: 10.2s (+1.3s, +14.4%)

🔴 search/query_and_filter_search.js

  • Old: 32.2s → New: 36.5s (+4.3s, +13.3%)

🔴 analytics/analytics.js

  • Old: 8.2s → New: 9.2s (+1.0s, +12.2%)

🔴 ingestionV2/run_history.js

  • Old: 95.8s → New: 107.3s (+11.5s, +12.0%)

🔴 actions/docPropagation.js

  • Old: 5.5s → New: 6.1s (+0.6s, +10.5%)

🔴 mutations/dataset_ownership.js

  • Old: 174.4s → New: 187.7s (+13.3s, +7.6%)

🔍 Pytest - Significant Changes (>10% or >10s)

76 tests with significant duration changes

🔴 tests.managed_ingestion.managed_ingestion_test::test_create_list_get_ingestion_execution_request

  • Old: 0.0s → New: 44.0s (+44.0s, +4403100.0%)

🔴 test_e2e::test_create_group

  • Old: 0.0s → New: 10.8s (+10.8s, +1081600.0%)

🔴 test_e2e::test_gms_get_user

  • Old: 0.0s → New: 64.1s (+64.1s, +641020.0%)

🔴 test_e2e::test_remove_group

  • Old: 0.0s → New: 10.8s (+10.7s, +30625.7%)

🔴 tests.lineage.test_lineage_sdk::test_table_level_lineage

  • Old: 0.2s → New: 10.7s (+10.5s, +6240.8%)

🔴 tests.assertions.assertions_test::test_gms_get_latest_assertions_results_by_partition

  • Old: 5.5s → New: 15.7s (+10.2s, +187.2%)

🔴 tests.privileges.test_privileges::test_privilege_to_create_and_manage_secrets

  • Old: 20.2s → New: 50.1s (+29.9s, +147.7%)

🔴 tests.entity_versioning.test_versioning_ingest::test_ingest_many_versions

  • Old: 9.3s → New: 19.0s (+9.7s, +104.6%)

🟢 tests.assertions.assertions_test::test_gms_get_assertion_info

  • Old: 12.9s → New: 0.0s (-12.9s, -99.9%)

🔴 tests.structured_properties.test_structured_properties::test_structured_property_string

  • Old: 20.3s → New: 40.5s (+20.2s, +99.9%)

🟢 tests.lineage.test_lineage_sdk::test_column_level_lineage

  • Old: 13.0s → New: 0.1s (-12.9s, -99.4%)

🟢 test_e2e::test_search_results_recommendations

  • Old: 74.8s → New: 5.4s (-69.4s, -92.7%)

🟢 test_e2e::test_frontend_app_config

  • Old: 70.4s → New: 5.5s (-64.9s, -92.2%)

🔴 test_authentication_e2e::test_graphql_endpoint_valid_token

  • Old: 6.6s → New: 12.5s (+5.8s, +88.0%)

🔴 test_e2e::test_update_corp_group_properties

  • Old: 18.7s → New: 35.1s (+16.4s, +87.5%)

... and 61 more

✨ Cypress - Test Changes

➕ Added: 10 tests (2.2 min total)

View new tests
  • manage_tagsV2/assign_unassign_tags.js: 28.9s
  • manage_tagsV2/create_edit_remove_tags.js: 16.5s
  • manage_tagsV2/search_bar_placeholder.js: 3.4s
  • manage_tagsV2/search_not_exists.js: 4.4s
  • manage_tagsV2/title_search_results.js: 3.9s
  • summaryTab/dataProductSummary.js: 13.7s
  • summaryTab/domainSummary.js: 15.2s
  • summaryTab/glossaryNodeSummary.js: 13.8s
  • summaryTab/glossaryTermSummary.js: 15.2s
  • uploadFiles/uploadFiles.js: 15.8s

➖ Removed: 2 tests (4.8 min total)

View removed tests
  • manage_tagsV2/manage_tagsV2.js: 49.0s
  • summaryTab/summaryTab.js: 241.8s

✨ Pytest - Test Changes

➕ Added: 9 tests (1.8 min total)

View new tests
  • test_e2e::test_add_remove_members_from_group: 34.2s
  • test_e2e::test_remove_user: 15.5s
  • test_e2e::test_update_corp_group_description: 27.9s
  • tests.analytics.test_analytics::test_analytics_charts_have_data: 6.7s
  • tests.analytics.test_analytics::test_tab_views_by_entity_type_chart: 5.4s
  • tests.analytics.test_analytics::test_top_searches_chart: 5.4s
  • tests.analytics.test_analytics::test_top_viewed_datasets_chart: 5.4s
  • tests.analytics.test_analytics::test_weekly_active_users_chart: 5.4s
  • tests.entity_versioning.test_versioning::test_link_unlink_three_versions_unlink_and_relink: 0.0s

Generated by automated test weight update workflow

Automated update of test weights based on analysis of recent successful CI runs.
This improves batch balancing and reduces overall CI execution time.

Generated by: Update Test Weights workflow
Run: https://github.com/datahub-project/datahub/actions/runs/19202110048
@chakru-r chakru-r self-requested a review November 10, 2025 15:15
@codecov
Copy link

codecov bot commented Nov 10, 2025

❌ 1 Tests Failed:

Tests completed Failed Passed Skipped
430 1 429 6
View the top 1 failed test(s) by shortest run time
glossary cypress/e2e/glossaryV2/v2_glossary.js::cypress/e2e/glossaryV2/v2_glossary.js
Stack Traces | 76.5s run time
2025-11-11T14:33:07.234Z
Timed out retrying after 10000ms: Expected not to find content: 'CypressGlossaryGroup' but continuously found it.

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

@anshbansal
Copy link
Collaborator

merged this in #15173 so closing this one. We can revisit next week's PR

@anshbansal anshbansal closed this Nov 12, 2025
@anshbansal anshbansal deleted the auto/update-test-weights-20251109-023350 branch November 12, 2025 05:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants