Skip to content

[FEATURE]: pytest/Test Impact Analysis (ITR) - to print out list of actual tests to skip #14592

@rafal-pomocnik-captivateiq

Description

Package Name

No response

Package Version(s)

3.10.2

Describe the goal of the feature

https://github.com/DataDog/dd-trace-py/blob/v3.10.2/ddtrace/internal/ci_visibility/recorder.py#L649

Returned is the len of items to be skipped, but not actual items, which would be beneficial to know for proper distribution among multiple runners and capability to ignore specific tests from being unnecessarily passed to run and not working well with other optimisations done (in my case for pytest-split and its test durations distribution across runners)

Could be at info level, could be at debug level, whatever works, I scrape out logs to grab values anyway

Is your feature request related to a problem?

Yes, otherwise I end up in a situation that runner 1 might try to run all tests that are gonna be skipped, while runner 2 might run only tests that are not gonna be skipped, thus they are not evenly distributed across workers

Describe alternatives you've considered

Patching package on my own or trying to hit /api/v2/ci/tests/skippable internal endpoint on my own

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions