Skip to content

[FEA]: Add join_streams to pylibcudf #20315

@TomAugspurger

Description

@TomAugspurger

Is your feature request related to a problem? Please describe.

As part of cudf-polars' work to use CUDA streams, we need a way to join multiple CUDA streams (in, e.g., a join operation) to avoid race conditions.

Describe the solution you'd like

cudf (C++) offers a join_streams method:

/**
* @brief Synchronize a stream to an event on a set of streams.
*
* @param streams Streams to wait on.
* @param stream Joined stream that synchronizes with the waited-on streams.
*/
void join_streams(host_span<rmm::cuda_stream_view const> streams, rmm::cuda_stream_view stream);
. A python API in pylibcudf that wraps that should work for our use cases.

Describe alternatives you've considered

Reimplementing the logic in cudf-polars.

Additional context

Metadata

Metadata

Assignees

Labels

cudf-polarsIssues specific to cudf-polarsfeature requestNew feature or request

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions