-
-
Notifications
You must be signed in to change notification settings - Fork 738
Description
The distributed ThreadPoolExecutor sets the name of each thread based on thread_name_prefix parameter.
The dask worker, by default, passes a fixed name Dask-Default-Threads
as the thread_name_prefix
Corresponding code in dask worker which sets name
Dask's worker parameters only allow overriding the executor, but since executor
has to be an instance of some Executor
(i.e. its a python object), we can't pass this object from outside of python,
for example, when passing "worker json spec" to the dask spec
command to start a worker.
If we can allow user to override this thread_name_prefix of the default executor, by adding one more parameter in the worker params which accepts a string, that would be useful.
Also on another note, the default name of the worker threadpool, can be derived from the worker's self.name
attribute itself, rather than always defaulting to Dask-Default-Threads