Join GitHub today
GitHub is home to over 50 million developers working together to host and review code, manage projects, and build software together.
Sign upray.util.multiprocessing.Pool.starmap does not work with zip #11451
Comments
|
cc @edoakes Thanks for this report :). Btw, feel free to contribute to the fix!! That'll be really helpful |


What is the problem?
It seems that
ray.util.multiprocessing.Pool.starmapdoes not work with iterable created from zip, unless it's explicitly converted to a list etc. For example, this one works:But this one gives me an error, saying that
TypeError: <lambda>() takes 2 positional arguments but 4 were given.With python's own
multiprocessing.PoolI don't need to explicitly convert it to a list, so I think it'd be better if the behavior ofray.util.multiprocessing.Poolcan be the same here? I guess this issue would be easy to fix.Ray version and other system information (Python version, TensorFlow version, OS):
Ray 1.0.0 installed via pip, Python 3.6.11, SUSE 15.
Reproduction (REQUIRED)
Please provide a script that can be run to reproduce the issue. The script should have no external library dependencies (i.e., use fake or mock data / environments):
See above.