Support batch generation in MLXLM #1754
samwestb
started this conversation in
Feature requests
Replies: 1 comment
-
|
I had not heard about it, thanks for letting us know! If you want to contribute, feel free to do so. Could you open an issue for it please? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Batch generation was recently merged into mlx-lm, ml-explore/mlx-lm#443
This would be super helpful in one of my projects. Happy to help test or contribute if needed.
Thanks for the awesome work on outlines!
Beta Was this translation helpful? Give feedback.
All reactions