[Feature]: support chunked prefill on non-x86 platform #25170
Description
🚀 The feature, motivation and pitch
Currently chunked prefill only works on x86 CPU, as shown in source code.
This feature request is to support chunked prefill on non-x86 CPUs like Arm.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.