Post
3936
you gotta go fast and go read the latest blog by
@ror
et al. explaining Continuous Batching in depth
https://huggingface.co/blog/continuous_batching
https://huggingface.co/blog/continuous_batching