feat: support batching #101
Description
Note: Only the vllm_offline and transformers backends in the outlines library support batching.
{{ message }}
Note: Only the vllm_offline and transformers backends in the outlines library support batching.