Skip to content

feat(engine): support batch generation and enable shared memory queue…

65f00b4
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

feat(pymllm): VocabParallelEmbedding & pymllm's cuda infra init #640

feat(engine): support batch generation and enable shared memory queue…
65f00b4
Select commit
Loading
Failed to load commit list.