Skip to content

fix(embed): respect physical batch limits for non-causal embeddings - #2387

Open
original4422 wants to merge 2 commits into
abetlen:mainfrom
original4422:fix/noncausal-embedding-microbatches
Open

fix(embed): respect physical batch limits for non-causal embeddings#2387
original4422 wants to merge 2 commits into
abetlen:mainfrom
original4422:fix/noncausal-embedding-microbatches

Commits

  1. Commits on Oct 17, 2026