2026-10-23 15:01:07
🎯 Faster decoding with DSpark draft tokens and confidence-scheduled verification (default max draft length: 5). SWA bounded replay cuts decoder prefill work by replaying only a bounded suffix
🔒 Batch-invariant inference keeps results identical across batch compositions, deterministic sampling returns identical outputs for identical inputs and seeds (both NVIDIA only). Structured outputs constrain generation to regex, JSON schema or EBNF grammar