Tootfinder

Opt-in global Mastodon full text search. Join the index!

@michabbb@social.vivaldi.net
2026-10-23 15:01:07

🎯 Faster decoding with DSpark draft tokens and confidence-scheduled verification (default max draft length: 5). SWA bounded replay cuts decoder prefill work by replaying only a bounded suffix
🔒 Batch-invariant inference keeps results identical across batch compositions, deterministic sampling returns identical outputs for identical inputs and seeds (both NVIDIA only). Structured outputs constrain generation to regex, JSON schema or EBNF grammar