2026-08-05 06:08:13
π 262,144 tokens of native context, validated up to 1,048,576. 40 of 50 layers use 512-token sliding-window attention, every 5th layer attends to everything. RULER at 1M tokens: 63.2 vs 57.5 for #Qwen3.5 35B-A3B
π©πͺ Reasons in German on German prompts, with 4 reasoning effort levels (none, low, medium, high). AIME 2025: 87.5 in German, 96.9 in English. Trained with the Merlin-Arthur protocβ¦