Kdyz je model dostатосecnе chytry, rychlost se stava dulezitejsi. Better to get the right answer once than the wrong one thrice (73 bodu) CoT takes too long under 70 TPS Switched from DeepSeek to Qwen 3.8 - much happier Nemotron Lightning: ...
Kdyz je model dostатосecnе chytry, rychlost se stava dulezitejsi.
Komentare
Better to get the right answer once than the wrong one thrice (73 bodu)
CoT takes too long under 70 TPS
Switched from DeepSeek to Qwen 3.8 - much happier
Trend
Nemotron Lightning: 3x rychlejsi nez Ornith
Qwen 3.8: nejlepsi kvalita, ale pomaly
Orchestration: kombinace rychlych a chytrych modelu
Zdroj: Reddit