Today, MLCommons ® announced new results for its industry-standard MLPerf ® Inference v6.0 benchmark suite. This release includes several important advances that ensure the benchmark suite tests ...
IEEE Spectrum on MSN
Why are large language models so terrible at video games?
AI models code simple games, but struggle to play them ...
New research finds that forcing Large Language Models to give shorter answers notably improves the accuracy and quality of ...
Morning Overview on MSN
Google’s TurboQuant claims 6x lower memory use for large AI models
Google researchers have proposed TurboQuant, a method for compressing the key-value caches that large language models rely on ...
Every AI model release inevitably includes charts touting how it outperformed its competitors in this benchmark test or that evaluation matrix. However, these benchmarks often test for general ...
Existing datasets for medical QA cannot comprehensively assess the proficiency of LLMs in pediatrics. To fill this problem, a ...
This study introduces MathEval, a comprehensive benchmarking framework designed to systematically evaluate the mathematical reasoning capabilities of large language models (LLMs). Addressing key ...
Large language models (LLMs) show promise in assisting knowledge-intensive fields such as oncology, where up-to-date information and multidisciplinary expertise are critical. Traditional LLMs risk ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results