Microsoft’s ADeLe wants to give your AI a cognitive profile

How smart is an AI really? This is one of the most difficult questions to answer accurately. So far, evaluation methods have focused on simple metrics of successes or errors, without offering context on why a right model or failure. Microsoft Research proposes a paradigm shift with ADeLe, a system that analyzes what skills a task requires and if the model possesses them. What is ADeLe and how does it work? ADeLe (Annotated Demand Levels) is an e…

Microsoft’s ADeLe wants to give your AI a cognitive profile

Modern AI models are advancing at breakneck speed, but the way we evaluate them has barely kept pace. Traditional benchmarks tell us whether a model passed or failed a test but rarely offer insights into why it performed the way it did or how it might fare on unfamiliar challenges. A new research effort from Microsoft and its collaborators proposes a rigorous framework that reimagines how we evaluate AI systems. Evaluating AI by what it needs to…