1 link tagged with all of: benchmarks + microsoft-research + performance-prediction
Click any tag below to further narrow down your results
Links
A team of Microsoft researchers developed ADeLe, a new evaluation framework for AI models that predicts performance on unfamiliar tasks and explains the reasons for success or failure. By analyzing cognitive and knowledge-based abilities required for various tasks, ADeLe generates detailed ability profiles and accurate predictions, addressing limitations in current AI benchmarks. This innovative approach aims to enhance AI evaluation and reliability ahead of real-world deployment.