Integration of cognitive tasks into artificial general intelligence test for large models

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3AIL6BFLWL" target="_blank" >RIV/00216208:11320/25:IL6BFLWL - isvavai.cz</a>

Result on the web

<a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85189562652&doi=10.1016%2fj.isci.2024.109550&partnerID=40&md5=00b8ba47af46f5d0d98a2eba1985bcfc" target="_blank" >https://www.scopus.com/inward/record.uri?eid=2-s2.0-85189562652&doi=10.1016%2fj.isci.2024.109550&partnerID=40&md5=00b8ba47af46f5d0d98a2eba1985bcfc</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1016/j.isci.2024.109550" target="_blank" >10.1016/j.isci.2024.109550</a>

Result language

angličtina

Original language name

Integration of cognitive tasks into artificial general intelligence test for large models

Original language description

During the evolution of large models, performance evaluation is necessary for assessing their capabilities. However, current model evaluations mainly rely on specific tasks and datasets, lacking a united framework for assessing the multidimensional intelligence of large models. In this perspective, we advocate for a comprehensive framework of cognitive science-inspired artificial general intelligence (AGI) tests, including crystallized, fluid, social, and embodied intelligence. The AGI tests consist of well-designed cognitive tests adopted from human intelligence tests, and then naturally encapsulates into an immersive virtual community. We propose increasing the complexity of AGI testing tasks commensurate with advancements in large models and emphasizing the necessity for the interpretation of test results to avoid false negatives and false positives. We believe that cognitive science-inspired AGI tests will effectively guide the targeted improvement of large models in specific dimensions of intelligence and accelerate the integration of large models into human society. © 2024 The Author(s)

Czech name

—

Czech description

—

Type

J_SC - Article in a specialist periodical, which is included in the SCOPUS database

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

—

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

iScience

ISSN

2589-0042

e-ISSN

—

Volume of the periodical

27

Issue of the periodical within the volume

4

Country of publishing house

US - UNITED STATES

Number of pages

15

Pages from-to

1-15

UT code for WoS article

—

EID of the result in the Scopus database

2-s2.0-85189562652