Annotation Protocol for Textbook Enrichment with Prerequisite Knowledge Graph

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F23%3AGRJQIQYM" target="_blank" >RIV/00216208:11320/23:GRJQIQYM - isvavai.cz</a>

Result on the web

<a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85171573789&doi=10.1007%2fs10758-023-09682-6&partnerID=40&md5=6e54f9eb63ed6025eb618d094835ed75" target="_blank" >https://www.scopus.com/inward/record.uri?eid=2-s2.0-85171573789&doi=10.1007%2fs10758-023-09682-6&partnerID=40&md5=6e54f9eb63ed6025eb618d094835ed75</a>

DOI - Digital Object Identifier

<a href="http://dx.doi.org/10.1007/s10758-023-09682-6" target="_blank" >10.1007/s10758-023-09682-6</a>

Result language

angličtina

Original language name

Annotation Protocol for Textbook Enrichment with Prerequisite Knowledge Graph

Original language description

"Extracting and formally representing the knowledge embedded in textbooks, such as the concepts explained and the relations between them, can support the provision of advanced knowledge-based services for learning environments and digital libraries. In this paper, we consider a specific type of relation in textbooks referred to as prerequisite relations (PR). PRs represent precedence relations between concepts aimed to provide the reader with the knowledge needed to understand a further concept(s). Their annotation in educational texts produces datasets that can be represented as a graph of concepts connected by PRs. However, building good-quality and reliable datasets of PRs from a textbook is still an open issue, not just for automated annotation methods but even for manual annotation. In turn, the lack of good-quality datasets and well-defined criteria to identify PRs affect the development and validation of automated methods for prerequisite identification. As a contribution to this issue, in this paper, we propose PREAP, a protocol for the annotation of prerequisite relations in textbooks aimed at obtaining reliable annotated data that can be shared, compared, and reused in the research community. PREAP defines a novel textbook-driven annotation method aimed to capture the structure of prerequisites underlying the text. The protocol has been evaluated against baseline methods for manual and automatic annotation. The findings show that PREAP enables the creation of prerequisite knowledge graphs that have higher inter-annotator agreement, accuracy, and alignment with text than the baseline methods. This suggests that the protocol is able to accurately capture the PRs expressed in the text. Furthermore, the findings show that the time required to complete the annotation using PREAP are significantly shorter than with the other manual baseline methods. The paper includes also guidelines for using PREAP in three annotation scenarios, experimentally tested. We also provide example datasets and a user interface that we developed to support prerequisite annotation. © 2023, The Author(s)."

Czech name

—

Czech description

—

Type

J_SC - Article in a specialist periodical, which is included in the SCOPUS database

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

—

Publication year

2023

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Name of the periodical

"Technology, Knowledge and Learning"

ISSN

2211-1662

e-ISSN

—

Volume of the periodical

""

Issue of the periodical within the volume

2023

Country of publishing house

US - UNITED STATES

Number of pages

32

Pages from-to

1-32

UT code for WoS article

—

EID of the result in the Scopus database

2-s2.0-85171573789