Pyramid-based Summary Evaluation Using Abstract Meaning Representation

Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F49777513%3A23520%2F17%3A43949738" target="_blank" >RIV/49777513:23520/17:43949738 - isvavai.cz</a>
Result on the web
<a href="http://dx.doi.org/10.26615/978-954-452-049-6_090" target="_blank" >http://dx.doi.org/10.26615/978-954-452-049-6_090</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.26615/978-954-452-049-6_090" target="_blank" >10.26615/978-954-452-049-6_090</a>

Result language
angličtina
Original language name
Pyramid-based Summary Evaluation Using Abstract Meaning Representation
Original language description
We propose a novel metric for evaluating summary content coverage. The evaluation framework follows the Pyramid approach to measure how many summarization content units, considered important by human annotators, are contained in an automatic summary. Our approach automatizes the evaluation process, which does not need any manual intervention on the evaluated summary side. Our approach compares abstract meaning representations of each content unit mention and each summary sentence. We found that the proposed metric complements well the widely-used ROUGE metrics.
Czech name
—
Czech description
—

Project
<a href="/en/project/LO1506" target="_blank" >LO1506: Sustainability support of the centre NTIS - New Technologies for the Information Society</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)<br>S - Specificky vyzkum na vysokych skolach

Publication year
2017
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection
Proceedings of the International Conference Recent Advances in Natural Language Processing, RANLP 2017
ISBN
978-954-452-048-9
ISSN
1313-8502
e-ISSN
neuvedeno
Number of pages
6
Pages from-to
701-706
Publisher name
INCOMA Ltd.
Place of publication
Shoumen, BULGARIA
Event location
Varna Bulgaria
Event date
Sep 2, 2017
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
—

Similar results(10)