DeepR3: Reducing, Reusing and Recycling Large Models for Developing Responsible and Green Language Technologies

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216208%3A11320%2F25%3AMZ8EGUQ5" target="_blank" >RIV/00216208:11320/25:MZ8EGUQ5 - isvavai.cz</a>

Result on the web

<a href="https://www.scopus.com/inward/record.uri?eid=2-s2.0-85200154573&partnerID=40&md5=6ab6bd616eef1f4a4f2f043337ae113b" target="_blank" >https://www.scopus.com/inward/record.uri?eid=2-s2.0-85200154573&partnerID=40&md5=6ab6bd616eef1f4a4f2f043337ae113b</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

DeepR3: Reducing, Reusing and Recycling Large Models for Developing Responsible and Green Language Technologies

Original language description

This paper presents the DeepR3 project, a coordinated project composed of three local projects at the Hitz Centre (University of the Basque Country), CiTIUS (University of Santiago de Compostela) and Barcelona Supercomputing Center, respectively. The main objective of DeepR3 is to research on parameter efficient ways to extend existing pre-trained language models for Spanish, Catalan, Basque, Galician plus English, and adapt them to new domains, genres and languages. In this project, we will apply the newly developed techniques to improve the state of the art on text generation tasks in the mentioned languages, reusing and recycling pre-trained models for machine translation, developing advanced content-based domain applications in sectors such as Meteorology, and developing new benchmarks and datasets for evaluating and assessing progress towards responsible natural language understanding and generation. DeepR3 is funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. © 2024 Copyright for this paper by its authors.

Czech name

—

Czech description

—

Type

D - Article in proceedings

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

—

Continuities

—

Publication year

2024

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů

Article name in the collection

CEUR Workshop Proc.

ISBN

—

ISSN

1613-0073

e-ISSN

—

Number of pages

6

Pages from-to

6-11

Publisher name

CEUR-WS

Place of publication

—

Event location

A Coruna

Event date

Jan 1, 2025

Type of event by nationality

WRD - Celosvětová akce

UT code for WoS article

—