The unreasonable effectiveness of pattern generation
Identifikátory výsledku
Kód výsledku v IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F00216224%3A14330%2F19%3A00110960" target="_blank" >RIV/00216224:14330/19:00110960 - isvavai.cz</a>
Výsledek na webu
<a href="https://tug.org/members/TUGboat/tb40-2/tb125sojka-patgen.pdf" target="_blank" >https://tug.org/members/TUGboat/tb40-2/tb125sojka-patgen.pdf</a>
DOI - Digital Object Identifier
—
Alternativní jazyky
Jazyk výsledku
angličtina
Název v původním jazyce
The unreasonable effectiveness of pattern generation
Popis výsledku v původním jazyce
Languages are constantly evolving, and so are their hyphenation rules and needs. The effectiveness and utility of TeX’s hyphenation have been proven by its usage in almost all typesetting systems in use today. The current Czech hyphenation patterns were generated in 1995, and no hyphenated word database was freely available. We have developed a new Czech word database and have used the patgen program to generate new effective Czech hyphenation patterns efficiently and evaluated their generalization qualities. We have achieved full coverage on the training dataset of 3,000,000 words and developed a validation procedure of new patterns for Czech based on the testing database of 105,000 words approved by the Czech Academy of Science linguists. Our pattern generation case study exemplifies a practical solution to the widespread dictionary problem. The study has proved the versatility, effectiveness, and extensibility of Liang’s approach to hyphenation developed for TeX. The unreasonable effectiveness of pattern technology has led to applications that are and will be used, even more widely now, nearly 40 years after its inception.
Název v anglickém jazyce
The unreasonable effectiveness of pattern generation
Popis výsledku anglicky
Languages are constantly evolving, and so are their hyphenation rules and needs. The effectiveness and utility of TeX’s hyphenation have been proven by its usage in almost all typesetting systems in use today. The current Czech hyphenation patterns were generated in 1995, and no hyphenated word database was freely available. We have developed a new Czech word database and have used the patgen program to generate new effective Czech hyphenation patterns efficiently and evaluated their generalization qualities. We have achieved full coverage on the training dataset of 3,000,000 words and developed a validation procedure of new patterns for Czech based on the testing database of 105,000 words approved by the Czech Academy of Science linguists. Our pattern generation case study exemplifies a practical solution to the widespread dictionary problem. The study has proved the versatility, effectiveness, and extensibility of Liang’s approach to hyphenation developed for TeX. The unreasonable effectiveness of pattern technology has led to applications that are and will be used, even more widely now, nearly 40 years after its inception.
Klasifikace
Druh
J<sub>ost</sub> - Ostatní články v recenzovaných periodicích
CEP obor
—
OECD FORD obor
20206 - Computer hardware and architecture
Návaznosti výsledku
Projekt
—
Návaznosti
I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Ostatní
Rok uplatnění
2019
Kód důvěrnosti údajů
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Údaje specifické pro druh výsledku
Název periodika
TUGboat: The Communications of the TeX Users Group
ISSN
0896-3207
e-ISSN
—
Svazek periodika
40
Číslo periodika v rámci svazku
2
Stát vydavatele periodika
US - Spojené státy americké
Počet stran výsledku
7
Strana od-do
187-193
Kód UT WoS článku
—
EID výsledku v databázi Scopus
—