Interdependence of text mining quality and the input data preprocessing
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F62156489%3A43110%2F15%3A43906660" target="_blank" >RIV/62156489:43110/15:43906660 - isvavai.cz</a>
Result on the web
<a href="http://dx.doi.org/10.1007/978-3-319-18476-0_15" target="_blank" >http://dx.doi.org/10.1007/978-3-319-18476-0_15</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/978-3-319-18476-0_15" target="_blank" >10.1007/978-3-319-18476-0_15</a>
Alternative languages
Result language
angličtina
Original language name
Interdependence of text mining quality and the input data preprocessing
Original language description
The paper focuses on preprocessing techniques application to short informal textual documents created in different natural languages. The goal is to evaluate the impact on the quality of the results and computational complexity of the text mining processdesigned to reveal knowledge hidden in the data. Extensive number of experiments were carried out with real world text data with correction of spelling errors, stemming, stop words removal, and their combinations applied. Support vector machine, decision trees, and k-means algorithms as the commonly used methods were considered to analyze the text data. The text mining quality was generally not influenced significantly, however, the positive impact represented by the decreased computational complexitywas observed.
Czech name
—
Czech description
—
Classification
Type
D - Article in proceedings
CEP classification
IN - Informatics
OECD FORD branch
—
Result continuities
Project
—
Continuities
S - Specificky vyzkum na vysokych skolach
Others
Publication year
2015
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Article name in the collection
Artificial Intelligence Perspectives and Applications. Volume 1
ISBN
978-3-319-18475-3
ISSN
2194-5357
e-ISSN
—
Number of pages
10
Pages from-to
141-150
Publisher name
Springer Switzerland
Place of publication
Cham
Event location
Zlín
Event date
Apr 27, 2015
Type of event by nationality
WRD - Celosvětová akce
UT code for WoS article
000371407800015