Learning Entropy: Multiscale Measure for Incremental Learning
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21220%2F13%3A00212013" target="_blank" >RIV/68407700:21220/13:00212013 - isvavai.cz</a>
Result on the web
<a href="http://www.mdpi.com/1099-4300/15/10/4159" target="_blank" >http://www.mdpi.com/1099-4300/15/10/4159</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.3390/e15104159" target="_blank" >10.3390/e15104159</a>
Alternative languages
Result language
angličtina
Original language name
Learning Entropy: Multiscale Measure for Incremental Learning
Original language description
First, this paper recalls a recently introduced method of adaptive monitoring of dynamical systems and presents the most recent extension with a multiscale-enhanced approach. Then, it is shown that this concept of real-time data monitoring establishes anovel non-Shannon and non-probabilistic concept of novelty quantification, i.e., Entropy of Learning, or in short the Learning Entropy. This novel cognitive measure can be used for evaluation of each newly measured sample of data, or even of whole intervals. The Learning Entropy is quantified in respect to the inconsistency of data to the temporary governing law of system behavior that is incrementally learned by adaptive models such as linear or polynomial adaptive filters or neural networks. The paperpresents this novel concept on the example of gradient descent learning technique with normalized learning rate.
Czech name
—
Czech description
—
Classification
Type
J<sub>x</sub> - Unclassified - Peer-reviewed scientific article (Jimp, Jsc and Jost)
CEP classification
BC - Theory and management systems
OECD FORD branch
—
Result continuities
Project
<a href="/en/project/TA03020312" target="_blank" >TA03020312: Research of oxyfuel combustion in a bubbling fluidized bed for CCS technologies</a><br>
Continuities
S - Specificky vyzkum na vysokych skolach
Others
Publication year
2013
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Name of the periodical
Entropy
ISSN
1099-4300
e-ISSN
—
Volume of the periodical
15
Issue of the periodical within the volume
10
Country of publishing house
CH - SWITZERLAND
Number of pages
29
Pages from-to
4159-4187
UT code for WoS article
000328486900010
EID of the result in the Scopus database
—