Abstract
This paper provides a review of Shannon and other entropy measures in evaluating the quality of materials used in perception, cognition and learning processes. Energy-based metrics are not suitable for cognition, as energy itself does not carry information. Instead, morphological (structural and contextual) as well as entropy-based metrics should be considered in cognitive informatics. The data and signal transformation processes are defined and discussed in the perceptual framework, followed by various classes of information and entropies suitable for characterization of data, signals and distortion. Other entropies are also described, including the Renyi generalized entropy spectrum, Kolmogorov complexity measure, Kolmogorov-Sinai entropy and Prigogine entropy for evolutionary dynamical systems. Although such entropy-based measures are suitable for many signals, they are not sufficient for scale-invariant (fractal and multifractal) signals without complementary measures.
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.