The Computational Theory of Intelligence: Information Entropy
Author(s)
Daniel Kovach1*
ABSTRACT
This paper presents an information theoretic approach to the concept of intelligence in the computational sense. We introduce a probabilistic framework from which computation alintelligence is shown to be an entropy minimizing process at the local level. Using this new scheme, we develop a simple data driven clustering example and discuss its applications.
This paper presents an information theoretic approach to the concept of intelligence in the computational sense. We introduce a probabilistic framework from which computation alintelligence is shown to be an entropy minimizing process at the local level. Using this new scheme, we develop a simple data driven clustering example and discuss its applications.
Cite this paper
Kovach, D. (2014) The Computational Theory of Intelligence: Information Entropy. International Journal of Modern Nonlinear Theory and Application, 3, 182-190. doi: 10.4236/ijmnta.2014.34020.
Kovach, D. (2014) The Computational Theory of Intelligence: Information Entropy. International Journal of Modern Nonlinear Theory and Application, 3, 182-190. doi: 10.4236/ijmnta.2014.34020.
References
[1] Wechsler, D. and Matarazzo, J.D. (1972) Wechsler’s Measurement and Appraisal of Adult Intelligence. Oxford UP, New York. [2] Gardner, H. (1993) Frames of the Mind: The Theory of Multiple Intelligences. Basic, New York. [3] Sternberg, R.J. (1982) Handbook of Human Intelligence. Cambridge UP, Cambridge Cambridgeshire. [4] Hawkins, J. and Sandra, B. (2004) On Intelligence. Times, New York. [5] Ihara, S. (1993) Information Theory for Continuous Systems. World Scientific, Singapore. [6] Schroeder, D.V. (2000) An Introduction to Thermal Physics. Addison Wesley, San Francisco. [7] Penrose, R. (2011) Cycles of Time: An Extraordinary New View of the Universe. Alfred A. Knopf, New York. [8] Hawking, S.W. (1998) A Brief History of Time. Bantam, New York. [9] Jones, M.T. (2008) Artificial Intelligence: A Systems Approach. Infinity Science, Hingham. [10] Russell, S.J. and Peter, No. (2003) Artificial Intelligence: A Modern Approach. Prentice Hall/Pearson Education, Upper Saddle River. [11] (2013) Download Python. N.p., n.d. Web. 17 August 2013. http://www.python.org/getit [12] Marr, D. and Poggio, T. (1979) A Computational Theory of Human Stereo Vision. Proceedings of the Royal Society B: Biological Sciences, 204, 301-328. http://dx.doi.org/10.1098/rspb.1979.0029 [13] Meyer, D.E. and Kieras, D.E. (1997) A Computational Theory of Executive Cognitive Processes and Multiple-Task Performance: Part I. Basic Mechanisms. Psychological Review, 104, 3-65.
http://dx.doi.org/10.1098/rspb.1979.0029 [14] Wissner-Gross, A. and Freer, C. (2013) Causal Entropic Forces. Physical Review Letters, 110, Article ID: 168702.
http://dx.doi.org/10.1103/PhysRevLett.110.168702 [15] (2013) Entropica. N.p., n.d. Web. 17 August 2013. http://www.entropica.com
[1] Wechsler, D. and Matarazzo, J.D. (1972) Wechsler’s Measurement and Appraisal of Adult Intelligence. Oxford UP, New York. [2] Gardner, H. (1993) Frames of the Mind: The Theory of Multiple Intelligences. Basic, New York. [3] Sternberg, R.J. (1982) Handbook of Human Intelligence. Cambridge UP, Cambridge Cambridgeshire. [4] Hawkins, J. and Sandra, B. (2004) On Intelligence. Times, New York. [5] Ihara, S. (1993) Information Theory for Continuous Systems. World Scientific, Singapore. [6] Schroeder, D.V. (2000) An Introduction to Thermal Physics. Addison Wesley, San Francisco. [7] Penrose, R. (2011) Cycles of Time: An Extraordinary New View of the Universe. Alfred A. Knopf, New York. [8] Hawking, S.W. (1998) A Brief History of Time. Bantam, New York. [9] Jones, M.T. (2008) Artificial Intelligence: A Systems Approach. Infinity Science, Hingham. [10] Russell, S.J. and Peter, No. (2003) Artificial Intelligence: A Modern Approach. Prentice Hall/Pearson Education, Upper Saddle River. [11] (2013) Download Python. N.p., n.d. Web. 17 August 2013. http://www.python.org/getit [12] Marr, D. and Poggio, T. (1979) A Computational Theory of Human Stereo Vision. Proceedings of the Royal Society B: Biological Sciences, 204, 301-328. http://dx.doi.org/10.1098/rspb.1979.0029 [13] Meyer, D.E. and Kieras, D.E. (1997) A Computational Theory of Executive Cognitive Processes and Multiple-Task Performance: Part I. Basic Mechanisms. Psychological Review, 104, 3-65.
http://dx.doi.org/10.1098/rspb.1979.0029 [14] Wissner-Gross, A. and Freer, C. (2013) Causal Entropic Forces. Physical Review Letters, 110, Article ID: 168702.
http://dx.doi.org/10.1103/PhysRevLett.110.168702 [15] (2013) Entropica. N.p., n.d. Web. 17 August 2013. http://www.entropica.com