The following list is a partial education plan for students interested in the research of Artificial General Intelligence. It includes materials for roughly 25 one-semester courses.
Notes:
The opinions expressed here are highly personal. Not only are the topics and reading materials selected according to my opinion, but also there are my own works included wherever relevant (they are distinguished from the others using square brackets).
This list is not intended to cover all relevant topics, but what I think as the most important. Some crucial decisions are on what NOT to include, as well as on how to allocate time among the topics. Therefore, adding new topics into the list is not always a good idea.
Introductory Readings
The following materials can be read by anyone with a high-school education.
Computing machinery and intelligence, Alan M. Turing
Gödel, Escher, Bach: An Eternal Golden Braid, Douglas R. Hofstadter
A. Undergraduate-level Coursework
Each of the following topic can be covered by a one-semester undergraduate course, with the recommended textbook.
Discrete Mathematics
Discrete Mathematics and Its Applications, 7/E, Kenneth Rosen
Probability and Statistics
A Modern Introduction to Probability and Statistics, 2/E, Dekking et al.
Computer Programming
Java How to Program, 7/E, Deitel & Associates
Data Structure and Algorithms
Data Structures and Algorithm Analysis in Java, 2/E, Mark Allen Weiss
Operating System
Operating System Concepts, 9/E, Avi Silberschatz et al.
Cognitive Psychology
Cognitive Psychology, 4/E, Douglas Medin et al.
Cognitive Neuroscience
Cognition, Brain, and Consciousness, Bernard J. Baars, Nicole M. Gage
Language and Cognition
Language in Mind: An Introduction to Psycholinguistics, 1/E, Julie Sedivy
Theory of Knowledge
Epistemology, Richard Feldman
Artificial Intelligence
Artificial Intelligence: Structures and Strategies for Complex Problem Solving, 6/E, George F. Luger
B. Graduate-level Study
Each of the following topic can be covered by a one-semester graduate course (or upper-division undergraduate course), with the recommended textbook.
Theoretical Computer Science
Introduction to Automata Theory, Languages, and Computation, 3/E, John E. Hopcroft, Rajeev Motwani, Jeffrey D. Ullman
Reasoning Under Uncertainty
Readings in Uncertain Reasoning, Glenn Shafer, Judea Pearl
Machine Learning
Machine Learning, Peter Flach
Philosophical Logic
Philosophy of Logics, Susan Haack
Decision Theory
Rationality in Action: Contemporary Approaches, Paul K. Moser
Categorization
Concepts: Core Readings, Eric Margolis, Stephen Laurence
Perception and Action
Sensorimotor Foundations of Higher Cognition, Patrick Haggard, Yves Rossetti, Mitsuo Kawato
Memory
Human Memory: Theory And Practice, A.D. Baddeley
Developmental Psychology
Theories of Developmental Psychology, 4/E, Patricia A. Miller
Philosophy of Science
Philosophy of Science: The Central Issues, 2/E, J. A. Cover, Martin Curd
C. Readings on Advanced Topics
Each of the following topic can be covered in a graduate seminar for roughly a month, using the listed materials.
Research goal(s) of AI
From here to Human-Level AI, John McCarthy
Human-level artificial intelligence? Be serious!, Nils J. Nilsson
(AA)AI: more than the sum of its parts, Ronald J. Brachman
Universal Intelligence: A Definition of Machine Intelligence, Shane Legg, Marcus Hutter
[What Do You Mean by "AI"?, Pei Wang]
Limitation of AI
Minds, machines and Gödel, J. R. Lucas
What Computers Can't Do, Hubert L. Dreyfus
Minds, Brains, and Programs, John R. Searle
The Emperor's New Mind, Roger Penrose
[Three Fundamental Misconceptions of Artificial Intelligence, Pei Wang]
Symbolic vs. connectionist AI
Computer Science as Empirical Inquiry: Symbols and Search, Allen Newell, Herbert A. Simon
Waking Up From the Boolean Dream, or, Subcognition as Computation, Douglas Hofstadter
On the proper treatment of connectionism, Paul Smolensky
Connectionism and Cognitive Architecture: a Critical Analysis, Jerry A. Fodor, Zenon W. Pylyshyn
[Artificial General Intelligence and Classical Neural Network, Pei Wang]
Deep learning
Deep Learning, Yann LeCun, Yoshua Bengio, Geoffrey Hinton
Mastering the game of Go with deep neural networks and tree search, David Silver et al.
Deep Learning in Neural Networks: An Overview, Juergen Schmidhuber
[Different Conceptions of Learning: Function Approximation vs. Self-Organization, Pei Wang, Xiang Li]
Non-classical computation
Thinking may be more than computing, Peter Kugel
Approximate Reasoning Using Anytime Algorithms, Shlomo Zilberstein
Turing's Ideas and Models of Computation, Eugene Eberbach, Dina Goldin, Peter Wegner
[Case-by-case Problem Solving, Pei Wang]
Credit assignment and resource allocation
Principles of Meta-Reasoning, Stuart Russell, Eric Wefald
Manifesto for an Evolutionary Economics of Intelligence, Eric B. Baum
Properties of the Bucket Brigade, John Holland
The Parallel Terraced Scan: An Optimization For An Agent-Oriented Architecture, John Rehling, Douglas Hostadter
[Problem-Solving under Insufficient Resources, Pei Wang]
Term logics
Term logic, Wikipedia
An Invitation to Formal Reasoning: The Logic of Terms, Frederic Sommers, George Englebretsen
[Unified Inference in Extended Syllogism, Pei Wang]
Uncertain probabilities
Towards a unified theory of imprecise probability, Peter Walley
Probabilistic Logic Networks, Ben Goertzel et al.
[Confidence as Higher-Order Uncertainty, Pei Wang]
Non-Tarskian semantics
Holism, Conceptual-Role Semantics, and Syntactic Semantics, William J. Rapaport
Logic without Model Theory, Robert Kowalski
Contentful Mental States for Robot Baby, Paul R. Cohen et al.
Procedural semantics, Philip N. Johnson-Laird
[Experience-Grounded Semantics: A theory for intelligent systems, Pei Wang]
Embodied and situated cognition
Intelligence without representation, Rodney A. Brooks
How the Body Shapes the Way We Think: A New View of Intelligence, Rolf Pfeifer, Josh C. Bongard
The symbol grounding problem, Stevan Harnad
Perceptual symbol systems, Lawrence W. Barsalou
The Ecological Approach to Visual Perception, James J. Gibson
[Embodiment: Does a laptop have a body?, Pei Wang]
Analogy and metaphor
The Analogical Mind, Dedre Gentner, Keith J. Holyoak, Boicho K. Kokinov
Fluid Concepts and Creative Analogies, Douglas Hofstadter, FARG
Metaphors We Live By, George Lakoff, Mark Johnson
Case-Based Reasoning: Experiences, Lessons, & Future Directions, David B. Leake
[Analogy in a general-purpose reasoning system, Pei Wang]
Animal cognition
The Principles of Learning and Behavior, Michael Domjan
Animal Minds: Beyond Cognition to Consciousness, Donald R. Griffin
The Thinking Ape: Evolutionary Origins of Intelligence, Richard Byrne
[Issues in Temporal and Causal Inference, Pei Wang]
Reasoning about change
Robot's Dilemma Revisited: The Frame Problem in Artificial Intelligence, Zenon W. Pylyshyn
Some Philosophical Problems from the Standpoint of Artificial Intelligence, John McCarthy, Patrick J. Hayes
Reasoning about plans, James F. Allen et al.
Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto
[Assumptions of decision-making models in AGI, Pei Wang]
Motivation and emotion
Human Motivation, David C. McClelland
The Functional Autonomy of Motives, Gordon W. Allport
The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind, Marvin Minsky
Who Needs Emotions?: The Brain Meets the Robot, Jean-Marc Fellous, Michael A. Arbib
[Motivation Management in AGI Systems, Pei Wang]
Cognitive linguistics
Cognitive Linguistics: Basic Readings, Dirk Geeraerts
Language, Thought, and Logic, John M. Ellis
[Natural Language Processing by Reasoning and Learning, Pei Wang]
Self
I Am a Strange Loop, Douglas R. Hofstadter
A Cognitive Theory of Consciousness, Bernard Baars
Metacognition in computation: A selected research review, Michael T. Cox
Cognitive architecture
Unified Theories of Cognition, Allen Newell
An Integrated Theory of the Mind, John R. Anderson, et al.
Robotics
An Introduction to AI Robotics, Robin R. Murphy
Prospects for Human Level Intelligence for Humanoid Robots, Rodney A. Brooks
Autonomous Mental Development by Robots and Animals, Juyang Weng et al.
Agent and multi-agent system
The Society of Mind, Marvin Minsky
Agent Technology: Foundations, Applications, and Markets, Nicholas R. Jennings, Michael J. Wooldridge
Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence, Gerhard Weiss
Contemporary AGI research
Conferences
Collections: 2007 , 2012
Journal: JAGI
[Rigid Flexibility: The Logic of Intelligence, Pei Wang]
Suggested Education for Future AGI Researchers
Pei Wang
The following list is a partial education plan for students interested in the research of Artificial General Intelligence. It includes materials for roughly 25 one-semester courses.
Notes:
The opinions expressed here are highly personal. Not only are the topics and reading materials selected according to my opinion, but also there are my own works included wherever relevant (they are distinguished from the others using square brackets).
This list is not intended to cover all relevant topics, but what I think as the most important. Some crucial decisions are on what NOT to include, as well as on how to allocate time among the topics. Therefore, adding new topics into the list is not always a good idea.
Introductory Readings
The following materials can be read by anyone with a high-school education.
Computing machinery and intelligence, Alan M. Turing
Gödel, Escher, Bach: An Eternal Golden Braid, Douglas R. Hofstadter
A. Undergraduate-level Coursework
Each of the following topic can be covered by a one-semester undergraduate course, with the recommended textbook.
Discrete Mathematics
Discrete Mathematics and Its Applications, 7/E, Kenneth Rosen
Probability and Statistics
A Modern Introduction to Probability and Statistics, 2/E, Dekking et al.
Computer Programming
Java How to Program, 7/E, Deitel & Associates
Data Structure and Algorithms
Data Structures and Algorithm Analysis in Java, 2/E, Mark Allen Weiss
Operating System
Operating System Concepts, 9/E, Avi Silberschatz et al.
Cognitive Psychology
Cognitive Psychology, 4/E, Douglas Medin et al.
Cognitive Neuroscience
Cognition, Brain, and Consciousness, Bernard J. Baars, Nicole M. Gage
Language and Cognition
Language in Mind: An Introduction to Psycholinguistics, 1/E, Julie Sedivy
Theory of Knowledge
Epistemology, Richard Feldman
Artificial Intelligence
Artificial Intelligence: Structures and Strategies for Complex Problem Solving, 6/E, George F. Luger
B. Graduate-level Study
Each of the following topic can be covered by a one-semester graduate course (or upper-division undergraduate course), with the recommended textbook.
Theoretical Computer Science
Introduction to Automata Theory, Languages, and Computation, 3/E, John E. Hopcroft, Rajeev Motwani, Jeffrey D. Ullman
Reasoning Under Uncertainty
Readings in Uncertain Reasoning, Glenn Shafer, Judea Pearl
Machine Learning
Machine Learning, Peter Flach
Philosophical Logic
Philosophy of Logics, Susan Haack
Decision Theory
Rationality in Action: Contemporary Approaches, Paul K. Moser
Categorization
Concepts: Core Readings, Eric Margolis, Stephen Laurence
Perception and Action
Sensorimotor Foundations of Higher Cognition, Patrick Haggard, Yves Rossetti, Mitsuo Kawato
Memory
Human Memory: Theory And Practice, A.D. Baddeley
Developmental Psychology
Theories of Developmental Psychology, 4/E, Patricia A. Miller
Philosophy of Science
Philosophy of Science: The Central Issues, 2/E, J. A. Cover, Martin Curd
C. Readings on Advanced Topics
Each of the following topic can be covered in a graduate seminar for roughly a month, using the listed materials.
Research goal(s) of AI
From here to Human-Level AI, John McCarthy
Human-level artificial intelligence? Be serious!, Nils J. Nilsson
(AA)AI: more than the sum of its parts, Ronald J. Brachman
Universal Intelligence: A Definition of Machine Intelligence, Shane Legg, Marcus Hutter
[What Do You Mean by "AI"?, Pei Wang]
Limitation of AI
Minds, machines and Gödel, J. R. Lucas
What Computers Can't Do, Hubert L. Dreyfus
Minds, Brains, and Programs, John R. Searle
The Emperor's New Mind, Roger Penrose
[Three Fundamental Misconceptions of Artificial Intelligence, Pei Wang]
Symbolic vs. connectionist AI
Computer Science as Empirical Inquiry: Symbols and Search, Allen Newell, Herbert A. Simon
Waking Up From the Boolean Dream, or, Subcognition as Computation, Douglas Hofstadter
On the proper treatment of connectionism, Paul Smolensky
Connectionism and Cognitive Architecture: a Critical Analysis, Jerry A. Fodor, Zenon W. Pylyshyn
[Artificial General Intelligence and Classical Neural Network, Pei Wang]
Deep learning
Deep Learning, Yann LeCun, Yoshua Bengio, Geoffrey Hinton
Mastering the game of Go with deep neural networks and tree search, David Silver et al.
Deep Learning in Neural Networks: An Overview, Juergen Schmidhuber
[Different Conceptions of Learning: Function Approximation vs. Self-Organization, Pei Wang, Xiang Li]
Non-classical computation
Thinking may be more than computing, Peter Kugel
Approximate Reasoning Using Anytime Algorithms, Shlomo Zilberstein
Turing's Ideas and Models of Computation, Eugene Eberbach, Dina Goldin, Peter Wegner
[Case-by-case Problem Solving, Pei Wang]
Credit assignment and resource allocation
Principles of Meta-Reasoning, Stuart Russell, Eric Wefald
Manifesto for an Evolutionary Economics of Intelligence, Eric B. Baum
Properties of the Bucket Brigade, John Holland
The Parallel Terraced Scan: An Optimization For An Agent-Oriented Architecture, John Rehling, Douglas Hostadter
[Problem-Solving under Insufficient Resources, Pei Wang]
Term logics
Term logic, Wikipedia
An Invitation to Formal Reasoning: The Logic of Terms, Frederic Sommers, George Englebretsen
[Unified Inference in Extended Syllogism, Pei Wang]
Uncertain probabilities
Towards a unified theory of imprecise probability, Peter Walley
Probabilistic Logic Networks, Ben Goertzel et al.
[Confidence as Higher-Order Uncertainty, Pei Wang]
Non-Tarskian semantics
Holism, Conceptual-Role Semantics, and Syntactic Semantics, William J. Rapaport
Logic without Model Theory, Robert Kowalski
Contentful Mental States for Robot Baby, Paul R. Cohen et al.
Procedural semantics, Philip N. Johnson-Laird
[Experience-Grounded Semantics: A theory for intelligent systems, Pei Wang]
Embodied and situated cognition
Intelligence without representation, Rodney A. Brooks
How the Body Shapes the Way We Think: A New View of Intelligence, Rolf Pfeifer, Josh C. Bongard
The symbol grounding problem, Stevan Harnad
Perceptual symbol systems, Lawrence W. Barsalou
The Ecological Approach to Visual Perception, James J. Gibson
[Embodiment: Does a laptop have a body?, Pei Wang]
Analogy and metaphor
The Analogical Mind, Dedre Gentner, Keith J. Holyoak, Boicho K. Kokinov
Fluid Concepts and Creative Analogies, Douglas Hofstadter, FARG
Metaphors We Live By, George Lakoff, Mark Johnson
Case-Based Reasoning: Experiences, Lessons, & Future Directions, David B. Leake
[Analogy in a general-purpose reasoning system, Pei Wang]
Animal cognition
The Principles of Learning and Behavior, Michael Domjan
Animal Minds: Beyond Cognition to Consciousness, Donald R. Griffin
The Thinking Ape: Evolutionary Origins of Intelligence, Richard Byrne
[Issues in Temporal and Causal Inference, Pei Wang]
Reasoning about change
Robot's Dilemma Revisited: The Frame Problem in Artificial Intelligence, Zenon W. Pylyshyn
Some Philosophical Problems from the Standpoint of Artificial Intelligence, John McCarthy, Patrick J. Hayes
Reasoning about plans, James F. Allen et al.
Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto
[Assumptions of decision-making models in AGI, Pei Wang]
Motivation and emotion
Human Motivation, David C. McClelland
The Functional Autonomy of Motives, Gordon W. Allport
The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind, Marvin Minsky
Who Needs Emotions?: The Brain Meets the Robot, Jean-Marc Fellous, Michael A. Arbib
[Motivation Management in AGI Systems, Pei Wang]
Cognitive linguistics
Cognitive Linguistics: Basic Readings, Dirk Geeraerts
Language, Thought, and Logic, John M. Ellis
[Natural Language Processing by Reasoning and Learning, Pei Wang]
Self
I Am a Strange Loop, Douglas R. Hofstadter
A Cognitive Theory of Consciousness, Bernard Baars
Metacognition in computation: A selected research review, Michael T. Cox
Cognitive architecture
Unified Theories of Cognition, Allen Newell
An Integrated Theory of the Mind, John R. Anderson, et al.
Robotics
An Introduction to AI Robotics, Robin R. Murphy
Prospects for Human Level Intelligence for Humanoid Robots, Rodney A. Brooks
Autonomous Mental Development by Robots and Animals, Juyang Weng et al.
Agent and multi-agent system
The Society of Mind, Marvin Minsky
Agent Technology: Foundations, Applications, and Markets, Nicholas R. Jennings, Michael J. Wooldridge
Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence, Gerhard Weiss
Contemporary AGI research
Conferences
Collections: 2007 , 2012
Journal: JAGI
[Rigid Flexibility: The Logic of Intelligence, Pei Wang]