[SOLVED] algorithm game math AI statistic software Bayesian react theory comp4620/8620: Advanced Topics in AI Foundations of Artificial Intelligence

comp4620/8620: Advanced Topics in AI Foundations of Artificial Intelligence
Marcus Hutter
Australian National University Canberra, ACT, 0200, Australia http://www.hutter1.net/
ANU

Foundations of Artificial Intelligence 2 Marcus Hutter
Abstract: Motivation
The dream of creating artificial devices that reach or outperform human intelligence is an old one, however a computationally efficient theory of true intelligence has not been found yet, despite considerable efforts in the last 50 years. Nowadays most research is more modest, focussing on solving more narrow, specific problems, associated with only some aspects of intelligence, like playing chess or natural language translation, either as a goal in itself or as a bottom-up approach. The dual, top down approach, is to find a mathematical (not computational) definition of general intelligence. Note that the AI problem remains non-trivial even when ignoring computational aspects.

Foundations of Artificial Intelligence 3 Marcus Hutter
Abstract: Contents
In this course we will develop such an elegant mathematical parameter-free theory of an optimal reinforcement learning agent embedded in an arbitrary unknown environment that possesses essentially all aspects of rational intelligence. Most of the course is devoted to giving an introduction to the key ingredients of this theory, which are important subjects in their own right: Occams razor; Turing machines; Kolmogorov complexity; probability theory; Solomonoff induction; Bayesian sequence prediction; minimum description length principle; agents; sequential decision theory; adaptive control theory; reinforcement learning; Levin search and extensions.

Foundations of Artificial Intelligence 4 Marcus Hutter
Background and Context
Organizational
Artificial General Intelligence
Natural and Artificial Approaches
On Elegant Theories of
What is (Artificial) Intelligence?
What is Universal Artificial Intelligence? Relevant Research Fields
Relation between ML & RL & (U)AI
Course Highlights

Foundations of Artificial Intelligence 5 Marcus Hutter
Organizational ANU Course COMP4620/8620
Lecturer: Marcus Hutter, Assistant: Sultan Javed Majeed
When: Semester 2, 2017. Lecture/Tutorials/Labs:
Generic timetable: http://timetabling.anu.edu.au/sws2017/ Detailed Schedule: See course homepage
Where: Australian National University
Register with ISIS or Wattle or Admin or Lecturer.
Course is based on: book Universal AI (2005) by M.H.
Literature: See course homepage
Course Homepage: More/all information available at http://cs.anu.edu.au/courses/COMP4620/

Foundations of Artificial Intelligence 6 Marcus Hutter
Artificial General Intelligence
What is (not) the goal of AGI research?
Is: Build general-purpose Super-Intelligences.
Not: Create AI software solving specific problems. Might ignite a technological Singularity.
What is (Artificial) Intelligence?
What are we really doing and aiming at?
Is it to build systems by trial&error, and if they do something we think is smarter than previous systems, call it success?
Is it to try to mimic the behavior of biological organisms?
We need (and have!) theories which
can guide our search for intelligent algorithms.

Foundations of Artificial Intelligence 7 Marcus Hutter
Natural Approaches
copy and improve (human) nature
Biological Approaches to Super-Intelligence
Brain Scan & Simulation Genetic Enhancement
Brain Augmentation
Not the topic of this course

Foundations of Artificial Intelligence 8 Marcus Hutter
Artificial Approaches
Design from first principles. At best inspired by nature.
Artificial Intelligent Systems:
Logic/language based: expert/reasoning/proving/cognitive systems.
Economics inspired:
Cybernetics:
Machine Learning:
Information processing: data compression intelligence.
Separately too limited for AGI, but jointly very powerful.
utility, sequential decisions, game theory. adaptive dynamic control.
reinforcement learning.
Topic of this course: Foundations of artificial approaches to AGI

Foundations of Artificial Intelligence 9 Marcus Hutter
There is an Elegant Theory of
Cellular Automata Iterative maps QED Super-Strings Universal AI
Computing
Chaos and Order
Chemistry
the Universe
Super Intelligence

Foundations of Artificial Intelligence 10 Marcus Hutter
What is (Artificial) Intelligence?
Intelligence can have many faces formal definition difficult
What is AI?
Thinking
Acting
humanly
Cognitive Science
Turing test, Behaviorism
rationally
Laws Thought
Doing the Right Thing
reasoning
creativity
association
generalization
pattern recognition
problem solving
memorization planning
achieving goals learning
optimization
self-preservation
vision
language processing
motor skills
classification
induction deduction
Collection of 70+ Defs of Intelligence
http://www.vetta.org/
definitions-of-intelligence/
Real world is nasty: partially unobservable, uncertain, unknown, non-ergodic, reactive, vast, but luckily structured,

Foundations of Artificial Intelligence 11 Marcus Hutter
What is Universal Artificial Intelligence?
Sequential Decision Theory solves the problem of rational agents in uncertain worlds if the environmental probability distribution is known.
Solomonoffs theory of Universal Induction solves the problem of sequence prediction for unknown prior distribution.
Combining both ideas one arrives at
A Unified View of Artificial Intelligence
==
Decision Theory = Probability + Utility Theory ++
Universal Induction = Ockham + Bayes + Turing
Group project: Implement a Universal Agent able to learn by itself to
play TicTacToe/Pacman/Poker/ www.youtube.com/watch?v=yfsMHtmGDKE

Foundations of Artificial Intelligence 12 Marcus Hutter
Relevant Research Fields
(Universal) Artificial Intelligence has interconnections with (draws from and contributes to) many research fields:
computer science (artificial intelligence, machine learning), engineering (information theory, adaptive control),
economics (rational agents, game theory),
mathematics (statistics, probability),
psychology (behaviorism, motivation, incentives), philosophy (reasoning, induction, knowledge).

Foundations of Artificial Intelligence 13 Marcus Hutter
Relation between ML & RL & (U)AI
Universal Artificial Intelligence
Covers all Reinforcement Learning problem types
Statistical Machine Learning
Mostly i.i.d. data classification, regression, clustering
RL Problems & Algorithms
Stochastic, unknown, non-i.i.d. environments
Artificial Intelligence
Traditionally deterministic, known world / planning problem

Foundations of Artificial Intelligence 14 Marcus Hutter
Course Highlights
Formal definition of (general rational) Intelligence.
Optimal rational agent for arbitrary problems.
Philosophical, mathematical, and computational background.
Some approximations, implementations, and applications. (learning TicTacToe, PacMan, simplified Poker from scratch)
State-of-the-art artificial general intelligence.

Foundations of Artificial Intelligence 15 Marcus Hutter
Table of Contents
1. A SHORT TOUR THROUGH THE COURSE
2. INFORMATION THEORY & KOLMOGOROV COMPLEXITY
3. BAYESIAN PROBABILITY THEORY
4. ALGORITHMIC PROBABILITY & UNIVERSAL INDUCTION
5. MINIMUM DESCRIPTION LENGTH
6. THE UNIVERSAL SIMILARITY METRIC
7. BAYESIAN SEQUENCE PREDICTION
8. UNIVERSAL RATIONAL AGENTS
9. THEORY OF RATIONAL AGENTS
10. APPROXIMATIONS & APPLICATIONS
11. DISCUSSION