Emergent Inference, or How can a program become a self-programming AGI system? Sergio Pissanetzky Self-programming Workshop AGI-11

Overview of Emergent Inference ► 1850 ● Helmholtz discovered Unconscious Inference. ► 2005 ● Motivation: Interest in refactoring. ● Scope: Refactoring is universal. ● Approach: Computational experiments. ► Discoveries: ● Partially ordered sets. ● Emergent inference. ● Emergence in complex dynamical systems. ● EI happens in the brain.

Brain experiments knowledge senses and afferent nerves partially ordered set brain natural structures emergent inference predicted structures compare feedback

a b c d e f g h i Aj AAk AAl Am AAn Ap Aq Ar As a = α * χ b = δ * μ c = α * ψ d = δ * ω e = β * φ f = β * χ g = β * ψ h = α * φ i = δ * ν j = ν + e k = h + i l = a + b m = μ + f n = c + d p = θ + n q = ω + g r = π + l s = ρ + k PROGRAM (SCRAMBLED) CANONICAL MATRIX The first experiment

d c AAn Ap f Am b a AAl Ar e Aj i h AAk As g Aq CANONICAL MATRIX (STRUCTURED) d = δ * ω c = α * ψ n = c + d p = θ + n f = β * χ m = μ + f b = δ * μ a = α * χ l = a + b r = π + l e = β * φ j = ν + e i = δ * ν h = α * φ k = h + i s = ρ + k g = β * ψ q = ω + g REFACTORED PROGRAM The result from the first experiment This process is emergent inference

The importance of this discovery: ● it is a rigorous mathematical solution obtained from first principles, not a phenomenological guess or an engineering compromise. ● it is universal ● it is a side effect of an unrelated process ● it requires no domain-specific knowledge ● it is not man-made ● it is ready for use in computers

Claim Any system has a natural hierarchical structure that can be found by emergent inference. Emergent Inference explains emergence and self-organization in complex dynamical systems. Emergent inference in the brain gives rise to intelligence. Conjectures

Representing systems as partially ordered sets Any system of Mathematics, Physics, Chemistry, Biology, Engineering, CS,... Model, theory, equations. z = f(x, y) Set = {x, y, z} Partial order = {x < z, y < z} A computer program. Parser. CFS Brain model = neural network + reduce energy consumption. C = interconnections  memory F = fire  behavior S = shrink  intelligence, emotions, creativity. Clustering takes place. Iteration forms clusters of clusters. Clusters are neural cliques, cortical columns, cortical modules.

Traditional software development cycle structure PROGRAM BRAIN (human analyst) emergent inference emergent inference emergent inference stream of experience knowledge data

Software Categorization Category Emergent Inference Structures or rules Source of Intelligence Autonomy Appeal Knowledge base Regular program Nfrozenhumansomepracticalconventional Narrow AI Nfrozenhumansomefuturisticconventional HybridY frozen + adaptive human + machine somerevolutionary conventional + posets AGI (future) Yadaptivemachinefullsingularity partially ordered sets

car position sensors stage sensors, actors chess sensors Traditional AI and AGI car driving program stage control program chess playing program car controls stage controls chess controls There is no integration, and no refactoring

car The brain The brain integrates and refactors naturally stage chess senses human brain drive car manage stage play chess

Emergent inference problem of Physics raw image token ring (in C) emergent inference law of Physics image recognition OO program classes, objects interdependent tasks parallel program EI integrates and refactors naturally

We need a principle for intelligence Aeronautical Engineering : lift force identified as the principle of flight. Software engineering ’s: the automation of objects ’s: the automation of refactoring. Artificial intelligence ’s: the automation of integration ’s: the automation of self-programming. Neuroscience. - “the exact way in which the brain enables thought is one of the great mysteries of science.” (Russell-Norvig). - “we are still a long way from understanding how cognitive processes actually work.” (Russell-Norvig). Emergent inference is the principle for intelligence

Conclusions ● Self-programming can not be achieved without AGI. ● AGI can not be achieved by writing programs. ● EI is the principle for intelligence, AGI and self- programming.