Blog – page 10

Type

Experiment 24General 30Reading List 16Theory 55

Topics

CLA 13Reinforcement Learning 13HTM 11Hierarchical Generative Models 10Sparse Distributed Representations 10Neocortex 9Deep Learning 8Cortical Learning Algorithm 7Predictive Coding 7columns 6Hippocampus 6Temporal Pooling 6Thalamocortical 6unsupervised learning 6hierarchy 5neurobiology 5pyramidal cell 5

  1. TP 3/3: Proposed Temporal Pooler

    by David Rawlinson and Gideon Kowadlo A Temporal Pooler ProposalWe will describe a Temporal Pooler design below. We have tested this design and it gives satisfactory output given the criteria and expectations described below and in the previous articles in this series (post #1, post #2). It is also relatively simple. You could imagine this…

  2. TP 2/3: Jeff’s new Temporal Pooler

    By David Rawlinson and Gideon Kowadlo Jeff’s new Temporal Pooler This is article 2 in a 3 part series about Temporal Pooling (TP) in MPF/CLA-like algorithms. You can read part 1 here. For the rest of this article we will assume you’ve read part 1. This article is about the new TP proposed by Jeff Hawkins. The…

  3. Thalamocortical architecture

    by Gideon Kowadlo and David Rawlinson Introduction One of the keys to understanding the neocortex as a whole, and the emergence of intelligence, is to understand how the cortical hierarchical levels interconnect. This includes: the physical connections, the meaning of the signals being transmitted, and possibly also the way the signal is encoded. Physical connections: Physical…

  4. Constraints on intelligence

    by Gideon Kowadlo and David Rawlinson Introduction This article contains some musings on the factors that limit the increase of intelligence as a species. We speculate that ultimately, our level of intelligence is limited by at least two factors, and possibly a third: our own cultural development, physical constraints, and an intelligence threshold. We’ll now…

  5. A notation for intracortical neural connections

    by Gideon Kowadlo and David Rawlinson In a previous post (section ‘Regions’), we discussed the distinction between cortical layers and levels. The literature often describes connections between cortical layers in one level to cortical layers in another level. We are not aware of a written convention for this purpose and propose one here. The basic form describes…

  6. TP 1/3: Temporal Pooler background

    by David Rawlinson and Gideon Kowadlo Article Series This is the first of 3 articles about temporal pooler design for Numenta’s Cortical Learning Algorithm (CLA) and related methods (e.g. HTM/MPF). It has limited relevance to Deep Belief Networks. This first part will describe some of the considerations, objectives and constraints on temporal pooler design. We…

  7. Architecture of the Memory Prediction Framework / Cortical Learning Algorithm / Hierarchical Temporal Memory

    by David Rawlinson and Gideon Kowadlo Introduction The Memory Prediction Framework (MPF) is a general description of a class of algorithms. Numenta’s Cortical Learning Algorithm (CLA) is a specific instance of the framework. Numenta’s Hierarchical Temporal Memory (HTM) was an earlier instance of the framework. HTM and CLA adopt different internal representations so it is…

  8. Introduction

    by David Rawlinson and Gideon Kowadlo The Blog This blog will be written by several people. Other contributors are welcome – send us an email to introduce yourself! The content will be a series of short articles about a set of common architectures for artificial general intelligence (AGI). Specifically, we will look at the…