Deep Learning

Multilayer Perceptron

We have seen what can be learned by the perceptron algorithm — namely, linear decision boundaries for binary classification problems.

It may also be of interest to know that the perceptron algorithm can also be used for regression with the simple modification of not applying an activation function (i.e. the sigmoid). I refer the interested reader to open another tab.

We begin with the punchline:

XOR

/projects/ml/dl/mlp/
xor.png
Not linearly separable in \(\mathbb{R}^2\)

Now clearly, taking a ruler, your finger or positioning any straight-lined object on the above figure will not enable you to separate the blue (true) from the red (false) circles. This was also one of Marvin Minsky's arguments against further development of the Perceptron in 1963. However, with the benefit of hindsight, we shall not retire so quickly, instead we add another layer of the neurons:

Read more >

Perceptron

This is tomorrow's work, but for now I just want to test some codeblocks:

pwd
pwd
.
├── LICENSE
├── README.md
├── archetypes
├── assets
├── backup
├── config
├── content
├── data
├── eslint.config.mjs
├── go.mod
├── go.sum
├── hugo-mod-json-resume
├── hugo-theme-gruvbox-inkscape.svg
├── hugo-theme-gruvbox.svg
├── hugo_stats.json
├── i18n
├── layouts
├── node_modules
├── package-lock.json
├── package.hugo.json
├── package.json
├── postcss.config.js
├── public
├── resources
├── static
└── theme.toml

14 directories, 13 files
./
├── _index.org
└── _index.org~
1 directory, 2 files
  #include <stdio.h>

  int main() {
    char a[5] = "hello";
    printf("%s world!\n", a);
    return 0;
  }
  
    cd /usr/local/etc
    cp php.ini php.ini.bak
    vi php.ini
  
  
    pwd
    /usr/home/chris/bin
    ls -la
    total 2
    drwxr-xr-x   2 chris  chris     11 Jan 10 16:48 .
    drwxr--r-x  45 chris  chris     92 Feb 14 11:10 ..
    -rwxr-xr-x   1 chris  chris    444 Aug 25  2013 backup
    -rwxr-xr-x   1 chris  chris    642 Jan 17 14:42 deploy
  
  
    Hello,
    World!

    Foo
    Bar