The task

Sort 8×8 pixel patterns into 6 types. 300 training patterns in total. Examples without noise:

H-STRIPE
V-STRIPE
DIAGONAL
CHECKER
X-CROSS
FRAME

All network weights

Lighter = higher value. Orange = large gradient on the last step.

Network activations

INPUT (64) HIDDEN (6) OUTPUT (6)

Node brightness = activation. Line strength = weight size.

Try the network

Click cells to draw an 8×8 pattern. The network classifies it as you draw.

Prediction: —
Confidence: —
Hidden layer (6 units)
Output layer (6 classes)
for each batch: gradient = ∂Loss/∂θ θ = θ - α · gradient where: θ = network parameters (weights) α = learning rate (step size)
α = 0.100
6
0.2x
Training stops at this step count. 0 means it runs until you pause it.
Iteration: 0
Loss: 0.000
Accuracy: 0%
Status: Ready