Skip to content

GPU-trained feed-forward neural nets from scratch in 200 lines of ๐Ÿ + numpy

Notifications You must be signed in to change notification settings

NickTikhonov/nn

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

26 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

nn

The most barebones nn implementation + GPU-enabled training harness that can be used to train serious models. Using only numpy and pandas.

import nn

n = nn.NN([784,1000,1000,10], Tanh, gpu=True)
opt = nn.Adam(n, X_train, Y_train, X_test, Y_test, batch_size=4096 * 4)
opt.train(epochs=100, lr=0.001, momentum=0.90).

Supports:

  • Feed-forward deep neural nets
  • Sigmoid + Tanh activation
  • Gradient descent + Adam optimisers
  • CPU + GPU training

About

GPU-trained feed-forward neural nets from scratch in 200 lines of ๐Ÿ + numpy

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages