Move forward feeding to sigmoid
authorMartin Pitt <martin@piware.de>
Sat, 29 Aug 2020 13:01:24 +0000 (15:01 +0200)
committerMartin Pitt <martin@piware.de>
Sun, 30 Aug 2020 09:40:28 +0000 (11:40 +0200)
Let's comare it to reLU later on.

train.py

index 8a6dc96f2c1d40281d452fc3c894fffb79a73436..366a5a06a2d7b7a9f436228fb4d4b873d0ed5495 100755 (executable)
--- a/train.py
+++ b/train.py
@@ -46,7 +46,7 @@ for i in range(1, NUM_LAYERS):
     biases.append(rg.normal(scale=10, size=SIZES[i]))
 
 
     biases.append(rg.normal(scale=10, size=SIZES[i]))
 
 
-def feed_forward(x, transfer=reLU):
+def feed_forward(x, transfer=sigmoid):
     '''Compute all z and output vectors for given input vector'''
 
     a_s = [x]
     '''Compute all z and output vectors for given input vector'''
 
     a_s = [x]