From: Martin Pitt <martin@piware.de>
Date: Sat, 29 Aug 2020 13:01:24 +0000 (+0200)
Subject: Move forward feeding to sigmoid
X-Git-Url: https://piware.de/gitweb/?a=commitdiff_plain;h=a856d010176366562caf03eaa873bb91f658446e;p=handwriting-recognition.git

Move forward feeding to sigmoid

Let's comare it to reLU later on.
---

diff --git a/train.py b/train.py
index 8a6dc96..366a5a0 100755
--- a/train.py
+++ b/train.py
@@ -46,7 +46,7 @@ for i in range(1, NUM_LAYERS):
     biases.append(rg.normal(scale=10, size=SIZES[i]))
 
 
-def feed_forward(x, transfer=reLU):
+def feed_forward(x, transfer=sigmoid):
     '''Compute all z and output vectors for given input vector'''
 
     a_s = [x]