Error in forward prop

[Nkakon]

In line 28, what is written is:
k0 = X

It should be:
k0 = nonlin(X)

this is so that the weights are effected by the output of the node and not the input, and would also be consistent with the k1 and k2 values used.

[tonyhoo]

Normally, the activation function is not applied on the input layer directly. The input layer will multiply (dot products) by the weights and then apply activation function on the result.