April 2018

Vanishing gradient TensorFlow - accuracy scenarios

The vanishing gradient problem and ReLUs – a TensorFlow investigation

Deep learning is huge in machine learning at the moment, and no wonder – it is making large and important strides in solving problems in computer vision, natural language and reinforcement learning and problems in many other areas. Deep learning neural networks are neural networks which are characterized by many layers – making them deep instead of wide. Deep networks have been… Read More »The vanishing gradient problem and ReLUs – a TensorFlow investigation