机器学习相关

激活函数

Fundamentals of Deep Learning – Activation Functions and When to Use Them?

Dishashree26 Gupta — January 30, 2020

Deep Learning Intermediate Python Technique

Overview

Activation function is one of the building blocks on Neural Network

Learn about the different activation functions in deep learning

Code activation functions in python and visualize results in live coding window

This article was originally published in October 2017 and updated in January 2020 with three new activation functions and python codes.

总结：先用 ReLU （有 dead neuron 的时候 用 leaky ReLU）分类用 sigmoid

https://www.analyticsvidhya.com/blog/2020/01/fundamentals-deep-learning-activation-functions-when-to-use-them/