Deriving Taylor Series for Deep Learning Activation Functions

We derive Taylor Polynomials for the Hyperbolic Tangent, Sigmoid, and Exponential Linear Unit Deep Learning Activation Functions in order to use them in the video bellow to improve training performance and decrease training time: [video coming out tommorow] TIMESTAMPS: 0:00 What are Activation Functions 0:15 What We’re Trying to Do 1:16 Hyperbolic Tangent 2:00 Exponential Linear Unit 3:42 Sigmoid 6:40 Next Steps