The activation ops provide different types of nonlinearities for use in neural networks. These include smooth nonlinearities, such as sigmoid, tanh, elu, softplus, and softsign. On the other hand, some continuous but not-everywhere-differentiable functions that can be used are relu, relu6, crelu, and relu_x. All activation ops apply component-wise and produce a tensor of the same shape as the input tensor. Now let us see how to use a few commonly used activation functions in TensorFlow syntax.
Activation functions
by Pradeep Pujari, Md. Rezaul Karim, Mohit Sewak
Practical Convolutional Neural Networks
- Title Page
- Copyright and Credits
- Packt Upsell
- Contributors
- Preface
- Deep Neural Networks – Overview
- Introduction to Convolutional Neural Networks
- Build Your First CNN and Performance Optimization
- CNN architectures and drawbacks of DNNs
- Convolution and pooling operations in TensorFlow
- Training a CNN
- Building, training, and evaluating our first CNN
- Dataset description
- Step 1 – Loading the required packages
- Step 2 – Loading the training/test images to generate train/test set
- Step 3- Defining CNN hyperparameters
- Step 4 – Constructing the CNN layers
- Step 5 – Preparing the TensorFlow graph
- Step 6 – Creating a CNN model
- Step 7 – Running the TensorFlow graph to train the CNN model
- Step 8 – Model evaluation
- Dataset description
- Model performance optimization
- Summary
- Popular CNN Model Architectures
- Transfer Learning
- Autoencoders for CNN
- Object Detection and Instance Segmentation with CNN
- The differences between object detection and image classification
- Traditional, nonCNN approaches to object detection
- R-CNN – Regions with CNN features
- Fast R-CNN – fast region-based CNN
- Faster R-CNN – faster region proposal network-based CNN
- Mask R-CNN – Instance segmentation with CNN
- Instance segmentation in code
- References
- Summary
- GAN: Generating New Images with CNN
- Attention Mechanism for CNN and Visual Models
- Other Books You May Enjoy
Activation functions
-
No Comment
..................Content has been hidden....................
You can't read the all page of ebook, please click here login for view all page.