Neural Network Basics

• Softmax function approximates probability distribution by normalising data to 0-1 range within a collection. The sum of probabiliy within the collection is 1.
  
  See usage of softmax in classification at softmax-regression-related-logistic-regression.