From 194396181d82fb7b006c51668000b434d37c7668 Mon Sep 17 00:00:00 2001 From: marc <78002988+novak-99@users.noreply.github.com> Date: Thu, 27 May 2021 19:53:57 -0700 Subject: [PATCH] Update README.md --- README.md | 33 ++++++++++++++++++++++++++++++++- 1 file changed, 32 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index df18a26..36f6871 100644 --- a/README.md +++ b/README.md @@ -16,7 +16,28 @@ Machine learning is a vast and exiciting discipline, garnering attention from sp 5. Probit Regression 6. CLogLog Regression 2. ***Deep, Dynamically Size Neural Networks*** - 1. Possible Loss Functions + 1. Possible Activation Functions + - Linear + - Sigmoid + - Swish + - Softplus + - CLogLog + - Gaussian CDF + - GELU + - Unit Step + - Sinh + - Cosh + - Tanh + - Csch + - Sech + - Coth + - Arsinh + - Arcosh + - Artanh + - Arcsch + - Arsech + - Arcoth + 2. Possible Loss Functions - MSE - RMSE - MAE @@ -24,3 +45,13 @@ Machine learning is a vast and exiciting discipline, garnering attention from sp - Log Loss - Cross Entropy - Hinge Loss + 3. Possible Regularization Methods + - Lasso + - Ridge + - ElasticNet + 4. Possible Weight Initialization Methods + - Uniform + - Xavier Normal + - Xavier Uniform + - He Normal + - He Uniform