This commit is contained in:
novak_99 2022-02-05 00:45:23 -08:00
parent d483662ce2
commit bee83e0a39
2 changed files with 4 additions and 0 deletions

View File

@ -558,6 +558,8 @@ void ANN::Adam(double learning_rate, int max_epoch, int mini_batch_size, double
}
}
// https://www.youtube.com/watch?v=4qDt4QUl4zE
// The above video detailed the necessary components of the line search algorithm.
double ANN::backTrackingLineSearch(double beta, double learningRate){
LinAlg alg;
forwardPass();

View File

@ -136,6 +136,8 @@ The result will be the model's predictions for the entire dataset.
- Epoch Based
- Step Based
- Exponential
7. Learning Rate Finders
- Backtracking Line Search Optimization
3. ***Prebuilt Neural Networks***
1. Multilayer Peceptron
2. Autoencoder