Member-only story
Training Machine Learning Models: From Optimization to Scalable Training Systems
← Part 5 — Logistic Regression from Scratch | Part 7 — Decision Trees Explained →
A practical guide to loss functions, gradient descent, learning rates, feature scaling, regularization, logistic regression, softmax, and production-scale ML training.
Machine learning models do not simply “learn” from data.
They solve an optimization problem.
Given a dataset, a model, and an objective function, training is the process of finding parameter values that make the model perform well according to that objective.
That seemingly simple idea connects a large part of classical machine learning:
- Linear Regression
- the Normal Equation
- Gradient Descent
- Stochastic and Mini-batch optimization
- Learning-rate selection
- Feature scaling
- Polynomial Regression
- Bias and variance
- Ridge, Lasso, and Elastic Net
- Early stopping
- Logistic Regression
- Softmax Regression
- Large-scale distributed training










