Gianluca Turcatel
Ordinary Least Square: Closed Form Solution & Gradient Descent
The Jupyter Notebook for this article can be found HERE . Ordinary Least Squares (OLS) is a widely used method for estimating the...
top of page
Search
Gianluca Turcatel
Jan 15, 20224 min read
Simulated Annealing
Introduction Simulated annealing is a well-established metaheuristic, physics-based method that seeks the parameters of a model that...
2880
Gianluca Turcatel
Jan 11, 20228 min read
Simple and Steepest Ascent Hill Climbing
Introduction Hill climbing is one of the simplest metaheuristic optimization methods that, given a state space and an objective function...
1,3030
Gianluca Turcatel
Jan 9, 20223 min read
Python Conditionals
Conditionals, as the name suggests, allow the conditional execution of a statement or series of statements based on the values of a...
160
Gianluca Turcatel
Jan 5, 20226 min read
K-Means Clustering From Scratch
Introduction K-Means clustering is an unsupervised machine learning algorithm that seeks to group alike data points together. It aims to...
3340
Gianluca Turcatel
Jan 2, 20225 min read
Particle Swarm Optimization
Introduction Particle swarm optimization (PSO) is a very well establish computational method that optimizes a problem by iteratively...
1890
Gianluca Turcatel
Dec 30, 20214 min read
Logistic Regression From Scratch
Logistic regression is among the most famous classification algorithm. It is probably the first classifier that Data Scientists employ to...
1930
Gianluca Turcatel
Dec 27, 20214 min read
SVM From Scratch
Introduction In this article I will walk you through every detail of the linear SVM classifier, from theory to implementation. The...
6740
Gianluca Turcatel
Dec 27, 20212 min read
SVM Margin Formula Derivation
When introduced to the SVM algorithm, we all came across the formula for the width of the margin: where w is the vector identifying the...
2,8500
Gianluca Turcatel
Dec 24, 20212 min read
Why Gradient Descent Works
Gradient descent is very well known optimization tool to estimate an algorithm's parameters minimizing the loss function. Often we don't...
2640
Gianluca Turcatel
Dec 23, 20211 min read
Derivation of the Binary Cross Entropy Loss Gradient
The binary cross entropy loss function is the preferred loss function in binary classification tasks, and is utilized to estimate the...
18,3980
Gianluca Turcatel
Dec 19, 20212 min read
OLS Formula Derivation
OLS is most famous algorithm that estimates the parameters of a linear regression model. OLS minimizes the following loss function: In...
2130
Gianluca Turcatel
Dec 13, 20213 min read
Linear Regression: Linear Regression Equation & OLS
Linear regression is one of the oldest algorithm in machine learning. It is an approach for modelling the relationship between a variable...
880
bottom of page