Machine Learning from scratch

In this repository we have implemented most popular Machine Learning algorithm from scratch. The math of any particular algorithm is also described.

Mathematics of ML

Linear algebra

Probability

Calculus

Machine Learning

Bayesian

• Gaussian Discriminant Analysis(GDA)
• Naive Bayes

Clustering

• Hierarchical Clustering
• K means

Dimensionality reduction

• Linear Discriminant Analysis(LDA)
• Principal Component Analysis
• T-SNE

Ensemble

• Bagging
  • Random Forest
• Boosting
  • AdaBoost

Instance based

• K Nearest Neighbor(KNN)
• Support Vector Machine(SVM)

Neural Network

• Artificial Neural Network(ANN)
  • Perceptron
  • Multi layer perceptron
• Convolutional Neural Network(CNN)
• Recurrent Neural Network(RNN)
• Auto Encoder
• Generative Adversarial Network(GAN)
• Transformer

Regression

• Linear Regression
• Logistic Regression

Tree

• Decision Tree

Others

• Feature Selection
• Optimization
• Performance Measurement
  • Precision, Recall, ROC, AUC, Confusion Matrix
• Regularization
• Terminology

Other ML resources

• 600 Data Science question
• 100 ML questions