---

This note summarises the Youtube Videos published by Josh Starmer (Youtube Account: StatQuest with Josh Starmer). I would like to say a big thank you to him and his super useful videos!

Table of Contents

Decision Trees

• Main Idea
• What If We Have Numeric Data?
• Ranked Data
• Multiple Choice Data
• Feature Selection
• Missing Data
• Regression Trees (1, 2)
• Prune Regression Trees (1, 2)

Random Forests

• Building
• Using
• Evaluating
• Missing Data (1, 2, 3)

AdaBoost

• Concepts
• Building (1, 2, 3)
• Using

Gradient Boost

• Regression Main Ideas
• Regression Details
• Classification Main Ideas
• Classification Details

XGBoost

• XGBoost Trees for Regression
• XGBoost Trees for Classification
• Mathematical Details
• Optimisation