Menu

1 / 2

I Built My Own Hands-on AI Tutorial – Chapter 1: Regression (From Scratch + XGBoost)

DEV Community·zkaria gamal·6 months ago
#kIpiATyI
Reading 0:00
15s threshold

A few weeks ago, I revisited my old AI/ML projects.

As I looked through the code, I felt something was missing. I was using models like RandomForestRegressor and XGBRegressor , getting decent results… but I didn’t feel I truly understood what was happening under the hood.

So I made a decision:

Instead of consuming more tutorials, I would build my own comprehensive Hands-on AI Tutorial — first for myself, and then for the community.

Today, I’m happy to announce that Chapter 1: Regression is complete ! 🎉

What’s Inside Chapter 1

I implemented and compared 5 different regression techniques on real-world datasets:

Linear Regression — Implemented from scratch using the Normal Equation (NumPy only)

Decision Tree Regression

Random Forest Regression

XGBoost Regression — This one consistently delivered impressive performance

Support Vector Regression (SVR) with linear, RBF, and polynomial kernels

For every algorithm, I did the following:

Built a from-scratch version (where applicable)

Compared it with…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.