Machine Learning
Topic 44 · Tools & libraries · ⏱ about 1 h

Tools & Libraries: Start Here

A short index: which package does which job and where it is taught. NumPy, pandas, plotting, SQL and scikit-learn stay in their own topics; this section adds PyTorch, Hugging Face and gradient boosting.

Show:
In this topic
Beginner

The ML engineer's toolbox

This page only points to where things are taught; it does not repeat them. A handful of packages do almost all everyday ML work. You do not need to memorise their APIs: you need to know which tool fits which job, the core pattern of each, and how to read its documentation.

JobPackageTaught in
Arrays and mathsNumPyNumPy: Fast Arrays
Tables: load, clean, join, grouppandaspandas
ChartsMatplotlib, seabornPlotting
Data from databasesSQL (SQLite, PostgreSQL…)SQL for ML
Classical ML: preprocessing, models, evaluationscikit-learnscikit-learn Essentials
Best models for table dataXGBoost, LightGBM (and scikit-learn's HistGradientBoosting)Gradient Boosting Libraries
Deep learningPyTorchPyTorch Essentials, then Deep Learning in Practice and the Deep Learning track
Pretrained models: text, vision, audio, LLMsHugging Face (transformers, datasets, peft)Hugging Face, then the NLP track
Code, versions, environments, teststerminal, git, venv/conda, pytestYour Developer Toolkit

What about TensorFlow/Keras and JAX? PyTorch is now the most common framework in research and in most job adverts. Keras (now multi-backend) and JAX are used in some companies and labs; once you know PyTorch, their concepts (tensors, layers, autograd, optimisers, training loops) transfer directly, so learn them if a job needs them.

Beginner

How to learn any new library quickly

  1. Find the core pattern: scikit-learn is fit / predict; PyTorch is Module + DataLoader + loop; Hugging Face is from_pretrained. Most of the API follows from it.
  2. Run the official quickstart end to end before reading anything else.
  3. Read the docstring of the functions you use: help(f) or f? in Jupyter. Check the defaults: many bugs are surprising defaults.
  4. Pin versions in requirements.txt; APIs change (for example, parameter names in Hugging Face and XGBoost have changed between versions).
  5. Check what the library did: print shapes, look at a few outputs, and compare with a tiny case you can compute by hand.
Check yourself

Quiz

1. Which package would you reach for first to train a model on a table of customer records?

2. You need a pretrained text classifier quickly. Which library?

3. Why pin package versions in a project?

Go deeper

📚 Further reading

Trusted, mostly free sources: official documentation, well-known textbooks and courses. When you want to confirm or go deeper on anything here, start with these.

Ready