Natural Language Processing
Topic 1 · NLP · ⏱ about 1 h

NLP: Start Here

What natural language processing covers today, the tasks and tools a junior NLP engineer uses, and how this track connects to the LLM topic and its game season.

Show:
In this topic
Beginner

NLP in the age of large language models

Natural language processing (NLP) builds systems that read, understand and generate human language. Large language models (LLMs) now solve many NLP tasks with a prompt, but that has made the fundamentals more important, not less: someone has to decide when a small fine-tuned model is better (cheaper, faster, private, more accurate on a narrow task), how text is tokenised, how outputs are evaluated, and how models are adapted and aligned.

TaskExampleTypical approach today
Text classificationroute a patient message: billing, prescription, urgent…TF-IDF baseline → fine-tuned small encoder (or an LLM with few-shot prompts)
Sequence labelling (NER)find names, medicines and dates to redact or extractfine-tuned encoder with BIO tags
Semantic searchfind policy paragraphs matching a questionsentence embeddings + vector index
Generationsummarise a consultation, draft a replyLLM (prompted, RAG, or fine-tuned), carefully evaluated
Translation, speechinterpreter support, voice notesmultilingual / speech models

Prerequisites: the Transformers and Transfer learning topics, and the core course's LLM topic (prompting, RAG, evaluation), which this track complements.

Beginner

Tools, and how this track is organised

Standard tools: Hugging Face transformers, datasets, tokenizers and evaluate; sentence-transformers for embeddings; spaCy for fast pipelines (tokenising, NER); scikit-learn for baselines; PEFT/TRL for LoRA, instruction tuning and preference training; vLLM or llama.cpp for serving LLMs.

TopicsGame
Text & tokenisation · Embeddings · Classification & sequence labellingN1: The patient-message inbox
Language models, decoding & evaluation · Training and aligning LLMsN2: Summaries clinicians can trust
Try it

Hands-on: Colab notebooks for this track

11: fine-tune DistilBERT to classify messages and to tag entities (NER), against a TF-IDF baseline. 12: decoding strategies, perplexity and ROUGE, then LoRA instruction-tuning of a small language model.

Interactive: this part runs in your browser.

Check yourself

Quiz

1. Why still learn NLP fundamentals when LLMs can do many tasks with a prompt?

2. Finding every medicine name in a message is…

3. Which library provides LoRA and preference-training utilities?

Go deeper

📚 Further reading

Trusted, mostly free sources: official documentation, well-known textbooks and courses. When you want to confirm or go deeper on anything here, start with these.

Ready