Course prerequisites
You need basic Python, a computer that can run Docker, and some comfort with a terminal. You do not need to know Kafka, Docker or Java. This page lists exactly what to have ready, so nothing surprises you once you start.
What you should already know
Python basics. The scripts in this course are short, but you should be able to read and edit them.
- Functions, loops,
ifstatements andtry/except - Dictionaries and lists
- Importing a library and installing one with
pip - Running a script from the terminal
- Reading and writing JSON with
json.dumps()andjson.loads()
A terminal. You will type commands, move between folders and run scripts. In several labs you will have three or four terminal windows open at once, so being comfortable switching between them helps.
Helpful, but not required. A general idea of what a database or an API does. A little familiarity with threads or callbacks also helps in the producer and consumer sections, but each is explained when it appears.
What you do not need
- No Kafka experience
- No Docker experience. The first section walks you through installing and using it
- No Java or Scala
- No cloud account. Everything runs on your own machine
- No Linux administration or networking background
Your computer
| Requirement | Details |
|---|---|
| Operating system | Windows or macOS. The setup lessons give steps for both |
| Memory | At least 8 GB of RAM. 16 GB is better, because three Kafka brokers run at the same time |
| Disk space | A few GB free for Docker images and Kafka data |
| Permissions | You can install software on this machine. On Windows, you need administrator access for the one-time WSL2 setup |
| Internet | Needed for the one-time downloads. The labs themselves run locally |
Linux users can follow the Docker and Python steps, but the setup lessons do not cover installing them on Linux.
Software you will install
You install all of this during the setup lessons in the first section. You do not need to prepare anything in advance.
- WSL2 (Windows only), which Docker uses in the background
- Docker Desktop, which runs the Kafka cluster
- Python 3 and the confluent-kafka library
- A code editor of your choice. Any editor that can open and run Python files works
- SQLite, which the capstone project uses. It comes built into Python, so there is nothing extra to install
Docker Desktop is free for personal and educational use. If you plan to use it at work, check Docker's current license terms for your company size.
Time to plan for
- Setup: about 30 to 40 minutes, done once, at the start of the course
- Capstone project: about 3 to 4 hours, on top of the video time. You can split it over two days. It comes with a starter kit that you download from the last section
- Labs with waiting: one retention lab asks you to wait about five minutes, and the idempotent producer experiment runs for about 17 minutes while you restart brokers. You can do other things while they run
A quick self-check
Read this snippet. If you can say what it prints, you have the Python you need.
pythonimport json events = [ {"user": "a", "type": "click"}, {"user": "b", "type": "view"}, ] for event in events: text = json.dumps(event) print(text) print(json.loads(text)["user"])
It prints each event as a JSON string, then the user name from that same event, so four lines in total. If that is clear, you are ready. If not, a short Python tutorial on dictionaries, loops and JSON is all the preparation you need.
Quick recap
- You need basic Python, a working terminal and a Windows or macOS machine with at least 8 GB of RAM.
- No prior Kafka, Docker or Java experience is needed.
- The setup lessons install WSL2 (Windows only), Docker Desktop, Python and the confluent-kafka library.
- Setup takes about 30 to 40 minutes. A few labs include waiting time.
- The capstone project at the end takes about 3 to 4 hours.
- When you are ready, start with the first section.