Weekends Eureka – Safouane Chergui

Why does SwiGLU work ?

Python

NLP

Deep Learning

The goal of this blog post is to explain why modern LLM architectures use SwiGLU as the activation function for the feed-forward part and have moved away from ReLU.

Safouane Chergui

Stop Vibe-Checking: Real-World Lessons on LLM Evals

LLM

Agent

Evaluation

Deploying LLM-powered systems in production is the easy part. The hard part? Making sure they’re actually working.

Safouane Chergui

PDF parsing is hard

Python

PDF

The goal of this blogpost is to explain what a PDF is internally and why parsing PDF files is not that easy.

Safouane Chergui

Why I ditched pip and conda for Pixi

Python

Package management

I’ve been using pip and then conda for as long as I can remember. Last year, I did a double-switch. First, I moved to uv and then not long after it I moved to pixi.

Safouane Chergui

Byte Pair Encoding Tokenization

Python

NLP

The aim of this blog is to explain to you how BPE Tokenization works. We’re going to build a basic tokenizer using BPE tokenization and we’ll apply it on a dummy example.

Safouane Chergui