Safouane Chergui
About
Weekends Eureka
Categories
All
(2)
NLP
(1)
Package management
(1)
Python
(2)
Why I ditched pip & conda for Pixi
Python
Package management
I’ve been using pip and then conda for as long as I can remember. Last year, I did a double-switch. First, I moved to
uv
and then not long after it I moved to
pixi
.
Jul 5, 2025
Safouane Chergui
Byte Pair Encoding Tokenization
Python
NLP
The aim of this blog is to explain to you how BPE Tokenization works. We’re going to build a basic tokenizer using BPE tokenization and we’ll apply it on a dummy example.
Jul 7, 2024
Safouane Chergui
No matching items