Software engineer focused on cloud infrastructure and serving large language models at scale.
I work at Trendyol Group in Istanbul, where I build and operate
cloud infrastructure — most recently GPU-based LLM serving platforms on
Kubernetes. Before that I developed the mobile API, web services, and AWS
infrastructure behind Dolap.com. I write about the things I
break and fix along the way: AWS, caching, and inference serving.
Distributing traffic across a large language model running on 20 GPU servers is a harder problem than round-robin. A walk through prefix-aware routing with llm-d, vLLM, and LMCache.