Coolblue

🎓 Master's Thesis Defended — 9.5 / 10! Today I defended my Master's thesis in Responsible Artificial Intelligence at the OPIT - Open Institute of Technology Really happy to share that I scored a 9.5 out of 10. Thesis: Evaluating AI-Generated Product Descriptions — A Comparative Study of LLM-as-a-Judge Taxonomies and Single-Score Metrics 💡 In short: we can evaluate AI-generated product descriptions with an AI judge that agrees with our senior copywriters in about 95% of their pass/fail decisions, and it stays cheap and scalable. 📊 What we found: We tested 16 AI judges, traditional and semantic metrics against human annotations on product descriptions. - Our taxonomy-based judges, built around Coolblue's product advice taxonomy, beat every generic metric. Traditional metrics had almost no power to tell good from bad editorial quality. - Best setup: Gemini 2.5 Flash with our domain-specific prompt. 94.2% agreement with senior copywriters, at a much lower cost than frontier models. - AI judges are too lenient though. When they disagree with copywriters, 62.1% of the time they pass text that humans would fail. So we still need human audits. - Some checks (sentence length, auxiliary verbs) work better as rules, not AI. A hybrid setup (LLM judges + rule-based checks) gives the best results. 🔧 In practice: a closed-loop evaluation pipeline with automated scoring, role-based correction routing, false-positive monitoring, and a living taxonomy managed by editors. Ready to scale across languages and product categories. 🙏 This would not have been possible without: Coolblue for giving me the space, the data, and the trust to turn a real business use case into research. The Product Advice Journey team, Roy Ahuis and the crew, for the collaboration and domain expertise. My academic supervisor Marzi Bakhshandeh , PhD and company supervisor Jelle van Elburg for the guidance and sharp feedback throughout. Thanks the committee Zorina Alliata and Sina Famouri for the challenge questions during my defense. For me, the biggest takeaway is that AI and human expertise work best together. Not replacing each other, but making each other better. Onwards! 🚀 #AI #LLM #NLP #MachineLearning #ResponsibleAI #MasterThesis #DataEngineering #Coolblue #ProductDescriptions #LLMAsAJudge #NLG