Data Scientist - AI Booster Team (f|m|d)

At idealo, Generative AI (GenAI) is becoming a multiplier across every team. The AI Booster Team is our internal technical competence center: we pair with product teams, build reusable GenAI building blocks and share best practices company-wide. We validate AI business cases through data and ship evaluation frameworks that turn pilots into production. As a Data Scientist you will translate ideas into evidence: designing experiments, measuring LLM quality, and unlocking the full value of idealo’s data assets to guide today’s and tomorrow’s GenAI initiatives.

This position is available full-time or part-time.

About your new role

• Quantify opportunities & run experiments - perform causal analyses using experiments and observational methods to evaluate the business impact of GenAI features.

• Own model evaluation pipelines - create metrics dashboards and human / AI-assisted reviews that benchmark LLM quality, cost and safety.

• Guide model selection - compare foundation models, fine-tunes and RAG setups, recommending the right balance of performance vs. cost.

• Champion data strategy - surface high-value datasets (product, pricing, behaviour) and advocate their use in current and future AI products.

• Pair & coach - work embedded with engineers and analysts, sharing best practices in experimentation, metrics, and GenAI evaluation.

• Harvest patterns - document reusable evaluation playbooks so every team can measure GenAI success consistently.

Skills & Requirements

• 3 + years in data science / analytics, including A/B testing or causal inference at scale.

• Expert SQL and Python (pandas, StatsModels / SciPy, scikit-learn); comfortable with notebooks and BI tools for storytelling.

• Hands-on with LLM assessment - prompt / temperature sweeps, embedding similarity metrics, human-in-the-loop studies, and LLM-as-a-judge tools (e.g. Bedrock model evaluation, OpenAI Evals).

• Familiar with Generative AI stacks (Hugging Face, LangChain/LlamaIndex, vector DBs like Pinecone/Qdrant) and retrieval-augmented generation concepts.

• Proficiency in AWS analytics & MLOps: SageMaker Experiments / Pipelines, Bedrock, Athena, Lambda, Step Functions; able to automate evaluation workflows and cost dashboards.

• Strong communication: can turn complex findings into clear, actionable insights and coach cross-functional teams.

• We’re keen to see evidence of exceptional achievement - perhaps you’ve scaled a personal project to thousands of users, published influential research, ranked highly in competitive arenas (e.g. sports, Kaggle, hackathons) or maintain widely-used open-source libraries. Tell us what makes you stand out!

You don’t tick every single box? No worries! We hire people, not checklists, and value motivation to grow.

At idealo you can expect

• You need vacation? We offer you 30 days of vacation. Not enough? You can "buy" an additional 15 days every year by converting your salary and it's seen as a positive thing.

• You want to further your education? We take your personal development goals seriously and, in addition to our idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, we also offer you the opportunity to benefit individually from additional learning and development budget.

• And what about the office? Our office in the heart of Berlin offers excellent free lunch, as well as free coffee, lemonades and after-work beer, in addition to the "standard foosball". It also has a fabulous rooftop terrace with view of the whole of berlin where you can network with colleagues from our group of companies.

• You want full flexibility on your way to work and beyond? No problem with a job bike or Deutschlandticket - and it's environmentally friendly, too!

• You don't live in Germany yet? We support you in the visa process and with your relocation.

• Want to keep yourself fit? We offer many different fitness and sports options, such as an Urban Sports or Gympass membership, to suit your personal needs.

About idealo

idealo is a Berlin success story: in 2000 we started out with the mission of helping consumers make the best purchasing decisions. Today, with ~2.5 million visits per day, ~50,000 shops, and more than ~500 million product offers, we are one of the most popular German e-commerce websites and one of the leading European shopping and comparison platforms. We are active as a price comparison platform in six countries (Austria, France, Germany, Great Britain, Italy, and Spain).
We are located in the heart of Berlin and offer a unique idealo spirit. Your ideas are the driving force that moves our business forward. Not only our product portfolio is diverse, but also the people who work on it. We want you just as you are! Origin, religion, gender, sexual orientation, or a degree of disability are irrelevant.
If you are passionate about improving the world of online shopping alongside ~700 idealos from ~60 nations, we are happy to receive your application!

Information for applicants with severe disabilities: As an applicant with a severe disability, you can get advice from our Representative Body for Severely Disabled People (SBV) during the application process. Please inform us regarding this topic.

For the inclusion of people with disabilities, our office is accessible without steps. When you start with us, we will see what else is needed!

#LI-AJ