Senior Cloud Engineer – AI Platform (LLM) (f/m/x)

At idealo, we’re building the platform layer that powers real AI features for millions of users. Our mission is to connect Large Language Models (LLMs) with e-commerce intelligence and make them secure, observable, scalable, and cost-efficient in production.

A central piece of our generative AI infrastructure is the MCP Server – a new interface bridging idealo’s product data with LLM-based applications. Your work will lay the foundation of infrastructure, tooling, and guardrails that enable product and ML teams to ship trusted AI features quickly.

About your new role 

• Build and operate Infrastructure as Code (CDK/Terraform/CloudFormation) for reproducible environments. 

• Provide platform primitives: model/endpoint gateway, prompt/agent registry, configuration & feature flags, rollout strategies (canary, A/B), rate limiting & quotas. 

• Create and maintain RAG infrastructure (vector stores, indexing pipelines, retrieval services) with observability & SLOs. 

• Define and monitor SLOs and implement latency/cost controls (caching, batching, routing). 

• Integrate Foundation Model providers (AWS Bedrock, OpenAI, Azure AI) and manage versioning/rollbacks. 

• Enable evaluation gates (with MLEs): wire up eval pipelines and quality signals (judges, test sets) into CI/CD. 

• Drive security, compliance, and monitoring (logs, traces, metrics, alerts, incident response). 

Skills & Requirements 

• 5+ years of experience in cloud/platform engineering running production systems at scale. 

• Proven ability to design, build, and operate secure, observable, and cost-efficient infrastructure. 

• Expertise in AWS (or equivalent), IaC (CDK/Terraform), CI/CD, networking, security, and observability. 

• Practical experience integrating LLM services and building RAG systems (retrieval, embeddings, vector DBs).  

• Knowledge of TypeScript (Node.js) and Python (tooling, pipelines). 

• Comfortable with containerization, automation & orchestration (Airflow, Step Functions, SageMaker Pipelines or similar). 

• Mindset: evaluation-aware, data-driven, cost- & latency-conscious, up-to-date with fast-moving AI tech. 

• Nice to have: exposure to prompt/agent frameworks and e-commerce systems. 

At idealo you can expect

• You need vacation? We offer you 30 days of vacation. Not enough? You can "buy" an additional 15 days every year by converting your salary and it's seen as a positive thing.

• You want to further your education? We take your personal development goals seriously and, in addition to our idealo Learning Hub, eLearning offerings (e.g., Udemy), coaching & mediation, we also offer you the opportunity to benefit individually from additional learning and development budget.

• And what about the office? Our office in the heart of Berlin offers excellent free lunch, as well as free coffee, lemonades and after-work beer, in addition to the "standard foosball". It also has a fabulous rooftop terrace with view of the whole of berlin where you can network with colleagues from our group of companies.

• You want full flexibility on your way to work and beyond? No problem with a job bike or Deutschlandticket - and it's environmentally friendly, too!

• You don't live in Germany yet? We support you in the visa process and with your relocation.

• Want to keep yourself fit? We offer many different fitness and sports options, such as an Urban Sports or Gympass membership, to suit your personal needs.

About idealo

idealo is a Berlin success story: in 2000 we started out with the mission of helping consumers make the best purchasing decisions. Today, with ~2.5 million visits per day, ~50,000 shops, and more than ~500 million product offers, we are one of the most popular German e-commerce websites and one of the leading European shopping and comparison platforms. We are active as a price comparison platform in six countries (Austria, France, Germany, Great Britain, Italy, and Spain).
We are located in the heart of Berlin and offer a unique idealo spirit. Your ideas are the driving force that moves our business forward. Not only our product portfolio is diverse, but also the people who work on it. We want you just as you are! Origin, religion, gender, sexual orientation, or a degree of disability are irrelevant.
If you are passionate about improving the world of online shopping alongside ~700 idealos from ~60 nations, we are happy to receive your application!

Information for applicants with severe disabilities: As an applicant with a severe disability, you can get advice from our Representative Body for Severely Disabled People (SBV) during the application process. Please inform us regarding this topic.

For the inclusion of people with disabilities, our office is accessible without steps. When you start with us, we will see what else is needed!

#LI-MW1