Join to apply for the Mid Senior GenAI Platform Engineer role at myGwork - LGBTQ+ Business Community
Get AI-powered advice on this job and more exclusive features.
This job is with E.ON UK, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.
We are maintaining and enhancing our Generative AI Platform that enables our entire organisation to leverage Generative AI safely, efficiently and at scale. As a Generative AI Platform Engineer, you will be the force multiplier, moving beyond building end‑user applications to developing robust, centralised services that power all internal GenAI product squads.
This is a hybrid role, typically working 1 day per week at our Citigen office in London.
Responsibilities
* Design, build, and maintain the highly reliable Model Serving Layer (Gateways, load balancing, caching, throttling) for low‑latency access to LLMs and other generative models.
* Engineer and maintain production‑ready Vector Database and Retrieval‑Augmented Generation (RAG) infrastructure, including high‑throughput indexing pipelines and efficient retrieval strategies for enterprise data.
* Develop and manage a standardised, secure Agent Framework/SDK (e.g., based on LangGraph or a custom library) that promotes consistency and maintainability across all agents built from the platform.
* Implement robust mechanisms for cost tracking, monitoring, precise cost allocation/chargebacks per squad, alongside implementing rate‑limiting and budget controls.
* Systematically benchmark, curate, and integrate the most cost‑effective and performant models for distinct use cases.
* Build and maintain scalable, secure infrastructure and data pipelines for custom model fine‑tuning requested by product teams.
* Architect and deploy platform‑level safety filters (e.g., toxicity, PII masking, jailbreak prevention) that are enforced across all model inputs and outputs.
* Build and maintain the centralised logging, monitoring, and observability stack to track crucial GenAI metrics (hallucination rate, latency, token usage, drift detection).
* Ensure the platform and RAG data handling adheres to strict compliance and data privacy regulations (e.g., GDPR) through automated enforcement and auditing.
* Drive the quality of the developer experience by writing exceptional SDKs, clear APIs, comprehensive documentation, and contributing to internal knowledge sharing (e.g., through workshops).
Qualifications
* Minimum 2 years of experience in Software Engineering, ML Engineering, Data Science, or Data Engineering with a specialised focus on building Generative AI products or agent‑based systems.
* Proficiency in Python and developing highly concurrent, scalable API services and microservices in a cloud environment.
* Extensive, hands‑on experience with cloud infrastructure (AWS, GCP, or Azure), Infrastructure as Code (Terraform), Docker‑containerisation, and an understanding of Kubernetes.
* Understanding of LLM architectures, inference serving optimisation techniques (quantisation, caching), and MLOps tooling (e.g., MLFlow, Kubeflow).
* Proven experience designing, implementing, and optimising complex RAG pipelines using vector databases (e.g., Pinecone, PGVector).
* Practical experience with agentic frameworks (LangChain, LlamaIndex, Langgraph, or custom implementation) and defining tool‑use patterns.
* Demonstrated experience designing complex, multi‑tenant platform systems, prioritising reliability, security, and separation of concerns.
* Proven ability to engineer for operational efficiency, with a track record of implementing cost‑saving measures in large‑scale cloud deployments.
* Strong commitment to improving Developer Experience (DX) and acting as a technical consultant for internal product teams.
Benefits
* Competitive salary.
* Flexible hybrid and family‑friendly policies.
* 26 days of annual leave plus bank holidays.
* Generous pension, life cover, and bonus opportunities.
* Access to 20 flexible benefits with tax/NI savings.
* Award‑winning workplace and inclusive diversity culture.
Compensation
Salary: Negotiable. Start date: ASAP.
Location
Citigen, 47‑53 Charterhouse Street, London, EC1M 6PB.
#J-18808-Ljbffr