Do you enjoy building robust APIs and scalable pipelines to operationalize model evaluation? Do you want to help product teams get fast, reliable feedback on their AI outputs through automation? About our Team Elsevier’s AI Evaluation team designs, builds, and operates NLP/LLM evaluation solutions used across multiple product lines. We partner with Product, Technology, Domain SMEs, and Governance to ensure our AI features are safe, effective, and continuously improving. About the Role As a Senior Machine Learning Engineer, you will build and maintain the infrastructure and APIs that power automated evaluation of AI products. You’ll ensure evaluations are scalable, reliable, and integrated into product development workflows, enabling product teams to quickly assess model outputs and iterate on their features. Responsibilities · API & platform development — Build and maintain evaluation APIs and backend services to run automated assessments. · Pipeline orchestration — Develop scalable Python/SQL pipelines, integrate with CI/CD, and implement monitoring/logging for evaluation jobs. · Infrastructure & reliability — Ensure reproducibility, version control, observability, and error handling across evaluation workflows. · Collaboration — Work closely with fellow Data Scientists, SMEs, Product, and Engineering teams to operationalize metrics and evaluation processes. · Automation & tooling — Support auto-assessments as first-pass evaluation and integration with downstream SME-evals. Requirements · Education/Experience: Master’s + 3 years, or Bachelor’s + 5 years, in CS, Data Engineering, Software Engineering, or related field; experience building production ML pipelines. · Technical: Strong Python (FastAPI/Flask), SQL, cloud platforms (AWS /Azure / Databricks); orchestration frameworks (Airflow, Prefect, Dagster); containerization (Docker/K8s); CI/CD pipelines; logging and monitoring. · Practices: Git, reproducibility, documentation; collaborative coding and design review. · Communication: Ability to explain technical choices and results to non-technical stakeholders. · Mindset: Ownership, bias-for-action, curiosity, and collaborative problem-solving. Nice to have · Experience with LLM/NLP evaluation pipelines or agentic systems. · Familiarity with auto-assessment frameworks and multi-product evaluation scaling. · Exposure to healthcare or regulated content doma We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120. Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here. Please read our Candidate Privacy Policy. We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: EEO Know Your Rights. Elsevier is a global leader in advanced information and decision support for science and healthcare. We believe that by working together with the communities we serve, we can shape human progress to go further, happen faster, and benefit all. We support continuous discovery and uphold the highest standards of content integrity, reliability, and reproducibility so the communities we serve can advance their field of science, healthcare or innovation with confidence. By combining high-quality content with powerful analytics, we transform complexity into clarity and deliver mission-critical insights that help professionals make better decisions when it matters most. We deliver insights that help research institutions, governments, and funders achieve their goals. We help researchers discover and share knowledge, collaborate, and accelerate innovation. We help librarians provide verified, quality information to universities. We help innovators turn knowledge into new products. We help health professionals improve patient care and educators train the next generation of doctors and nurses. Connecting quality content and innovative technologies, we make progress go further and happen faster. And by championing inclusion and sustainability, we ensure progress benefits all. With 9,500 employees, over 2,300 technologists in 5 major tech hubs, and more than 60 locations across the globe, we are committed to supporting the scientific and healthcare communities around the world. We offer a diverse range of opportunities across technology, commercial, business, and early career jobs. If you are looking for a career that inspires progress in science, innovation and health, and allows you to grow every day, find your team at Elsevier. Elsevier is part of RELX Group. Let’s shape progress together. Join us. elsevier.com/about/careers