AI Engineer (LLM)
Location: New York, NY (Hybrid – 3 days onsite) - Must be based in NY/NJ
We are partnering with a mission-driven organisation investing heavily in AI and Large Language Model (LLM) capabilities. They are building out a specialist AI team and are looking for experienced AI Engineers to develop and scale production-grade AI systems.
This is an opportunity to work on cutting-edge LLM applications within an environment that combines startup-style innovation with the stability of a well-established organisation.
The Role
You will join a dedicated LLM engineering team, contributing to the design, development, and deployment of AI-powered systems and applications.
The work includes:
- Building LLM-powered products and services
- Designing and implementing RAG pipelines
- Scaling and optimising existing AI systems
- Working on greenfield AI initiatives
Key Responsibilities
- Develop and deploy production LLM applications
- Design and optimise retrieval-augmented generation (RAG) systems
- Build scalable Python-based APIs and microservices
- Integrate AI systems with internal platforms and data sources
- Implement evaluation, monitoring, and optimisation of LLM outputs
- Collaborate with cross-functional teams across engineering and product
Required Experience
- Strong experience building LLM-based applications
- Advanced Python engineering skills
- Experience with RAG, vector databases, and prompt pipelines
- Experience deploying systems in cloud environments (AWS, GCP, or Azure)
- Background working on production AI/ML systems
- Excellent communication skills
Nice to Have
- Experience with LangChain, LangGraph, or similar frameworks
- Familiarity with Kubernetes, Docker, or serverless architectures
- Experience with event-driven systems or API integrations
- Experience working in start up environments
Working Environment
- Hybrid working (3 days onsite in Manhattan)
- Collaborative, high-performing AI engineering team
- Fast-paced environment with strong focus on real-world impact
ADVERT DISCLAIMER
Research indicates that men will apply to a role when they only meet 50-60% of the descriptions, however, when looking at women and other minority groups, they can look for up to a 99% match in order to apply to a role. If you feel you are a fit for our role, please still apply, don’t worry if you don’t tick every single box. We’d still love to hear from you. We encourage underrepresented talent to apply to all our roles & support accessibility needs
