Job Title: AI Engineer (LLM Focus)
Industry: Tech / AI
Contract Duration: 6 Months
Location: New York/Hybrid (3 days onsite / 2 days remote)
Hourly Rate: $60 - $100/hr
The Role:
- Join a small, focused LLM team of 5–6 engineers working on production-grade AI systems at one of New York City's largest and most established organisations
- Build and own LLM-powered applications end to end, from design and architecture through to deployment and monitoring
- Design and improve RAG pipelines, connecting internal data sources to LLM systems in a reliable, scalable way
- Build multi-agent and agentic workflows using frameworks like LangGraph, enabling complex automated reasoning and task completion
- Develop and maintain FastAPI-based backend services and APIs that integrate LLM systems into the wider tech stack
- Deploy and scale systems on cloud infrastructure (AWS/GCP/Azure), ensuring reliability and performance under real production load
- Implement evaluation frameworks, guardrails, and monitoring to keep LLM outputs accurate and trustworthy over time
- Work across a mix of greenfield AI projects and scaling existing systems, with a genuine startup-style pace and ownership backed by a large, stable organisation
Skills Needed:
- Strong hands-on experience building and shipping production LLM systems - RAG pipelines, agent workflows, orchestration
- Proficient in Python with solid backend engineering experience (FastAPI or equivalent)
- Experience with LLM frameworks such as LangChain or LangGraph
- Cloud deployment experience on AWS, GCP, or Azure - containers, Kubernetes, CI/CD
- Strong understanding of API design and system integration across multiple services
- Experience working in or alongside startup environments, comfortable with ownership and ambiguous requirements
- 6+ years of software or AI engineering experience
- Excellent communication skills and ability to work cross-functionally in a small, fast-moving team
Research indicates that men will apply to a role when they meet only 50–60% of the requirements, while women and other underrepresented groups often look for a 90–100% match. If this role excites you but you don't tick every single box, please still apply. We'd love to hear from you.
