AI (AGENTS) ENGINEER - PYTHON | AI INFRA START UP | UP TO $300k + EQUITY | ONSITE NY
Realm is supporting an NY-based AI infra startup that’s already profitable and backed by some of the best investors in the game.
They’re building something genuinely novel and pushing the limits of AI. The team is small (<50 engineers), extremely sharp (ex-Datadog, DE Shaw, MIT), and hands-on with Go, Python, and C++ - the kind of engineers who care deeply about performance, reliability, and correctness.
We’re looking for an AI Engineer to join the AI Agents team, a high-performing team responsible for deploying frontier LLMs in production, optimizing multi-step reasoning workflows, and improving the performance and accuracy of agentic architectures across distributed systems.
In this role, you’ll:
- Design and implement AI agent architectures, building multi-step reasoning workflows that combine LLMs with supporting systems to analyze large-scale observability data.
- Develop prompting and orchestration tooling, including prompt engineering frameworks, function-calling interfaces, and agentic workflows optimized for latency, reliability, and performance.
- Deploy AI components to production, integrating models and orchestration layers into a highly scalable, low-latency environment with strict uptime requirements.
- Experiment with new approaches, prototyping and testing LLMs, prompting strategies, and fine-tuning methods to improve accuracy, coverage, and overall agent quality.
- Collaborate across engineering teams, partnering with backend, infrastructure, and product stakeholders to ensure AI agents fit seamlessly into the broader system architecture.
- Build observability and debugging tooling, creating evaluation systems and monitoring pipelines that track agent performance and reliability in production workloads.
Interview process: 3 stages
Compensation: Up to $300k + equity
Location: New York City (in-office)
If this sounds interesting, please apply directly to this job posting or email rsampson@realmgroup.io.
#AI #Observability #OpenTelemetry #OTel #Agents #AIAgents #Infrastructure #Go #Python #Rust
