The Opportunity at Komodo Health:
Healthcare in the U.S. is a mess. Komodo Health is fixing that—with data. We’ve mapped the patient journey across the country to build the most complete picture of disease burden and treatment gaps. Our customers—pharma companies, payers, and health systems—use this data to make decisions that meaningfully improve patient outcomes.
Labs@Komodo builds the AI-native platforms and systems that turn this data into action. We are the team behind Marmot, Komodo’s AI-native product—designed with AI embedded directly into both the interface and the development workflow. By combining Komodo’s unmatched healthcare data with modern LLMs, marmot is delivering some of the most compelling real-world insights of the new AI era.
Mission of the Role:
As an Applied AI Engineer, you will design and deploy end-to-end AI solutions that power real products and internal tools. You’ll work at the intersection of applied research, engineering, and product development, bringing modern AI techniques into scalable production systems.
You’ll collaborate closely with product, platform, and data teams to build AI capabilities that transform how healthcare data is explored, understood, and operationalized.
Looking back on your first 12 months at Komodo Health, you will have accomplished…
- Ship production AI features that improve the precision, usability, and intelligence of Komodo’s platform.
- Design and deploy agent-based AI pipelines integrated into real customer-facing products.
- Build internal AI productivity tools that accelerate engineering workflows across Komodo.
- Prototype and validate new AI approaches using emerging research and model capabilities.
- Contribute reusable prompt templates, orchestration patterns, and AI system architecture.
- Implement monitoring, evaluation, and observability frameworks for deployed AI services.
What You'll Own:
- Designing, building, and deploying end-to-end AI systems for both product features and internal tooling.
- Developing agent pipelines, prompt chains, and orchestration frameworks for LLM-driven workflows.
- Selecting the appropriate AI techniques (LLMs, classic ML, or hybrid approaches) for specific problems.
- Collaborating with product managers, engineers, and data scientists to define requirements and deliver solutions.
- Building scalable AI services with monitoring, evaluation, and deployment pipelines.
- Contributing reusable patterns to Komodo’s AI infrastructure and internal tooling ecosystem.
What you bring to Komodo Health (required):
- Experience building production-grade AI systems or AI-powered applications.
- Strong proficiency in Python.
- Experience working with LLMs, prompt engineering, or agent-based architectures.
- Familiarity with modern GenAI tooling and frameworks such as: vLLM, CrewAI, Strands, OpenAI / Chat Completions APIs
- Ability to integrate AI capabilities across backend services and product interfaces.
- Experience designing evaluation frameworks, testing strategies, or monitoring systems for AI features.
- Strong collaboration skills across engineering, product, and data teams.
Expectations of AI Use in this role (required):
- At Komodo, AI is core to how we build. Engineers in this role are expected to actively experiment with new AI techniques, share learnings across teams, and contribute to evolving best practices for building reliable, scalable AI systems. You will play a key role in shaping Komodo’s AI-first engineering culture.
Additional skills and experience we’d prioritize (nice to have)…
- Healthcare data expertise.
- Experience with distributed computing frameworks (e.g., Spark, Snowflake, Databricks) for large-scale data processing.
** Location flexible: NYC or SF hybrid, and remote
