Tech Stack
- Python
- JAX and XLA
- Rust / C++
- Spark
Focus
- Provide complete assessment of models.
- Deep dive into model training and data to identify the weakness point revealed in evaluation.
- Communicate with modeling and data team to come up with plans to improve model quality.
Ideal Experience
- Model assessment and evaluation task development (including public and in-house benchmarking).
- Collect data and synthesize data for new evals.
- Build infrastructure and framework for easy-to-use model evaluation, familiarity with inference frameworks like SGlang and vLLM.
Location
The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation.
Annual Salary Range
$180,000 - $440,000 USD
Benefits
Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
