About the Team
The pre-training data team at xAI is dedicated to crafting the ultimate data recipe for training an omni-model that unlocks the universe's secrets through text, image, video, and audio. To achieve this vision, we're seeking visionary engineers with deep expertise in multimodal pre-training data.
Tech Stack
Location
The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation.
In this role, you might:
- Collaborate with the crawling team to discover and source datasets.
- Architect pipelines to transform datasets at petabyte scales with efficiency and precision.
- Develop robust and diverse evaluations for pre-training models.
- Craft insightful experiments to assess dataset performance.
- Innovate the recipe for scaling pre-training data to new frontiers.
Exceptional candidates may have:
- Expertise in ML and large model scaling, with familiarity across all kinds of scaling laws.
- Strong ability to design ML experiments.
- Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities.
- Strong engineering abilities in Spark, Ray, and other frameworks for large-scale data processing.
Interview Process
After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to a 15-minute interview (“phone interview”) during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process, which consists of four technical interviews:
- Coding assessment in a language of your choice.
- Technical sessions (2): These sessions will be testing your ability to formulate, design and solve concrete problems in real world with LLM.
- Meet the Team: Present your past exceptional work and your vision with xAI to a small audience.
Our goal is to finish the main process within one week. All interviews will be conducted via Google Meet.
Annual Salary Range
$180,000 - $440,000 USD
Benefits
Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.