Overview
Build and validate data pipelines for AI benchmarking projects.
About the hiring company
Based in San Francisco, California, the hiring company is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. The hiring company supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L
Role Overview
- We are looking for experienced Software Engineers (SWE Bench – Data Engineer / Data Science) to contribute to benchmark-driven evaluation projects focused on real-world data engineering and data science workflows. This role involves hands-on work with production-like datasets, data pipelines, and data science tasks to help evaluate and improve the performance of advanced AI systems.
- The ideal candidate has strong foundations in data engineering and data science, with the ability to work across data preparation, analysis, and model-related workflows in real-world codebases.
What does day-to-day life look like?
Work with structured and unstructured datasets to support
SWE Bench-style evaluation tasks
- .
- Design, build, and validate data pipelines used in benchmarking and evaluation workflows.
- Perform data processing, analysis, feature preparation, and validation for data science use cases.
- Write, run, and modify
Python code
- to process data and support experiments locally.
- Evaluate data quality, transformations, and outputs for correctness and reproducibility.
- Create clean, well-documented, and reusable data workflows suitable for benchmarking.
- Participate in code reviews to ensure high standards of code quality and maintainability.
- Collaborate with researchers and engineers to design challenging, real-world data engineering and data science tasks for AI systems.
Requirements
- Minimum 3+ years of overall experience as a Data Engineer, Data Scientist, or Software Engineer (data-focused).
- Strong proficiency in
Python
- for data engineering and data science workflows.
- Demonstrable experience with data processing, analysis, and model-related workflows.
- Solid understanding of machine learning and data science fundamentals.
- Experience working with structured and unstructured data.
- Ability to understand, navigate, and modify complex, real-world codebases.
- Experience writing readable, reusable, maintainable, and well-documented code.
- Strong problem-solving skills, including experience with algorithmic or data-intensive problems.
- Excellent spoken and written
English communication skills
.
Perks of Freelancing With the hiring company
- Work in a fully remote environment.
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details
Commitments Required
At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.
Engagement Type
Contractor assignment (no medical/paid leave)
Duration of Contract
3 months (adjustable based on engagement)
Location
India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Brazil, Mexico
Evaluation Process
Technical Interview with live coding challege (60 mins)