Overview
Develop and maintain high-quality code for AI model training and optimization.
About the hiring company
- The hiring company is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.
- The hiring company helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview
We are actively seeking talented developers proficient in Python & Javascript/Typescript to join our ambitious team dedicated to pushing the frontiers of AI technology. This opportunity is tailored for professionals who thrive on developing innovative solutions and aspire to be at the forefront of AI advancements. You will work with different companies in the US who are looking to develop cutting-edge commercial and research AI solutions.
What does day-to-day look like
Design, develop, and maintain efficient, high-quality code to train and optimize AI models.
Conduct evaluations (Evals)
- to benchmark model performance and analyze results for continuous improvement.
- Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
- Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
- Lead efforts in
Supervised Fine-Tuning (SFT)
- , including creating and maintaining high-quality, task-specific datasets.
- Collaborate with researchers and annotators to execute
Reinforcement Learning with Human Feedback (RLHF)
- and refine reward models.
- Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
- Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
- Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
- Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
- Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.
Required Skills
- Write readable, reusable, and maintainable code
- Participate in code reviews to ensure that the standards for code quality are met
- Demonstrate your proficiency with your Python and Javascript/Typescript, while covering all bases
- Provide clear, clean, well-organized, correct, and clearly annotated/classifiable code in the responses
- Bachelor’s/Master’s degree in Engineering, Computer Science (or equivalent experience)
- Demonstrable experience with developing web apps using modular development and scalable architectures as well as a strong focus on code readability and security/stability (i.e. testing).
- Proficiency with the syntax and conventions of Python and JS/TS (Javascript/Typescript)
- Extensive experience working with JavaScript or TypeScript & Python
- Solid understanding of JavaScript ES6 and either Node.js or Nest JS and React or Angular or VueJS
- Nice to have some prior software Quality Assurance, Test Planning experience & test driven development
- Excellent spoken and written English communication skills
- Mandatory knowledge of Docker is required.
- Nice to have some LLM experience with prompting in ChatGPT and other llms.
Perks of Freelancing With the hiring company
- Work in a fully remote environment.
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details
Commitments Required
at least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week)
Engagement type
Contractor ass