Software Engineer - AI Coding Tasks (Contractor)

About the role

Askable is seeking experienced software engineers to create high-quality coding exercises that test the limits of AI coding models. The work sits on the "evidence layer" of AI: turning real-world code changes from repositories you know well into structured assessments that remain difficult for state-of-the-art AI to solve. It is a remote, contract-based opportunity open to developers worldwide, with about 10 hours per week and a flat fee of US$1,000 per successfully reviewed task.

Key responsibilities

• Curate coding challenges from public repositories you are familiar with, taking a genuine change or feature and turning it into a structured assessment.
• Set up repository environments within the Askable platform.
• Draft project briefs and define clear solution criteria.
• Develop automated grading checks to evaluate whether a solution is correct.
• Run stress tests on tasks so they cannot be easily bypassed by flawed logic.
• Execute tasks against leading AI models and refine them based on feedback from internal reviewers.

Required profile

• At least 2 years of professional software engineering experience.
• Proven contributions to public open-source repositories.
• Ability to explain complex code changes clearly.
• A stable, secure and private computer setup for high-level development work.

Required skills

• Advanced proficiency in at least one major language such as Python, TypeScript, Go, Rust, Java or C++.
• Strong technical literacy in Linux, Docker, Git and automated testing frameworks.
• Experience or strong interest in AI coding tools and evaluating model performance.