Software Engineer, AI Coding Tasks (Contract) at Askable

Interested in this role? Apply Now

Description

Headquarters: Australia
URL: https://www.askablelabs.com/

We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US$1,000 per task, and you can do as many tasks as you want.

You turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models.

Remote, any location. US$1,000 per task that passes review. Minimum of one task a week, about 10 hours a week.

How it works

  • Apply. Complete a short screener interview and upload your resume.
  • Propose. Once you're selected, pick a change from a repository you know and submit a short proposal. We approve it or suggest a better candidate.
  • Build. In our platform, set up the repository as it was before the change, then write the brief, the correct solution and the grading checks.
  • Stress-test. Try lazy, incorrect and shortcut solutions and make sure your checks catch them.
  • Model testing. Run your task against leading AI models until strong models often fail but a skilled engineer can clearly solve it.
  • Review. A reviewer checks your task and you revise it. Most tasks take more than one round.
  • Next task. Once your task is accepted, start another.

    • Requirements

    • 2+ years of professional software engineering
    • Code merged into a public open-source repository, ideally one you know well. A private codebase you own may also qualify (not employer or client code)
    • Strong in at least one of Python, TypeScript, Go, Rust, Java or C++
    • Solid with Docker, Linux, Git and automated testing
    • Regular use of an AI coding tool
    • Experience writing tests, rubrics or evaluation criteria, ideally for AI models
    • You can explain a change clearly and concisely, in your own words
    • At least 10 hours a week, starting now
    • A secure personal or work computer (no public or shared machines)

    Nice to have

    • Deep expertise in one area, such as databases, compilers, distributed systems, security or infrastructure
    • Experience building agent tasks or RL environments

    Terms

    • US$1,000 for each task that passes our quality review, paid directly to you
    • Once your proposal is qualified, you sign Askable's contract and accept its terms
    • The work is used for AI training. The change and your solution must be your own, and you must be free to license them to us
    • Don't publish the work anywhere: no public pull request or public fork

    Apply at https://www.askable.com/experts/roles/senior-software-engineer

    To apply: https://weworkremotely.com/remote-jobs/askable-software-engineer-ai-coding-tasks-contract

    Skills

    AI
    ⚠️

    Important Safety Notice:

    Be cautious when applying for jobs! Never disclose sensitive personal information such as your banking details, social security number, or other private information to any third-party organizations through this platform. Some listings may not be curated, and the project is not responsible for scams or phishing attempts made through non-curated job listings.

    Comments

    Details

    Type
    Contract
    Presence
    Remote
    Source
    We Work Remotely
    Views
    Posted
    19 days ago

    Company

    A
    View Company
    Interested in this role? Apply Now