Loading...

Freelance Agent Evaluation Engineer

  • Part Time
  • Anywhere

Mindrift

We’re looking for a Freelance Agent Evaluation Engineer to create challenging tasks and evaluation criteria for AI coding agents. The work involves building virtual companies, assembling and calibrating tasks, and designing tests that accept correct solutions and reject incorrect ones.

Requirements

  • Degree in Computer Science, Software Engineering, or related fields
  • 5+ years in software development, primarily Python
  • Background in full-stack development
  • Experience writing tests (functional, integration)
  • Docker containers and familiarity with infrastructure tools
  • CI/CD understanding (GitHub Actions)
  • English proficiency – B2

Benefits

  • Up to $45 per hour equivalent
  • Flexible work schedule
  • Opportunity to work on AI-related projects

Originally posted on Himalayas

To apply for this job please visit himalayas.app.

About this role & career path

Working in New Zealand

New Zealand is an island country in the southwestern Pacific Ocean. It consists of two main landmasses—the North Island and the South Island —and over 600 smaller islands. It is the sixth-largest island country by area and lies east of Australia across the Tasman Sea and south of the islands of New Caledonia, Fiji, and Tonga. The country's varied topography and sharp mountain peaks, including the Southern Alps, owe much to tectonic uplift and volcanic eruptions. New Zealand's capital city is Wellington, and its most populous city is Auckland.

    More jobs at Mindrift

    Keep exploring on Get A Job.ai

    Not quite the right fit? Your next opportunity is a click away.

    Hiring instead? Post a job and reach candidates searching right now.