Loading...

Freelance Agent Evaluation Engineer

  • Full Time
  • Anywhere

Mindrift

Mindrift connects specialists with project-based AI opportunities for leading tech companies. Freelance Agent Evaluation Engineer is a part-time opportunity to evaluate AI coding agents and create challenging tasks within realistic simulated environments.

Requirements

  • Degree in Computer Science, Software Engineering, or related fields
  • 5+ years in software development, primarily Python (FastAPI, pytest, async/await, subprocess, file operations)
  • Background in full-stack development, with experience building React-based interfaces (JavaScript/TypeScript) and robust back-end systems
  • Experience writing tests (functional, integration — not just running them)
  • Docker containers, and familiarity with infrastructure tools (Postgres, Kafka, Redis)
  • CI/CD understanding (GitHub Actions as a user: triggers, labels, reading results)
  • English proficiency – B2

Benefits

  • Part-time opportunity
  • Estimated $50 per hour equivalent
  • Flexibility to choose when and how to work

Originally posted on Himalayas

To apply for this job please visit himalayas.app.

About this role & career path

Working in Austria

Austria, formally the Republic of Austria, is a landlocked country in Central Europe, lying in the Eastern Alps. It is a federation of nine states, of which the capital Vienna is the most populous city and state. Austria is bordered by Germany to the northwest, the Czech Republic to the north, Slovakia to the northeast, Hungary to the east, Slovenia and Italy to the south, and Switzerland and Liechtenstein to the west. The country occupies an area of 83,879 km2 (32,386 sq mi) and has a population of about 9.2 million.

    More jobs at Mindrift

    Keep exploring on Get A Job.ai

    Not quite the right fit? Your next opportunity is a click away.

    Hiring instead? Post a job and reach candidates searching right now.