Loading...

Freelance Agent Evaluation Engineer

  • Full Time
  • Anywhere

Mindrift

Freelance Agent Evaluation Engineer needed to create challenging tasks and evaluation criteria for AI coding agents in a simulated environment, with an estimated 20 hours of effort per task and up to $21 per hour equivalent pay.

Requirements

  • Degree in Computer Science, Software Engineering, or related fields
  • 5+ years in software development, primarily Python (FastAPI, pytest, async/await, subprocess, file operations)
  • Background in full-stack development, with experience building React-based interfaces (JavaScript/TypeScript) and robust back-end systems
  • Experience writing tests (functional, integration — not just running them)
  • Docker containers, and familiarity with infrastructure tools (Postgres, Kafka, Redis)
  • CI/CD understanding (GitHub Actions as a user: triggers, labels, reading results)
  • English proficiency – B2

Benefits

  • Part-time, non-permanent projects
  • Opportunity to work on AI-related projects
  • Competitive pay ($21 per hour equivalent)
  • Flexible work schedule

Originally posted on Himalayas

To apply for this job please visit himalayas.app.

About this role & career path

Working in Chile

Chile, officially the Republic of Chile, is a country in western South America. It is the southernmost country in the world and the closest to Antarctica, extending along a narrow strip of land between the Andes Mountains and the Pacific Ocean. According to the 2024 census, Chile had an enumerated population of 18.5 million. The country covers a territorial area of 756,102 square kilometers (291,933 sq mi), sharing borders with Peru to the north, Bolivia to the northeast, Argentina to the east, and the Drake Passage to the south. It also administers several Pacific islands, including Juan Fern

    More jobs at Mindrift

    Keep exploring on Get A Job.ai

    Not quite the right fit? Your next opportunity is a click away.

    Hiring instead? Post a job and reach candidates searching right now.