Analytical Evaluator – AI Feedback

About This Opportunity

We are representing a confidential AI research organization seeking an Analytical Evaluator to strengthen machine learning model outputs through rigorous feedback and evaluation. This is a remote contract role based in Australia.

Our client works at the cutting edge of artificial intelligence development, and this position plays a critical role in improving model reasoning and training data quality.

Responsibilities

• Evaluate AI-generated responses to assess reasoning quality and rigor in model outputs
• Provide structured written feedback to improve training data quality and downstream performance
• Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations
• Ensure consistent and honest judgment, including critical assessments when warranted
• Work independently and asynchronously to meet deadlines while contributing to AI model performance improvements

What We're Looking For

Must-Have Qualifications:

• Bachelor's degree from a top-500 globally ranked university preferred
• Strong analytical and written communication skills
• Ability to work independently and follow detailed task guidelines
• Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
• Native English fluency required

How We Work With You

Candidates apply directly through Get A Job.ai. Our recruiting team will screen applications and conduct initial assessments. Qualified candidates will be submitted to our client for consideration. Please do not attempt to contact the client directly, as all communication must flow through our talent team to ensure a professional process for all parties.

Pay

Pay via Get A Job.ai: $70 AUD per hour. This is a contract position with remote work flexibility.

Equal Opportunity: Get A Job.ai is committed to providing equal employment opportunities to all qualified applicants regardless of race, color, religion, sex, national origin, age, disability, or any other protected characteristic.