Language Model Evaluator – Fully Remote | Upto $20/hr Part-time

About This Opportunity

We are representing a confidential AI research organization seeking a Language Model Evaluator to work remotely from Bangladesh. This is a part-time contract role where you'll contribute to improving cutting-edge language models through careful evaluation and quality assessment.

Responsibilities

• Conduct fact-checking using trusted public sources and external tools
• Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies
• Assess reasoning quality, clarity, tone, and completeness of AI-generated responses
• Ensure model responses align with expected conversational behavior and system guidelines
• Work independently and asynchronously to meet deadlines while contributing to AI model performance improvements

What We're Looking For

Required:

• Bachelor's degree
• Native speaker in Bengali
• Significant experience using large language models (LLMs)
• Excellent writing skills in English
• Strong attention to detail
• Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)

Preferred:

• Prior experience with RLHF, model evaluation, or data annotation work
• Experience writing or editing high-quality written content
• Experience comparing multiple outputs and making fine-grained qualitative judgments

How We Work With You

When you apply through Get A Job.ai, our talent team will review your profile and conduct an initial screening. If you're a strong match, we'll submit your application to our client for consideration. Please do not contact the client directly—all communication flows through our recruiting team to ensure a smooth process for everyone.

Pay

This is a part-time contract position. Pay details will be discussed during the screening process with our recruiting team.

Equal Opportunity: Get A Job.ai is committed to providing equal employment opportunities to all qualified candidates regardless of race, color, religion, sex, national origin, age, disability, or any other protected characteristic.