Language Model Analyst – Fully Remote | Upto $20/hr Part-time

About This Opportunity

We are representing a confidential AI research organization seeking a Language Model Analyst for fully remote, part-time contract work. This role is perfect for detail-oriented professionals fluent in both Tamil and English who are passionate about evaluating and improving large language model outputs.

Location: Sri Lanka (Fully Remote)
Type: Part-time Contract
Languages Required: Native Tamil speaker with excellent English writing skills

Responsibilities

• Conduct rigorous fact-checking using trusted public sources and external verification tools
• Generate high-quality human evaluation data by analyzing response strengths, weaknesses, and factual accuracy
• Assess reasoning quality, clarity, tone, and completeness of model-generated responses
• Ensure conversational outputs align with expected behavior and system guidelines
• Provide structured feedback to improve model performance across multiple dimensions

What We're Looking For

Required:

• Bachelor's degree in any field
• Native fluency in Tamil
• Excellent writing skills in English
• Significant hands-on experience using large language models
• Strong attention to detail and analytical thinking
• Background in domains requiring structured analytical thinking (research, policy, analytics, linguistics, engineering, or similar)

Preferred:

• Prior experience with RLHF (Reinforcement Learning from Human Feedback), model evaluation, or data annotation
• Experience writing or editing high-quality content
• Experience comparing multiple outputs and making fine-grained qualitative judgments

How We Work With You

Candidates apply directly through Get A Job.ai. Our talent team will review your application and conduct an initial screening. Qualified candidates will be submitted to our client for consideration. Please do not contact the client organization directly—all communication will be coordinated through our recruiting team to ensure a smooth process.

Pay

This position is compensated on an hourly basis. Specific rates will be discussed during the screening process based on experience and qualifications.

Get A Job.ai is an equal opportunity recruiter. We welcome applications from candidates of all backgrounds and do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, or any other protected characteristic.