[Remote] Online Generalist Jobs in India
Note: The job is a remote job and is open to candidates in USA. Rex.zone is hiring remote, full-time Online Generalists to support AI/ML data operations across LLM training pipelines. The role involves performing data labeling, evaluation, and quality assurance to improve training data quality and reduce model errors.
Responsibilities
- Label and review text and image data to support LLM training pipelines
- Complete RLHF preference ranking and prompt-response evaluation using provided guidelines
- Perform QA evaluation for accuracy, consistency, and guideline adherence
- Apply content safety labeling and policy-based ratings for unsafe content detection
- Resolve edge cases, document decisions, and escalate issues through defined workflows
- Support NLP annotation (classification, summarization checks, named entity recognition)
- Support LLM evaluation (response ranking, prompt evaluation, RLHF evaluation)
- Support computer vision annotation (bounding boxes, segmentation, attribute tagging)
- Support QA operations (sampling plans, error taxonomies, reviewer calibration)
Skills
- Ability to follow detailed instructions and apply consistent judgment in a remote environment
- Strong written English and careful reading; able to explain labeling decisions clearly
- Comfort with web-based tools, spreadsheets, and task queues
- Experience with data labeling, RLHF, prompt evaluation, content moderation, or AI evaluation programs
- Familiarity with NLP, named entity recognition, or computer vision annotation
- Experience improving training data quality via error analysis, calibration, or guideline refinement
Company Overview