STEM Master’s/Ph.D. Research Report Evaluator

Company Description

MillionLogics, a trusted Oracle Partner, is a global IT solutions provider combining innovation and expertise to enable digital transformation. With headquarters in London, UK, and a dynamic development centre in Hyderabad, India, MillionLogics bridges strategic business insight with exceptional technical talent. Through services such as Data & AI, Cloud Solutions, IT Consulting, and Database Services, we empower organisations with scalable and future-ready solutions tailored to their needs. Led by seasoned professionals, MillionLogics is dedicated to delivering cutting-edge technology and driving measurable outcomes for clients worldwide. Role Overview:

• We are conducting an initiative that involves evaluating deep research reports generated by AI systems. Evaluators will read and assess reports across multiple quality dimensions using a structured rubric, providing both numerical ratings and written justifications.
• This is a one-pass evaluation: each report is reviewed by a single general evaluator. The project covers hundreds of reports spanning diverse domains, including technology, healthcare, education, science, economics, social sciences, arts, and more.

Offer Details: Contract Duration: 6 months initially Compensation: USD 20-25 per hour (net/take-home) Working hours: Preferably full-time (40 hours/week) for U.S.-based candidates, but part-time is also acceptable with a 4-hour overlap with PST What does day-to-day look like?

• Read the research query to understand the intent and scope of the assigned report.
• Read and annotate the report using a PDF reader (Adobe Acrobat), highlighting key evidence and flagging issues such as broken links, weak sources, and claim-source mismatches.
• Score the report across 10 dimensions on a 1–5 scale using the provided rubric.
• Write justifications for each rating, referencing specific evidence from the report.
• Submit results via a survey and return the annotated PDF.

Requirements:

• Graduate student (Master’s or PhD candidate).
• Professionals with 1–3 years of experience in a relevant or adjacent domain.
• Regularly reads and consumes research reports, white papers, or analytical documents.
• Strong English reading comprehension and written communication skills.
• Based in the USA or Canada.
• Comfortable working with PDF annotation tools (Adobe Acrobat) and online surveys.
• Familiarity with one or more of the report domains: technology, healthcare, education, science, economics, social sciences, or related fields.
• Experience with quality evaluation, annotation, or data labelling tasks.
• Attention to detail and ability to provide clear, evidence-based written feedback

What MillionLogics is NOT seeking from your expertise:

• Confidential or proprietary information from any employer or university.
• Trade secrets or internal company or university data.
• Specific client information or case details.
• Any information that would violate NDAs, employment agreements or other confidentiality obligations.

How to Apply? Please send your updated CV to [email protected] with job ID: 72795 as your email subject. Apply tot his job Apply To this Job