LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

SHdYVDNDMElPMHlSUFgyOThMT0RZUzFaM2c9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Siri InfoSolutions Inc

React JS Developer Job at Siri InfoSolutions Inc

 ...Job Description Skill: React JS Developer Must Have Technical/Functional Skills: ~8+ years of professional experience in front-end development. ~ Develop User Interfaces: Build and implement highly responsive user interface components using React... 

Boston Medical Center

Senior Director, Supply Chain, Pharmacy Job at Boston Medical Center

 ...: Under the direction of the Executive Director, System Pharmacy , this position will oversee and lead the pharmacy supply chain...  ...strategies focused on demonstrating value proposition to payors in the delivery of high touch patient services, adherence services and data... 

AVEM MEDICAL LLC

Medical Sales Representative Job at AVEM MEDICAL LLC

 ...Job Description: Medical Sales Representative We are seeking a highly motivated and results-driven individual to join our team as...  ...of successful sales experience, preferably in the medical or pharmaceutical industry. 3. Strong interpersonal and communication skills,... 

Confidential

$510,000 Midwest Family Medicine Job at Confidential

 ...great work-life balance Average 12-18 patients per day Student loan repayment match program The Community: Enjoy fishing, boating, and camping at a National Wildlife Refuge Region is known for excellent hunting - deer, pheasant, and waterfowl Safe neighborhoods... 

Southwest Leadership Academy

ELA Interventionist Job at Southwest Leadership Academy

 ...Philadelphia. Southwest Leadership Academy Charter School supports over 600 students in grades K-8 in single-sex classrooms, leveraging research from the world-renowned Gurian Institute around socio-emotional learning and differentiation between the sexes, fueling growth,...