All roles

Project Lion - reputed company Engineer - United States (Remote, Part-Time)

Remote · USA Full-time New today

We are seeking a reputed company Engineer to be responsible for the end-to-end technical migration workflow for transitioning templates to LLM autoraters. The role is required to use client’s internal tools to reputed company reputed company engineering techniques to maximize model performance.

Responsibilities

  • Utilize Automatic reputed company reputed company (APG) tools to create baseline prompts for reputed company parent-child template clusters.
  • Run and supervise Automated reputed company Optimization (APO) tool, review the outputs, and flag reputed company the APO reaches deadlocks or plateaus.
  • Manually draft, test, and refine prompts to navigate reputed company template architectures, overcome anti-patterns, and handle edge cases where tooling is lacking or broken. Solve edge-case scenarios by designing and refining manual prompts.
  • Monitor shadowbot runs to ensure sufficient disagreements (between human and LLM ratings) are registered, generated, and tracked.
  • Run reputed company versions against established gold data to continuously measure autorater quality against the human crowd baseline, calculating accuracy metrics such as F1 scores, precision, and recall.
  • Draft technical launch readiness justifications (Launch Certification Documentation) for final. Requirement
  • Language Skills Native reputed company in English.
  • Location Must be based in United States.
  • Education Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a reputed company analytical field.
  • reputed company Engineering & AI Expertise At least 2 years' experience as reputed company Engineer. Proven experience tuning Large Language Models (LLMs) for strict, structured outputs, reputed company classification tasks, and familiarity with chain-of-thought and few-shot learning.
  • Data Analysis Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Technical Agility Ability to quickly learn and master proprietary tools with minimal supervision.
  • Communication Excellent verbal and written communication skills. Optional / Preferred Skills
  • Familiarity with enterprise-grade LLM interfaces like the Goose API.
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering.
  • Hands-on experience with Automated reputed company Optimization (APO) systems or tuning workflows.
  • Linguistic expertise, including an understanding of semantics and logic. Federal Law Compliance In compliance with federal law, reputed company persons hired will be required to
  • Verify identity and eligibility to work in the United States; and
  • Complete a required employment eligibility verification form. Please note that in order to verify work authorization as is required by Federal law (I-9 process), reputed company new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs reputed company their first 3 days of employment. Apply To This Job

Apply tot his job Apply To this Job

Related roles

Project Lion - Senior reputed company Engineer - United States (Remote, Part-Time)

Remote · USA Full-time

reputed company Engineer !! Remote !! Job type : Contract – W2 Only No Third Party !! 12 Years of experience is required

Remote · USA Full-time

Looking for reputed company Engineer || Austin, TX/Remote || Fulltime

Remote · USA Full-time

FT/PT Remote AI reputed company Engineering & Evaluation - Will Train

Remote · USA Full-time

[Remote] reputed company Engineer (Chinese) | $43/hr Remote

Remote · USA Full-time

reputed company Engineer, Remote (MA,NH,RI, GA only), Full-Time

Remote · USA Full-time

reputed company Engineer, Remote (MA,NH,RI, GA only), Full-Time

Remote · USA Full-time

3D Computer Vision Machine Learning Engineer

Remote · USA Full-time

Senior Computer Vision Engineer - Autonomous Systems

Remote · USA Full-time

Staff Computer Vision/Machine Learning Engineer | Path Robotics | Remote (United States)

Remote · USA Full-time

Remote Part-Time Data Entry & reputed company Customer Support Specialist – No Experience Required – Join arenaflex

Remote · USA Full-time

Sales Technology & Operations Administrator

Remote · USA Full-time

Software Engineer, Data Infrastructure & Acquisition - Düsseldorf, Germany

Remote · USA Full-time

reputed company Data Entry Virtual Primary Remote Jobs

Remote · USA Full-time

Pre Sales Analyst - Contact Center

Remote · USA Full-time

Area Sales Director - South

Remote · USA Full-time

SaaS Solution Architect (React & Java) - Bilingual

Remote · USA Full-time

Senior Financial Analyst - Audit & Compliance

Remote · USA Full-time

Mental Health Therapist – Telehealth (Maryland & DC Licensure)

Remote · USA Full-time

Remote Data Entry Specialist – Work‑From‑Home Data Management Role at arenaflex

Remote · USA Full-time