AI Operations Lead (Human-in-the-Loop) - NYC-based

New York

Published 5 hours ago

Lead the Teams Shaping the Future of AI – On-Site [NYC]

Are you a strategic leader who thrives at the intersection of data quality and people operations? Welo Data is seeking a Data Quality Lead to oversee high-impact teams of analysts dedicated to AI model evaluation.

This isn’t just a management role—it’s an opportunity to define how quality is measured in a human-in-the-loop environment. You will act as the bridge between technical stakeholders and analyst teams, translating complex AI guidelines into clear, actionable operational excellence.

The Mission: Quality Leadership at Scale

  • Team Architecture: Lead and mentor a specialized team of Data Quality Analysts, fostering growth and managing high-performance output.
  • Quality Ownership: Own the end-to-end quality loop, including audits, calibrations, and the identification of model performance trends.
  • Strategic Translation: Turn ambiguous, evolving AI guidelines into structured direction for your teams.
  • Stakeholder Partnership: Act as the primary representative for your team, aligning with global stakeholders on quality standards and program goals.
  • Operational Innovation: Drive continuous improvement across tooling, evaluation methods, and hiring for specialized linguistic talent.

Project Details

  • Job Title: AI Operations Lead 
  • Employment Type: W2 Full-Time Employee
  • Hours: 40 hrs/week
  • Location: New York City

Premium Perks & Benefits

This role offers more than just a paycheck—it includes a world-class workspace experience:

  • Gourmet Dining: Free breakfast, lunch, and dinner with a wide variety of cuisines.
  • Wellness & Insurance: Comprehensive Medical, Dental, and Vision coverage + 401(k) and HSA.
  • Time Off: 15 days of combined Paid Sick/Holiday time + Memorial Day and Labor Day.
  • Campus Culture: Access to micro-kitchens, premium coffee, and unique features like rooftop nature parks.
  • Commuter Support: Free shuttles, transport benefits, and bike-to-work perks.

Who We’re Looking For

  • Industry Veteran: 5–8 years of experience in Data Quality, QA, or AI/ML operations.
  • Proven Leader: 2+ years of experience managing teams in a high-scale data or AI environment.
  • Strategic Mindset: Ability to "zoom out" to see patterns while maintaining deep attention to detail.
  • Operational Agility: Comfortable navigating ambiguity and balancing speed with rigorous quality standards.
  • Technical Interest: A genuine curiosity about how human feedback shapes the behavior of Large Language Models (LLMs).


 

Contract

Mid-Senior Level

New York