Lead Generative AI Analyst

Welocalize, Inc.

  • San Francisco, CA
  • 17 days ago

    Highlights

    This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Job Responsibilities: The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products.

    Numbers & Facts

    LocationSan Francisco, CA

    Description

    If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact servicedesk@welocalize.com subject Workday Candidate Login

    When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

    Thank you!

    NOTICE: For Privacy Policy please review here

    Job Responsibilities:

    The Lead Generative AI Analyst plays a pivotal role in leading technical and writing teams to deliver NEMO products. This position also involves customer-facing responsibilities, ensuring world-class quality through tracking metrics, labeling initiatives, and training stakeholders. Exposure to potentially sensitive content may be required.

    Responsibilities:

    • Lead technical and writing teams to deliver NEMO products.
    • Act as the liaison between customers, DataFactory teams, product teams, and research teams.
    • Track annotator metrics to ensure top-quality deliverables.
    • Write creative prompts and responses across diverse topics.
    • Manage labeling initiatives with third-party firms and internal customers.
    • Develop and update detailed guidelines and specifications for stakeholders.
    • Train teams on best practices for creating large language models and datasets.
    • Handle potentially toxic or offensive content as required (e.g., sexually explicit, graphic, or disturbing material).

    Additional Job Details:

    Requirements:

    • Proven track record of delivering quality products on time.
    • Native-level English proficiency with excellent written and verbal communication skills.
    • Self-driven, motivated, and enthusiastic about working on state-of-the-art machine learning tools.
    • Domain knowledge in specialized fields (e.g., Law, Gardening, Biology, US History, Academic Engineering).
    • 4-year accredited college degree or equivalent experience.

    Ways to Stand Out:

    • Over 1 year of experience delivering products in the LLM space.
    • College degree or experience in Linguistics, English Literature, Creative Writing, Journalism, STEM, or relevant domain knowledge.
    • Deep understanding of large language models and RLHF.
    • Experience in labeling and tagging frames/tasks/prompts for DNN preparation.
    • QA/testing experience.
    • Python scripting skills are a plus.

    Similar Jobs

    See more jobs