Job Description

Description

OVERVIEWWe are seeking a Generative AI Analyst to support a high-impact machine learning project. This role focuses on creating high-quality prompts and responses across diverse topics and leading labeling initiatives with internal and external partners. The ideal candidate is a strong communicator with native-level U.S. English, experienced in working with data and comfortable training teams on best practices for LLM development. This position is fully remote and suited for someone motivated to work with cutting-edge AI technologies.Project DetailsJob Title: Generative AI AnalystLocation: RemoteHours: 40 hours weeklyLanguage: English (US)Start date: April 2026Employment Type: Full-time W-2 employee with benefits – 5 days a weekPay rate: $27.38/hourIf you reside in California, please apply to the California-specific posting for the applicable rateMust have valid work authorization in the US (Welo Data does not sponsor VISAs at this time).Key ResponsibilitiesCreatively writing prompts and responses to a variety of diverse topicsPerform LLM annotation and evaluation tasks (ranking, scoring, labeling, tagging)Evaluate model outputs for accuracy, relevance, and instruction-followingIdentify and document issues such as hallucinations and inconsistenciesParticipating in and/or supporting labeling workflows, including hands-on annotation and collaboration with internal or external teamsTraining teams on best practices for creating Large Language Models/Data setsRequirementsHands-on experience performing data annotation or evaluation tasks (e.g., labeling, ranking, scoring, or tagging LLM outputs)Native or near-native English with excellent writing skillsStrong attention to detail and ability to follow guidelines consistentlySelf-driven, motivated and enthusiastic to work on state-of-art machine learning tools4 year Accredited College degree or equivalent experienceWays to stand out from the crowd:College Degree or experience in Linguistics, English Literature, Creative Writing, Journalism, and domain knowledge (Law/Medical/Math/Coding/etc.)Experience working in annotation platforms or structured labeling environments is a plusDeep understanding of Large Language Models/RLHFExperience in labeling/tagging of frames/tasks/prompts to prepare for DNNQA/testing experiencePlease note that in order to verify work authorization as is required by Federal law (I-9 process), all new employees must complete a live video verification with their selected IDs and provide photos of these selected IDs within their first 3 days of employment.

Job Tags

Similar Jobs