We are looking for a highly skilled Quality Analyst Project Coordinator to support the development of advanced AI tools for product attribution, classification and other purposes. This project focuses on creating a rich and diverse dataset of written Italian text, annotated and corrected by humans.
Responsibilities:
- Review and audit labeled datasets for both text
and image-based content to ensure accuracy, consistency, and adherence to
guidelines.
- Document and share feedback with the individual
labelers
- Identify trends and insights in quality
performance, and effectively mitigate quality performance issues.
- Communicate quality trends and insights to the
customer. Calibrate with the customer on instructions and edge
cases.
- Evaluate responses generated by AI, verifying
correctness, clarity, relevance, and alignment with task instructions.
- Apply knowledge of the Consumer Packaged Goods
domain to accurately classify and/or describe products.
- Collaborate with cross-functional teams to
update labeling workflows and improve quality.
- Monitor performance metrics (e.g., accuracy
rates, inter-rater agreement) and contribute to continuous improvement
initiatives.
- Generate responses with intentional but
realistic grammar, spelling, and structural errors.
- calibration sessions to align QA standards
across teams and help train new reviewers or analysts.
- Adapt quickly to evolving guidelines, new task
types, and AI model updates in a fast-paced, iterative environment.
- Ensure that documentation is up to date.
Qualifications:
- English as a second language – minimum C1
English proficiency required.
- C2 level of Italian
- Ability to follow linguistic and situational
writing prompts.
- Excellent written communication and coordination
skills
- 2 years working experience in a corporate/
business environment.
Prior
experience in at least one of the following:
- Linguistic QA
- Data annotation for NLP/AI projects
- ESL/EFL teaching, editing, or copyediting
- Keen eye for detail -spotting subtle grammar and
structure issues others miss.
- Comfortable reviewing and providing feedback on
structured data.
- Ability to give actionable and constructive
feedback to annotators.
- Experience with creating and tracking timelines,
milestones, and status reports is a plus.
How to Apply
 Job in Kenya - Sama){kind=link}