Senior Member of Technical Staff, Synthetic Data

About Cohere

Cohere is a leading enterprise AI company focused on security-first approaches. We develop advanced foundational AI models and comprehensive products intended to address practical business challenges. Our team comprises passionate researchers, engineers, designers, and specialists dedicated to expanding the capabilities and value our models deliver to customers. Headquartered in Toronto with offices worldwide, we foster innovative AI solutions that accelerate widespread AI adoption.

Role Overview

We are seeking a Senior Machine Learning Engineer specializing in synthetic data to spearhead the design and maintenance of scalable synthetic data pipelines critical for our cutting-edge language models. Your role includes managing the entire synthetic data lifecycle—from pipeline optimization and data generation to thorough data analysis and model quality assessment through ablation studies. Working extensively with diverse web, code, and multilingual datasets, you will transform raw data using generative technologies to enhance token efficiency and improve model training metrics such as throughput and accelerator utilization. This position supports Cohere's mission to pioneer effective and reliable natural language processing capabilities.

Key Responsibilities

• Develop and operate scalable inference pipelines across large GPU clusters.
• Perform systematic data ablation experiments to evaluate and improve data quality.
• Research and integrate innovative synthetic data curation techniques to enhance NLP models.
• Collaborate closely with cross-disciplinary teams including research scientists and engineers to align data infrastructure with advanced language model requirements.

Qualifications

• Strong proficiency in software engineering with solid experience in Python and building complex data pipelines.
• Familiarity with big data processing frameworks such as Apache Spark, Apache Beam, or Pandas.
• Experience working with large language models through professional projects, open-source contributions, or personal research.
• Knowledge of LLM inference frameworks like vLLM and TensorRT.
• Comfort handling large-scale, multilingual datasets including web and code bases.
• A drive to bridge the gap between research innovation and engineering challenges in AI data pipelines.
• Preferred: Publications in prestigious conferences or journals such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP.

Employee Benefits

• Weekly lunch stipend equivalent to $75 or £75.
• Comprehensive health and dental insurance including dedicated mental health coverage.
• Retirement plans with matching contributions: RRSP, 401K, and Pension Schemes.
• Fully paid parental leave top-up for up to six months for either parent.
• Annual enrichment budget for arts, culture, fitness, wellness, personal time, workspace enhancement, education, courses, conferences, and coaching.
• Generous paid vacation totaling six weeks annually.
• Travel allowance for remote employees to visit offices and participate in company offsites.

Working Environment

• Remote-friendly culture with global offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin, and Seoul.
• Office perks include daily lunches, snacks, and social engagement events.
• Co-working space subsidies for employees preferring collaborative work environments outside the home.
• $500 home office stipend for all employees to set up an ideal workspace.

Diversity & Inclusion

We value diversity and inclusion and encourage candidates from all backgrounds to apply. We commit to providing accommodations for applicants during the recruitment process upon request.

Additional Information

Note that we may utilize AI tools to assist in screening candidates, although human recruiters will review submissions extensively. Beware of fraudulent job postings; legitimate communications and listings originate only from Cohere email addresses or our official career portals.