111K–150K USD / year
Language Assessment Expert
OtherWorkplace — Pittsburgh, PA
Published on 2026-11-13
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Support test development and research for the Duolingo English Test. Collaborate across disciplines to create and evaluate language assessments, ensuring tasks and scores are valid, reliable, and fair.
About the company
Duolingo is a language-learning platform that offers a variety of courses and tools to help users learn new languages through interactive exercises and innovative technologies. The company also develops educational products like Duolingo Math and employs a range of professionals to enhance its services.
The team
Assessment Research and Development team
What you'll do
- Collaborate with researchers, engineers, and designers to develop language assessments
- Design and evaluate assessment tasks, including interactive formats
- Conduct qualitative and quantitative studies of validity, reliability, and fairness
- Apply language assessment and measurement principles to improve test design, content, scoring, and quality assurance
- Translate research findings into recommendations for technical and non-technical partners
- Share findings through reports, publications, blog posts, and presentations
What we're looking for
- PhD in language testing, applied linguistics, second language acquisition, educational measurement, or a related field
- Experience developing or researching high-stakes language assessments, or comparable professional experience
- Expertise in language assessment, test design, validity, reliability, fairness, and measuring language proficiency
- Experience designing and analyzing qualitative and quantitative research studies
- Experience communicating research through publications, reports, or presentations
- Ability to explain measurement concepts clearly to cross-disciplinary collaborators
- Proficiency with data-analysis tools such as R or Python
- Strong collaboration, project-management, and organizational skills
Nice to have
- Experience applying large language models, natural language processing, or related technologies to language assessment
- Experience collaborating with software engineers or AI researchers on digital assessment products
- Experience designing or developing computer-adaptive tests
- Expertise in evidence-centered design, interactive-task development, or integrated-skills assessment
Benefits
- Equity compensation