Position: Research Intern - STAC (Sociotechnical Alignment Center)
Description (Summary):
The Sociotechnical Alignment Center (STAC) is a team of researchers, applied scientists, and linguists in Microsoft Research (MSR) who represent part of the research pillar of Microsoft’s Responsible AI efforts. Founded within Microsoft Research in 2022, STAC’s mission is to guide the sociotechnical alignment of AI systems, with a particular emphasis on measuring risks, capabilities, performance, and other properties of these systems.
STAC is looking to hire several Research Interns in Redmond and NYC to conduct research on measuring risks, capabilities, performance, and other properties of AI systems, with a focus on “generative” or “general purpose” systems. STAC’s approach to evaluation is grounded in measurement theory from the social sciences and in statistics. STAC is especially interested in candidates with expertise in theoretical and methodological approaches that can be applied to help advance and mature the field of AI system evaluation. Prior experience with AI system evaluation specifically is not required. We especially encourage applications from candidates interested in topics including but not limited to: applications of methodologies from psychometrics and educational testing to the design and validation of evaluations (including methods such as item response theory, factor analysis, and other latent variable models); measurement theory from the social sciences; reliability of generative AI systems and generative AI system evaluation; validity of generative AI system evaluation; improving human and automated annotation methods for use in evaluation; participatory methods in measurement (including how different stakeholders interpret/work with/set goals for AI system measurement).
Preferred and Required Qualifications:
- Currently enrolled in a relevant PhD program.
- Demonstrated ability to conduct original research.
- Ability to collaborate effectively with other researchers and product development teams.
- Proficient interpersonal skills, cross-group, and cross-culture collaboration.
- Ability to think unconventionally to derive creative and innovative solutions.
Stipend:
- The base pay range for this internship is USD $6,550 - $12,880 per month. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $8,480 - $13,920 per month.
Application Deadline: December 18th, 2024, with applications accepted until all positions are filled
For additional detail, and to apply online, see Microsoft's job posting.