Research Scientist, Machine Learning - Audio
Meta · Redmond, Washington, United States · $122K–$181K/yr
Software Development · 10,001+ employees
About the role
Develop novel algorithms and signal processing techniques to improve AI agent interactions in VR and AR environments. Lead the creation of prototypes and collaborate across teams to integrate ML solutions with hardware and software co-design.
What they look for
Requirements
Requires a PhD or equivalent experience in a technical field like Computer Science or Electrical Engineering. Candidates must have 3+ years of experience in speech signal processing and proficiency in C++, MATLAB, or Python.
Benefits
Full description
At Meta’s Reality Labs Research, our goal is to make consumer virtual, augmented, and mixed reality experiences. Come work alongside scientists and engineers to create the technology that makes VR and AR pervasive and universal. Join us as we develop technologies that define the future of AR and VR. We are a team of researchers and engineers creating the future of augmented and virtual reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR and VR have the potential to transform how we work, play, and connect.
We are developing all the technologies needed to enable breakthrough Smart glasses, AR glasses and VR headsets, including optics and displays, computer vision, audio, graphics, brain-computer interfaces, haptic interaction, eye/hand/face/body tracking, perception science, and true telepresence. Some of those will advance much faster than others, but they all need to happen to enable AR and VR that are so compelling that they become an integral part of our lives.
The audio team within Reality Labs Research is looking for an experienced, innovative Machine Learning Research Scientist, with a specialty in audio and speech processing to join our growing team. You will be doing research and conducting applied research in technologies that improve interactions with an AI agent under challenging acoustic conditions, with a team of dedicated researchers, developers, and engineers. You will operate at the intersection of acoustics, speech, and signal processing algorithms with hardware and software co-design.
Responsibilities
- Develop novel algorithms and signal processing techniques to solve complex problems at the intersection between machine learning, acoustics, and signal processing with applications in VR and AR
- Develop sensor fusion solutions with limited compute and memory
- Develop ML algorithms that deliver on engineering best practices and product quality
- Lead the development of applications to enable quick prototyping, proof-of-concept, and demonstrations
- Collaborate with teams in the larger Reality Labs organization and provide creative leadership on cross-team technologies
Minimum Qualifications
- Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
- Ph.D. or equivalent experience in Applied Mathematics, Audio Engineering and Signal Processing, Acoustics, Electrical Engineering, Computer Science, Biomedical Engineering, or a related field
- Experience in developing and shipping speech input solutions
- 3+ years of experience in developing, implementing, and evaluating algorithms and signal processing techniques for speech
- 3+ years of experience in programming in C++, MATLAB, or Python
- Experience collaborating with geographically distributed or cross-functional teams
Preferred Qualifications
- Demonstrated experience in designing, executing, and analyzing perceptual studies to evaluate audio performance
- Proven track record of successfully leading complex research projects with significant impact on products or company's strategy
- 3+ years of experience developing, implementing, and evaluating algorithms and signal processing techniques for beamforming and machine learning solutions
$122,000/year to $181,000/year + bonus + equity + benefits