Amazon Devices is an inventive research and development company that designs and engineer high-profile devices like Echo, Fire Tablets, Fire TV, and other consumer devices. We are looking for exceptional scientists to join our Science team to advance the state-of-the-art in developing efficient multimodal language models across our product portfolio. Through close hardware-software integration, we design and train models for resource efficiency across the hardware and software tech stack.
The Silicon and Solutions Group Edge AI team is looking for a talented Data Scientist who will build industry-leading training datasets and evaluation benchmarks for multimodal language models on the edge for new devices, including audio and vision experiences.
Key job responsibilities
- Collaborate with cross-functional engineers and scientists to advance the state of the art in multimodal model evaluations for devices
- Design data collection and annotation projects to curate novel, high-quality datasets for training and evaluations
- Curate high quality publicly available datasets and develop synthetic annotation/generation methods to scale datasets
- Analyze large offline and online datasets to understand model gaps, develop methods to interpret model failures, and collaborate with training teams to enhance model capabilities for product use cases
- Work closely with scientists, compiler engineers, data collection, and product teams to advance evaluation methods
A day in the life
As a Data Scientist with the Silicon and Solutions Group Edge AI team, you'll contribute to innovative methods for evaluating new product experiences, design new datasets and data collection projects, curate massive datasets for quality and diversity, and discover ways to enhance our model capabilities and enrich our customer experiences. You'll have opportunities to collaborate across teams of engineers and scientists to bring algorithms and models to production.
About the team
Our Edge AI science team brings together our unique skills and experiences to deliver state-of-the-art multimodal AI models that enable new experiences on Amazon devices. We work at the intersection of hardware, software, and science to build models designed for our custom silicon.
BASIC QUALIFICATIONS
- Master's degree or above in computer science, mathematics, statistics, machine learning or equivalent quantitative field
- Experience in a ML or data scientist role with a large technology company
- Experience with data scripting languages (e.g. SQL, Python, R etc.) or statistical/mathematical software (e.g. R, SAS, or Matlab)
- Experience with machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance
- Experience applying theoretical models in an applied environment
PREFERRED QUALIFICATIONS
- Experience diving into data to discover hidden patterns and of conducting error/deviation analysis
- Experience developing experimental and analytic plans for data modeling processes, use of strong baselines, ability to accurately determine cause and effect relations
- Experience implementing algorithms using both toolkits and self-developed code
- Experience working with large language models and/or vision-language models