AIML - Distinguished Engineer, ML Systems Evaluation Engineering
Job Description
Summary
Do you want to play a part in building groundbreaking technology for large-scale systems, natural language, big data, and artificial intelligence? Join the AIML team at Apple, and help us as we improve the user experience of Siri and AIML products, helping millions of people get things done across the globe!
Description
In this senior technical leadership role, you will define our model evaluation strategy and determine and develop appropriate methodologies to improve model accuracy. Our goal is to deliver offline evaluation insights that drive model development and improvements with wins for our end-user experience, all while upholding the privacy standards that Apple is known for. With the advent of Apple Intelligence, you will face novel challenges in developing representative datasets and simulations to deliver a highly personalized user experience. Utilizing personal context presents specific challenges to delivering accurate responses to every user, demanding innovative evaluation solutions. These models power the next generation of Siri and Apple products, and you will be part of this exciting journey.
As the senior team leader, you will cultivate collaboration with your peers and partners across AIML and Apple. Your leadership will be instrumental in fostering a culture of continuous improvement and taking state-of-the-art evaluation solutions to Apple partners while learning from them.
As the senior team leader, you will cultivate collaboration with your peers and partners across AIML and Apple. Your leadership will be instrumental in fostering a culture of continuous improvement and taking state-of-the-art evaluation solutions to Apple partners while learning from them.
Minimum Qualifications
- 10+ years of technical leadership experience
- Experience with Machine Learning development and evaluation
- Demonstrated contributions towards the development of natural language products and/or technologies
- Proven and consistent track record of forming senior partnerships to solve complex technical problems at scale, ideally for products with a global customer base
- MS/PhD in Machine Learning, Computer Science, or equivalent experience in a related field
Preferred Qualifications
- Extensive experience delivering large-scale product or platform outcomes, leveraging cross-functional partnerships
- Proven record of gaining technical expertise on the job; demonstrates the ability to learn new technologies independently.
- Excellent understanding of an ML-based product lifecycle.
- Demonstrated depth of knowledge and application of statistics-based evaluation methodologies or user success metrics.
- Expertise in generative AI technology, large language models (LLMs)
- Experience with systems engineering; in-depth understanding of interdependencies of ML and SW components.
- Proven innovation record
- Experience providing technical guidance to an engineering organization
- Ability to develop a long-term vision and execute strategies at scale while maintaining a grasp of technical details for better decision-making
- Experience in establishing and maintaining technical cross-functional partnerships across multiple organizations
- Experience with technical presentations for multiple audiences, including executives