We are looking for a Product Manager to drive the expansion of our strategic initiatives and accelerate the development of our next-generation hardware-software co-design AI products. As a Product Manager for Machine Learning and Hardware Acceleration, you will play a crucial role in defining new and innovative ways to connect the dots between our machine learning development and system development. We’re looking for a seasoned Product Manager who is well-versed in both domains and is capable of leveraging the unique synergies between ML and system capabilities to unlock unprecedented ML potential within our stack. And equally importantly, someone who can identify the prevalent challenges in ML today and translate them into future hardware features. Your role will involve collaborating closely with ML and system development teams to optimize the interplay between ML models, application requirements, and system architectures, driving performance and efficiency to new heights.

What you’ll be doing (Responsibilities):

• Develop and articulate a compelling ML system product roadmap and strategy, come up with clear requirements and collaborate with cross engineering teams
• Lead the productization of prominent research breakthroughs in ML, focusing on accelerated inference for LLMs as a leading example
• Collaborate with ML and system development teams to identify and optimize the interplay between ML models, apps/solutions requirements, and system architecture, maximizing performance and efficiency
• Drive the development of ML system product to unlock unprecedented ML potential by leveraging our existing technology stack
• Lead the development of system and hardware enhancements to address current challenges in ML. Build differentiators into future products. Anticipate future hardware trends and ML advancements, aligning them with our technology stack roadmap for a competitive present and prepare for what could be coming next
• Lead cross-functional teams in design, development, and delivery of innovative new products and solutions, ensuring alignment across teams and with respect to customer requirements
• Collaborate closely with internal stakeholders across engineering, marketing, sales, and product to align product development efforts and drive successful product launches
• Engage with customer to gather feedback, understand pain points, and prioritize product enhancements, ensuring continuous improvement and customer satisfaction

Basic Qualifications

• 10+ years of relevant work experience in AI/ML technology development, product management at a technology company
• 3+ years of system hardware development or system architecture design experience
• 5+ years of product management or technical product management experience
• Masters degree or PhD in Computer Science or related field
• Strong understanding of LLMs, particularly in the context of performance optimization and large-scale deployment
• Expertise in system architecture and hardware design, with a deep understanding of the interplay between hardware capabilities and ML model requirements
• Solid understanding in optimizing machine learning models for GPU or other accelerator based products
• Proven track record of successfully productizing ML research breakthroughs and driving innovation in ML applications.
• Proven track record of success in product management roles, with experience leading the development and launch of AI-driven products or services
• Strategic mindset with ability to think critically, anticipate market trends, and develop innovative product strategies
• Strong leadership and interpersonal skills, with the ability to inspire and influence cross-functional teams to achieve shared goals
• Passion for understanding customer needs and delivering exceptional user experiences, with a customer-centric approach to product development
• Excellent verbal and written communication skills, with the ability to grasp complex technical concepts and articulate it to diverse audiences
• Self-starter, with a hands-on demeanor in a multifaceted fast paced environment

Preferred Qualifications

• Experience working with or applying Large Language Models in products
• Experience with pre-training, fine-tuning, and evaluating LLMs, multimodal models, and computer vision models
• Experience building and scaling distributed systems
• Rapid prototyping experience with different products and services to validate product market fit
• Proficient in Python
• Possess an active interest in emerging research and industry trends

Annual Salary Range and Level:
The base salary for this position ranges from $150,000.00 per year up to $215,000.00 per year. This range is based on role, level, and location and reflects the salary target for new hires in the US. Individual pay within the range will depend on a number of factors, including a candidate’s job-related qualifications, skills, competencies and experience, and location.