At d-Matrix

We are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

What We Value

• Humility
• Direct communication
• Inclusivity: our team is inclusive, and our differing perspectives allow for better solutions.
• Execution: we are seeking individuals passionate about tackling challenges and driven by execution.

Ready to come find your playground? Together, we can help shape the endless possibilities of AI.

Location

Hybrid, working on-site at our Santa Clara, CA, headquarters 3-5 days per week.

The Role: Principal Engineer/Technical Director, Distributed Systems

What You Will Do:

The Principal Engineer/Director role requires you to be part of the team that helps productize the SW stack for our AI compute engine. As part of the software team, you will lead the development, enhancement, and maintenance of the distributed systems software stack for scale-out of the next generation AI hardware.

• The d-Matrix software stack consists of runtime and lowering software.
• The runtime software consists of host drivers, inference serving engines, and embedded chip software that support execution of large language models across single cards, multiple cards on a node, and multiple nodes on and across racks in a data center.
• The distributed systems team builds software to enable scale-out. This includes support for data plane operations such as protocol translation hardware NICs, as well as control and management plane operations such as telemetry, monitoring, microservices, container orchestration, and datacenter network tooling.

What You Will Bring:

• BS Computer Science, Engineering, Math, Physics or related degree / MS Preferred
• Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals
• Leadership experience at manager or senior manager level with software for AI accelerator HW
• Proficient in C/C++ and Python development in Linux environment and using standard development tools
• Experience designing and implementing algorithms in high-level languages such as C/C++ and Python
• Experience with host bring-up of specialized hardware such as NICs, network FPGAs, and smart NICs
• Experience with distributed systems software such as message passing and MPI
• Experience with designing and integrating systems for reliability, high availability, fault tolerance, and failover
• Experience with cluster orchestration, including defining containers and integration with Kubernetes
• Experience with performance benchmarking and tuning of large-scale distributed systems
• Self-motivated team player with a strong sense of ownership and leadership

Desired:

• Prior startup, small team or incubation experience
• Experience scaling up large-scale machine learning systems, specifically large language models, using expert parallelism and data parallelism
• Work experience at a cloud provider or AI compute/subsystem company

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work.

We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.