AI/HPC Network Engineer
Meta

Job Info

Meta's AI Training and Inference Infrastructure is growing exponentially to support ever increasing use cases of AI. This results in a dramatic scaling challenge that our engineers have to deal with on a daily basis. We need to build and evolve our network infrastructure that connects myriads of GPUs together. In addition, we need to ensure that the network is running smoothly and meets stringent performance and availability requirements of RDMA workloads that expects a loss-less fabric interconnect. To enhance the performance of these systems, we continuously seek opportunities for improvement across our infrastructure stack, including network fabric, host networking, communication libraries, and scheduling infrastructure.

AI/HPC Network Engineer Responsibilities:

• Design, develop, test and operate networking systems to support large scale AI training jobs.
• Establish and implement global best practices and contribute to the design of new scalable network solutions.
• Research, develop and deploy numerous technologies and network topologies in order to evolve and scale our AI networks.
• Lead projects to address hard technical challenges, directly contributing to roadmaps and partner alongside the best engineers in the industry to develop reliable and scalable solutions.
• Work closely with our hardware, software, and sourcing teams to develop new networking solutions and influence the future of networking and its associated infrastructure.
• Define and develop optimized network automation tools and systems, including configuration, provisioning, monitoring, alarming, auto-remediation and more.
• Participate in an on-call rotation to support the global network infrastructure and analyze data to diagnose and identify root causes to network issues.
• Help onboard new team members while working with other technical leads and managers to make the team a success.

Minimum Qualifications:

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• 7+ years of relevant experience developing scalable and reliable systems and/or networks.
• Experience in designing, deploying and operating datacenter networks at scale.
• Experience coding in languages like Python, C++, Go.
• Experience in network automation software, leveraging software defined networking principles.
• Understanding of AI technologies and associated network technologies (IB/RDMA/RoCE)

Preferred Qualifications:

• 4+ years of experience working on networks supporting large scale training workloads.
• In-depth Knowledge of IB/RDMA/RoCE Networks.
• Understanding of AI training workloads and demands they exert on networks.
• Understanding of RDMA congestion control mechanisms on IB and RoCE Networks.

About Meta: