HPC Performance and Validation Engineer

Company : INSPYR Solutions

Title: HPC Performance and Validation Engineer
Location: Dallas, Texas (Hybrid – relocation assistance available)  
Duration: Full-time – direct hire
Compensation: $200,000 – $300,000 (Base) OTE: $400,000+ 
Work Requirements: US Citizen OR GC Holders 

HPC Performance and Validation Engineer
Do you want to tackle the biggest questions in finance with near infinite compute power at your fingertips?
Our client is a leading quantitative research and technology firm, with offices in London and Dallas.
They are proud to employ some of the best people in their field and to nurture their talent in a dynamic, flexible and highly stimulating culture where world-beating ideas are cultivated and rewarded.
This is a hybrid role based in their new Dallas infrastructure hub where they work on the latest technologies in a cutting-edge environment.
 
The Role:

• As an HPC Validation and Performance Engineer, you will take ownership of the validation and optimization of our HPC CPU and GPU calc farms.
• This critical role will involve developing a validation and performance baselining framework, which ensures system readiness for AI/ML and HPC workloads across multiple architectures. Your role will be essential in providing continuous performance benchmarking, real-time observability, and long-term strategic readiness.
• You will drive the implementation of advanced tooling and frameworks, maintaining an infrastructure that is crucial to our cutting-edge research efforts. You will be accountable for providing data driven performance metrics to support architectural design choices as we continue to globally scale our data centre footprint.
• We are looking for someone with deep technical expertise in compute, storage or networking optimizations and performance engineering who can develop solutions that scale with our growing infrastructure.
• This role demands a forward-thinking engineer who can anticipate industry trends and adopt emerging architectures and strategies to keep us at the forefront of innovation.

 
Key Responsibilities:

• Architecting and implementing a validation framework to certify the readiness and utilization of GPU nodes across a large, distributed HPC environment
• Defining methodologies to continually assess performance and optimising infrastructure across AI/ML workloads
• Developing and executing comprehensive performance testing using industry and customer specific benchmarks, ensuring optimal performance across HPC compute, storage and networking
• Contribute to research reports that will describe the discoveries of the benchmarking, evaluating the complete HW performance and efficiency
• Leading efforts to debug, identify and then resolve bottlenecks in system performance
• Building robust, scalable tools for automated validation and testing, utilising Python, Go, Kubernetes and CI/CD pipelines to streamline continuous validation and benchmarking processes
• Implementing monitoring solutions using Prometheus, Grafana and other modern monitoring technologies to track performance metrics and real-time health of the cluster
• Defining and implementing best practice for continuous performance validation, ensuring that the infrastructure remains reliable and efficient as new technologies emerge
• Staying informed on industry trends and advancements to ensure long-term strategic alignment
• Working cross-functionally with engineering, infrastructure and research teams to align validation efforts with the broader business objectives, ensuring that the platform meets evolving research demands

 
Who are we looking for?

• Accelerator performance experience, including profiling and tuning with large-scale GPU clusters
• In-depth understanding of NVIDIA ClusterKit, Nsight and Validation Suite, MLPerf and DCGM tools for GPU and DPUs
• Networking & Storage performance experience, including profiling and optimisation with NVIDIA ClusterKit, iPerf or equivalent across InfiniBand/RoCe network implementations
• System benchmarking experience across Linux and familiarity with the Phronix suite or equivalent
• Experience with HPC workloads across distributed global locations, bringing data driven performance data to compliment key architectural decisions
• Strong proficiency in developing automation tools and micro benchmarking frameworks for validation using Python, Go, and Kubernetes in a Ubuntu Linux environment
• Expertise with key monitoring platforms including OTEL, Prometheus, ELK and Grafana and in definition and implementing the overall observability strategy for HPC validation and performance monitoring
• A deep understanding of emerging technologies, architectures and strategies, with the ability to assess their potential impact on infrastructure and adopt them as part of a long-term plan
• Proven ability to lead complex technical projects, influence decisions and engage with stakeholders across technical and research teams

About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at (url removed).

INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.
 

Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions’ Privacy Policy and INSPYR Solutions’ AI and Automated Employment Decision Tool Policy: (url removed). By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.

Apply Online