Software Engineer, Model Inference

This critical role is responsible for the performance and scalability of OpenAI’s core generative models at inference time. You will design, build, and optimize low-latency, high-throughput systems capable of serving petabytes of model calls daily. Key responsibilities include profiling bottlenecks in massive compute clusters, implementing advanced quantization techniques, developing custom kernel optimizations (e.g., on CUDA/TPUs), and ensuring system reliability across diverse hardware environments. The successful candidate must have deep expertise in the entire ML stack, from compiler optimization to distributed systems design, with a relentless focus on maximizing throughput while minimizing operational cost.

(تازہ ترین نوکریاں، سلیبس اور ٹیسٹ کی تیاری کی مکمل معلومات)