Pre-training Data Infrastructure Engineer

Anthropic is seeking a highly skilled Pre-training Data Infrastructure Engineer to join our core AI infrastructure team. This role involves managing the entire lifecycle of data used for training state-of-the-art foundation models. You will be responsible for building resilient, scalable data pipelines capable of processing petabytes of diverse text and code datasets efficiently. Key tasks include implementing version control for massive datasets, optimizing data formats for high throughput computation, and collaborating with research teams to ingest novel data modalities. The ideal candidate possesses deep expertise in cloud computing architectures (e.g., Kubernetes, Spark), advanced knowledge of distributed systems principles, and exceptional Python programming skills. This position is crucial to Anthropic's ability to scale its LLM capabilities while maintaining the highest standards of data quality and integrity.

(تازہ ترین نوکریاں، سلیبس اور ٹیسٹ کی تیاری کی مکمل معلومات)