Data Transfer Engineer

Data Transfer Engineer

As a Data Transfer Engineer in the Accelerated Compute Engineering (ACE) team, you will manage high-speed data transfer services for advanced compute environments, including our AI Factory. You will be responsible for deploying, configuring, and optimizing Data Transfer Appliances to ensure seamless, high-bandwidth data mobility between HPC clusters and AI infrastructure, eliminating bottlenecks for large-scale computational workloads.

Responsibilities

• Manage the end-to-end lifecycle of Data Transfer Appliances and resolve network and I/O bottlenecks.
• Integrate storage architectures including Object Storage, NAS, and parallel file systems like GPFS.
• Automate deployment and configuration using tools like Ansible, Kickstart, or Red Hat Satellite.
• Monitor system health via logs and network statistics, and track performance metrics.
• Develop documentation and tools to simplify data movement for the scientific community and provide high-level technical support.

Requirements

• Bachelor’s or advanced degree in Computer Science, Engineering, or a related field.
• Experience managing large-scale Linux environments with deep CLI proficiency.
• Background in high-performance computing (HPC) or AI infrastructure.
• Strong scripting skills in Bash and Python, and experience with infrastructure as code (Ansible).
• Deep understanding of parallel file systems (Lustre, GPFS) and high-speed networking (InfiniBand, TCP/IP).
• Knowledge of security protocols including IAM, LDAP, AD, OIDC, and certificate management.
• Strong diagnostic mindset and excellent technical communication skills in English.