Base Career helps you apply smarter for this job.
Key skills for this role
We are seeking a highly skilled GCP Infrastructure Engineer to design, build, and manage the cloud infrastructure that powers Generative AI (GenAI) applications at scale.
In this role, you will leverage Google Cloud Platform (GCP) Vertex AI, IBM Watsonx, and containerization technologies such as Docker and Kubernetes (GKE) to deliver secure, scalable, and high-performance AI solutions.
You will own the end-to-end infrastructure lifecycle — from design and provisioning to automation, monitoring, and optimization — while enabling data scientists and ML engineers to seamlessly deploy and operate GenAI workloads.
Before you apply to a job, select your language preference from the options available at the top right of this page.
Explore your next opportunity at a Fortune Global 500 organization.
Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day.
We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion.
If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level.
We are seeking a highly skilled GCP Infrastructure Engineer to design, build, and manage the cloud infrastructure that powers Generative AI (GenAI) applications at scale.
In this role, you will leverage Google Cloud Platform (GCP) Vertex AI, IBM Watsonx, and containerization technologies such as Docker and Kubernetes (GKE) to deliver secure, scalable, and high-performance AI solutions.
You will own the end-to-end infrastructure lifecycle — from design and provisioning to automation, monitoring, and optimization — while enabling data scientists and ML engineers to seamlessly deploy and operate GenAI workloads.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
Chennai, IND
Karnes City, USA
Oklahoma City, USA
Perth, AUS
Horsley, AUS
Chennai, IND
Goleta, USA
Botany, AUS
Karnes City, USA
Oklahoma City, USA
Dartmouth, CAN
Design, provision, and maintain scalable, secure, and cost-efficient infrastructure for GenAI applications on GCP.
Deploy and manage containerized workloads using Docker and Kubernetes (GKE).
Configure and optimize Vertex AI and IBM Watsonx platforms for training, fine-tuning, and serving LLMs and other generative models.
Implement high-performance GPU/TPU clusters to support distributed training and large-scale inference.
Ensure business continuity through backup, disaster recovery, and multi-region deployments.
Develop and maintain Infrastructure as Code (IaC) templates with Terraform, or Cloud Deployment Manager.
Adopt GitOps practices (Flux) for infrastructure lifecycle management.
Build and optimize CI/CD pipelines for data pipelines, model workflows, and GenAI applications.
Apply SRE principles (SLIs, SLOs, SLAs) to guarantee platform reliability and uptime.
Embed DevSecOps best practices across the infrastructure lifecycle, including policy-as-code, vulnerability scanning, and secrets management.
Enforce identity and access management (IAM), network segmentation, and data encryption in compliance with standards (HIPAA, SOX, GDPR, FedRAMP).
Collaborate with enterprise security and compliance teams to implement governance frameworks for GenAI platforms.
Implement observability stacks (Prometheus, Grafana, Cloud Monitoring, Datadog) for both infra health and ML-specific metrics (model drift, data anomalies).
Define KPIs to monitor system health, performance, and adoption across AI workloads.
Optimize cloud cost efficiency for GPU/TPU-intensive workloads using autoscaling, preemptible instances, and utilization monitoring.
Partner with data scientists, ML engineers, and software teams to streamline GenAI application development and deployment.
Provide onboarding, documentation, and reusable templates to enable faster adoption of AI infrastructure.
Stay current with the latest advancements in GenAI, cloud-native infrastructure, and container orchestration.
Bachelor’s or master’s degree in computer science, Software Engineering, or a related field.
8+ years of experience in cloud infrastructure engineering, DevOps, or platform engineering.
with GenAI use cases (chatbots, content generation, code assistants, etc.).
Strong hands-on expertise with Google Cloud Platform (GCP), especially Vertex AI.
with IBM Watsonx for AI application deployment and management.
Proven skills in Docker, Kubernetes (GKE), and container orchestration at scale.
Proficiency in Python, Bash, or other relevant scripting languages.
Strong understanding of cloud networking, IAM, and security best practices.
with CI/CD tools (GitHub Actions, GitLab CI, Jenkins) and IaC tools (Terraform, Pulumi, Ansible, Deployment Manager).
Familiarity with data pipelines and integration tools (Dataflow, Apache Beam, Pub/Sub, Kafka).
Excellent problem-solving, debugging, and communication skills.
Experience in MLOps practices for model deployment, monitoring, and retraining.
Exposure to multi-cloud or hybrid cloud environments (GCP, AWS, Azure, on-prem).
Hands-on experience with feature stores (Vertex AI Feature Store, Feast) and ML observability tools (EvidentlyAI, Fiddler).
Knowledge of distributed training frameworks (Horovod, DeepSpeed, PyTorch Distributed).
Contributions to open-source projects in infrastructure, MLOps, or GenAI.
managing infrastructure in regulated industries.
Certified Kubernetes Administrator (CKA) or Certified Kubernetes Application Developer (CKAD)
IBM Certified Watsonx Generative AI Engineer – Associate
IBM Certified Solution Architect - Cloud Pak for Data
Other relevant certifications in AI, Machine Learning, or Cloud-Native technologies.
UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.
UPS is an American multinational package delivery and supply chain management company. It is one of the world's largest shipping carriers, operating in over 200 countries and territories.
Visit company websiteJobs and hiring trendsFull-time
Senior · 8+ years experience
Apply faster on company sites with our extension.