Software Engineer, Data Infrastructure & Acquisition
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
A partner company seeks a Software Engineer to build and scale data ingestion pipelines for AI model training. Requires 5+ years of software engineering experience, Python, GCP, Terraform, and Docker skills.
Key Skills for This Role
Responsibilities
- Build and maintain scalable data ingestion and processing pipelines
- Extend cloud infrastructure (GCP) using Infrastructure as Code tools
- Identify and integrate new data sources into acquisition systems
- Collaborate with research and AI teams to improve dataset quality and efficiency
- Optimize systems for cost, throughput, and reliability at scale
- Contribute to architecture and roadmap decisions for data infrastructure
Requirements
- 5+ years of software engineering experience
- Strong proficiency in Python and Linux environments (bash scripting)
- Experience with GCP and Infrastructure as Code (Terraform preferred)
- Hands on experience with Docker and cloud native development
- Exposure to large scale data pipelines or web crawling systems (preferred)
- Strong problem solving and system design skills
- Excellent communication and cross functional collaboration abilities
- Degree in Computer Science or related technical field (BS/MS/PhD)
Full Job Posting
Overview
- This role sits at the intersection of software engineering, data infrastructure, and applied AI, focusing on building and scaling the systems that power large scale dataset acquisition for next generation machine learning models.
Accountabilities
- Build and maintain scalable data ingestion and processing pipelines
- Extend cloud infrastructure (GCP) using Infrastructure as Code tools
- Identify and integrate new data sources into acquisition systems
- Collaborate with research and AI teams to improve dataset quality and efficiency
- Optimize systems for cost, throughput, and reliability at scale
- Contribute to architecture and roadmap decisions for data infrastructure
Requirements
- 5+ years of software engineering experience
- Strong proficiency in Python and Linux environments (bash scripting)
- Experience with GCP and Infrastructure as Code (Terraform preferred)
- Hands on experience with Docker and cloud native development
- Exposure to large scale data pipelines or web crawling systems (preferred)
- Strong problem solving and system design skills
- Excellent communication and cross functional collaboration abilities
- Degree in Computer Science or related technical field (BS/MS/PhD)
Benefits
- Competitive base salary with bonus and equity opportunities
- Fully remote, distributed first work environment
- High impact role working on AI systems used at global scale
- Opportunity to shape foundational data infrastructure for ML models
- Collaborative, engineering driven culture with strong autonomy
- Access to cutting edge AI and data engineering technologies
- Fast paced environment with ownership over meaningful technical problems
- Work on a product that improves accessibility and learning experiences worldwide
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Jobgether
Technical Recruiter / Talent Acquisition Partner
Abu Dhabi, UAE
Jobgether is looking for an experienced Technical Recruiter / Talent Acquisition Partner based in the UAE to manage end-to-end recruitment across technology, engineering, and business functions. The role offers remote wo
Userplane Protocol Stack Engineer
Abu Dhabi, UAE
Jobgether is hiring a Userplane Protocol Stack Engineer for a partner company in the UAE. The role involves designing, developing, and supporting network communication solutions using TCP/IP, Kubernetes, cloud platforms,
DOTNetCore developers
Abu Dhabi, UAE
Jobgether is hiring a .NET Core Developer for a partner company in the UAE. The role involves designing, building, and integrating secure, scalable platforms using .NET Core, REST, gRPC, and event-driven architectures. R
Freelance Recruiter (Global Recruitment Partner)
Abu Dhabi, UAE
We are seeking an experienced Freelance Recruiter to manage end-to-end sourcing and placement across multiple industries. You will source, screen, and engage candidates using LinkedIn, Boolean search, and professional ne
Talent Sourcer (Freelance)
Abu Dhabi, UAE
We are looking for a freelance Talent Sourcer based in the UAE to identify and engage exceptional candidates using innovative sourcing strategies. You will build talent pipelines, conduct market mapping, and screen candi
International Creative Writer with French
Abu Dhabi, UAE
We are looking for a freelance International Creative Writer with native French skills to craft engaging dialogues for a virtual assistant. You will write, edit, and localize conversational content, ensuring cultural rel
Head of Product (Core/PAM)
Abu Dhabi, UAE
Jobgether seeks a Head of Product to define product vision and strategy for a Player Account Management (PAM) platform in the iGaming industry. This remote leadership role requires 7+ years of product management experien
Software Craftsperson/Node.js/React.js/AI
Abu Dhabi, UAE
A remote opportunity for a software engineer passionate about building high-quality, scalable systems using Node.js, React.js, and AI-powered tools. You will take full-stack ownership, apply software craftsmanship practi
Technical Recruiter / Talent Acquisition Partner
Abu Dhabi, UAE
Userplane Protocol Stack Engineer
Abu Dhabi, UAE
DOTNetCore developers
Abu Dhabi, UAE
Freelance Recruiter (Global Recruitment Partner)
Abu Dhabi, UAE
Talent Sourcer (Freelance)
Abu Dhabi, UAE
International Creative Writer with French
Abu Dhabi, UAE
Head of Product (Core/PAM)
Abu Dhabi, UAE
Software Craftsperson/Node.js/React.js/AI
Abu Dhabi, UAE