Base Career helps you apply smarter for this job.
Key skills for this role
Pipeline Engineering: Build and operate robust ingestion pipelines (both batch and streaming) from databases, event streams, and third-party APIs.
Storage & Performance: Own storage architecture across the lake, lakehouse, and warehouse, optimizing for partitioning, cost efficiency, and query speed.
Reliability & Observability: Keep pipelines observable and restartable by implementing orchestration, automated testing, alerting, and ensuring clean recovery when something breaks at 08:00.
Engineering Best Practices: Work like a true software engineer by implementing infrastructure as code, CI/CD for data workloads, code reviews, and strict version control.
Data Contracts & Governance: Agree on data contracts with data-producing teams to keep schema drift under control, while managing access, retention, and lineage.
Lasting Documentation: Produce clear and comprehensive documentation that ensures your work outlives the engagement.
Has Proven Production Experience: You have built and ran data pipelines in production—and, more importantly, you can articulate what you learned when they broke.
Is an AI-Augmented Engineer: You seamlessly integrate AI tooling into your daily workflow, but you maintain the strict review discipline to verify what it generates before it ships.
Is a Confident Communicator: You possess fluent English and are completely comfortable working directly with customer teams.
Has a Cost Engineering Mindset (Valued): You know how to make a pipeline cheaper and can quantify the savings.
Understands Compliance (Valued): You have exposure to regulated environments, including GDPR obligations, access control, and auditable lineage.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
London, GBR
London, GBR
London, GBR
London, GBR
London, GBR
London, GBR
London, GBR
London, GBR
London, GBR
London, GBR
London, GBR
Core Languages: Advanced, production-grade SQL and Python .
Cloud Platforms: Production depth in one major cloud provider ( AWS , GCP , or Azure ), with a solid grasp of principles to move between them. (A second cloud platform is a plus).
Orchestration: Production experience with an orchestrator from a main vendor (e.g., Airflow , Dagster , Azure Data Factory , or equivalent).
Warehousing & Transformation (Nice to have): Warehouse depth in Snowflake or BigQuery (dimensional or Data Vault modelling), and experience with dbt or equivalent transformation frameworks.
Processing & Streaming (Nice to have): Spark or PySpark at scale, Databricks , and streaming/pub-sub brokers like Kafka , Kinesis , Pub/Sub , or MQTT-class brokers.
AI Data Infrastructure & Formats (Nice to have): Embedding pipelines, vector stores, retrieval feeds, feature stores, and open table/file formats ( Parquet , Iceberg , Delta ).
DevOps & Quality (Nice to have): Terraform , Docker , Kubernetes , GitHub Actions , and data quality frameworks in production ( Great Expectations , Soda , Monte Carlo ).
Source Systems (Nice to have): NoSQL stores (like MongoDB ) and marketing/ad-platform data ( Google Ads , Meta , CRM platform APIs).
We're thrilled to have the opportunity to share with you what it's like to be a part of the Mindera community.
We're a group of friendly and talented individuals who work together to bring projects to life, in a fun, politics-free environment.
Our culture is all about being adaptable and self-organized. We want Minders to take risks, make decisions, work together and feel free to be their most authentic selves, every single day.
We work closely with our clients to truly understand their products and develop high-performance, resilient, and scalable software systems that make a real impact for their users and businesses, worldwide.
We are proud of our work, we're always learning and growing in our Agile and collaborative environment, and we hope you'll love it here just as much as we do!
Check out our Handbook & get to know us better: https://mindera.com/handbook.pdf
Mindera around the world: Por to, Portugal | Aveiro, Portugal | Coimbra, Portugal | Leicester, UK | San Diego, USA | San Francisco, USA | Chennai, India | Bengaluru, India | Blumenau, Brazil | Cluj-Napoca, Romania | Valencia, Spain | Casablanca, Morocco | Melbourne, Victoria, Australia & Remote
Develops bespoke software systems and digital products for enterprises.
Visit company websiteJobs and hiring trendsFull-time
Senior
Hybrid
Apply faster on company sites with our extension.