greenhouse
Data Engineer - Cloud & SaaS Integrations
DoiT
Remote, GBR
Mid · 3+ years experience
Remote
Discovered 5 days ago
airflowawsazurebigquerydbtgcp
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
airflowawsazure
Key Skills for This Role
airflowawsazurebigquerydbtgcp
Full Job Posting
Responsibilities
- Expanding vendor coverage. This is the core of the role. Build new integrations against third-party billing and usage APIs, and get more of our customers' spend visible in the platform. Keep existing integrations current as vendors change their APIs and pricing models - which they do constantly. Drive down the marginal cost of the next integration so coverage scales faster.
- Working AI-augmented. Use AI daily across the full span of your work - exploring unfamiliar codebases and third-party APIs, prototyping approaches, generating and reviewing code, debugging, writing tests, and producing documentation. Push on what the tooling can do for this codebase, and bring judgement about where AI raises velocity and where a human still has to hold the quality bar.
- Data correctness and completeness. Own the quality of the data our integrations produce: duplication, gaps, and race conditions in ingestion and reprocessing, deduplication of spend that also arrives via cloud marketplaces, and support for customers' negotiated rates rather than public list pricing. Build the checks and reconciliation that let us prove the numbers are right rather than hope they are.
- Normalization across vendors. Design and build the models that make dozens of differently-shaped vendor bills comparable - consistent units, currencies, time granularity, resource and service taxonomies, and cost categories.
- Pipeline ownership. Own the orchestration, scheduling, and backfill mechanics for ingestion pipelines end-to-end - including making backfills a routine, safe, self-service operation.
- Collaborating and problem-solving. Work with product, support, and the engineers building on top of this data to understand where the gaps hurt. Propose work you think should happen; you're not here to wait for a spec.
Qualifications
- 3+ years of professional experience in data engineering or a data-heavy backend role, with production ownership of pipelines that other people depend on
- Strong SQL - you can write, read and reason about the performance of non-trivial analytical queries
- Hands-on experience building and operating data pipelines with an orchestration framework. Dagster or Airflow is highly desired; equivalent experience with Prefect, dbt or a comparable tool is relevant if you're ready to work in Dagster/Airflow
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at DoiT
Manager of Sales, Attribute™, EMEA
, GBR
Discovered YesterdayFull-time
Manager of Sales, Attribute™, EMEA
, GBR
Discovered YesterdayFull-time
Manager of Sales, Attribute™, EMEA
, GBR
Discovered YesterdayFull-time
Manager of Sales, Attribute™, EMEA
, GBR
Discovered YesterdayFull-time
Account Manager, US
, USA
Discovered 2 days agoFull-time
Account Manager, US
, CAN
Discovered 2 days ago
Data Engineer - Cloud & SaaS Integrations
, GBR
Discovered 2 days agoFull Time, Contract
Engineering Manager - Revenue Management Azure
, GBR
Discovered 2 days agoFull-time
