Base Career helps you apply smarter for this job.
Key skills for this role
Designing, developing, and maintaining the ETL/ELT pipelines that power the Resonate business - Spark and Scala on AWS EMR, working with terabyte-scale datasets across S3 and Snowflake
Tuning multi-terabyte and petabyte scale Spark applications for performance and cost, and debugging the problems that only ever show up at that size
Partnering with senior engineers and product management to take product requests from design and planning through to pipelines running in production
Monitoring pipeline health in Grafana, tracking down data quality issues, and fixing the cause rather than the symptom
Writing clean, testable code with thorough unit and integration tests, using Gen AI to move faster through the parts that used to slow you down
Using Gen AI tools across pipeline development, monitoring, and day-to-day engineering work - and helping the team figure out where they genuinely help and where they do not
Taking part in code reviews, technical design discussions, and sprint planning, with your point of view on architecture actually counting
Supporting production operations, including an on-call rotation and incident response
Around five years or more of professional experience in software engineering, data engineering, or a closely related field
At least three years hands-on with Spark and Scala, specifically the DataFrame and Dataset APIs
Proven experience tuning Spark applications at multi-terabyte or petabyte scale - you have done it, not just read about it
Real debugging and problem-solving experience in the big data ecosystem, including the jobs that only fail in production
Solid relational database experience
Working knowledge of modern cloud stacks for processing big data - AWS (EMR, S3, Lambda), Kafka, Snowflake, Grafana, Hadoop, Elastic Stack, and Docker
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
San Francisco, USA
San Francisco, USA
Derby, GBR
, USA
, USA
, USA
San Francisco, USA
San Francisco, USA
San Francisco, USA
Derby, GBR
, USA
A strong grasp of the full software development lifecycle, from exploration and design through to delivery in production, plus good instincts on solution architecture, data structures, and data modeling
Real enthusiasm for using generative AI to accelerate data engineering work - pipeline development, system monitoring, and developer productivity
Hands-on experience building and maintaining big data pipelines with Gen AI
Experience using probabilistic data structures
A track record of implementing high cardinality data systems at scale
A bachelor’s degree in computer science, computer engineering, or equivalent experience
You care about the quality of what you ship and you are happy to say so in a design discussion. You are the kind of engineer who wants to know why a job got slower, not just make it faster again, and you would rather write the test than explain later why there was not one. You are comfortable being hands-on and self-directed, and you do not need someone to hand you a fully specified ticket before you can make progress.
You are also curious about how the work itself is changing. The engineers who do well here treat Gen AI as something to get good at, not something to be wary of, and they bring the rest of the team along with what they learn. It is a small, friendly team where what you build is visible and matters to the business straight away.
Data at a scale that is genuinely difficult - terabyte and petabyte workloads, high cardinality, and problems that need real engineering rather than a bigger cluster
A team that has already made the shift to Gen AI in day-to-day engineering work, with the space to push that further
A modern stack you will actually work across, not one you will hear about in a roadmap deck: Spark, Scala, AWS, Snowflake, Kafka, Docker
A company past the early-stage chaos, with serious enterprise customers, a clear direction, and enough scale to make the work meaningful
A remote-first environment with genuine flexibility and occasional travel for company and client events
If this sounds like the role you’ve been looking for, we’d love to talk.
At Resonate, we care about more than your experience on paper. We look for teammates who bring the right mindset and ways of working to help us do great work, together. The Resonators who thrive here embody these qualities:
Proactive Problem-Solving: You spot challenges early and take initiative to solve them.
Ownership: You take initiative, follow through, and hold yourself accountable.
Collaboration: You value working with others and building strong, respectful relationships.
Adaptability: You stay steady through change and adjust when needed.
Growth Mindset: You’re open to learning, feedback, and trying new things.
Customer Focus: You keep the end user in mind and aim for impact.
Clear Communication: You express ideas simply and listen to understand.
Integrity & Empathy: You act with honesty and consider the people around you.
Strategic Thinking: You focus on what matters most and work with purpose.
Drive: You show up motivated and ready to move things forward.
Readiness: You bring the skills to contribute meaningfully from day one.
These attributes are the foundation of how we work and grow together!
AI-powered consumer intelligence company providing data, insights, and marketing technology to brands, agencies, political groups, and advocates.
Visit company websiteJobs and hiring trendsFull-time
Senior · 5+ years experience
Remote
Apply faster on company sites with our extension.