workable
Principal Data Engineer - Contract (London)
Insight Investment
Manchester, GBR
Contract
Senior
Hybrid
Discovered 2 weeks ago
SnowflakeSnowparkPySparkPolarsDaskdbt
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
SnowflakeSnowparkPySpark
Key Skills for This Role
SnowflakeSnowparkPySparkPolarsDaskdbt
Full Job Posting
Role Responsibilities
- Contribute to the solution design and implementation of a robust and scalable data platform using
- Snowflake with complementary tooling to meet the organisation's needs.
- Help evolve the Insight Data Strategy, communicate outcomes from a leadership through to team level.
- Set the firm-wide standards and conventions for ingesting, governing, transforming, persisting, and democratising data.
- Provide expertise in ELT pipeline performance optimisation
- Enable the adoption of advanced analytics & AI by configuring best-in-class tooling.
- Evolve the usage of infrastructure-as-code in collaboration with cloud engineering.
- Align technical designs with internal data, privacy, security and compliance policies.
- Stay abreast of industry trends and emerging technologies related to Snowflake and big data processing, recommending relevant advancements for consideration.
Experience Required
Snowflake (Warehouses, Tasks/Streams, Snowpipe, Snowpark, Distributed UDF/Sproc, Time Travel, Cloning)
Demonstratable experience of delivering end to end pipelines in Snowpark (transferable frameworks such as Pyspark, Polars or Dask are also welcome).
DBT including Jinja templating or equivalent transformation frameworks
Python including build tools, test automation frameworks and engineering best practices
SQL (including Snowflake-optimised SQL)
Experience with CI/CD pipelines (GitHub Actions / TeamCity / Artifactory).
Demonstrate initiative and independence to solve problems. § Be able to communicate abstract or complex ideas or solutions effectively. § Stand by software engineering principles around quality and doing things the right way.
Experience working in and with Agile teams performing iterative development. § Ability to collaborate with end users, stakeholders, teams, and team members. § Have a constant desire to improve knowledge and drive adoption of new tech or approaches within the teams. § Own mistakes and work with your colleagues to redress them, learn from them and make improvements for the long-term.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Insight Investment
Senior Investment Analyst/Portfolio Manager, Structured Credit (New York)
New York City, USA
SeniorFull-time
Discovered 1 weeks agoView →
Senior Tailored Investment Reporting Associate (London)
London, GBR
SeniorFull-time
Discovered 2 weeks agoView →
Senior Business Analyst (Fixed Income / Investment) - Contract
London, GBR
SeniorContract
Discovered 2 weeks agoView →
Market Operations Analyst (New York)
New York City, USA
Discovered 1 weeks agoFull-time
Portfolio Analyst (San Francisco)
San Francisco, USA
Discovered 1 weeks agoFull-time
Guideline Management Associate (Boston)
Boston, USA
Discovered 1 weeks agoFull-time
Senior Investment Analyst/Portfolio Manager, Structured Credit (New York)
New York City, USA
Discovered 1 weeks agoFull-time
Director, Client Portfolio Management
Boston, USA
Discovered 1 weeks agoFull-time
Senior Tailored Investment Reporting Associate (London)
London, GBR
Discovered 2 weeks agoFull-time
Senior Business Analyst (Fixed Income / Investment) - Contract
London, GBR
Discovered 2 weeks agoContract
Investment Analyst, Secured Finance (London)
London, GBR
Discovered 2 weeks agoFull-time