{bc}
linkedin

Data Engineer [T500-29045]

Stolt-Nielsen
Hyderabad, IND
Full-time
Mid-Senior
Onsite
Discovered 1 weeks ago
DatabricksPythonPySparkSQLDelta LakeUnity Catalog
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

DatabricksPythonPySpark
Smart Apply

Full Job Posting

About Stolt-Nielsen

Stolt-Nielsen is a global provider of bulk-liquid and chemical logistics, transportation, and storage.

The Digital Innovation Centre builds systems and supports digital transformation across the logistics business.

About the Role

The Data Engineer will build and optimize data infrastructure supporting analytics and AI initiatives.

The role focuses on reliable pipelines, data quality, performance, and trusted data access for analysts, data scientists, and business stakeholders.

The engineering team uses modern tools and provides training, mentoring, and opportunities to shape technology practices.

Required Skills

  • Required technologies include Databricks, Python, SQL, Lakehouse Medallion architecture, Unity Catalog, REST APIs, event-driven architectures, Azure data and storage services, Git, CI/CD, and infrastructure as code.
  • The role also mentions Cursor or other AI-enabled IDEs and workflows.

What You’ll Do

  • Design, develop, and maintain scalable Databricks data pipelines using PySpark and Delta Lake.
  • Build ETL/ELT processes to ingest data from APIs, databases, files, and cloud systems.
  • Optimize data models and storage for analytics, machine learning, and BI reporting.
  • Write SQL queries, views, and stored procedures for transformation and analysis.
  • Collaborate with cross-functional teams to translate business needs into technical solutions.
  • Implement data quality, governance, and security standards across platforms.
  • Monitor and troubleshoot workflows for performance, reliability, and cost efficiency.
  • Stay current with data engineering and cloud-native data architecture practices.

What You’ll Bring

  • A bachelor’s or master’s degree in computer science or a related field is required.
  • At least 3 years of hands-on experience as a Data Engineer, ETL Developer, or similar is required.
  • Strong Python skills, especially PySpark and pandas, and advanced SQL capability are required.
  • Hands-on Databricks experience must include workspaces, notebooks, jobs, clusters, and Unity Catalog.
  • Experience with data warehousing, data modeling, distributed processing, Azure PaaS, CI/CD, automated testing, and Agile delivery is required.
  • Analytical ability, attention to detail, effective communication, and cross-functional collaboration are required.

Must-Have Skills

  • Databricks with PySpark, Delta Lake, jobs, and workflows.
  • Python and PySpark for data processing and automation.
  • Advanced SQL for querying and performance tuning.
  • Data pipeline orchestration, data modeling, Git, CI/CD, and Unity Catalog.

Nice-to-Have Skills

  • Familiarity with dbt or modern data stack tools.
  • Knowledge of governance, cataloging, and access control tools such as Unity Catalog or Purview.
  • Exposure to machine learning workflows and model data preparation.
  • Experience with Databricks performance tuning and cost optimization.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Stolt-Nielsen