AWS Data Engineer

Tata Consultancy Services

Bengaluru, IND

Full-time

Mid-Senior

Onsite

Discovered 1 weeks ago

AWSAWS LambdaAWS Step FunctionsPythonPySparkDatabricks

Free

Job Fit Check

Base Career helps you apply smarter for this job.

Ready to Scan

Key skills for this role

AWSAWS LambdaAWS Step Functions

Design, build, and maintain data transformation pipelines using AWS Lambda, Step Functions, and Python.
Design, build, and maintain data transformation pipelines using PySpark and Databricks.
Implement and maintain a complex calculation engine.
Manage large datasets efficiently.
Manage SQL database systems such as PostgreSQL or MongoDB.
Implement and maintain complex data calculation formulas.
Collaborate with software engineers.
Participate in code reviews, design discussions, and software planning.
Contribute to automation, testing, and deployment processes.

AWS services, including Lambda Functions and Step Functions, are used for data pipeline development.
Python is required for pipeline development.
PySpark and Databricks are used for data transformation pipelines.
SQL database experience includes PostgreSQL or MongoDB.
The role involves automation, testing, code reviews, and deployment processes.

Experience designing, building, and maintaining data transformation pipelines using AWS services and Python.
Experience building pipelines with PySpark and Databricks.
Ability to implement and maintain complex calculation engines and formulas.
Experience managing large datasets efficiently.
Experience working with SQL databases, including PostgreSQL or MongoDB.
Ability to collaborate with software engineers and participate in technical design and planning.