icims
Data Engineer III
Stifel
Memphis, USA
Full-time
Senior · 7+ years experience
Onsite
Discovered 1 weeks ago
PythonSQLAWSAirflowTerraformGit
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonSQLAWS
Key Skills for This Role
PythonSQLAWSAirflowTerraformGit
Full Job Posting
Stifel strives for a culture that puts its clients and associates first: a culture where everyone belongs, everyone is welcome, and everyone contributes to the success of our clients, their careers, and the firm as a whole.
Let’s talk about how you can find your place here at Stifel, where success meets success .
The Data Engineer III is responsible for designing, developing, and maintaining data pipelines and infrastructure on the AWS platform.
The Data Engineer III works with large volumes of data, ensuring its quality, reliability, and accessibility.
Tasks may include data ingestion, transformation, storage, data sharing and consumption, and implementing data security and privacy measures.
This role is crucial in enabling efficient and effective data-driven decision-making.
- Build and maintain scalable and reliable data pipelines, ensuring the smooth flow of data from various sources to the desired destinations in the AWS cloud environment.
- Work closely with stakeholders to understand their data requirements and design data solutions that meet their needs.
- Understand data models/schemas and implement ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in the destination.
- Responsible for monitoring and optimizing the performance of data pipelines, troubleshooting any issues that arise, and ensuring data quality and integrity.
- Proficient in programming languages such as Python and SQL for database querying and manipulation.
- Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR.
- Knowledge of database design principles and experience with database management systems.
- Experience with data storage technologies, such as relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark).
- Understanding of Extract, Transform, Load (ETL) processes and experience with ETL tools like AWS Glue and SQL Server Integration Services is essential.
- Skilled at integrating disparate data sources and ensuring data quality and consistency.
- Understanding and experience with orchestration tools like Apache Airflow, AWS Glue Workflows, AWS Step Functions, and notification services.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Stifel
Operations Executive Director-Strategy & Execution
St. Louis, USA
SeniorFull-time
Discovered TodayView →
Alternative Investment Client Service Specialist II
New York City, USA
MidFull-time
Discovered TodayView →
Trade Support - Fixed Income Middle Office - Operations
St. Louis, USA
EntryFull-time
Discovered 3 days agoView →
Investment Banking Analyst (Future Opportunities)
Toronto, CAN
Discovered TodayFull-time
Operations Executive Director-Strategy & Execution
St. Louis, USA
Discovered TodayFull-time
Alternative Investment Client Service Specialist II
New York City, USA
Discovered TodayFull-time
Operations Associate II-Stifel Support
St. Louis, USA
Discovered 3 days agoFull-time
Annuity Solutions Specialist
St. Louis, USA
Discovered 3 days agoFull-time
Trade Support - Fixed Income Middle Office - Operations
St. Louis, USA
Discovered 3 days agoFull-time
Research Associate I
Atlanta, USA
Discovered 1 weeks agoFull-time
Venture Banking Credit Analyst
New York City, USA
Discovered 1 weeks agoFull-time