Big Data Developer
Role Overview
We are seeking a skilled Big Data Developer with 2–8 years of experience to design, develop, and maintain scalable data processing systems. The ideal candidate will have strong programming skills and hands-on experience with big data technologies, distributed computing, cloud platforms, and data pipeline development.
Key Skills for This Role
Full Job Posting
Big Data Developer
Job Title: Big Data Developer Job Locations: Austin, TX; Dallas, TX; Seattle, WA; Chicago, IL; New York, NY Job Type: Full-Time Experience Required: 2–8 Years Work Mode: Remote / Hybrid / On-site, depending on employer Estimated Annual Salary: $85,000–$160,000
Job Overview
We are seeking a skilled Big Data Developer with 2–8 years of experience to design, develop, and maintain scalable data processing systems. The ideal candidate will have strong programming skills and hands-on experience with big data technologies, distributed computing, cloud platforms, and data pipeline development.
Key Responsibilities
- Design, develop, and maintain scalable big data applications and processing pipelines.
- Build ETL/ELT workflows to process structured and unstructured data.
- Develop data processing solutions using Apache Spark, Hadoop, and related technologies.
- Write optimized SQL queries and data transformation scripts.
- Integrate data from databases, APIs, and external sources.
- Develop real-time data streaming solutions using Apache Kafka or similar technologies.
- Work with AWS, Microsoft Azure, or Google Cloud Platform.
- Optimize data processing performance, scalability, and reliability.
- Collaborate with data engineers, data scientists, analysts, and software developers.
- Implement data quality checks, security controls, and monitoring.
- Troubleshoot data processing issues and maintain technical documentation.
Required Skills
- Proficiency in Python, Java, Scala, or SQL.
- Experience with Apache Spark, Hadoop, Hive, or Kafka.
- Understanding of distributed computing and big data architecture.
- Hands-on experience with ETL/ELT pipelines and data integration.
- Knowledge of relational and NoSQL databases.
- Familiarity with cloud data platforms and data warehouses.
- Experience with data modeling, performance tuning, and data quality.
- Strong analytical, problem-solving, and communication skills.
Experience Levels & Estimated Annual Salary
- ExperienceEstimated Annual Salary (USD)2–3 Years$85,000–$105,0003–5 Years$100,000–$130,0005–8 Years$125,000–$160,000
- Salary estimates are indicative and vary by employer, location, industry, and technical expertise.
Educational Qualifications
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field preferred.
- Equivalent professional experience, relevant certifications, and demonstrated technical skills may be considered.
Preferred Qualifications
- Experience with AWS EMR, Azure Databricks, or Google Cloud Dataproc.
- Familiarity with Apache Airflow, Delta Lake, or cloud data warehouses.
- Knowledge of real-time streaming, data lakes, and distributed storage.
- Experience with Git, Docker, CI/CD, and automated testing.
- Understanding of data governance, security, and privacy standards.
Benefits
- Competitive salary and performance-based incentives.
- Health, dental, and vision insurance, where offered.
- Paid time off and company holidays.
- Professional development and certification opportunities.
- Opportunities to work on large-scale data engineering projects.
How to Apply
- Interested candidates can submit their updated resume highlighting relevant big data technologies, technical skills, certifications, and project experience.
- Equal Opportunity Statement: We welcome qualified applicants from diverse backgrounds. Candidates must meet the applicable US work authorization requirements for the position.
About EdgeQ Technologies Private Limited
A private U.S. staffing and recruitment firm connecting IT, healthcare, and other professionals with employers.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at EdgeQ Technologies Private Limited
QA Engineer
, USA
End User Computing (EUC) Engineer
, USA
Database Administrator (DBA)
, USA
SAP Technical & Functional Support Engineer
, USA
Desktop Applications Engineer
, USA
Analytics Engineer
, USA
CI/CD Engineer
, USA
Cloud Solutions Architect
, USA
