Base Career helps you apply smarter for this job.
Key skills for this role
Design, build, and maintain robust batch and streaming data pipelines that ingest data from multiple sources into analytical data stores.
Build and operate Apache Airflow DAGs , including scheduling, dependencies, retries, backfills, idempotency, concurrency, and failure handling.
Develop analytics-ready datasets using dbt , following well-structured staging, intermediate, and mart layers with appropriate tests, documentation, and incremental models.
Own ClickHouse as the primary analytical store, including: Schema and table design using the MergeTree family of engines Partitioning and sorting/primary key strategies Materialized views Distributed and replicated table architectures Query and memory optimization High-volume data ingestion and performance tuning
Schema and table design using the MergeTree family of engines
Partitioning and sorting/primary key strategies
Materialized views
Distributed and replicated table architectures
Query and memory optimization
High-volume data ingestion and performance tuning
Work with BigQuery where cloud data-warehouse patterns are appropriate, including data modeling and query/cost optimization.
Design and operate NoSQL and key-value data stores , including Bigtable, DynamoDB, and Redis, based on specific access patterns and performance requirements.
Build and maintain data-quality frameworks covering validation, testing, freshness, completeness, reconciliation, and anomaly detection.
Implement monitoring, alerting, structured logging, and observability for data pipelines and services.
Own pipeline SLAs, incident response, troubleshooting, and root-cause analysis.
Manage backfills, safe re-runs, schema evolution, and data migrations while minimizing downstream impact.
Build reproducible, containerized environments using Docker and contribute to CI/CD and Infrastructure as Code practices.
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
Delhi, IND
, IND
Delhi, IND
Delhi, IND
Gurugram, IND
, IND
, IND
, IND
, IND
Partner with analysts, data scientists, product managers, and product engineers to translate business and technical requirements into scalable data models and pipelines.
Continuously improve pipeline reliability, scalability, performance, and infrastructure cost efficiency.
Experience with search platforms such as Elasticsearch, OpenSearch, Apache Solr, or Vespa, including indexing pipelines, schema design, and relevance/performance tuning.
Experience with Aerospike or other high-performance, low-latency distributed key-value/NoSQL systems.
Experience building streaming and event-driven pipelines using Kafka, Pub/Sub, or similar technologies.
Experience with Change Data Capture (CDC) patterns and technologies.
Experience with Apache Spark and data-lake architectures using object storage such as GCS or S3.
Experience with Terraform or other Infrastructure as Code tools and Kubernetes .
Experience with data-quality and observability tools such as Great Expectations, Soda, Monte Carlo, or advanced dbt testing .
Understanding of data platform cost optimization / FinOps practices.
Experience handling high-volume e-commerce, product catalog, behavioral, or event data .
Familiarity with a second backend programming language, particularly Go .
Data pipelines are reliable, well-tested, observable, and consistently meet freshness and completeness SLAs .
Data models are clean, scalable, documented, and trusted by analytics, data science, and product teams.
Data-quality issues are identified before they impact downstream consumers .
Pipeline failures are diagnosed and resolved quickly, with clear root-cause analysis and preventive actions.
ClickHouse and the broader analytical platform scale smoothly with growing data volumes and query workloads .
Data infrastructure remains performant and cost-efficient as usage grows.
Downstream teams can confidently rely on the platform for analytics, reporting, experimentation, and data-driven product experiences .
Verified company details for this employer are not available yet.
Full-time
Senior · 4+ years experience
Remote
Apply faster on company sites with our extension.