gem
Software Engineering - Data Engineer
Voltai
Menlo Park, USA
Full-time
Mid
Onsite
Discovered 1 weeks ago
PythonGoRustBeautifulSouppdfminer.sixApache Airflow
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonGoRust
Key Skills for This Role
PythonGoRustBeautifulSouppdfminer.sixApache Airflow
Full Job Posting
- Collect, parse, and structure diverse data types —including text, images, tables, circuit diagrams, simulations, and signal data—into standardized formats suitable for machine learning applications
- Design and maintain scalable data pipelines that efficiently handle data ingestion, transformation, and integration into ML workflows, ensuring high throughput and reliability
- Optimize data storage solutions to balance performance, scalability, and cost-effectiveness, facilitating rapid access and processing of large datasets
- Collaborate with cross-functional teams , including ML and infra engineers, to curate high-quality training and evaluation datasets aligned with Voltai's product offerings
- Implement robust data validation and quality assurance processes to ensure the integrity and usability of datasets across various applications.
- Programming Languages : Proficiency in Python, with experience in compiled languages such as Go or Rust
- Data Parsing and Extraction : Expertise in parsing and extracting data from various formats and modalities, including PDFs, HTML, images, and binary files, utilizing tools like BeautifulSoup, pdfminer.six, and custom parsers
- Data Pipeline Frameworks : Experience with modern data pipeline frameworks such as Apache Airflow, Prefect, Dagster, or Apache Beam, enabling efficient orchestration of complex data workflows
- Data Processing Tools : Familiarity with tools like Apache Spark, Apache Flink, or similar platforms for large-scale data processing and transformation
- Database Systems : Strong knowledge of relational and non-relational databases, including PostgreSQL, Supabase, and other scalable storage solutions
- Cloud Platforms : In-depth experience with cloud services, particularly AWS, including S3, EC2, Lambda, and related services for deploying and managing data infrastructure
- Web Crawling and Agentic Crawling : Proficiency in building and managing web crawlers using frameworks like Scrapy, Firecrawl, or Crawl4AI, with an understanding of agentic crawling techniques to automate data extraction tasks
- Data Quality and Governance : Commitment to maintaining high data quality standards, with experience in implementing data validation, cleansing, and governance practices
- A strong background in hardware/electronics, gained through professional, academic, or personal projects
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Voltai
Operation Specialist
Palo Alto, USA
Discovered 2 days agoFull-time
Formal Verification Engineer
Palo Alto, USA
Discovered 2 days agoFull-time
Senior Forward Deployed Engineer (FDE)
Palo Alto, USA
Discovered 2 days agoFull-time
Machine Learning Engineer
Palo Alto, USA
Discovered 2 days agoFull-time
Research Engineer - CUDA Kernel Engineering
Palo Alto, USA
Discovered 2 days agoFull-time
System Engineer
Palo Alto, USA
Discovered 2 days agoFull-time
Power Electronics Engineer
Palo Alto, USA
Discovered 2 days agoFull-time
Software Engineer
Palo Alto, USA
Discovered 2 days agoFull-time