gem
Software Engineer - Data Platform
Andrenam
Hawthorne, USA
Full-time
Senior · 5+ years experience
Onsite
USD 150000-200000 yearly / year
Discovered 1 weeks ago
PythonPyArrowPolarsPandasNumPySciPy
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonPyArrowPolars
Key Skills for This Role
PythonPyArrowPolarsPandasNumPySciPy
Full Job Posting
- You will define how raw maritime signals become clean, consistent, labeled datasets for perception and foundation models.
- You will prioritize dataset quality, reproducibility, and evaluation fidelity.
- You will collaborate closely with ML/perception to map data contracts to model needs.
- Build and operate post‑processing pipelines that align, resample, and calibrate multi‑sensor data.
- Implement robust backfill/reprocessing frameworks to apply new filters, synchronizations, label corrections, and metadata enrichments across historical data.
- Establish lineage & versioning to guarantee experiment reproducibility.
- Build dataset discovery & access APIs/SDKs so downstream users can query by time, region, modality, labels, and quality flags.
- Instrument data quality metrics (completeness, corruption, drift, label density, class/region balance) with dashboards and alerts; run canary dataset builds.
- Optimize storage layouts for fast reads and parallelization (columnar formats, compression codecs, chunking strategies, sharding, locality, prefetching).
- Demonstrated ownership of dataset‑as‑a‑product: curated corpora supporting multiple model families with strong lineage and documentation.
- Experience designing splitting/sampling strategies (by time, platform, geography, class, SNR) to avoid leakage and ensure generalization.
- Hands‑on with labeling workflows (interfaces, ontologies, consensus, QA) and label‑store integrations.
- Proficiency in Python and data tooling (PyArrow/Polars/Pandas, NumPy/SciPy, audio/vision libs), plus one of Go/Rust/TypeScript for services.
- Comfort with orchestration (Airflow, Prefect) and metadata/lineage (MLflow, W&B).
- Exposure to edge/sensor data (audio/sonar, video, telemetry), time sync, and geospatial context.
- Competitive salary
- Long-term equity incentive program with significant growth potential.
- Flexible PTO and paid holidays.
- Comprehensive medical, dental, vision insurance.
- 401k
- Lunch and snacks provided in office.
- Access to a unique work environment, blending technology, maritime, and defense.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Andrenam
Senior Electrical Integration Engineer
Hawthorne, USA
Discovered 1 weeks agoFull-time
Senior Electrical Engineer
Hawthorne, USA
Discovered 1 weeks agoFull-time
Product Software Engineer
Hawthorne, USA
Discovered 1 weeks agoFull-time
Infrastructure Software Engineer
Hawthorne, USA
Discovered 1 weeks agoFull-time
Firmware Engineer
Hawthorne, USA
Discovered 1 weeks agoFull-time
Federal Account Executive
, USA
Discovered 1 weeks agoFull-time
Test Technician
Torrance, USA
Discovered 1 weeks agoFull-time
Director, Commercial Programs
, USA
Discovered 1 weeks agoFull-time