Sr. Data Engineer

Strong Data Engineering Experience: 5+ years of hands-on experience in data engineering (or related fields), including designing and building large-scale data pipelines and storage solutions. You should have taken projects through the full lifecycle from design to production deployment.

Cloud Proficiency (AWS): Strong experience working with AWS cloud services for data. You should be comfortable with tools like S3, EC2, ECS, EKS, Athena, Redshift, Glue, and Step Functions. Experience setting up infrastructure-as-code (Terraform/CloudFormation) for these services is a plus.

Database and Data Modeling Skills: Proficiency in SQL and relational database design. Able to design efficient schemas and optimize queries/indexes for performance. Experience building or working with data warehouses or lakehouses (e.g. Snowflake, Databricks Delta Lake) is highly desired. Familiarity with graph databases (Neo4j, AWS Neptune, etc.) and knowledge graph schemas will help you hit the ground running.

Programming Expertise: Fluency in at least one major programming language used in data engineering. Python is commonly used for data pipelines, and pandas/PySpark experience is valuable. We also value experience with TypeScript/Node.js in data contexts, since our stack leans toward modern web technologies. The ideal candidate can work across languages, for example writing a data API in C# or Node.js to interface with our backend while also crafting Python scripts for data processing. Clean, maintainable code and adherence to best practices are a must.

AI/ML Familiarity: While this is not a pure ML researcher role, you should understand how machine learning models consume data. Experience preparing datasets for training, working with feature stores, or integrating ML model outputs into applications is important. Knowledge of vector embeddings and experience with vector databases (Postgres pgvector, Chroma, Pinecone, etc.) is a big plus, as our AI features rely on semantic search. Familiarity with frameworks for building AI agents or retrieval-augmented generation (e.g. LangChain, LlamaIndex) is also valuable.

AI-Native Mindset: treating AI as core to the workflow, fluency with agentic tools and LLM-assisted dev, pushing the frontier of AI tooling.

DevOps and DataOps Skills: Solid understanding of containerization and deployment. Experience using Docker to package data applications and Kubernetes (or AWS EKS) to run distributed jobs/services. You should be comfortable setting up CI/CD pipelines for automated testing and deployment of data pipelines or ML models. Experience with workflow managers (Airflow, Prefect, dbt, or similar) is beneficial.

Strong Analytical and Problem-Solving Skills: Ability to analyze complex data problems, debug pipeline issues, and optimize system performance. You should be detail-oriented about data correctness and have a knack for troubleshooting data discrepancies or bottlenecks in processing.

Compliance and Security: working in a regulated SEC environment, handling sensitive investor/financial data, building with auditability, least-privilege, and data governance in mind.

Collaboration and Communication: Excellent communication skills and a collaborative mindset. You will be working with a diverse fully-remote team, so you need to articulate ideas clearly and build consensus. Comfort mentoring peers and driving technical projects to completion is important, as is a positive attitude toward continuous learning and improvement. We value growth mindset and adaptability.

Bachelor’s degree in Computer Science, similar technical field of study, or equivalent practical experience

Providing our clients with a world-class experience is our number one priority. We obsessively search for ways to improve the experience for our clients and partners. This requires extraordinary response times, proactivity, and ensuring that everything we do, from product strategy to offline communications is a top-tier client experience.

Challenge convention: Instead of detailing all the reasons why an idea may not work, we constantly question things to determine how a viable idea may be put into motion.

Commitment to continuous improvement: We find ways to personally scale each day by pushing ourselves up the learning curve.

Meritocracy, not politics: We place the utmost value on results and rewards through merit, not reward actions driven by political agendas or behavior.

Civil Discourse is embraced: We believe open, intellectually curious conversations are required to consistently arrive at the best decisions. Respect is paramount in our dealings with one another, but our mission is always to get the right answer collectively, not to be right.

Embrace technological change: We adopt tools and techniques that make us faster, smarter, and better. We stay open to innovation, especially around AI and automation, and drop outdated methods without hesitation. Complacency kills progress, we value adaptability and curiosity.

Location: Fully Remote Position (All I-9 eligible candidates will be considered)

Employment: Full-time

Seniority: Mid-level professional

Salary: Total compensation may also include a discretionary performance-based bonus. The expected base salary range for this role is $145,000 to $220,000.

Actual compensation will be determined based on the candidate's primary work location and other job-related factors including skills, experience, qualifications, interview performance, internal equity, and market data. Candidates located in higher cost-of-living markets, including the San Francisco Bay Area, may be considered within the higher end of the range.

This range reflects base salary only and does not include bonus, equity, benefits or other forms of compensation that may be offered. Total compensation may also include a discretionary performance-based bonus.

Benefits: Medical, dental, and vision. 401(k), and responsible vacation time (PTO)

Travel required for team/department offsites

An in-person interview may be required during the interview process

A Broadband internet connection required

Compliance with Allocate's Code of Ethics is a given for this role.