linkedin
Junior Data Engineer — Web Scraping & Pipelines
Master Art Index
Montreal, CAN
Full Time
Junior
Hybrid
1 weeks ago
PythonSQLPostgreSQLWeb ScrapingScrapyBeautifulSoup
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonSQLPostgreSQL
About the Role
Master Art Index is hiring a Junior Data Engineer to build and maintain web scrapers and data pipelines for art market data. The role involves Python, SQL, and ETL work with high ownership.
Key Skills for This Role
PythonSQLPostgreSQLWeb ScrapingScrapyBeautifulSoup
Responsibilities
- Build and maintain scrapers that collect publicly available art market data from web sources using Python (e.g. Scrapy, BeautifulSoup, Playwright, or Selenium)
- Clean, transform, and standardize messy, inconsistent real world data so it’s ready for use
- Store the cleaned data reliably in our PostgreSQL database — designing sensible schemas and writing efficient queries
- Keep the pipelines running: schedule jobs, monitor for failures, and keep the data fresh
- Apply basic data quality checks and validation so the data downstream teams rely on stays accurate
Requirements
- 2+ years of experience writing Python for real world tasks — or a recent graduate with strong, demonstrable Python skills
- Comfortable with SQL and relational databases (PostgreSQL a plus): writing queries and designing simple schemas
- Experience (personal projects count) building web scrapers and handling messy, inconsistent data
- A practical, self directed approach — you’re comfortable owning a task from start to finish
Full Job Posting
About Master Art Index
- Master Art Index (MAI) is building the definitive intelligence layer for the global art market.
- We develop AI driven valuation models, structured databases, and financial grade data infrastructure for blue chip modern and contemporary artworks.
- Our platform sits at the intersection of finance, technology, and art.
- We are a lean, cross functional team of AI engineers, computer vision specialists, product managers, and full stack developers.
The Role
- We’re looking for someone who can confidently use Python and SQL to build and maintain the scrapers that power MAI.
- Your job is to collect publicly available art market data from the web, clean and standardize it, and store it reliably in our database.
- You’ll own these pipelines end to end and keep them running smoothly as we grow.
- This is a hands on, high ownership role.
- You’ll work closely with our AI engineers, computer vision engineer, product manager, and full stack developers, reporting to the Head of AI Engineering.
What You’ll Do
- Build and maintain scrapers that collect publicly available art market data from web sources using Python (e.g. Scrapy, BeautifulSoup, Playwright, or Selenium).
- Clean, transform, and standardize messy, inconsistent real world data so it’s ready for use.
- Store the cleaned data reliably in our PostgreSQL database — designing sensible schemas and writing efficient queries.
- Keep the pipelines running: schedule jobs, monitor for failures, and keep the data fresh.
- Apply basic data quality checks and validation so the data downstream teams rely on stays accurate.
What We’re Looking For
- 2+ years of experience writing Python for real world tasks — or a recent graduate with strong, demonstrable Python skills.
- Comfortable with SQL and relational databases (PostgreSQL a plus): writing queries and designing simple schemas.
- Experience (personal projects count) building web scrapers and handling messy, inconsistent data.
- A practical, self directed approach — you’re comfortable owning a task from start to finish.
Nice to Have
- Experience scheduling or orchestrating pipelines (cron, Apache Airflow, AWS EventBridge, or equivalent).
- Hands on AWS experience (Lambda, EC2, S3, RDS).
- Familiarity with containerization (Docker) or infrastructure as code (Terraform, AWS CDK).
- Familiarity with ETL/ELT tooling (dbt, AWS Glue, or equivalent).
- Exposure to art market platforms (Christie’s, Sotheby’s, Artsy, Artnet) or how auction and gallery data is structured.
- An interest in the art world, collectibles, or alternative asset markets.
What We Offer
- A genuinely hard, technically interesting problem — art market data is sparse, inconsistent, and largely unstructured.
- High ownership from day one on infrastructure that is already in use and growing.
- A lean, senior cross functional team: no bureaucracy, fast decisions, direct access to leadership.
- Proximity to cutting edge AI and computer vision work applied to a non commoditized domain.
- Flexible Friday remote work with four collaborative in office days in Montreal.
- Competitive base compensation: CAD 65,000 – CAD 75,000 CAD, commensurate with experience.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career