Data Engineer - Data Engineering

Engineering
San Francisco
Full-time
Apply
We build simple yet innovative consumer products and developer APIs that shape how everybody interacts with money and the financial system.
The main goal of the DE team in 2024-25 is to build robust golden data sets to power our business goals of creating more insights based products. Making data-driven decisions is key to Plaid's culture. To support that, we need to scale our data systems while maintaining correct and complete data. We provide tooling and guidance to teams across engineering, product, and business and help them explore our data quickly and safely to get the data insights they need, which ultimately helps Plaid serve our customers more effectively. Data Engineers heavily leverage SQL and Python to build data workflows. We use tools like DBT, Airflow, Redshift, ElasticSearch, Atlanta, and Retool to orchestrate data pipelines and define workflows. We work with engineers, product managers, business intelligence, data analysts, and many other teams to build Plaid's data strategy and a data-first mindset. Our engineering culture is IC-driven -- we favor bottom-up ideation and empowerment of our incredibly talented team. We are looking for engineers who are motivated by creating impact for our consumers and customers, growing together as a team, shipping the MVP, and leaving things better than we found them.

You will be in a high impact role that will directly enable business leaders to make faster and more informed business judgements based on the datasets you build. You will have the opportunity to carve out the ownership and scope of internal datasets and visualizations across Plaid which is a currently unowned area that we intend to take over and build SLAs on. You will have the opportunity to learn best practices and up-level your technical skills from our strong DE team and from the broader Data Platform team. You will collaborate with and have strong and cross functional partnerships with literally all teams at Plaid from Engineering to Product to Marketing/Finance etc.

Responsibilities

  • Understanding different aspects of the Plaid product and strategy to inform golden dataset choices, design and data usage principles.
  • Have data quality and performance top of mind while designing datasets
  • Advocating for adopting industry tools and practices at the right time
  • Owning core SQL and Python data pipelines that power our data lake and data warehouse
  • Well-documented data with defined dataset quality, uptime, and usefulness.

Qualifications

  • 2+ years of dedicated data engineering experience, solving complex data pipeline issues at scale.
  • You have experience building data models and data pipelines on top of large datasets (in the order of 500TB to petabytes)
  • You value SQL as a flexible and extensible tool and are comfortable with modern SQL data orchestration tools like DBT, Mode, and Airflow.
  • [Nice to have] You have experience working with different performant warehouses and data lakes; Redshift, Snowflake, Databricks
  • [Nice to have] You have experience building and maintaining batch and real-time pipelines using technologies like Spark, Kafka.
$163,200.00 - $223,200.00 per year

The target base salary for this position ranges from $163,200/year to $223,200/year in Zone 1. The target base salary will vary based on the job's location. 

Our geographic zones are as follows:
Zone 1 - New York City and San Francisco Bay Area 
Zone 2 - Los Angeles, Seattle, Washington D.C.
Zone 3 - Austin, Boston, Denver, Houston, Portland, Sacramento, San Diego
Zone 4 - Raleigh-Durham and all other US cities

Additional compensation in the form(s) of equity and/or commission are dependent on the position offered. Plaid provides a comprehensive benefit plan, including medical, dental, vision, and 401(k). Pay is based on factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience and skillset, and location. Pay and benefits are subject to change at any time, consistent with the terms of any applicable compensation or benefit plans.

Other opportunities

  • New York

    Data Scientist - Credit

    See role

  • New York

    Data Scientist - Fraud

    See role

  • New York

    Engineering Manager - Machine Learning

    See role

  • New York

    Engineering Manager - Payment Risk

    See role

  • New York

    Engineering Manager - Update Pipeline

    See role

  • New York

    Experienced Engineering Manager - Customer Growth & Experience

    See role

  • New York

    Machine Learning Engineer - Data Foundation and AI

    See role

  • New York

    Senior Data Scientist - Payments

    See role

  • New York

    Senior Software Engineer - Backend

    See role

  • New York

    Senior Software Engineer - Fullstack

    See role

  • New York

    Software Engineer

    See role

  • New York

    Software Engineer - Intelligent Tooling

    See role

  • New York

    Software Engineer - Platform

    See role

  • New York

    Staff Machine Learning Engineer - Credit

    See role

  • New York

    Staff Machine Learning Engineer - Fraud Data

    See role

  • New York

    Staff Software Engineer - Money Movement

    See role

  • New York

    Staff Software Engineer - Product Foundations

    See role

  • Raleigh-Durham

    Data Scientist - Credit

    See role

  • Raleigh-Durham

    Data Scientist - Fraud

    See role

  • San Francisco

    Data Scientist - Credit

    See role

  • San Francisco

    Data Scientist - Fraud

    See role

  • San Francisco

    Engineering Manager - Intelligent Tooling

    See role

  • San Francisco

    Engineering Manager - Machine Learning

    See role

  • San Francisco

    Engineering Manager - Machine Learning Infrastructure

    See role

  • San Francisco

    Engineering Manager - Payment Risk

    See role

  • San Francisco

    Engineering Manager - Update Pipeline

    See role

  • San Francisco

    Experienced Engineering Manager - Customer Growth & Experience

    See role

  • San Francisco

    Machine Learning Engineer - Data Foundation and AI

    See role

  • San Francisco

    Senior Data Engineer - Data Engineering

    See role

  • San Francisco

    Senior Data Scientist - Payments

    See role

  • San Francisco

    Senior Software Engineer - Backend

    See role

  • San Francisco

    Senior Software Engineer - Data Infrastructure

    See role

  • San Francisco

    Senior Software Engineer - Fullstack

    See role

  • San Francisco

    Senior Software Engineer - ML Infrastructure

    See role

  • San Francisco

    Senior Software Engineer - Network Enablement (Applied ML)

    See role

  • San Francisco

    Software Engineer

    See role

  • San Francisco

    Software Engineer - Intelligent Tooling

    See role

  • San Francisco

    Software Engineer - Platform

    See role

  • San Francisco

    Staff Machine Learning Engineer - Credit

    See role

  • San Francisco

    Staff Machine Learning Engineer - Fraud Data

    See role

  • San Francisco

    Staff Software Engineer - AI

    See role

  • San Francisco

    Staff Software Engineer - Consumer

    See role

  • San Francisco

    Staff Software Engineer - Money Movement

    See role

  • San Francisco

    Staff Software Engineer - Product Foundations

    See role

  • San Francisco

    Staff Technical Program Manager - FinOps

    See role

  • Seattle, WA

    Staff Machine Learning Engineer - Fraud Data

    See role

  • Washington DC

    Staff Machine Learning Engineer - Fraud Data

    See role