Senior Data Quality Engineer (Remote)

 Upgrade ( View website )
 June 1, 2021
 United States
Upgrade is a fintech unicorn founded in 2017. In the last four years, over 15 million people have applied for an Upgrade card or loan, and we have delivered over $7 billion in affordable and responsible credit. Our innovative Upgrade Card combines the flexibility of a credit card with the low cost of an installment loan. Our latest offering, Rewards Checking, gives customers access to no-fee checking accounts with 2% cash back rewards on common everyday spending. Learn more about the team.
 
 
Upgrade has been named a “Best Place to Work in the Bay Area” by the San Francisco Business Times and Silicon Valley Business Journal 3 years in a row, and received “Best Company for Women” and “Best Company for Diversity” awards from Comparably.
 
We are looking for new team members who get excited about designing and implementing new and better products and join a team of 600 talented and passionate professionals. Come join us if you like to tackle big problems and make a meaningful difference in people’s lives.
This is a remote position based in the United States.

Responsibilities

  • Work closely with other members of the Data Engineering and BI teams to design, develop and execute automated test plans to ensure the quality of our data in our Data Warehouse.
  • Investigate current data loading procedures and create detailed, comprehensive and well-structured test plans and test cases around data pipelines.
  • Recommend, automate, implement, and monitor preventative and corrective actions to ensure that data quality assurance standards are achieved.
  • Use best-practice CI/CD methodologies to ensure that the build and deployment pipelines are fast, robust and secure.
  • Automate Data profiling across our Data Warehouse to identify bad data within the production systems.
  • Required Skillset

  • Excellent SQL skills with the ability to understand complex SQL.
  • Experience building test automation frameworks for unit, functional, integration, system and performance tests for data pipelines built using Airflow, SQL, Python, Kafka and AWS S3.
  • Automate data quality checks by profiling data with scripting languages such as Python and SQL on large datasets.
  • Experience testing data in various formats such as tabular, Json, CSV, Avro, Parquet, XML etc.
  • Familiarity with data warehouse concepts and principles and experience in testing data integrations and data migrations.
  • Solid team player with excellent interpersonal and communication skills necessary to work effectively with customers and other team members. 
  • Worked in a fast paced environment being scrappy when needed.
  • Bonus points for

  • Experience with columnar data stores such as Redshift/SnowflakeExperience with docker and kubernetes.
  • Experience with real time data processing using kafka, rabbitmq, kinesis or SQS.
  • Experience with financial data and its secure storage and retrieval.
  • Experience with python testing frameworks such as Pytest, Robot, Nose etc
  • Benefits/Perks

  • Competitive salary and stock option plan. 
  • 100% paid coverage of medical, dental and vision insurance. 
  • Unlimited vacation. 
  • Learning stipend for personal growth and development. 
  • Paid parental leave.  
  • We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.