Job Description

A company within aviation data analytics is looking for a Sr. Data Engineer to assist in building a new, next-gen platform and services using modern, scalable technologies. As a member of the Data Tooling team, this resource will develop the tools and systems to allow data specialists to manage the data pipeline, from ingesting flight schedule data and connections data from over 800 airlines to producing a global schedule product. This team is currently taking a legacy Oracle system and building a replacement system that processes these airline schedules across the globe. This global data set is a fundamental part of business and is used downstream by many other teams and products across the organization.

Experience with infrastructure as code toolsets

Airflow experience
5+ years of experience within a Data Engineering role

Fluent in Python or similar technology

Experience with Parquet, ORC, or other big data columnar storage format

Experience with AWS data stack such as S2, Glue, Athena or EMR

Hands on experience designing data pipelines/ETL in Airflow, Prefect, Argo, or similar technologies

Deep understanding of SQL and experience working with several relational databases

Strong written and verbal communication skills more