Job Description

A company within aviation data analytics is looking for a Sr. Data Engineer to join a cross-functional, agile, data/software engineering team. This team is responsible for charting, acquiring and enriching airline ticket data and related information that is coming from a variety of providers and platforms. The team then delivers the data to external customers, internal teams, and industry leading products such as Diio Mi, a tool customers use to make commercial planning decisions.



Responsibilities

Design, write, test, and deploy production-ready Python code

Assist in maintaining legacy code and applications

Participate in the development processes, coding best practices, and code reviews

Share ownership of data transfers in various capacities at various stages including acquisition, transformation, and delivery

ETL orchestration and automation experience

CI/CD pipeline experience

Experience with Parquet, ORC, or other big data columnar storage format
5+ years of experience with Data Engineering/Software Engineering

Expertise in Python & SQL development

Hands on experience with AWS S3, Athena, Lambda, Batch and Glue

Working knowledge of databases and data storage more