As the Director, Data Engineering, you will lead a team that performs a critical function for our direct-response marketing agency: managing the ingestion of donor and transaction data from hundreds of clients into an intricate data ecosystem. You'll have the responsibility of overseeing our data infrastructure, ranging from on-premise Microsoft SQL Server to Snowflake in AWS, as well as IBM iSeries Db2.
Responsibilities
Own the maturation of our ETL pipelines' code development lifecycle
Oversee the administration of data environment including the data lake, which uses API connectors to sync tens of millions of client data records per day
Develop, implement, optimize, and support data pipelines in systems such as Knime, dbt and SSIS
Manage and mentor a team of data engineers and a team of data coordinators
Drive efficiency and cost-savings by standardizing and unifying technologies, centralizing error reporting, and scaling operations.
Work closely with internal stakeholders, balancing their expectations with the capabilities of our data environments and capacity of the engineering team.
Work in collaboration with the product development department to shape the feature and functional needs of new data systems.
Support CRM data implementations and the data integration needs of CRM customers.
Oversee monitoring of ETL processes to resolve immediate issues and understand root causes for permanent solutions
Qualifications
Extensive experience in data management and data engineering, working with various data models, RDBMSs, and ETL tools.
Strong proficiency in SQL, with a deep understanding of query optimization, data modeling, and database design.
Strong background in data transformation, with proficiency in Python and dbt preferred.
Hands-on experience with data pipeline development in Knime, dbt and SSIS.
Exceptional leadership, communication, and interpersonal skills.
Proven ability to quickly gain context, prioritize tasks, and manage urgent needs.
Experience managing a backlog of work, prioritizing and assigning tasks, and managing team’s capacity
Experience in managing a data-focused team and a keen ability to nurture their development.
Seniority level
Director
Employment type
Full-time
Job function
Engineering and Information Technology
Industries
Staffing and Recruiting
Referrals increase your chances of interviewing at Thomas Edwards Group by 2x