The initial focus would be to migrate all clients off the Mastermine MYSQL database, over to the Postgres ClientDB.
Top 3 skills: 5+ years in MySQL/Postgres databases, ETL/data integration, data warehousing
We use MySQL 5.5 and Postgres 14/15.
The data is on-site, not in the cloud.
Need for an ETL/Data Integration Specialist to help with the extra integration work.
They have MySQL and Postgres databases. They have 2 other people who are doing the work, but they need extra help because their processes are very manual but they want to move towards automating the ETL tasks. They have to manually create the ETL jobs and SQL queries to move the data over and cleanse it.
Summary
The Database and ETL Data Integration Specialist / Developer is responsible for the design, development, testing, execution, and quality assurance of both automated and manual data ETL, integration, and exchange processes between HFI and our clients. Works extensively with large sets of data and develops secure and efficient processes, utilizing various software applications to streamline and expedite the generation of client facing reports.
Essential Functions & Responsibilities
Responsible for the efficient, compliant, timely, and secure acquisition, integration, provision, and exchange of the enterprise data between HFI and our clients.
Liaise with other IT staff to maintain process documentation, workflows and user requirements.
Work with internal business and technology staff to accurately gather and interpret requirements, specifications, and database models to determine appropriate ETL development solutions.
Develop ETL technical specifications and recommend, design, develop, test, implement/automate, and support innovative and optimal data solutions.
Develop and document technical best practices for ETL-related automations including data movement, data aggregation, data quality, and data cleansing.
Assess and document the structure, quality, and compliance of source data and coordinate with business and technology staff to identify and resolve issues.
Create, execute, and document unit test plans for ETL and data integration processes and programs.
Monitor and administer automated and manual data integration and ETL jobs to verify execution and measure performance.
Communicate project status, issues, and accomplishments periodically to staff and users.
Assist other employees in the ETL tools, programs, processes, and best practices.
Other duties may be assigned.
Requirements
Bachelor’s Degree in Computer Science/Information Systems with 1-2 years of experience or equivalent work experience (i.e. ETL/Data Integration Specialist with 1-3 years of experience in an enterprise business environment).
Must have experience with MYSQL and Postgres databases.
Must have experience with ETL tools. Pentaho Spoon preferable.
Must be familiar with common data warehousing tasks such as data staging, data integration, building conformed dimensions and mapping tables.
Experience working with high volume data exchange and integrating large (100m + rows) structured and unstructured data in multiple formats, character sets, and delivery methods.
Expert-level SQL user strongly preferred.
Experienced with scripting and scheduling tools to build data processing and reporting automations.
Expertise in working with technical and business teams to extract and document data integration/exchange requirements.
Ability to communicate complex technical concepts effectively, both verbally and in writing.
Ability to handle multiple projects and meet monthly deadlines.
Takes pride in one's work; very detail-oriented and thorough.
Seniority level
Entry level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Steneral Consulting by 2x