Data Engineer - 100% Remote 4 openings - both mid-level and senior-level
Summary This role is charged with developing data pipelines integrating dozens of data sources and target systems, ensures data quality, creates models, and then exposes the data in various forms for consumption by other teams and platforms. We are looking for a software engineer who has experience with data infrastructure, ETL systems, reporting environments, or machine learning pipelines.
What you'll be doing
Design, develop, and launch efficient and reliable data pipelines to move and transform data to enable downstream consumption and insights
Refine code to ensure performance and reliability of data pipelines and data processing
Write unit tests, and automate functional and integration tests
Collaborate with other data engineers, analysts, product managers, and customers to implement technical solutions to business problems
Support the development process by participating in regular Agile/Scrum activities, code reviews, and architectural reviews
Implement DevOps patterns in conjunction with our DevOps/SREs
Diagnose and solve issues in existing data pipelines, and use learnings to build their successors
Skills we're seeking
2+ years of experience with Data Engineering in cloud-based environments
We have 4 openings, both mid-level and senior-level, so senior experience is also great, but need at least 2 years for the mid-level roles
Demonstrated hands-on Engineering experience delivering large scale data, analytics, reporting, or machine learning products/solutions
Strong SQL experience
Python experience
Experience with the issues of performance, availability, scalability, reliability, and maintainability of data pipelines
Nice to have experience
Experience with Spark and PySpark
Data modeling experience
DevOps experience
Seniority level
Entry level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at 1872 Consulting by 2x