The role is a combination of design/implementation and consulting with hands-on experience. It will require one to envision, design, and implement the technical solution working with customer and internal technical team. Must have been involved in this role, where she/he has led the design and/or implementation of several complex data-oriented solutions on Hadoop Big Data Platform. Experience working with customer Business/IT team. Should be able to speak confidently throughout the conversation. The candidate is expected to play developer role who can interact with the customer, work with teams (local or remote) and lead the technical or business discussions in key meetings.
Skills & Experience
Mandatory to have End-To-End experience working in a Databricks Data environment (Dev, QA and Prod) with large data sets (Petabytes)
Must have worked on several projects in the Big Data / Hadoop space; Comfortable with the broader Databricks ecosystems
Hands-on with experience with - Spark, Databricks & SQL; Good in Java / Python, PySpark/Spark language
Experience working on Apache Spark, creating data processing jobs and running them on Databricks
Experience with Python and deployments for data sourcing and loads into ADLS (Azure Data Lake)
Very comfortable with SQL; Knowledge of Kafka would be value add; Basics of Unix commands
Secondary Skills / Good To have – Experience working with Azure Data Services (Big Plus)
Soft skills/other skills – Good communication skills and Positive attitude
BE/BS /MS / MCA degree in Computer Science / IT / IS or relevant
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Engineering and Information Technology
Industries
Human Resources Services
Referrals increase your chances of interviewing at Skybeyo by 2x