Shaurya Garg’s Post

We have an Urgent requirement on Azure Data Factory with Data Bricks with our Client . Please share the resume to Nicky@bintechgroup.com Direct No.: 973-577-8108 Role: Azure Data Factory with Data Bricks Loc: NJ(JERSEY CITY), Candidate must be local, Position: Hybrid( 2xweek) Experience: 11+ PRIMARY RESPONSIBILITIES ( Azure DataBricks) The job responsibilities are described herein: • Develop notebooks in Azure DataBricks using Python, R, SQL programming languages. • Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform. Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions. Provide technical guidance on technology implementation and architectural changes. • Sr. Azure Cloud Engineer coordinating with platform, APIM, Azure DevOps, and Support. Analyze and design technical solutions on Azure to address business needs. Develop, test, and modify software to improve efficiency of data platforms and applications. • Ability to own projects from end to end, working with business stakeholders, IT teams, data stewards, and 3rd party companies to ensure accurate and insightful outcomes. Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards. Enable streaming data use-cases and standard design patterns in a big data environment. • Collaborating with data scientists to integrate algorithms and models into automated processes. Applying expertise, judgment, and precedents to contribute to the resolution of moderately complex problems. • Review and provide feedback on core code changes and support production deployment. CORE TECHNOLOGIES Azure DataBricks, Proficiency in Python; R; Azure data factory, Azure Functions, Azure Data Lake storage, Azure Event Grid, Azure Log Analytics, Azure Monitor, Azure Service Bus, Python, SQL Server, Oracle / PL-SQL, T-SQL and SQL stored procedures, Azure DevOps hashtag #Azure hashtag #azuredataengineer hashtag #azurearchitect hashtag #azurejobs hashtag #azurecloudengineer hashtag #azuredatabricks hashtag #azuredeveloper hashtag #azuredatafactory hashtag #azureengineer hashtag #azuredatalake hashtag #azurecloud hashtag #databricks hashtag #datalake hashtag #bricks hashtag #azurebricks hashtag #c2c hashtag #w2 hashtag #python hashtag #sqldeveloper hashtag #sqlserver hashtag #azuredevops hashtag #azuredatalakestorage hashtag #servicebus hashtag #newjersey hashtag #jerseycity hashtag #salesrecruiter

We have an Urgent requirement on Azure Data Factory with Data Bricks with our Client . Please share the resume to Nicky@bintechgroup.com Direct No.: 973-577-8108 Role: Azure Data Factory with Data Bricks Loc: NJ(JERSEY CITY), Candidate must be local, Position: Hybrid( 2xweek) Experience: 11+ PRIMARY RESPONSIBILITIES ( Azure DataBricks) The job responsibilities are described herein: • Develop notebooks in Azure DataBricks using Python, R, SQL programming languages. • Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform. Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions. Provide technical guidance on technology implementation and architectural changes. • Sr. Azure Cloud Engineer coordinating with platform, APIM, Azure DevOps, and Support. Analyze and design technical solutions on Azure to address business needs. Develop, test, and modify software to improve efficiency of data platforms and applications. • Ability to own projects from end to end, working with business stakeholders, IT teams, data stewards, and 3rd party companies to ensure accurate and insightful outcomes. Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards. Enable streaming data use-cases and standard design patterns in a big data environment. • Collaborating with data scientists to integrate algorithms and models into automated processes. Applying expertise, judgment, and precedents to contribute to the resolution of moderately complex problems. • Review and provide feedback on core code changes and support production deployment. CORE TECHNOLOGIES Azure DataBricks, Proficiency in Python; R; Azure data factory, Azure Functions, Azure Data Lake storage, Azure Event Grid, Azure Log Analytics, Azure Monitor, Azure Service Bus, Python, SQL Server, Oracle / PL-SQL, T-SQL and SQL stored procedures, Azure DevOps hashtag #Azure hashtag #azuredataengineer hashtag #azurearchitect hashtag #azurejobs hashtag #azurecloudengineer hashtag #azuredatabricks hashtag #azuredeveloper hashtag #azuredatafactory hashtag #azureengineer hashtag #azuredatalake hashtag #azurecloud hashtag #databricks hashtag #datalake hashtag #bricks hashtag #azurebricks hashtag #c2c hashtag #w2 hashtag #python hashtag #sqldeveloper hashtag #sqlserver hashtag #azuredevops hashtag #azuredatalakestorage hashtag #servicebus hashtag #newjersey hashtag #jerseycity hashtag #salesrecruiter

#hiringimmediately Data Engineer with AWS Redshit (Mandatory) Harrisburgh, PA Onsite H4EAD/GC-EAD/GC/USC 12 Months C2C/W2 As an AWS Redshift Data Engineer, the primary responsibility is to design, implement, and maintain data solutions using Amazon Redshift. The ideal candidate should possess the following skills: Data Modeling and Design: Develop and maintain data models for Redshift databases, including schema design, table structures, and optimization techniques. Collaborate with data architects and stakeholders to understand requirements and translate them into efficient data structures. ETL Development: Design and implement Extract, Transform, Load (ETL) processes to extract data from various sources, transform it as per business requirements, and load it into Redshift. Develop efficient and scalable ETL workflows, considering data quality, performance, and data governance. Performance Optimization: Optimize query performance by creating appropriate data distribution keys, sort keys, and compression techniques. Identify and resolve performance bottlenecks, fine-tune queries, and optimize data processing to enhance Redshift's performance. Data Integration: Integrate Redshift with other AWS services, such as AWS Glue, AWS Lambda, Amazon S3, and more, to build end-to-end data pipelines. Ensure seamless data flow between different systems and platforms, maintaining data integrity and consistency. Monitoring and Troubleshooting: Implement monitoring and alerting systems to proactively identify issues and ensure the stability and availability of the Redshift cluster. Perform troubleshooting, diagnose and resolve data-related issues, and work closely with support teams to resolve any performance or operational problems. Security and Compliance: Implement security best practices to protect data stored in Redshift. Ensure compliance with data privacy regulations and industry standards, such as GDPR and HIPAA. Implement encryption, access controls, and data masking techniques to secure sensitive data. Documentation and Collaboration: Maintain documentation of data models, ETL processes, and system configurations. Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and provide data solutions that meet their needs. Scalability and Capacity Planning: Plan and execute strategies for scaling Redshift clusters to handle increasing data volumes and user demands. Monitor resource utilization, track data growth, and make recommendations for capacity planning and infrastructure scaling. Knowledge or previous experience in Oracle PLSQL will be an added advantage.   Send Resumes to sam@ojusllc.com for immediate response. #dataengineer #dataengineerjobs #usitrecruitment #c2crequirements #usitstaffing #immediatehiring #itandsoftware #usaitjobs #corp2corp

Please share resumes at ben@orbitztechs.com Role: Senior Data Engineer with extensive AWS, AWS Glue and Python experience!!! ***Highly prefer candidates with AWS Certifications*** Location: Only local to Maryland - Owings Mills MD / Don't send me relocation candidates Visa Status: Any visa is fine but No H1B. Experience: 12+ Years Manager Notes: Role: Data Engineer- Absolute Must Haves – Everything highlighted below • The data engineer will be working on dashboard and reporting team, looking to have the skill sets of python/pyspark, some database technology. • AWS- AWS Glue is a must. Python, pyspark, AWS lambda to hit ground running as top skills. • Snaplogic is nice to have but they mainly use glue • Current database: using snowflake for development for recording purposes, but open database exp wise • Current ETL tool is Glue • day to day: mainly doing the development of dashboard. Once requirements have been added to board, working with BI engineers to determine what the dashboards need and coding Job Description This position will focus on developing various database and data loading/transformation efforts. Initiatives could include multiple source files and/or files sourced both internally and externally. Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark. Possible work leveraging SnapLogic for ETL, depending upon use case. Work will be applicable to multiple applications. Knowledge of automated testing of data a plus. Responsibilities: • Design and built systems for analytical reporting • Analyze data and design ETL frameworks using Python and Spark technologies • Collaborate with business partners to gather requirements and translate that to technical specifications • Adhere to lean agile methodologies • Production Support including trouble shooting and problem-solving capabilities • Implement data pipelines to meet business requirements and adhere to best practices. Required Skills: • Proficient in Python, Spark and database technologies • Experience with various AWS services like AWS Glue, IAM, RDS, S3, SQS, SNS, Lambdas, Cloud Formation, Cloud Watch, Event Bridge, CLI • Experience with Unix/Linux • Experience with SQL • Experience with source code control, preferably Git. • Experience in CI (Continuous Integration)/ CD (Continuous Delivery) software development pipeline stages like Commit, Build, Automated Tests, and Deploy Desired Skills: • Experience in creating AWS Glue components - Jobs, Triggers, Workflows • Experience with AWS CLI • Experience working with databases such as Snowflake and/or Aurora • Experience with Hashicorp tool suite - Terraform, Vault • Experience with soap and rest services. • Experience working with XML, JSON, YAML • Experience with logging tools such as Cloudwatch and Splunk

#Hello Connections, Hope you are doing well. #naveed from Interas Labs. #Interaslabs has an immediate Job requirement below. Please share your Resumes to naveed@interaslabs.com Role: AWS Data Engineer Experience: 7+ years Position: Full-time Location: Remote Primary Responsibilities · Design and develop data lakes, manage data flows that integrate information from various sources into a common data lake platform through an ETL Tool · Code and manage delta lake implementations on S3 using technologies like Data bricks or Apache Hoodie · Triage, debug and fix technical issues related to Data Lakes · Design and Develop Data warehouses for Scale · Design and Evaluate Data Models (Star, Snowflake and Flattened) · Design data access patterns for OLTP and OLAP based transactions · Coordinate with Business and Technical teams through all the phases in the software development life cycle · Participate in making major technical and architectural decisions · Maintain and Manage Code repositories like Git You Must Have: · 5+ Years of Experience operating on AWS Cloud with building Data Lake architectures · 3+ Years of Experience with AWS Data services like S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS and Redshift · 3+ Years of Experience building Data Warehouses on Snowflake, Redshift, HANA, Teradata, Exasol etc. · 3+ Years of working knowledge in Spark · 3+ Years of Experience in building Delta Lakes using technologies like Apache Hoodie or Data bricks · 3+ Years of Experience working on any ETL tools and technologies · 3+ Years of Experience in any programming language (Python, R, Scala, Java) · Bachelor’s degree in computer science, information technology, data science, data analytics or related field · Experience working on Agile projects and Agile methodology in general We Value: · Strong RDBMS and data modelling skills · AWS cloud certification is a big plus Soma Sreeja Shashi Reddy Bandha Venkatesh #DataEngineering #DataLakes #ETL #DeltaLake #AWS #DataWarehousing #Spark #ETLTools #Programming #AgileDevelopment #DataModeling #CloudComputing #AWSDataServices #BigData #DataAnalytics #TechJobs #DataScience #SoftwareDevelopment #AWSCertified #RDBMS #DataIntegration #DataArchitecture #DataOps #BigDataAnalytics #DataManagement #DataTransformation #DataVisualization #DataEngineeringJobs #DataMigration #CloudArchitecture #DataGovernance #DataQuality #DataPipeline #DataInfrastructure #TechCareers #AWSJobs #TechSkills #DatabaseManagement #DataProfessionals #AWSArchitecture

We are hiring #Databricks Engineerclients interesting candidates please send resumes to perimidi.p@kksoftwareassociates.com Visa status: Only GC, USC & H1B Position:- Databricks Engineer Location: -  Iselin, NJ(South) | Edison | New Jersey,NJ Day -1 onsite • Develop deep understanding of the data sources, implement data standards, maintain data quality and master data management.• Expert in building Databricks notebooks in extracting the data from various source systems like DB2, Teradata and perform data cleansing, data wrangling, data ETL processing and loading to AZURE SQL DB.• Expert in building Ephemeral Notebooks in Databricks like wrapper, driver and config for processing the data, back feeding the data to DB2 using multiprocessing thread pool.• Expert in developing JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data.• Expert in using Databricks with Azure Data Factory (ADF) to compute large volumes of data.• Performed ETL operations in Azure Databricks by connecting to different relational database source systems using jdbc connectors.• Developed Python scripts to do file validations in Databricks and automated the process using ADF.• Analyzed the SQL scripts and designed it by using Pyspark SQL for faster performance.• Worked on reading and writing multiple data formats like JSON, Parquet, and delta from various sources using Pyspark.• Developed an automated process in Azure cloud which can ingest data daily from web service and load in to Azure SQL DB.• Expert in optimizing the Pyspark jobs to run on different Cluster for faster data processing.• Developed spark applications in python (Pyspark) on distributed environment to load huge number of CSV files with different schema in to Pyspark Dataframes and process them to reload in to Azure SQL DB tables.• Analyzed data where it lives by Mounting Azure Data Lake and Blob to Databricks.• Used Logic App to take decisional actions based on the workflow and developed custom alerts using Azure Data Factory, SQLDB and Logic App.• Developed Databricks ETL pipelines using notebooks, Spark Dataframes, SPARK SQL and python scripting.• Developed Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.• Good Knowledge and exposure to the Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, Driver Node, Worker Node, Stages, Executors and Tasks.• Involved in performance tuning of Spark Applications for setting right Batch Interval time, correct level of Parallelism and memory tuning.• Expert in understanding current production state of application and determine the impact of new implementation on existing business processes.• Involved in Migration of data from On-prem server to Cloud databases (Azure Synapse Analytics (DW) & Azure SQL DB).