Nilasu Consulting Services Pvt. Ltd.’s Post

Enhance your productivity In essence, while ETL developers are concentrated on the intricacies of the ETL process, Data engineers have a broader purview that includes managing ETL operations, data architecture, and infrastructure. This wider scope enables them to address a range of challenges in the data lifecycle, from initial extraction to long-term data management. A Data Engineer is primarily defined by the breadth of their responsibilities and their skill set typically includes programming languages like Python, SQL, and Spark, leverage your skills too... #informaticapowercenter #informaticadeveloper #sql #snowflake #aws #dataintegration #etl #etldeveloper #etlinformatica #powercenter #pentaho #datastagedeveloper #iics#SSIS, #Informatica, #Talend, #Datastage #abinitio #pentaho #abinitiodeveloper #etl #dataengineering #PySpark

Hello Connections, 🔍 Exploring Ab Initio's Vector Concepts: Join me for a dive into key interview questions! Perfect for data enthusiasts and professionals alike.  Let's decode together! #AbInitio #DataEngineering #InterviewPrep" Interview Question 3 : You have Two cities given with their distances.Your task is to remove the duplicates cities with same distances . I have used below vector approach to solve the problem. Input File City1 City2 Distance Pune Mumbai 200 Bangalore Pune 800 Mumbai Pune 200 Pune Bangalore 800 Pune Hyderabad 560 Hyderabad Pune 560 Output: Mumbai Pune 200 Bangalore Pune 800 Hyderabad Pune 560 Solution: InputFile(use proper DML) --> Reformat(Refer Below code) --> Sort(Key:{City1,City2}) --> DedupSort(Key:{City1,City2}) --> OutputFile out :: reformat(in) = begin let string("")[big endian integer(4)]vec1= allocate_with_defaults();  let string("")[big endian integer(4)]vec2= allocate_with_defaults();  let string("")[big endian integer(4)]vec3= allocate_with_defaults();  vec1=[ vector in.City1 ]; vec2=[vector in.City2 ]; vec3=vector_sort_dedup_first(vector_sort(vector_append(vec1,string_join(vec2,"")))); out.City1::vec3[0]; out.City2::vec3[1];  out.Distance :: in.Distance;  end; Please comment for any inputs/suggestions

"Hello LinkedIn Community! 🌟 Exciting Opportunity Alert!" Greetings from Lucidspire! Mail 📩 pallavi.kp@lucidspire.com Role: Data Engineer Data Integration Experience: 3+ and 5+Years Location: Pune , Chennai , Bangalore Notice Period: 15 Days About Client: At the forefront of the staffing industry, Our client is a minority-and women-owned business enterprise (MWBE) committed to maximizing global workforce solutions on behalf of its clients, empowering businesses and talent through applied human intelligence. They are a preferred go-to supplier across multiple regions and countries providing consistent deliverables, terms, rates, and cost savings. Our Client employs over 11,000 industry professionals, supported by over 35 national and global locations across the United States, Canada, India, and China. JD: Mandatory Skills : abinito developer, ETL Development: Lead the design, development, and optimization of ETL processes using Ab Initio's Graphical Development Environment (GDE), ensuring data accuracy, consistency, and availability. Data Integration: Build, maintain, and optimize data integration workflows, enabling seamless data flow across various systems and platforms. Data Transformation: Design and implement intricate data transformations, data cleansing, and data enrichment logic within Ab Initio graphs. Metadata Management: Utilize Ab Initio's metadata capabilities to document data lineage, transformations, and data definitions, ensuring transparency and compliance. Performance Optimization: Monitor and optimize Ab Initio ETL processes for efficiency, scalability, and performance, addressing and resolving bottlenecks as needed. Error Handling: Develop robust error handling and logging mechanisms to track and manage ETL job failures and exceptions. Collaboration: Collaborate with cross-functional teams, including data engineers, data analysts, data scientists, and business stakeholders, to understand requirements and ensure the successful delivery of data integration projects. Version Control: Use version control systems (e.g., Git) to manage Ab Initiocode and collaborate effectively with team members. Documentation: Create and maintain comprehensive documentation of Ab Initio graphs, data integration processes, best practices, and standards for the team. Troubleshooting and Support: Investigate and resolve complex ETL-related issues, provide support to team members and users, and conduct root cause analysis when problems arise. Detailed Job Description: highly skilled Ab Initio Developer to join our data engineering team. The Ab Initio Developer will play a crucial role in designing. #DataEngineer #DataIntegration #Initio #AbInitioGraphs #ETL #efficiency, #scalability #performance #addressing #resolving #bottleneck #GDE #OpenToWork #Hiring #OpenToWork #Pune #Chennai #Bangalore

Title – Palantir Developer Client – NCI Duration – 1-2 yrs (c2c) Developed PySpark scripts to clean and process data for varying projects Developed Ontology objects in Palantir (Foundry) for use in various Palantir tools. Developed Workshop applications in Palantir (Foundry) to allow users to view, enter, and update data. Developed custom typescript functions to facilitate actions in Workshop applications. Conduct data integrations Conduct data analysis and correlation Complete Palantir development

📌 CALCULATE() Power BI DAX function It is a part of the filter function category and is defined as "evaluating an expression in a modified filter context." An expression is essentially a measure and includes functions such as SUM, AVERAGE, and COUNT. This expression is evaluated in the context of one or more filters. The basic DAX syntax of the CALCULATE function is: CALCULATE( <expression> [, <filter1> [, <filter2> [, ...]]]) The expression - this is the aggregation component that is constructed just like a measure using functions like SUM, AVERAGE, and COUNT. The filters - this component allows you to specify one or more filters that control the context of the aggregation. #sqlskills #queries #dataanalyst #businessanalytics #jobseekersindia #interview #companies #windowfunction #powerbi #experience #tableau #abinitio #hiring #daxfunctions

hi I am looking for opportunity, here is my video profile. please let me know in case of any available opportunity. #sql #plsql #informatica #etl #unix #actuate #business #sdlc #agile #waterfall #incident #incidentmanagement #development #maintenance #productionsupport #telecommunications #bfs #banking #retailing #logistics #trainings #ai #chatbot #chatgpt #chatgptplus #voiceflow

#Pride in Every Heart*  Today, the ( QUANTOM TECH LLC. ) family celebrated 🎉India's hashtag #IndependenceDay with pride and joy 😊 . It was a day filled with reflection, unity, and a shared commitment to making our country proud through our work. Happy Independence Day from ( QUANTOM TECH LLC. ) ❤️ Jai Hind! 🇮🇳 #ProudIndian #IndependenceDay2024" . . . . . . . #we #are #hiring #java #dotnet #devops #BA #DA #AEM #ETLImformatica #Dataengineer #hadoop #sap #salesforce #QA #Python #w2roles #w2projects #contract #profilemarketing #quantomtechllc.

What is Sqoop? . . . . for more information and tutorial https://bit.ly/3UQpO4o check the above link . . . . #bigdata #sqoop #hadoop #datascience #java #javatpoint

Hi All, 🔊🔊 #LeadDataEngineer💻 #Apply Now⏳ #Experience -6+ Year's #Locations - Remote(Initial 10 Days in Hyderabad for KT) 👉Lead Data Engineer #SQL #On-Premises 👉Python/Scala #Spark 👉Hadoop 👉Hive #HDFS. 📩👉 abdul.sabur@programming.com or DM!! #Reference would be Highly Appreciated!! #Hadoop #Spark #HDFS #Python/Scala #SQL

Hello #Recruiter I hope you are doing well,   I'm Preethi(Ava) from Uipathtek. Sharing with you my #hotlist, candidates who are available immediately for new projects, Please share your requirements at Ava@uipathtek.com and you can reach me at +1 980-998-7755 #Data #Engineer #BigData #ETL #MSExcel #Tableau #Google #Analytics #MSBI #SSIS #SSRS #SAS #Enterprise #Miner #LINUX #SQL #Python #MSSQL #Server #MySQL, #PostgreSQL #Oracle #MongoDB #Windows #OS #Hadoop #Spark #PySpark #SparkSQL #Scala #Kafka #Sqoop #Hive #Yarn #HBase #Agile #Waterfall #AWS #S3 #EC2 #IAM #RDS #ECS #Kubernetes #EMR #Azure #Databricks #Blob #storage #Data #lake #GCP #GoogleCloudStorage #Dataflow #Dataproc #Bigquery #PubSub #hotist #C2C #Recruiter #benchsales #vendor #Javadeveloper #java #devops #awsdevops #azuredeveops #JavaScript #JSP #UML #WSDL #HTML #CSS #JQuery #PLSQL #Perl #Python #ShellScripting #Java #J2EE #JDBC #JSF #XML #Parsers #JSP #Servlets #Portals #EJB #JMS #JavaSwing #Struts #SpringFramework #JavaBeans #WebServices #web #technicalrecruiter #cloud #NetCore #net #dot #dotnet #Angular #ReactJS #TFS #GIT #frontend #backend #fullstack #Ruby #Restful #j2eedeveloper #cicd #ci #cd #Gitlab