Data Engineer - Chandigarh

Data Engineer - Chandigarh
Company:

Loadtap


Data Engineer - Chandigarh

Details of the offer

Must be willing to relocate to Chandigarh/Mohali, in our state-of-the-art office in Quark City in Mohali.We're looking for a data engineer.
Responsibilities include: building out infrastructure and implementing end-to-end data flows from ingest, to data transformation, machine learning for client-side applications.?¢ Must have Java/J2EE, Spring, Micro services, Python (Hands On) ?¢ Must have integration expert Hadoop Eco Systems and ML Expert ?¢ Knowledge of Spark, Accumulo, HDFS, YARN, MapReduce, Kafka is necessary.As a data engineer, you may have experience spanning traditional DW and ETL architectures.
But for this role it is important to have industry experience working with big data ecosystems like Spark/Hadoop and Redshift.
You've probably been in the industry as an engineer for 2+ years and have developed a passion for the data that drives businesses.
On your first day, we'll expect you to have:?¢ Deep understanding of big data challenges and eco-system?¢ Experience with solution building and architecting with public cloud offerings such as Amazon Web Services, Redshift, S3, EMR/Spark, Presto/Athena?¢ Experience with Spark and Hive?¢ Expertise in SQL, SQL tuning, schema design, Python and ETL processes?¢ Expertise in data pipeline with such workflow tools as Airflow, Oozie or Luigi?¢ Solid understanding experience in building RESTful APIs and microservices, e.g.
with Flask?¢ Experience in test automation and ensuring data quality across multiple datasets used for analytical purposes?¢ Experience with Lambda Architecture or other Big Data architectural best practices?¢ A graduate degree in Computer Science or similar discipline?¢ Commit code to open source projects?¢ Experience with test automation and continuous deliveryIt's great, but not required, if you have:?¢ Experience with Tableau?¢ Experience with Machine Learning?¢ Have worked with Data Scientists Skills:- Data Science, Big Data, Hadoop and Spark


Source: Neuvoo_Dinamico_Ppc


Area:

  • Other Jobs / Other Jobs - Crafts

Requirements

Related offers

Technical project manager

Job Description Job Title: IT Project Manager III About Company: Thermo Fisher Scientific Inc. is the world leader in serving science, with revenues of more...


From Thermo Fisher Scientific - Karnataka

Published a month ago

Staff engineer software - bengaluru

Job Description Job Title: Staff Engineer-Software Location: Bangalore About Company: Thermo Fisher Scientific Inc. is the world leader in serving science...


From Thermo Fisher Scientific - Karnataka

Published a month ago

Sap systems analyst - distribution & warehouse management - bengaluru

Job Description Job Title: SAP System Analyst Job Location: Bangalore About Company: Thermo Fisher Scientific Inc. is the world leader in serving science, with...


From Thermo Fisher Scientific - Karnataka

Published a month ago

Sap systems analyst distribution & wm

Job Description Job Title: SAP System Analyst Job Location: Bangalore About Company: Thermo Fisher Scientific Inc. is the world leader in serving science, with...


From Thermo Fisher Scientific - Karnataka

Published a month ago