Lead Data Engineer - Python/Spark/Solr (2-10 Yrs) Bangalore (Backend Developer)

Lead Data Engineer - Python/Spark/Solr (2-10 Yrs) Bangalore (Backend Developer)
Company:

The Modern Dimension


Lead Data Engineer - Python/Spark/Solr (2-10 Yrs) Bangalore (Backend Developer)

Details of the offer

Job Overview: - We are looking for savvy Data Engineers to join our growing team. They will be responsible for expanding and optimizing our existing data pipelines as well as building new ones from the ground up. - They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidates will be excited by the prospect of optimizing and/or re-designing our company's data architecture to support our next generation of products and data Create and maintain optimal data pipeline architecture - Assemble large, complex data sets that meet functional / non-functional business requirements - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. - Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources - Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. - Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs. Qualifications: - 4 yrs of Experience building and optimizing big data' data pipelines, architectures and data sets. - Experience supporting and working with cross-functional teams in a dynamic environment. - Strong analytic skills related to working with unstructured datasets. - Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - Experience with big data tools: Hadoop, Spark, Kafka, etc. - Experience with data pipeline and workflow management tools: Airflow, Azkaban, Luigi, Oozie, etc. - Experience with stream-processing systems: Storm, Spark Streaming, Kafka Streams etc. - Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. - Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. - 6 years of experience in a Data Engineer role, with at least a B.S. (or equivalent) in Computer Science (ref:hirist.com)


Source: Adzuna_Ppc


Area:

Requirements


Knowledges:

  • SQL

Hr operations analyst | fortune 500 cpg firm | 5-6 years

About the Job A great opportunity for an HR Operations Analyst to join the team leading digital innovation at a Fortune 500 company. This company is a leading...


From Fortune 500 Cpg Firm - Andhra Pradesh

Published 19 days ago

Software automation tester

Juntrax is looking for a Software Automation Tester who can assist in testing office management product for SMEs. Support software quality assurance by...


From Juntrax Solutions - Karnataka

Published 19 days ago

Full stack developer- reactjs

The ideal candidate is a detail-oriented team player with a good attitude to work well in a fast-paced environment. As part of our team, you will be working on...


From Juntrax Solutions - Karnataka

Published 19 days ago

Technical lead

Juntrax is a global integrated office management platform for SMEs. What we are looking for : Someone who has led a team of developers in a product-centric...


From Juntrax Solutions - Karnataka

Published 19 days ago