Sr/ Staff/Sr. Staff/Principal Engineer(Python | Spark | Bigdata |Sql)

The ZPA Advanced Analytics team at Zscaler is looking for a Bigdata/Spark Engineer who will help us in the analysis of vast amounts of data, write production grade pipelines, and infrastructure optimization.What You Will DoYou will be responsible for product features related to data transformations, enrichment, and analyticsYou will discuss with product managers, UI, and other backend teams to understand requirements and translate the same into functional specifications You will seize every opportunity to refactor code in the interests of maintainability and reusabilityLead and provide technical direction and mentorship to junior engineers and bring out the best in themThe ideal candidate has a proven track record of building large scale enterprise products, and is a creative thinker, problem solver, learner, and a fantastic manager of people, and is motivated with engineering excellence.ResponsibilitiesData mining using state-of-the-art methodsEnhancing data collection procedures to include information that is relevant for building analytic systemsProcessing, cleansing, and verifying the integrity of data used for analysisAd-hoc analysis and presenting your results in a clear mannerCreating automated anomaly detection systems and constant tracking of its performanceSkills and QualificationsBTech/MTech in CSE or relevant field from a reputed university.5+ years of experience in developing and deploying Big data solutionsExperience with Python, PySpark (PySparkSQL), Spark (SparkSQL), SQLExperience with Data visualization tools / Data visualization algorithmsUnderstanding and sense of data-warehousing and data-modeling techniquesStrong understanding of distributed systems, real-time analyticsExperience with stream-processing technologies like Apache Kafka and Apache FlinkSkill of self/unit testing and feature verificationExperience with data engineering tasks or working with data engineersGood interpersonal skills and positive attitudeExperience withcloud environments AWS/Azure/GCPExperience with Kubernetes, DockersBasic knowledge of Java and Microservices(Plus+ and optional) Pipeline orchestration tool Kubeflow(Plus+ and optional) basic ML/AL knowledge and experience working with ML engineers or Data scientists#LI-MS6