The Challenge As a Data Platform Engineer-Platform, you will be working in our Business Technology Data and Analytics function to develop a sound data foundation and processes that will scale with the company'sgrowth. Youwill be the subject matter expert of managing all platform technology stack of theEnterpriseData&Analytics team. You willdesign andimplementframeworks fordata pipelines,enabling insights from our Product and Corporate Systems for key partners and decision makers atOneTrust. You would alsobe responsible forenhancing andmaintainingour data warehousein collaboration withbusiness domain experts, analytics, and engineering teams. This is a fun role for problem solvers, who can intuitivelyanticipateproblems and can also look beyond immediate issues. It is for people who takethe initiativeto improve both our software and our development infrastructure. In short, we look for people who take pride in the craft and want to be part of creating and defining the team's operating model and contribution to the company. They will be a self-starter,detailand quality oriented, and passionate about havinga huge impactatOneTrust. If this role has your name written all over it, please contact us with a resume so that we explore further.Your Mission You will work closely with other team members like data architects and business analysts to understand what the business is trying to achieve, help to build best in class data platform solutions and architecture for scale.Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to design and build data flow frame works in Snowflake using dbt/airflow/Fivetran/ELT toolsAdministration, Production Support and Maintain analytics technology ecosystem (data warehouse, ETL Tools)Build and automate AWS cloud native technologies, deploy applications, and provision infrastructureLeverage the right tools for the right job to deliver testable, maintainable, and modern data solutionsOwn and document data pipelines and data lineagePassion for continuous betterment (i.e. better workflows, automation, efficiency)Design, build and implement automation framework for scale that deliver data with measurable quality under the SLAIdentify, document and promote best practicesReduces technical debt over time with root cause identification and resolution of system problemsYou AreBachelor's Degree or Master's Degree in Computer Science, Engineering or related field5+ years of overall experience and 3+ years of experience with very large-scale data warehouse projectsVery strong experience in SQL, knowledge of dimensional modeling, supporting data warehouse, scaling, optimizing and performance tuning ETL pipelines Strong experience in administration of databases, ETL tools and knowledge of basic Unix administration.Experience with Python and manipulation of various data formats for extraction and transformation Knowledge of ETL tool, Airflow is a big plus.Preferred: Prior experience with Snowflake, ETL/Integration tools administration (e.g. Informatica, Matillion, FiveTran)Experience with automating AWS cloud native technologies, deploying applications, and provisioning infrastructure.Knowledge of microservices and distributed application architecture, such as containers, Kubernetes, and/or serverless technology.Ability to work on multiple areas like Data pipeline ETL, Data modeling & design, writing complex SQL queries etc.Staying up-to-date with industry trends and emerging technologies to drive continuous improvement.Hands-on experience with Data Warehouse technologies (Snowflake, Redshift) and Big Data technologies (e.g Hadoop, Hive, Spark)Excellent written and verbal communication and interpersonal skills, able to effectively collaborate with technical and business partners
