*Job Title: AWS Data Engineer*Location: HyderabadPosition Overview:As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and integration solutions utilizing various AWS services. The ideal candidate will have extensive experience with AWS Spark, Redshift, S3, and other related technologies, along with a strong understanding of data engineering principles and best practices.Key Responsibilities:- Design, develop, and deploy data pipelines using AWS Spark and Spark Streaming for both batch and near-real-time processing.- Build and optimize data warehouse solutions on AWS Redshift, ensuring high performance and scalability.- Implement data storage and retrieval mechanisms using AWS S3, ensuring data integrity and security.- Utilize AWS DMS (Data Migration Service) for data replication tasks, where applicable.- Leverage AWS Step Functions, Airflow, or similar tools for orchestrating complex data workflows.- Develop and maintain ETL processes using AWS Glue or similar frameworks.- Collaborate with stakeholders to understand project requirements and translate them into scalable and efficient data integration solutions.- Monitor and optimize data pipelines for performance, reliability, and cost-effectiveness.- Stay current with AWS data and analytics offerings and recommend new technologies and approaches to enhance data engineering capabilities.Qualifications:- Bachelor's degree in Computer Science, Engineering, or related field.- 5+ years of experience in data engineering roles, with a focus on AWS technologies.- Proficiency in AWS Spark, Redshift, S3, and other relevant AWS services.- Experience with AWS DMS for data replication is a plus.- Familiarity with workflow orchestration tools such as AWS Step Functions or Airflow.- Strong understanding of data warehousing concepts and best practices.- Experience with AWS Glue or similar ETL frameworks is preferred.- Excellent problem-solving skills and attention to detail.- Ability to effectively communicate technical concepts to non-technical stakeholders.- Proven track record of delivering high-quality solutions in a fast-paced environment.Benefits:- Competitive salary and benefits package- Opportunity to work with cutting-edge technologies and industry experts- Flexible work environment with remote work options- Career growth and development opportunities
