Posted 4 days ago

IN_Senior Associate_AWS Data Engineer_D&A_Advisory_Bangalore

PricewaterhouseCoopers Services LLP India, Bengaluru Millenia
Onsite Full Time
Apply on source site

Job description

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems. *Why PWC At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us . At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations. " Job Description & Summary: A Career with in .........................

Responsibilities

Role Overview We are looking for an experienced AWS Data Engineer with 4–8 years of hands-on experience in designing, developing, and maintaining scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in AWS, Snowflake, Apache Airflow, Python, PySpark, and SQL, with a solid understanding of data warehousing, ETL/ELT, data modeling, and performance optimization. The candidate will work closely with data architects, analysts, application teams, and business stakeholders to build reliable and scalable data solutions.

Responsibilities

Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using AWS services. Build and orchestrate data pipelines using Apache Airflow, including DAG development, scheduling, monitoring, retries, dependencies, and error handling. Develop data processing and transformation solutions using Python and PySpark. Design and implement data warehouse solutions using Snowflake. Develop complex SQL queries, stored procedures, views, CTEs, and data transformations. Work with AWS services such as S3, Glue, Lambda, EMR, Athena, Redshift, and IAM. Build batch and, where required, near-real-time data ingestion pipelines. Implement data ingestion from APIs, databases, files, and other source systems into AWS/Snowflake. Perform Snowflake performance and cost optimization, including warehouse sizing, query optimization, clustering, partitioning, and efficient data loading. Implement Snowflake features such as Snowpipe, Streams, Tasks, stages, file formats, and secure data sharing. Develop scalable Spark/PySpark jobs and optimize transformations, joins, partitioning, caching, and resource utilization. Implement data quality checks, validation, reconciliation, and monitoring mechanisms. Troubleshoot pipeline failures, data issues, performance bottlenecks, and production incidents. Follow best practices for data security, governance, access control, and PII-sensitive data handling. Use Git and CI/CD practices for source control, automated testing, and deployment of data pipelines. Collaborate with cross-functional teams in an Agile/Scrum environment. Create technical documentation for data pipelines, workflows, data models, and operational procedures. Mandatory Skill sets: 4–8 years of experience in Data Engineering. Strong hands-on experience with AWS Data Engineering. Strong experience with Snowflake. Hands-on experience with Apache Airflow and DAG development. Strong programming experience in Python. Strong hands-on experience with PySpark / Apache Spark. Advanced SQL skills. Strong understanding of ETL/ELT and data pipeline development.

Experience

working with AWS S3 and AWS Glue. Good understanding of data warehousing and dimensional data modeling.

Experience

with data pipeline monitoring, debugging, and performance optimization. Good understanding of Git and CI/CD. Cloud AWS AWS Services S3, Glue, Lambda, EMR, Athena, Redshift, IAM Data Warehouse Snowflake Programming Python Big Data PySpark, Apache Spark Orchestration Apache Airflow Database SQL, Relational Databases Data Engineering ETL/ELT, Data Pipelines, Data Integration Data Modeling Star Schema, Snowflake Schema, Dimensional Modeling DevOps Git, CI/CD Optional Kafka, dbt, Terraform, Databricks

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline. Preferred Skill sets: AWS Lambda, EMR, Athena, Redshift, Kinesis, Step Functions, IAM. Snowflake Snowpipe, Streams, Tasks, Dynamic Tables, Time Travel and performance tuning.

Experience

with dbt.

Experience

with Kafka or other streaming technologies.

Experience

with Terraform / Infrastructure as Code.

Experience

with data quality tools such as Great Expectations. Knowledge of Lakehouse / Medallion Architecture.

Experience

with Databricks. Snowflake certification such as SnowPro Core. Exposure to Docker/Kubernetes is a plus. Years of experience required: 4–8 Years

Education

qualification: B.Tech/MCA/BCA/M.tech

Education

(if blank, degree and/or field of study not specified) Degrees/Field of Study required: Master of Engineering, Bachelor of Engineering Degrees/Field of Study preferred: Certifications (if blank, certifications not specified) Required Skills Data Engineering Optional Skills Accepting Feedback, Accepting Feedback, Active Listening, Algorithm Development, Alteryx (Automation Platform), Analytical Thinking, Analytic Research, Big Data, Business Data Analytics, Communication, Complex Data Analysis, Conducting Research, Creativity, Customer Analysis, Customer Needs Analysis, Dashboard Creation, Data Analysis, Data Analysis Software, Data Collection, Data-Driven Insights, Data Integration, Data Integrity, Data Mining, Data Modeling, Data Pipeline {+ 38 more} Desired Languages (If blank, desired languages not specified) Travel

Requirements

Available for Work Visa Sponsorship? Government Clearance Required? Job Posting End Date May 11, 2026 Are you ready to make a difference? Want to unlock new value by applying your unique perspective and talents? You can grow exponentially at PwC. Here, you can uncover hidden talents, build lifelong relationships rooted in trust and empathy and turn challenges into opportunities for innovation. We’ll help you grow your skills through challenging, meaningful work so you can go further.

Skills and functions

  • Airflow
  • Aws
  • Data Analytics
  • Data Engineering
  • Dbt
  • Kafka
  • Kubernetes
  • Python
  • Snowflake
  • Spark
  • Sql
  • Terraform