Intermediate ETL Tester with AWS Glue, S3 and Athena experience to support the validation of data accuracy, quality, and performance.

Our client is looking for an Intermediate ETL Tester with AWS Glue, S3 and Athena experience to support the validation of data accuracy, quality, and performance.

This role requires you to be onsite 5 days/week, working core business hours of 8-5 with free onsite parking

Must Haves:

• 5+ years experience as a QA specifically with ETL testing.
• Experience with AWS Glue, AWS S3, AWS Athena, AWS Lambda, and AWS DataSync
• Experience working with AWS Aurora (PostgreSQL), DynamoDB, and MS SQL Server
• Experience with test automation tools and frameworks.

Nice to Haves:

• Experience with other AWS services such as AWS Redshift and RDS
• Familiarity with Big Data technologies (e.g., Hadoop, Spark)
• AWS Certification related to data analytics or data engineering

Responsibilities:

• Lead the design, development, and implementation of ETL test strategies and plans.
• Validate data extraction, transformation, and loading processes to ensure data quality and integrity.
• Conduct detailed testing of data pipelines utilizing AWS Glue, ensuring transformations are correctly applied.
• Verify data storage and retrieval from AWS S3, ensuring data consistency and accessibility.
• Utilize AWS Athena to query and validate data stored in S3, applying SQL knowledge to perform complex queries.
• Leverage AWS Lambda for serverless functions within the testing strategy.
• Use AWS DataSync for data transfer operations and ensure data is accurately synchronized across environments.
• Validate the performance and accuracy of databases such as AWS Aurora (PostgreSQL), DynamoDB, and MS SQL Server.
• Create and maintain detailed documentation of test plans, test cases, and test results.
• Automate testing processes where possible to streamline validation efforts.
• Continuously monitor ETL processes post-deployment to identify and address any issues.
• Collaborate with cross-functional teams to understand requirements and deliver high-quality test results.
• Mentor and guide junior QA engineers and testers within the team.