Remote Freedom

Senior Spark QA Engineer

InfraCloud

Remote · India IndiaFull-timeyesterday

See how well you match this role

Upload your résumé — we'll score your fit and check off the skills you already have. Free.

Copilot fills Greenhouse, Ashby, Lever and SmartRecruiters forms. If this employer's page lands on one of those, the overlay appears there.

Skills

PythonJavaSQLSparkDatabricksETLData EngineeringKubernetesCI/CD

What you'll do

  • Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines.
  • Execute functional, scalability, and performance testing for Spark workloads.
  • Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc.
  • Conduct benchmarking, validation, and performance analysis of Spark applications.
  • Identify bottlenecks and troubleshoot distributed system issues.
  • Lead QA initiatives and mentor team members.

About the role

Senior Spark QA Engineer – Functional & Performance Testing Location: Remote Experience: 5+ Years Job Description - We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms. Key Responsibilities - • Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines. • Execute functional, scalability, and performance testing for Spark workloads. • Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc. • Conduct benchmarking, validation, and performance analysis of Spark applications. • Identify bottlenecks and troubleshoot distributed system issues. • Lead QA initiatives and mentor team members. Required Skills - • 5+ years of QA/testing experience with strong hands-on expertise in Apache Spark. • Experience in functional and performance testing of distributed systems. • Strong understanding of Spark architecture and optimization techniques. • Experience with Kubernetes and cloud-based Spark environments. • Proficiency in Python or Java. • Experience with automation frameworks and CI/CD pipelines. Originally posted on Himalayas

Sourced from Himalayas. Confirm the details and apply on the employer's site.