Senior QA Analyst - Hadoop Automation Tester

Location: North Vancouver, British Columbia, Canada
Date Posted: 06-12-2018
On behalf of our client, Affinity Staffing is seeking a Senior Big Data QA Analyst with experience with Hadoop.  In Integration & Automation testing team you will be responsible for creating, executing and maintaining automated regression testing for information management stream. You will be identifying the automation scope based big data based solution delivered by cross functional teams consisting of architects, data analysts and developers. The role also needs solid technical skills to solve any compatibility issues with upcoming automation frameworks in Hadoop.

The four must haves: 
  • Must have experience of Big-Data
  • Must have experience with Hadoop system (Spark, Hive, Scala, Pig, Hbase, and sqoop)
  • Must have ETL experience
  • Must have automation & testing experience.
The Big Data QA Analyst will be responsible for:
  • Understand the system functionality and derive automation scope based on inputs from application teams
  • Create automation scripts based on the framework defined from senior automation architects
  • Work closely with application technical teams to fix any issues identified during automation
  • Setup automation through continuous integration approach to be run every time build is deployed in a test environment
  • Maintain the automation scripts on regular basis as the agile teams deploy changes
  • Identify the test data needs and work with the test data management team collect/setup the data
  • Understand the interdependencies with various interface systems and ensure automation script cover the functionality as per the business process
You should have experience in working with agile teams that deliver work products in 2 to 4 weeks’ time frame. You should be able to work with cross functional teams to understand the scope of an application change and implemented the appropriate automation solution.
Position requirements
To make immediate contribution in this role, you will have demonstrated experience in the following:
  • Minimum 1 year of experience in working for testing of big data projects through employment or education
  • Hands on experience in Hadoop eco-system technologies like Spark, Hive, Scala, Pig, Hbase, and sqoop
  • Good knowledge of Java, Python and shell scripting
  • Has good understanding of performance testing and related techniques
  • Experience in querying and testing RDBMS such as DB2, Oracle using SQL.
  • Experience in creating and debugging complex SQL
  • Good understanding of ETL (Extract, Transform and Loading) and Data Pipeline
  • Experience with testing of integration of data from multiple data sources
  • Hands on experience in testing with structured and semi structured data
  • Experience with Data Processing engines like Apache Spark and streaming technologies like Apache Kafka
  • Experience with smoke and sanity testing to support environment moves and production batch support
About Affinity Staffing:
Affinity Staffing is a full-service Information Technology agency that takes a unique approach to recruiting. We believe recruiting is about creating long-term relationships that foster a mutually beneficial partnership - an affinity. Bringing a new style of recruiting founded on four core principles – Transparency – Flexibility – Efficiency – Agility.
For more information on Affinity Staffing, please visit
this job portal is powered by CATS