Do you have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack? Do you have experience conducting software quality functional assessments, systems testing, performance evaluation, automated testing? If so, this would be a great opportunity for you!
...
Our client is looking for a Senior Software Developer - ETL for a 9 month contract in Toronto.
This is a hybrid role 3 days onsite and 2 days remote.
Advantages
· Long-term contract with potential for extension
· Hybrid – 3 days a week onsite
· Earn a competitive rate within the industry
Responsibilities
· Design and implement comprehensive test plans for data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
· Conduct data quality assessments, validation, and profiling using tools like Great Expectations.
· Develop and maintain automated testing frameworks integrated into CI/CD pipelines.
· Collaborate with data engineers to ensure adherence to Medallion Architecture best practices.
· Monitor and assess pipeline performance, scalability, and data integrity.
· Implement and manage DevOps practices using Azure DevOps, Git, and related tools.
· Document test cases, validation rules, and QA processes clearly and consistently.
· Perform functional testing on Power BI Reports and dashboards
· Participate in Agile ceremonies and contribute to sprint planning and retrospectives.
Qualifications
MUST HAVES:
5+ years of experience in data engineering:
· Must have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
· Must have strong knowledge and hands-on experience with:
· Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL)
· Azure Databricks
· PySpark and SQL
· Power BI (data preparation, modelling, and visualization)
· Must have demonstrated experience in developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools
Must have experience conducting software quality functional assessments, systems testing, performance evaluation, automated testing, using a variety of tools such as:
- JIRA or Azure DevOps for defect tracking,
- Selenium for automated testing of web-based apps, including Power BI reports and dashboards,
- JMeter for performance evaluation.
· Conducting data quality assessments, validation, and profiling using tools like Great Expectations
· Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.
Summary
If you are interested in the Senior Software Developer - ETL role in Toronto, please apply online at www.randstad.ca. Qualified candidates will be contacted.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more
Do you have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack? Do you have experience conducting software quality functional assessments, systems testing, performance evaluation, automated testing? If so, this would be a great opportunity for you!
Our client is looking for a Senior Software Developer - ETL for a 9 month contract in Toronto.
This is a hybrid role 3 days onsite and 2 days remote.
Advantages
· Long-term contract with potential for extension
· Hybrid – 3 days a week onsite
· Earn a competitive rate within the industry
Responsibilities
· Design and implement comprehensive test plans for data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
· Conduct data quality assessments, validation, and profiling using tools like Great Expectations.
· Develop and maintain automated testing frameworks integrated into CI/CD pipelines.
· Collaborate with data engineers to ensure adherence to Medallion Architecture best practices.
...
· Monitor and assess pipeline performance, scalability, and data integrity.
· Implement and manage DevOps practices using Azure DevOps, Git, and related tools.
· Document test cases, validation rules, and QA processes clearly and consistently.
· Perform functional testing on Power BI Reports and dashboards
· Participate in Agile ceremonies and contribute to sprint planning and retrospectives.
Qualifications
MUST HAVES:
5+ years of experience in data engineering:
· Must have demonstrated expertise in designing and implementing comprehensive data pipelines and transformations in a Microsoft Azure + Databricks and Power BI technology stack.
· Must have strong knowledge and hands-on experience with:
· Microsoft Azure Data Services (ADF, ADLS Gen 2, Synapse, Azure SQL)
· Azure Databricks
· PySpark and SQL
· Power BI (data preparation, modelling, and visualization)
· Must have demonstrated experience in developing and maintaining data pipelines and release management through Continuous Integration and Continuous Delivery (CI/CD) and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools
Must have experience conducting software quality functional assessments, systems testing, performance evaluation, automated testing, using a variety of tools such as:
- JIRA or Azure DevOps for defect tracking,
- Selenium for automated testing of web-based apps, including Power BI reports and dashboards,
- JMeter for performance evaluation.
· Conducting data quality assessments, validation, and profiling using tools like Great Expectations
· Developing and maintaining automated testing frameworks integrated into CI/CD pipelines and DevOps practices using Azure DevOps, Git, Visual Studio Code, and related tools.
Summary
If you are interested in the Senior Software Developer - ETL role in Toronto, please apply online at www.randstad.ca. Qualified candidates will be contacted.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more
