This is a contract position for a Business Intelligence Specialist - ETL Developer for our client who is in the Broader Public Sector. Work location will be in the Greater Toronto Area.
This is a Hybrid Role with some days in the office at the discretion of the Hiring Manager.
The Contract runs for one year.
Hours per day will be 7.25
...
Advantages
Good Compensation working on projects that will make a difference to the people of Ontario.
Responsibilities
Design, develop and implement ingestion framework from Oracle source to Azure Data Lake - initial load and incremental ETL. Used tools are:
-Oracle Golden Gate (knowledge and experience are an asset but not required) for data ingestion and change data capture (currently in final stages of proof of concept)
-Azure Data Factory (expert knowledge) to maintain pipeline from Oracle to Azure Data Lake
-Azure Databricks/PySpark (good Python knowledge required) to build transformations of raw data into curated zone in the data lake
-Azure Synapse to build stored procedures and read data from data lake
Review the requirements, database tables, and database relationships - Identify gaps and inefficiencies in current production reporting environment and provide recommendations address them in the new platform.
Design ingesting framework and CDC - preferred tool is Oracle Golden Gate
Prepare design artifacts
Work with IT partner on configuration of Golden Gate - responsible to provide direction and "how to".
Analysis of data - physical model mapping from data source to reporting destination.
Understand the requirements. Recommend changes to the Physical model.
Develop the scripts of physical model, and create DB.
Access Oracle DB environments, use SSIS, SQL Server and other development tools for developing solution.
Proactively communicate with business on any changes required to conceptual, logical and Physical models, communicate and review dependencies and risks.
Development of ETL strategy and solution based on different set of modules
Understand the Tables and Relationships.
Create low level design documents and unit test cases.
Create the workflows of package design
Development and testing of data with Incremental and Full Load.
Develop high quality ETL mappings/scripts/jobs
ETL data from Applications to Data Warehouse
ETL data from Data Warehouse to Data Mart
Perform unit tests.
Performance Review, data Consistency checks
Troubleshoot performance issues, ETL Load issues, log activity for each Individual package and transformation.
Review Performance of ETL Overall.
End to end Integrated testing for Full Load and Incremental Load
Plan for Go Live, Production Deployment.
Create production deployment steps.
Configure parameters, scripts for go live. Test and review the instructions.
Create release documents and help build and deploy code across servers.
Go Live Support and Review after Go Live.
Review existing ETL process, tools and provide recommendation on improving performance and reduce ETL timelines.
Review Infrastructure and any pain points for overall process improvement
Knowledge Transfer to Ministry staff, development of documentation on the work completed.
Document share and work on the ETL end to end working knowledge, Troubleshooting steps, configuration and scripts review.
Transfer documents, scripts and review of documents.
Qualifications
7+ years in ETL tools such as Microsoft SSIS, stored procedures (Must Have)
2+ Azure Data Lake and Data Warehouse, and building Azure Data Factory pipelines (Must Have)
2+ years Python (Must Have)
Summary
If interested and qualified for this role, please apply today for immediate consideration!!!
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more
This is a contract position for a Business Intelligence Specialist - ETL Developer for our client who is in the Broader Public Sector. Work location will be in the Greater Toronto Area.
This is a Hybrid Role with some days in the office at the discretion of the Hiring Manager.
The Contract runs for one year.
Hours per day will be 7.25
Advantages
Good Compensation working on projects that will make a difference to the people of Ontario.
Responsibilities
Design, develop and implement ingestion framework from Oracle source to Azure Data Lake - initial load and incremental ETL. Used tools are:
-Oracle Golden Gate (knowledge and experience are an asset but not required) for data ingestion and change data capture (currently in final stages of proof of concept)
-Azure Data Factory (expert knowledge) to maintain pipeline from Oracle to Azure Data Lake
-Azure Databricks/PySpark (good Python knowledge required) to build transformations of raw data into curated zone in the data lake
-Azure Synapse to build stored procedures and read data from data lake
...
Review the requirements, database tables, and database relationships - Identify gaps and inefficiencies in current production reporting environment and provide recommendations address them in the new platform.
Design ingesting framework and CDC - preferred tool is Oracle Golden Gate
Prepare design artifacts
Work with IT partner on configuration of Golden Gate - responsible to provide direction and "how to".
Analysis of data - physical model mapping from data source to reporting destination.
Understand the requirements. Recommend changes to the Physical model.
Develop the scripts of physical model, and create DB.
Access Oracle DB environments, use SSIS, SQL Server and other development tools for developing solution.
Proactively communicate with business on any changes required to conceptual, logical and Physical models, communicate and review dependencies and risks.
Development of ETL strategy and solution based on different set of modules
Understand the Tables and Relationships.
Create low level design documents and unit test cases.
Create the workflows of package design
Development and testing of data with Incremental and Full Load.
Develop high quality ETL mappings/scripts/jobs
ETL data from Applications to Data Warehouse
ETL data from Data Warehouse to Data Mart
Perform unit tests.
Performance Review, data Consistency checks
Troubleshoot performance issues, ETL Load issues, log activity for each Individual package and transformation.
Review Performance of ETL Overall.
End to end Integrated testing for Full Load and Incremental Load
Plan for Go Live, Production Deployment.
Create production deployment steps.
Configure parameters, scripts for go live. Test and review the instructions.
Create release documents and help build and deploy code across servers.
Go Live Support and Review after Go Live.
Review existing ETL process, tools and provide recommendation on improving performance and reduce ETL timelines.
Review Infrastructure and any pain points for overall process improvement
Knowledge Transfer to Ministry staff, development of documentation on the work completed.
Document share and work on the ETL end to end working knowledge, Troubleshooting steps, configuration and scripts review.
Transfer documents, scripts and review of documents.
Qualifications
7+ years in ETL tools such as Microsoft SSIS, stored procedures (Must Have)
2+ Azure Data Lake and Data Warehouse, and building Azure Data Factory pipelines (Must Have)
2+ years Python (Must Have)
Summary
If interested and qualified for this role, please apply today for immediate consideration!!!
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more
