P3 - Senior Data Engineer 166502 - MS Azure and Purview

Advantages
You will have an opportunity to work with a leading employer in the local market.

Responsibilities
Main tasks for the Senior Data Engineer on this project:
 Work with stakeholders and source data SMEs to understand and capture metadata
regarding existing data assets.
 Design and implement data pipelines for moving data packages from source to the HDR
Platform landing zone.
 Perform data profiling and generate quality metrics to describe the characteristics of
source data.
 Document and describe the pipeline process for each data package.
 Assemble sets of data into secured data packages for transport.
 Datasets are to be saved to a well-known format for parsing and extraction (e.g., CSV,
JSON)
 Prepare documentation containing a high-level description of files in the package and
any NoSQL formats.
 Provide descriptive metadata, including:
 File sizes in bytes
 Files and attributes
 File checksum code (hash) for verifying files.
 Provide metadata modeling via MS Purview and metadata management via the MS
Purview Atlas API.
 Design and implement the MS Purview Data Map, including Data Store registration and
configuration to MS Azure Storage Accounts.
 Design and implement MS Purview Scan Rule Sets, Classifications and Classification
Rules to support privacy and data access requirements.
 Design and schedule MS Purview metadata scans leveraging customer Scan Rule Sets.
 Apply classifications and levels of sensitivity to all personal health information (PHI) data
elements in data sets landing on the platform. Provide oversight on the metadata Assets
using the Purview Data estate insights module.
 Provide custom data quality rules and associated data quality scans on the data estate.
 Ensure quality assurance of Purview related tasks by reviewing ingested data via Azure
Synapse Studio and MS Databricks.

 Design and implement policies and workflows within MS Purview to provide access to
HDR Platform data.
 Assist in the design and implementation of logical privacy groups within Purview using
Azure Active Directories.
 Work with the BI Architect to leverage metadata management modeling using MS
Purview to implement data access.
 Work with the HDR Solution Architect to develop the strategy for design, implementation,
and management of the policies for data access.
 Facilitate access to all draft materials on request and ensure that adequate feedback is
obtained from appropriate stakeholders prior to delivery of any final documents.
 Main deliverables for this resource, under the direction of the BI Architect and in
collaboration with other key project team members, are focused in the following areas:
 Delivery of HDR project Release 2 data sources to the HDR Platform.
 Documentation of data profile, data extract, transport design, transmission code, and
metadata characteristics for source data ingested into the HDR Platform.
 Data extract and transport testing/quality assurance documentation.
 Implementation of privacy requirements using the PHI Classification Matrix (Safe
Harbour) and Purview Asset Classification.
 Enhancement and extension of a custom developed Profiling Engine developed by the
HDR project to supplement MS Purview capabilities.
 Develop training and support materials for HDR Platform users and provincial resources
assigned to support the HDR Platform.
 Facilitate knowledge transfer and technical hand off to key HDR project and provincial
operational resources.
 Status reports.
 Other deliverables as required.

Qualifications
The qualifications and work experience required for the Senior Data Engineer are as follows:
 A minimum of three (3+) years of experience working as a data engineer for data
integration, migration, or extraction in a data warehouse context.
 A minimum of two (2+) years of experience in roles related to digital health.
 A minimum of five (5+) years of experience in an Enterprise Solution or Data Architect
role in a large and complex organizational and technological environment.
 Experience working with MS Azure cloud-native tools, including Azure Synapse
Analytics, Azure Databricks, and Azure Active Directory.
 Demonstrated experience working with MS Purview, including Purview Atlas API and the
Purview data policies and workflow modules.
 Demonstrated knowledge and experience profiling data, extracting data, and developing
data pipelines.
 Experience writing complex queries in both SQL and NoSQL syntax.
 Demonstrated knowledge and experience with data integration tools (e.g., SSIS, T-SQL,
Alteryx).
 Demonstrated experience working in an Agile project environment using Git and Azure
DevOps.

 Experience with Personal Health Information Classifications and protections using
proven de-identification/anonymization methods, such as the HIPAA Safe Harbor
method.

Summary
Do you have this experience? If you answer YES, then please apply IMMEDIATELY to so we can then
discuss your experience and interest in this opportunity!
Randstad Technologies Group
Canada's largest provider of IT Staffing Solutions, offering hundreds of permanent and contract
opportunities across all roles, levels and platforms. Our Web-based tools help you see and apply for jobs
matched automatically to your skills and preferences. When you're ready to interview we meet with you in
person to help you build the technology career path you've always wanted. Visit www.randstad.ca to get
started!

Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.

Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.