looking for a Data Engineer who will be a part of the IT Data team that will be responsible for leveraging the value of the data assets throughout the organization. The team will facilitate the development/implementation of the desired end-state data environment within our Azure Databricks environment leveraging emerging tools and technologies,
...
while evolving and refining standards and methodologies. The Data Engineer should have extensive experience working with very large data sets from the insurance industry and knowledge of building programs/mappings that leverage the Azure and Databricks platforms and Data warehouses. This role will also have significant knowledge of Data technologies and tools with the ability to share ideas among a collaborative team. Prior experience with ETL, Power BI Dashboards within the insurance industry context would be preferred
Advantages
Preferred:
Experience using Cloud platforms/technologies.
Experience in scripting languages including Shell, Perl, Python, R, Java.
Experience Big Data tools including with Storn, Hive, Spark, Map Reduce, Kafka, Flume, Tex, Pig, Oozi.
Experience with ETL technologies; strong SQL and stored procedure skills.
Experience with Dev/Ops.
Insurance Industry Experience.
Responsibilities
What you will do:
Architect, design and build data engineering solutions using Databricks as well as other Data Integration technologies. Preference will be given to candidates who have experience in Databricks on the Azure stack, but AWS experience is also acceptable.
Prior work in the P&C Insurance industry and experience with insurance data sets will be an advantage.
Produce appropriate design artifacts representing full Data Engineering Lifecycle
Advocate and enforce adoption of architecture standards such as technical design patterns, reusable code examples, and physical design best practices.
Assists with the transfer of knowledge of Data skills in the enterprise.
Provide data engineering consultation on complex Data projects.
Design integration solutions that fit within the enterprise’s larger data integration strategy or initiative, including recommending data integration tools.
Identify and design any transformations or conversions required to maximize data consistency and usability.
Utilize data profiling, cleansing, and conforming techniques to design procedures / packages.
Provide coaching and mentorship to junior members of the team.
Review requirements for data sourcing requests and understand feasibility.
Develop data integration solutions in alignment with enterprise data integration principles.
Gain access to the data sources and perform initial analysis to identify sourcing strategies and act as technical expert to provide guidance to the business.
Utilize enterprise process and approach to leverage reusable integration applications for projects and to support the development of standard integration specification template(s).
Develop process to enable exchange of data between applications and source systems.
Gather and understand the data necessary to satisfy the end-user business requirements.
Support the development and implementation of enterprise ETL standards and the design and development of ETL specifications and mappings.
Business Travel, as required.
Extended Hours during Peak Periods/Shift Work/Holiday Work, as required.
Regular Predictable Attendance.
Visibility in the Office, as required.
Qualifications
What you bring to the table:
Required:
Bachelor's Degree in Computer Science or Mathematics/Statistics and 6 or more years of experience in the Data Engineering area.
OR
High School Diploma or Equivalent and 8 or more years of experience in the Data Engineering area.
AND
5 or more of experience in Enterprise Data Engineering.
Experience in scripting languages.
Experience with data transformation and aggregation tools.
Experience in data analysis, data interrogation or data profiling.
Summary
We have a collaborative culture where diversity of thought is valued. We value your input and strive to give our employees the tools they need to make an impact.
We care about our employees’ well-being and offer a comprehensive health/benefits plan with varying levels of coverage to suit your specific needs and a competitive total compensation package.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more
looking for a Data Engineer who will be a part of the IT Data team that will be responsible for leveraging the value of the data assets throughout the organization. The team will facilitate the development/implementation of the desired end-state data environment within our Azure Databricks environment leveraging emerging tools and technologies, while evolving and refining standards and methodologies. The Data Engineer should have extensive experience working with very large data sets from the insurance industry and knowledge of building programs/mappings that leverage the Azure and Databricks platforms and Data warehouses. This role will also have significant knowledge of Data technologies and tools with the ability to share ideas among a collaborative team. Prior experience with ETL, Power BI Dashboards within the insurance industry context would be preferred
Advantages
Preferred:
Experience using Cloud platforms/technologies.
Experience in scripting languages including Shell, Perl, Python, R, Java.
Experience Big Data tools including with Storn, Hive, Spark, Map Reduce, Kafka, Flume, Tex, Pig, Oozi.
Experience with ETL technologies; strong SQL and stored procedure skills.
...
Experience with Dev/Ops.
Insurance Industry Experience.
Responsibilities
What you will do:
Architect, design and build data engineering solutions using Databricks as well as other Data Integration technologies. Preference will be given to candidates who have experience in Databricks on the Azure stack, but AWS experience is also acceptable.
Prior work in the P&C Insurance industry and experience with insurance data sets will be an advantage.
Produce appropriate design artifacts representing full Data Engineering Lifecycle
Advocate and enforce adoption of architecture standards such as technical design patterns, reusable code examples, and physical design best practices.
Assists with the transfer of knowledge of Data skills in the enterprise.
Provide data engineering consultation on complex Data projects.
Design integration solutions that fit within the enterprise’s larger data integration strategy or initiative, including recommending data integration tools.
Identify and design any transformations or conversions required to maximize data consistency and usability.
Utilize data profiling, cleansing, and conforming techniques to design procedures / packages.
Provide coaching and mentorship to junior members of the team.
Review requirements for data sourcing requests and understand feasibility.
Develop data integration solutions in alignment with enterprise data integration principles.
Gain access to the data sources and perform initial analysis to identify sourcing strategies and act as technical expert to provide guidance to the business.
Utilize enterprise process and approach to leverage reusable integration applications for projects and to support the development of standard integration specification template(s).
Develop process to enable exchange of data between applications and source systems.
Gather and understand the data necessary to satisfy the end-user business requirements.
Support the development and implementation of enterprise ETL standards and the design and development of ETL specifications and mappings.
Business Travel, as required.
Extended Hours during Peak Periods/Shift Work/Holiday Work, as required.
Regular Predictable Attendance.
Visibility in the Office, as required.
Qualifications
What you bring to the table:
Required:
Bachelor's Degree in Computer Science or Mathematics/Statistics and 6 or more years of experience in the Data Engineering area.
OR
High School Diploma or Equivalent and 8 or more years of experience in the Data Engineering area.
AND
5 or more of experience in Enterprise Data Engineering.
Experience in scripting languages.
Experience with data transformation and aggregation tools.
Experience in data analysis, data interrogation or data profiling.
Summary
We have a collaborative culture where diversity of thought is valued. We value your input and strive to give our employees the tools they need to make an impact.
We care about our employees’ well-being and offer a comprehensive health/benefits plan with varying levels of coverage to suit your specific needs and a competitive total compensation package.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more