We are seeking a Senior Software Developer - ETL with expertise in building and managing robust ETL/ELT pipelines leveraging the Microsoft Azure and Databricks ecosystems. This role demands hands-on experience with modern AI and ML tools for data processing, including OpenAI embedding models and Databricks Vector Search. The successful candidate will be responsible for developing secure, scalable data solutions, integrating REST APIs for data flow, and utilizing Azure DevOps for CI/CD and version control within an Agile team. This is a fully Onsite position based in Toronto.
...
Duration: 3 months (with potential for contract extension)
Advantages
AI/ML Data Focus: Direct and mandatory hands-on experience with the bleeding edge of AI data tooling (Vector Search, Embeddings, Azure ML) within a production environment.
Modern Cloud Stack: Expertise across the full Azure Data Ecosystem (ADF, ADLS Gen2, Databricks) for robust ETL/ELT.
DevOps Excellence: Deep involvement in automating pipelines and quality assurance via Azure DevOps CI/CD.
Onsite Collaboration: Fully onsite role in Toronto, facilitating close team integration.
Responsibilities
The Senior Software Developer - ETL will be responsible for:
- ETL/ELT Pipeline Development: Building and managing ETL/ELT pipelines using core Azure services, specifically:
- Microsoft Azure Data Factory
- Azure Data Lake Storage Gen2
- Azure Key Vault and Microsoft Sentinel (while enforcing security).
- AI & ML Integration: Hands-on development using Azure and Databricks AI tools, including:
- Document Intelligence and Azure Cognitive Services.
- OpenAI’s embedding models and Databricks Vector Search index.
- Utilizing Azure Machine Learning and Databricks ML workflows.
- Data Integration & APIs: Designing, consuming, and integrating REST APIs for data ingestion and distribution, ensuring reliable data flow from sources like the Oracle RDBMS.
- Databricks Development: Developing Databricks notebooks, jobs, dashboards, and reports, integrating them with Azure and Databricks data sources.
- DevOps & Quality: Proficient with Azure DevOps for Git-based version control (CI/CD pipelines, feature branches), and contributing to task planning and iteration demos within a Scrum Agile development team.
Qualifications
Must-Have Core Technical Skills:
- Hands-on with Azure and Databricks AI tools such as Document Intelligence, OpenAI’s embedding models, Databricks Vector Search index, Azure Machine Learning, Cognitive Services, and Databricks ML workflows.
- Proficient with Azure DevOps for Git-based version control, CI/CD pipelines, and documentation via Wiki.
- Ability to design, consume, and integrate REST APIs for data ingestion and distribution.
- Experience working with Oracle RDBMS.
- Experience participating in Scrum Agile development and working with concurrent development practices.
Nice-to-Have (Assets):
- At least 2 years of experience with Siebel database model (20% of evaluation score).
- Experience providing input to project estimates and designs.
Summary
If you're interested in the Senior Software Developer - ETL role based in Toronto, we encourage you to apply online at www.randstad.ca.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more
We are seeking a Senior Software Developer - ETL with expertise in building and managing robust ETL/ELT pipelines leveraging the Microsoft Azure and Databricks ecosystems. This role demands hands-on experience with modern AI and ML tools for data processing, including OpenAI embedding models and Databricks Vector Search. The successful candidate will be responsible for developing secure, scalable data solutions, integrating REST APIs for data flow, and utilizing Azure DevOps for CI/CD and version control within an Agile team. This is a fully Onsite position based in Toronto.
Duration: 3 months (with potential for contract extension)
Advantages
AI/ML Data Focus: Direct and mandatory hands-on experience with the bleeding edge of AI data tooling (Vector Search, Embeddings, Azure ML) within a production environment.
Modern Cloud Stack: Expertise across the full Azure Data Ecosystem (ADF, ADLS Gen2, Databricks) for robust ETL/ELT.
DevOps Excellence: Deep involvement in automating pipelines and quality assurance via Azure DevOps CI/CD.
Onsite Collaboration: Fully onsite role in Toronto, facilitating close team integration.
Responsibilities
...
The Senior Software Developer - ETL will be responsible for:
- ETL/ELT Pipeline Development: Building and managing ETL/ELT pipelines using core Azure services, specifically:
- Microsoft Azure Data Factory
- Azure Data Lake Storage Gen2
- Azure Key Vault and Microsoft Sentinel (while enforcing security).
- AI & ML Integration: Hands-on development using Azure and Databricks AI tools, including:
- Document Intelligence and Azure Cognitive Services.
- OpenAI’s embedding models and Databricks Vector Search index.
- Utilizing Azure Machine Learning and Databricks ML workflows.
- Data Integration & APIs: Designing, consuming, and integrating REST APIs for data ingestion and distribution, ensuring reliable data flow from sources like the Oracle RDBMS.
- Databricks Development: Developing Databricks notebooks, jobs, dashboards, and reports, integrating them with Azure and Databricks data sources.
- DevOps & Quality: Proficient with Azure DevOps for Git-based version control (CI/CD pipelines, feature branches), and contributing to task planning and iteration demos within a Scrum Agile development team.
Qualifications
Must-Have Core Technical Skills:
- Hands-on with Azure and Databricks AI tools such as Document Intelligence, OpenAI’s embedding models, Databricks Vector Search index, Azure Machine Learning, Cognitive Services, and Databricks ML workflows.
- Proficient with Azure DevOps for Git-based version control, CI/CD pipelines, and documentation via Wiki.
- Ability to design, consume, and integrate REST APIs for data ingestion and distribution.
- Experience working with Oracle RDBMS.
- Experience participating in Scrum Agile development and working with concurrent development practices.
Nice-to-Have (Assets):
- At least 2 years of experience with Siebel database model (20% of evaluation score).
- Experience providing input to project estimates and designs.
Summary
If you're interested in the Senior Software Developer - ETL role based in Toronto, we encourage you to apply online at www.randstad.ca.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
show more
