Data Engineer

Application Period: Nov. 1, 2024 - Nov. 30, 2024

Contact: jean-olivier.pitre@mcgill.ca

Data Engineer

Looking for ways to get involved with McGill University? The DataSphere Lab at McGill University is seeking a talented Data Engineer to join our team for an exciting project with a leading aviation industry client. You'll be part of a dynamic team, working on developing a platform to manage product-related documents and business processes, leveraging AI and machine learning to drive efficiency and insights.

Job Requirements:

  • Needs to be currently registered as a student at McGill University.
  • Highly self-motivated and able to work independently.
  • Strong communication skills required.
  • Enjoy collaborating in virtual settings (online).
  • Passionate about tech.
  • Experience in software development, computer science & data science is a must.
  • Exposure to cloud computing & version control (git) is a huge asset.

Responsibilities:

  • Implement data pipelines & data solutions using Azure services such as Azure Data Factory, Azure Databricks & Azure Synapse.
  • Implement and manage data storage solutions with Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
  • Develop ETL workflows to extract data from various sources (on-premises, cloud, APIs) and transform it into usable formats.
  • Use Python for data transformation, cleansing, and enrichment.
  • Work with Github & Github Actions for CI/CD pipeline integration and version control.
  • Automate data workflows and processes using PowerShell and Azure Automation.
  • Develop and maintain data models and schemas using SQL and T-SQL.
  • Implement data security and compliance measures with Azure Key Vault and Microsoft Entra.
  • Implement Azure Api Management to simplify the complexity of our backend systems.
  • Implement error handling, logging, and monitoring to Azure Monitoring and Azure Sentinel.
  • Document processes and create guides for internal use.

Paid Position:Yes, $20-$30/hour for 5-10 hours/week

To apply

Email Jean-Olivier Pitre (jean-olivier.pitre@mcgill.ca) directly, including a CV and the details of the position you are interested in.