Jobs
>
Ottawa

    Data Engineer - Ottawa, Canada - CGI

    CGI
    CGI background
    Full time
    Description

    Position Description:

    Security clearance: Reliability Clearance a MUST
    Location: Ottawa, ON
    Remote: Yes

    Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clients?

    Do you often find yourself in discussions about disparate and scattered data sources and feel the need to create robust data engineering infrastructure to remedy this disorder? If you have the technical expertise to build pipelines and enable data engineering or ETL within organizations, a genuine problem-solving aptitude, and the mindset required to collaborate with diverse clients and team members, we are looking for you.

    Your future duties and responsibilities:


    •Pipeline Construction: Build and maintain scalable and high-performance data pipelines using Azure Data Factory, Azure Databricks, or other Azure services to transport data seamlessly across systems.

    •Data Storage and Management: Manage data storage in Azure, selecting appropriate storage solutions (like Azure Data Lake, Azure SQL Database) to ensure data is stored efficiently and securely.

    •Data Cleaning and Transformation: Develop scripts or use ETL tools for data cleaning and transformation to prepare data for analysis, ensuring data quality and accessibility.

    •Automation and Optimization: Automate pipelines and optimize data retrieval using Python and Azure Data Factory, Azure Data Bricks.

    •Monitoring and Maintenance: Monitor data pipelines and performance, troubleshoot any issues, and ensure systems are up-to-date with the latest security patches.

    • Strategic collaboration with clients to explore and deliver key data engineering solutions

    • Delivery in areas of data preparation and transformations, as well as ETL or ELT development, whether on-premises or in the cloud

    • Building data engineering pipelines on the cloud (Azure, AWS, GCP, etc.)

    • Working in a professional environment with large, complex, and voluminous datasets, as well as scattered data sources

    • Utilizing SQL or advanced SQL skills and Python skills as needed

    • Gathering client requirements, coding, and implementing data solutions

    • Implementing proof of concepts to demonstrate value, then packaging and scaling full-fledged data engineering both on-premises and in cloud environments

    • Supporting and collaborating with other data engineers or data scientists on the team regarding technical knowledge

    Required qualifications to be successful in this role:


    • Python experience is a must

    • 5 years or more of practical experience in data engineering

    • Experience working on at least one modern cloud platform (Azure, AWS, GCP, etc.)

    • Excellent communication and teamwork skills

    Desirable:

    • Experience in data engineering with ML projects

    • Experience with pipeline management tools and data workflow tools such as Airflow, Jenkins, etc.

    • Experience with a variety of tools such as Azure Data Factory, Google Dataflow, Qlik Compose, AWS Data Pipeline or Glue, Talend, Microsoft SSIS, IBM Datastage, Informatica

    #LI-YH1

    Skills:

  • Data Engineering
  • English
  • ETL
  • MS SQL Server
  • Python
  • Amazon CloudFront
  • French

  • Center for Open Science

    Data Engineer

    7 hours ago


    Center for Open Science Ottawa, ON, Canada

    Flexible work environment with the option to work from home or from the office. · Who we are... · At Ecosystem, we want to help solve the complex energy and decarbonization challenges faced by the world today. · Ecosystem is a multidisciplinary and pioneer team of engineers re ...

  • Brainhunter

    Data Engineer

    2 days ago


    Brainhunter Ottawa, Canada

    Data Engineer - #61261 · About the Job: · Mindwire is currently seeking a Data Engineer to work for our valued Crown corporation client. · The position is remote with the option of a Hybrid work environment (Ottawa/Toronto). · Responsibilities: Converts historical data from SAS ...


  • Outrider Ottawa, ON, Canada

    Outrider is a software company that is automating distribution yards with electric, self-driving trucks. Our system eliminates manual tasks that are hazardous and repetitive while it improves safety and efficiency. Outrider's mission is to drive the rapid adoption of sustainable ...

  • Tiger Analytics

    Data Engineer

    1 day ago


    Tiger Analytics Ottawa, Canada Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our bu ...

  • Outrider

    Engineer - Python Data

    15 hours ago


    Outrider Ottawa, ON, Canada

    Engineer, Computer Vision & Machine Learning (3-months contract) Outrider is a software company that is automating distribution yards with electric, self-driving trucks. Our system eliminates manual tasks that are hazardous and repetitive while it improves safety and efficiency. ...


  • Englobe Ottawa, ON, Canada

    At nearly 3,000 people, Englobe is one of Canada's premier firms specializing in professional engineering services, environmental sciences, and soil and biomass treatment. · With offices located across Canada, the United Kingdom and France, we are conveniently located to support ...

  • CB Canada

    Senior Data Engineer

    22 hours ago


    CB Canada Ottawa, Canada

    Senior Data Engineer · On behalf of our public sector client, we are seeking a Senior Data Engineer. Remote work at present. Onsite work in Ottawa may be required at a later date. · Job Description: · The Senior Data Engineer Service Provider will be responsible for leading the d ...

  • Brainhunter

    Sr. Data Engineer

    2 days ago


    Brainhunter Ottawa, Canada

    Senior Data Engineer - #61271 · About the Job: · Mindwire is currently seeking a Senior Data Engineer to work for our valued Crown Corporation client. · This position is remote however the consultant may be required to go on-site one-two times throughout the contract duration. ...


  • Coradix Technology Consulting LTD Ottawa, Canada Contract

    Security Data Engineer · Date posted: Oct Job description · Reference # : JP-13825 · Location: Remote · Category: Security Data Engineer · Type: Contract · CORADIX Technology Consulting is currently seeking a Security Data Engineer to support one of our valued Government of C ...


  • Enterprise Solutions, Inc. Ottawa, Canada

    · Job Description:10 years of Data Engineering experience. · Proficient in Azure ADF data bricks data delta lake SQL python Spark and Snowflake · Looking for strengths around data preparation layers and has experience with BIG data structured and non-structured data. · Should ha ...


  • Avanade Ottawa, Canada

    Our talented Data & AI Practice is made up of globally recognized experts - and there's room for more analytical and ambitious data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let's talk ...


  • nugget Ottawa, Canada Part time

    Type: Part-time Contract · **Responsibilities**: · - Conduct keyword research and analyze search data to identify high-value opportunities for improving search engine rankings · - Optimize website content, meta tags, and structure for maximum visibility and search engine rankings ...


  • City of Ottawa Ottawa, Canada

    Requisition ID: 7803 · Department: Public Works Dept. · Service: Traffic Services · Branch: Traffic, Safety & Mobility Branch · Employment Type: 1 Full-time Temporary - Up to 1 year · Work Hours: 35.00 /hours per week · Affiliation: CUPE 503 Inside/Outside · Salary Information: $ ...


  • Kiewit Corporation Ottawa, Canada

    **Requisition ID: 167575** · **Job Level: Mid Level** · **Department: Field Operations** · **Market: Transportation** · **Employment Type: Full Time** · **POSITION OVERVIEW**: · - As a field coordinator you will be expected to be a job-site leader in health and safety, ensuring t ...

  • Morrison Hershfield

    Junior Inspector

    2 days ago


    Morrison Hershfield Ottawa, Canada

    Morrison Hershfield is a multi-disciplinary consulting engineering and management firm located throughout the US and Canada. We are a dynamic, employee-owned, team-oriented firm with a diverse project list that ensures you will be working on exciting, high-profile and challenging ...


  • Jabil Circuit Ottawa, Canada

    At Jabil we strive to make ANYTHING POSSIBLE and EVERYTHING BETTER. With over 260,000 diverse, talented and dedicated employees across 100 locations in 30 countries, our vision is to be the most technologically advanced and trusted manufacturing solutions provider. We combine an ...


  • Solink Ottawa, Canada

    **Associate Product Manager** · A job at Solink means working with an amazing team and tackling one of the biggest data problems out there. We are venture backed and focus on continuous execution to delight our customers. We have a creative and collaborative work environment, and ...


  • Solink Ottawa, Canada

    Associate Product Manager · A job at Solink means working with an amazing team and tackling one of the biggest data problems out there. We are venture-backed and focus on continuous execution to delight our customers. We have a creative and collaborative work environment, and all ...


  • BluMetric Environmental Inc. Ottawa, Canada

    **The Opportunity**: · **Key Responsibilities**: · - Create and maintain a wide variety of GIS/CAD data in proper formats and projections. · - Perform quality assurance checks on contractor supplied and internally generated GIS data. · - Follow cartographic and drafting standards ...


  • National Research Council Canada Ottawa, Canada

    Great Minds. One Goal. Canada's Success. · Help bring research to life and drive your career forward with the National Research Council of Canada (NRC), Canada's largest research and technology organization. · We are looking for a Technical Officer, Pneumatic and Hydraulic Pressu ...