Jobs
>
Ottawa

    Data Engineer - Ottawa, Canada - Brainhunter

    Brainhunter
    Brainhunter Ottawa, Canada

    Found in: Talent CA C2 - 4 days ago

    Default job background
    Description
    Data Engineer - #61261

    About the Job:
    Mindwire is currently seeking a Data Engineer to work for our valued Crown corporation client.

    The position is remote with the option of a Hybrid work environment (Ottawa/Toronto).

    Responsibilities:
  • Converts historical data from SAS database to Parquet.
  • Works closely with teams to develop and transition ongoing production process of analytical assets (currently coded in SAS and stored as SAS datasets) to be coded using Python (leveraging Pyspark) and stored in Parquet.
  • Recommends improvements and enhancements to conversion processes and ongoing production of analytical assets.
  • Prepares documentation required related to the results of the conversion (e.g. differences in converted data that will impact use by analysts).
  • Coaches and mentors staff in data conversion techniques.
    • Requirements and Qualifications:
  • 5 years' experience with version control using Git, including branching, merging, and collaborating with teams to manage code repositories effectively.
  • Extensive knowledge of SQL for querying and manipulating databases, with a solid understanding of database design and optimization (5 Years' Experience).
  • High level of expertise in data engineering processes, including data extraction, transformation, and loading (ETL), utilizing Informatica tools to create efficient and robust data pipelines.
  • Extensive programming experience in Python, with the ability to develop complex applications, scripts, and data processing tasks using a wide range of libraries and frameworks.
  • Proficient usage of Jupyter Notebooks as an integrated development environment for data analysis, data visualization, and interactive code execution, fostering efficient and reproducible workflows.
  • Extensive hands-on experience with Apache Spark, including the ability to design, optimize, and manage large-scale data processing and analytics pipelines.
  • In-depth knowledge of Apache Parquet file format for columnar storage, including its benefits and optimal usage in big data processing scenarios.
  • Outrider

    Engineer - Data Engineer

    Found in: Jooble CA O C2 - 3 days ago

    Outrider Ottawa, ON, Canada

    Outrider is a software company that is automating distribution yards with electric, self-driving trucks. Our system eliminates manual tasks that are hazardous and repetitive while it improves safety and efficiency. Outrider's mission is to drive the rapid adoption of sustainable ...

  • CGI

    Data Engineer

    Found in: Talent CA C2 - 10 minutes ago

    CGI Ottawa, Canada Full time

    Position Description: · Security clearance: Reliability Clearance a MUST · Location: Ottawa, ON · Remote: Yes · Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clie ...

  • Tiger Analytics

    Data Engineer

    Found in: Talent CA C2 - 4 days ago

    Tiger Analytics Ottawa, Canada Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our bu ...

  • Outrider

    ML Data Engineer

    Found in: Jooble CA O C2 - 3 days ago

    Outrider Ottawa, ON, Canada

    The company · Outrider is a software company that is automating distribution yards with electric, self-driving trucks. Our system eliminates manual tasks that are hazardous and repetitive while it improves safety and efficiency. Outrider's mission is to drive the rapid adoption ...

  • Englobe

    Technicien Data Engineering

    Found in: Jooble CA O C2 - 3 days ago

    Englobe Ottawa, ON, Canada

    At nearly 3,000 people, Englobe is one of Canada's premier firms specializing in professional engineering services, environmental sciences, and soil and biomass treatment. · With offices located across Canada, the United Kingdom and France, we are conveniently located to support ...

  • Brainhunter

    Sr. Data Engineer

    Found in: Talent CA C2 - 4 days ago

    Brainhunter Ottawa, Canada

    Senior Data Engineer - #61271 · About the Job: · Mindwire is currently seeking a Senior Data Engineer to work for our valued Crown Corporation client. · This position is remote however the consultant may be required to go on-site one-two times throughout the contract duration. ...

  • CB Canada

    Senior Data Engineer

    Found in: Talent CA 2 C2 - 2 days ago

    CB Canada Ottawa, Canada

    Senior Data Engineer · On behalf of our public sector client, we are seeking a Senior Data Engineer. Remote work at present. Onsite work in Ottawa may be required at a later date. · Job Description: · The Senior Data Engineer Service Provider will be responsible for leading the d ...

  • Coradix Technology Consulting LTD

    Security Data Engineer

    Found in: Talent CA C2 - 4 days ago

    Coradix Technology Consulting LTD Ottawa, Canada Contract

    Security Data Engineer · Date posted: Oct Job description · Reference # : JP-13825 · Location: Remote · Category: Security Data Engineer · Type: Contract · CORADIX Technology Consulting is currently seeking a Security Data Engineer to support one of our valued Government of C ...

  • Enterprise Solutions, Inc.

    Azure Data Engineer

    Found in: Talent CA C2 - 1 day ago

    Enterprise Solutions, Inc. Ottawa, Canada

    · Job Description:10 years of Data Engineering experience. · Proficient in Azure ADF data bricks data delta lake SQL python Spark and Snowflake · Looking for strengths around data preparation layers and has experience with BIG data structured and non-structured data. · Should ha ...

  • Groupe ABS

    Project Manager Materials Engineering

    Found in: Zoho Direct Apply - 2 days ago

    Groupe ABS Ottawa, Canada

    La description français suit la description anglaise · Job summary · Reporting to the Ontario regional director, the holder of this position will act as a project manager for ABS Group Inc. Your main responsibility will be to ensure the planning of tasks and the necessary follow- ...

  • Groupe ABS

    Environmental Team lead

    Found in: Zoho Direct Apply - 2 days ago

    Groupe ABS Ottawa, Canada

    La description français suit la description anglaise · Job summary · Step into the vibrant world of ABS as the environmental team lead, guided by our spirited Ontario's regional director Ignite synergy among project heads and managers, ensuring brilliant results and satisfied cli ...

  • Thales

    DSEF Services

    Found in: Indeed CA C2 - 3 days ago

    Thales Ottawa, ON, Canada Full time

    Location: Ottawa, Canada In fast changing markets, customers worldwide rely on Thales. Thales is a business where brilliant people from all over the world come together to share ideas and inspire each other. In aerospace, transportation, defence, security and space, our architec ...

  • Groom & Associates(és)

    Senior Mechanical Engineer

    Found in: Appcast CA C2 A - 1 day ago

    Groom & Associates(és) Ottawa, ON, Canada

    Senior Mechanical Engineer · This company delivers products and services into the naval and military defence and transport markets alongside performing specialist research and providing services, including training and product support. · In the maritime domain, this company's e ...

  • Orbcomm

    Firmware Engineer

    Found in: Appcast US C2 - 3 days ago

    Orbcomm Ottawa, Canada

    About the Opportunity: · The Firmware Engineer will be part of the team that develops and maintains firmware for ORBCOMM's embedded products. This role requires the ability to understand a significant installed base of technology in an environment supporting high availability mi ...

  • Fuze HR Solutions

    Principal Software Engineer

    Found in: Appcast CA C2 A - 3 days ago

    Fuze HR Solutions Greater Ottawa Metropolitan Area, Canada

    Looking to be a part of a highly innovative organization in your next opportunity? Our client is currently looking for a Principal Full Stack Engineer to join the team in Ottawa If you are looking for a new challenge, and have a great interest in technology, we want to hear from ...

  • General Dynamics Mission Systems–Canada

    Product Engineer, Intermediate

    Found in: Appcast CA C2 A - 1 day ago

    General Dynamics Mission Systems–Canada Ottawa, Canada

    At General Dynamics Mission Systems–Canada, our focus extends beyond engineering technology solutions—we are dedicated to cultivating careers. Our mission is to establish a workplace that thrives on diversity, where your beliefs, cultural background, experiences, and ideas are va ...

  • Groom & Associates(és)

    Senior System Engineer

    Found in: Appcast CA C2 A - 1 day ago

    Groom & Associates(és) Ottawa, ON, Canada

    Senior System Engineer · This company delivers products and services into the naval and military defence and transport markets alongside performing specialist research and providing services, including training and product support. · In the maritime domain, this company's engin ...

  • Rideau Transit Maintenance

    Electrical Engineer

    Found in: Appcast CA C2 A - 2 days ago

    Rideau Transit Maintenance Ottawa, Canada

    Rideau Transit Maintenance (RTM) is a General Partnership firm of ACS Infrastructure Canada, SNC Lavalin O&M, and Ellis Don. RTM has been awarded a long-term contract to maintain the Confederation Line, the new light rail transit system in Ottawa. RTM currently has an exciting ca ...

  • European Recruitment

    Senior ASIC Verification Engineer

    Found in: Appcast CA C2 A - 2 days ago

    European Recruitment Ottawa, Canada

    Senior ASIC Verification Engineer · A Semiconductor design company are looking for an experienced ASIC Verification Engineer to join their team, to work on cutting-edge projects across various products. · Due to stable and organic growth as a result of having a strong reputation ...

  • Procom

    Embedded C++ Developer

    Found in: Appcast CA C2 A - 2 days ago

    Procom Ottawa, Canada

    Embedded Software Developer, C++, Middleware · On behalf of our leading-industry client, Procom is seeking a Middleware Embedded Software Developer. This role requires on-site work in Ottawa. · In this position you will be working in the Software Development team, participating i ...