Jobs
>
Toronto

    Senior Data Engineer - Toronto, Canada - Prodigy Labs

    Prodigy Labs
    Prodigy Labs Toronto, Canada

    2 hours ago

    Default job background
    Accounting / Finance
    Description

    Data Engineer with Databricks & Spark Experience

    We are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.

    Responsibilities

    • Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed
    • Optimize data pipelines for performance, scalability, and reliability
    • Ensure data quality and integrity throughout the data lifecycle
    • Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs
    • Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations
    • Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management
    • Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community
    • Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies

    Qualifications

    • Bachelor's degree in Computer Science, Engineering, or related field, or equivalent work experience
    • 5+ years of experience in data engineering with Databricks and Spark
    • Proficient in SQL and Python, and familiar with Java or Scala
    • Experience with cloud platforms, such as Azure or AWS
    • Experience with big data technologies, such as Kafka, Hadoop, Hive, etc.
    • Experience with data warehouse and data lake concepts and architectures
    • Experience with data integration and ETL tools, such as Azure Data Factory or Talend
    • Experience with data visualization and reporting tools, such as Power BI or Tableau
    • Strong analytical and problem-solving skills
    • Excellent communication and teamwork skills
  • Société Financière Manuvie

    Data engineer

    1 week ago

    Société Financière Manuvie Toronto, ON, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • CIBC

    Data Engineer

    1 week ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • Société Financière Manuvie

    Senior data engineer

    1 week ago

    Société Financière Manuvie Toronto, ON, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Manulife Insurance Malaysia

    Lead Data Engineer

    2 weeks ago

    Manulife Insurance Malaysia Toronto, ON, Canada

    time type Temps plein · posted on Publié il y a 6 jour(s) · job requisition id JR · Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiativ ...

  • Atlantis IT group

    Aws Cloud Data Engineer@ Toronto, On

    1 week ago

    Atlantis IT group Toronto, Canada

    **AWS Cloud Data Engineer** · **Toronto, ON** · 1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers · AWS is preferred · ). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, d ...

  • CIBC

    Data Security Engineer

    4 days ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • CIBC

    Junior Data Engineer

    4 days ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • hireVouch

    Data Engineer

    4 days ago

    hireVouch Toronto, Canada

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join. · The Data Engineer will be responsible for building, processing, reviewing, and managing data along ...

  • Organigram Inc

    Data Engineer

    1 week ago

    Organigram Inc Toronto, Canada

    Description: · We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in SQL Server, Azure Data Factory, and data ingestion architecture within the Azure Cloud environment. Additionally, familiarity with Dynamics 365 and e ...

  • Morgan McKinley

    Data Engineer

    2 hours ago

    Morgan McKinley Toronto, Canada

    Job Description · Our client is a leader within the SaaS solutions loyalty and rewards space focused on increasing redemption and consumer loyalty looking for a Data Engineer to join their team. · Experience we need · Familiarity with graph database technologies such as TigerGrap ...

  • Bitstrapped

    Data Engineer

    2 hours ago

    Bitstrapped Toronto, Canada

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. · The Data Engineer will be involved in the ...

  • Apptoza Inc.

    Data Engineer

    5 days ago

    Apptoza Inc. Ontario, Canada

    Hi, · Hope you are doing well · We have a job opening for an AWS Data Engineer. · Role: AWS Data Engineer · Hybrid position · Location: Toronto, ON · Job Description: · 1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS ...

  • Rebelstork

    Data Engineer

    14 hours ago

    Rebelstork Toronto, Canada

    About Us: · Rebelstork is the largest baby gear liquidator and returns recommerce platform in North America, committed to diverting open box returns, overstock, and quality used items from landfills into the hands of parents at the best prices. Our mission is to revolutionize sus ...

  • Amgine

    Data Engineer

    1 week ago

    Amgine Toronto, Canada

    We're a well-funded Startup that is using Ai and Automation to streamline and automate booking processes for travelers and corporate agencies. AMGiNE has disrupted the space by developing proprietary Ai capabilities to radically improve corporate agent's efficiency and greatly en ...

  • Atlantis IT Group

    Engineer - Data Engineer

    2 weeks ago

    Atlantis IT Group Toronto, ON, Canada

    Role: AWS Data Engineer Hybrid position · Location: Toronto, ON · Job Description: · 1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers ( AWS is preferred ). Must be able to work with large volumes of data coming from vari ...

  • HCLTech

    Data Engineer

    1 week ago

    HCLTech Toronto, Canada

    Position: Data Engineer (Data Bricks) · Location: Toronto, Ontario / Remote · Skills Requirements: JD · Data Bricks: · • Strong hands on in Pyspark and Apache Spark · • Strong hands on in Medallion architecture · • Experience in Native Spark Migration to Databricks. · • Exper ...

  • Tata Consultancy Services

    Data engineer

    1 week ago

    Tata Consultancy Services Toronto, Canada

    TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity ...

  • Phmsociety

    Engineer - Data

    1 week ago

    Phmsociety Toronto, ON, Canada

    We are currently seeking anEngineer, Fleet Health Monitoringto join our team. You will work on vehicle architecture and understand how to apply data solutions to analyze vehicle issues and performance.Candidates will be expected to demonstrate excellence in their respective field ...

  • GalaxEons

    Data Engineer

    1 week ago

    GalaxEons Toronto, Canada

    Role: Data Engineer · Location: Toronto, ON (2 days/week onsite) · What You Will Do: · Work and develop in the Data Science and Data Engineering area. · Skills and Experience You Will Need: · Required: · 2-5 years of experience with the following: · PySpark · SQL · Databricks · A ...

  • Morgan McKinley

    Data Engineer

    3 days ago

    Morgan McKinley Toronto, Canada

    Job DescriptionOur client is a leader within the SaaS solutions loyalty and rewards space focused on increasing redemption and consumer loyalty looking for a Data Engineer to join their team.Experience we needFamiliarity with graph database technologies such as TigerGraph, Neo4j, ...