Jobs
>
Toronto

    Data engineer - Toronto, Canada - Tata Consultancy Services

    Tata Consultancy Services
    Tata Consultancy Services Toronto, Canada

    2 weeks ago

    Tata Consultancy Services background
    Description

    TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in.

    Our continued commitment to Culture and Diversity and is reflected in our people stories across our workforce implemented through equitable workplace policies and processes.

    About TCSTCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries.

    TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status.

    Our organizational structure is domain-led and designed to offer businesses a single window into industry-specific solutions. Our agile industry units have embedded capabilities to enable rapid responses that provide a competitive edge to our customers.

    This, coupled with a unique Global Network Delivery ModelTM (GNDMTM), is recognized as the current benchmark of excellence in technology deployment.

    We have made significant investments in digital technology, horizontal, and vertical platforms, allowing us to successfully serve our clients for over 50 years.


    Skills and Responsibilities:

    • Design, develop, and maintain data processing pipelines using Apache Spark.
    • Collaborate with data engineers, data scientists, and business analysts to understand data requirements and deliver solutions that meet business needs.
    • Write efficient Spark code to process, transform, and analyze large datasets.
    • Optimize Spark jobs for performance, scalability, and resource utilization.
    • Integrate Hadoop, Hive, Spring, Hibernate, Kafka, and ETL processes into Spark applications.
    • Troubleshoot and resolve issues related to data pipelines and Spark applications.
    • Monitor and manage Spark clusters to ensure high availability and reliability.
    • Implement data quality and validation processes to ensure accuracy and consistency of data.
    • Stay up-to-date with industry trends and best practices related to Spark, big data technologies, Python, and AWS services.
    • Document technical designs, processes, and procedures related to Spark development.
    • Provide technical guidance and mentorship to junior developers on Spark-related projects

    Qualifications:

    • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
    • Proven experience as a Spark Developer or in a similar role working with big data technologies.
    • Strong proficiency in Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib.
    • Proficiency in programming languages such as Scala or Python for Spark development.
    • Experience with data processing and ETL concepts, data warehousing, and data modeling.
    • Solid understanding of distributed computing principles and cluster management.
    Tata Consultancy Services Canada Inc.

    is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC).

    Should you require accommodations during the recruitment and selection process, please inform Human Resource.
    Thank you for your interest in TCS. Candidates that meet the qualification for this position will be contacted within a 2 week period. We invite you to continue to apply for other opportunities that match your profile.
  • Société Financière Manuvie

    Data Engineer

    1 week ago

    Société Financière Manuvie Toronto, ON, Canada $92,190 - $171,210

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Société Financière Manuvie

    Data engineer

    3 weeks ago

    Société Financière Manuvie Toronto, ON, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • CIBC

    Data Engineer

    3 weeks ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • Société Financière Manuvie

    Senior data engineer

    3 weeks ago

    Société Financière Manuvie Toronto, ON, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Manulife Insurance Malaysia

    Senior Data Engineer

    1 week ago

    Manulife Insurance Malaysia Toronto, ON, Canada $92,190 - $171,210

    time type Temps plein · posted on Publié il y a 6 jour(s) · job requisition id JR · Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiativ ...

  • Société Financière Manuvie

    Senior data engineer

    1 week ago

    Société Financière Manuvie Toronto, ON, Canada $92,190 - $171,210

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Atlantis IT group

    Aws Cloud Data Engineer@ Toronto, On

    3 weeks ago

    Atlantis IT group Toronto, Canada

    **AWS Cloud Data Engineer** · **Toronto, ON** · 1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers · AWS is preferred · ). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, d ...

  • CIBC

    Data Security Engineer

    2 weeks ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • CIBC

    Data Security Engineer

    1 day ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • CIBC

    Junior Data Engineer

    2 weeks ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • Société Financière Manuvie

    Senior data engineer

    1 week ago

    Société Financière Manuvie Old Toronto, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Organigram Inc

    Data Engineer

    2 days ago

    Organigram Inc Toronto, Canada

    Description: · We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in SQL Server, Azure Data Factory, and data ingestion architecture within the Azure Cloud environment. Additionally, familiarity with Dynamics 365 and e ...

  • Raise

    Data Engineer

    1 day ago

    Raise Toronto, Canada

    Data Engineer · Location Address: Hybrid - Toronto – 1-2 days / week (Wednesdays and Thursdays) – need candidates in GTA · Contract Duration: ASAP to Oct 31, 2024 – approx. 4 months · Possibility of extension · Schedule Hours: 9am-5pm Monday-Friday; standard 37.5 hrs/week · Reaso ...

  • Procom Labs

    Data Engineer

    1 week ago

    Procom Labs Toronto, Canada

    The role: · In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data ...

  • Finance Professionals Inc.

    Data Engineer

    23 hours ago

    Finance Professionals Inc. Toronto, Canada

    Typical Day in Role: · • Collaborate with business lines and other stakeholders and identify opportunities to drive business value by leveraging data engineer. · • Efficiently handle large volumes of structured and unstructured data through ingestion, modeling, transformation, an ...

  • Amgine

    Data Engineer

    3 weeks ago

    Amgine Toronto, Canada

    We're a well-funded Startup that is using Ai and Automation to streamline and automate booking processes for travelers and corporate agencies. AMGiNE has disrupted the space by developing proprietary Ai capabilities to radically improve corporate agent's efficiency and greatly en ...

  • Apptoza Inc.

    Data Engineer

    2 weeks ago

    Apptoza Inc. Ontario, Canada

    Hi, · Hope you are doing well · We have a job opening for an AWS Data Engineer. · Role: AWS Data Engineer · Hybrid position · Location: Toronto, ON · Job Description: · 1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS ...

  • hireVouch

    Data Engineer

    4 days ago

    hireVouch Toronto, ON, Canada

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join. · The Data Engineer will be responsible for building, processing, reviewing, and managing data along ...

  • Bitstrapped

    Data Engineer

    4 days ago

    Bitstrapped Toronto, Canada

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. · The Data Engineer will be involved in the ...

  • HCLTech

    Data Engineer

    3 weeks ago

    HCLTech Toronto, Canada

    Position: Data Engineer (Data Bricks) · Location: Toronto, Ontario / Remote · Skills Requirements: JD · Data Bricks: · • Strong hands on in Pyspark and Apache Spark · • Strong hands on in Medallion architecture · • Experience in Native Spark Migration to Databricks. · • Exper ...