Jobs
>
Markham

    Data Engineer - Markham, Canada - Workday

    Workday
    Workday Markham, Canada

    1 week ago

    Workday background
    Technology / Internet
    Description

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence.

    We are looking for a collaborative and resourceful Data Engineer/ETL Developer. You are dedicated, naturally inquisitive and are comfortable in a fast-paced environment.

    This role will be part of and a member of our Data Delivery Group, you will be responsible for analysis, design and implementation in high-performing, experienced team. You'll be required to apply your depth of knowledge and expertise to all many areas including requirements, infrastructure, and solutioning. Aviva has embarked on an exciting journey to modernize, craft and build a next generation of data platform to support the growing data needs for data engineering, analytics and Data Science.

    We embrace a culture challenging the status quo and constantly look to efficiently simplify processes, technology, and workflow.

    This position reports to the AVP – Data Delivery.

    What you'll do

    • Design and Develop ETL Pipeline to ingest data into Hadoop from different data sources (Files, Mainframe, Relational Sources, NoSQL Etc.) using Informatica BDM
    • Parse unstructured data, semi structured data such as JSON, XML etc. using Informatica Data Processor.
    • Analyze the Informatica PowerCenter Jobs and redesign and develop them in BDM.
    • Design and develop efficient Mapping and workflows to load data to Data Marts.
    • Perform the GAP analysis between various legacy applications to migrate them to newer platforms/data marts.
    • Write efficient queries in Hive or Impala and PostgreSQL to extract data on Adhoc basis to do the data analysis.
    • Identify the performance bottlenecks in ETL Jobs and tune their performance by enhancing or redesigning them.
    • Work with Hadoop administrators, Postgres DBAs to partition the hive tables, refresh metadata and various other activities, to enhance the performance of data loading and extraction.
    • Performance tuning of ETL mappings and queries.
    • Write simple or medium complex shell scripts to preprocess the files, schedule ETL jobs etc.
    • Identify various manual processes, queries etc. in the Data and BI areas, design and develop ETL Jobs to automate them.
    • Participate in daily scrums; work with vendor partners, QA team and business users in various stages of development cycle.
    • Advocate importance of data catalogs, data governance and data quality practices.
    • Outstanding problem solving skills
    • Work in an Agile delivery framework to evolve data models and solution designs to deliver value incrementally.
    • You are a self-starter with experience working in a fast-paced agile development environment.

    What you'll bring

    • University degree in Computer Engineering or Computer Science
    • 3+ years of experience working on Informatica BDM platform.
    • Experience on various execution modes in BDM such Blaze, Spark, Hive, Native.
    • 3+ years of experience working on Hadoop Platform, writing hive or impala queries.
    • 5+ years of experience working on relational databases (Oracle, Teradata, PostgreSQL etc.) and writing SQL queries.
    • Should have deep knowledge on performance tuning of ETL Jobs, Hadoop Jobs, SQL's, Partitioning, Indexing and various other techniques.
    • Experience in writing Shell scripts.
    • Experience in Spark Jobs (Python or Scala) is an asset.
    • Knowledge/experience in Cloud Data Lake Design – pref AWS technologies like S3, EMR, Redshift, Snowflake, could data catalog etc.,
    • Understanding of reporting/analytics tools (QlikSense, SAP Business Objects, SAS, DataIku, etc.,)
    • Familiar with the Agile software development
    • Excellent verbal and written communication skills
    • Insurance knowledge an asset-Ability to foundationally understand complex business process driving technical systems.

    What you'll get

    • Competitive rewards package including base compensation, eligibility for annual bonus, retirement savings, share plan, health benefits, personal wellness, and volunteer opportunities.
    • Exceptional Career Development opportunities.
    • We'll support your professional development education.

    Additional Information: Aviva Canada has an accommodation process in place to provide accommodations for employees with disabilities. If upon commencement of employment you require a specific accommodation because of a disability, please contact your Talent Acquisition Partner so that an appropriate accommodation can be arranged. This process applies throughout your career with Aviva Canada.

  • Syntronic

    Engineer - Data Engineer

    2 weeks ago

    Syntronic Markham, ON, Canada

    Are you ready to be part of a leading global engineering design house specializing in the design and development of embedded software/hardware, electronics, and electro-mechanics? · Professionals with ability to work both with in-house projects and on-site assignments at our cust ...

  • The Nationwide Group

    Data Engineer Data Analytics

    2 days ago

    The Nationwide Group Markham, ON, Canada

    Data Engineer · The Nationwide Group (TNG) is a pioneer in designing and developing outsourced financial services software, exclusively focused on creating comprehensive and customizable solutions for the real estate industry. Utilizing world-class technology, TNG delivers solut ...

  • Société Financière Manuvie

    Data engineer

    1 week ago

    Société Financière Manuvie Toronto, ON, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Société Financière Manuvie

    Data engineer

    3 hours ago

    Société Financière Manuvie Old Toronto, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • CIBC

    Data Engineer

    1 week ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...

  • General Motors

    Manager of Data Engineering

    2 weeks ago

    General Motors Markham, ON, Canada Full time

    Software-defined vehicles represent a new paradigm for automakers and consumers, fueled by technological advancements and an escalating demand for transportation solutions that are not only intelligent but also safer and more environmentally sustainable. At the core of this trans ...

  • Aviva

    Manager, Data Engineering

    1 day ago

    Aviva Markham, Canada

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence. · We are seeking a technology professional and leader to be our Manager, Data Engineering for our IT Data Plat ...

  • Adastra

    AWS Data Engineers

    5 days ago

    Adastra Markham, Canada

    Overview · We are seeking AWS Data Engineers to join our team. As an AWS Data Engineer, you will be responsible for designing, developing, and maintaining our company's data infrastructure on the AWS platform. The ideal consultant will have experience in the delivery of Finance ...

  • Workday

    AVP - Data Engineering

    1 week ago

    Workday Markham, Canada

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence. · We are looking for a forward-thinking AVP - Data Engineering to join and be part of our growing multidiscipl ...

  • Workday

    Senior Data Engineer

    1 week ago

    Workday Markham, Canada

    Individually we are people, but together we are Aviva. Individually these are just words, but together they are our Values – Care, Commitment, Community, and Confidence. · We are looking for a collaborative and resourceful Senior Data Engineer. You are dedicated, naturally inquis ...

  • Société Financière Manuvie

    Senior data engineer

    1 week ago

    Société Financière Manuvie Toronto, ON, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Manulife Insurance Malaysia

    Lead Data Engineer

    2 weeks ago

    Manulife Insurance Malaysia Toronto, ON, Canada

    time type Temps plein · posted on Publié il y a 6 jour(s) · job requisition id JR · Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiativ ...

  • Adastra

    Azure Data Engineer Lead

    5 days ago

    Adastra Markham, Canada

    Overview · As Azure Data Engineer Lead, you will handle end-to-end solutions, architecture design, and documentation for large scale data implementations (related to big data and data warehousing). This is a technical leadership role that requires the ability to take initiative ...

  • Atlantis IT group

    Aws Cloud Data Engineer@ Toronto, On

    1 week ago

    Atlantis IT group Toronto, Canada

    **AWS Cloud Data Engineer** · **Toronto, ON** · 1. Must have working knowledge in designing and implementing data pipelines on any of the cloud providers · AWS is preferred · ). Must be able to work with large volumes of data coming from various sources. Perform data cleansing, d ...

  • Manulife Insurance Malaysia

    Senior Data Engineer

    3 hours ago

    Manulife Insurance Malaysia Old Toronto, Canada

    time type Temps plein · posted on Publié il y a 6 jour(s) · job requisition id JR · Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiativ ...

  • Huawei Technologies Canada Co., Ltd.

    Coop Engineer Data Science

    5 days ago

    Huawei Technologies Canada Co., Ltd. Markham, Canada InternshipSHIP

    Our team has an immediate Co-op opening for Data Science · Responsibilities: · Research & Build (and/or Prototype) Gen AI model(s) using LLMs · Design, develop and fine-tune scalable LLMs (Large Language Model) · Collaborate with UX designer and front-end developer to incorporat ...

  • Huawei Technologies Canada Co., Ltd.

    Intern Engineer- Data Science

    1 week ago

    Huawei Technologies Canada Co., Ltd. Markham, Canada InternshipSHIP

    Our team has an immediate Internship opening for Data Science · Responsibilities: · Research & Build (and/or Prototype) Gen AI model(s) using LLMs · Design, develop and fine-tune scalable LLMs (Large Language Model) · Collaborate with UX designer and front-end developer to incor ...

  • Société Financière Manuvie

    Senior data engineer

    3 hours ago

    Société Financière Manuvie Old Toronto, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • Société Financière Manuvie

    Senior data engineer

    3 hours ago

    Société Financière Manuvie Old Toronto, Canada

    Nous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...

  • CIBC

    Data Security Engineer

    5 days ago

    CIBC Toronto, Canada Temps plein

    Nous bâtissons une banque axée sur les relations pour un monde moderne. Nous recrutons des professionnels talentueux et passionnés qui ont à cœur de faire ce qu'il faut pour nos clients. · À la Banque CIBC, nous misons sur vos forces et vos ambitions pour vous donner le pouvoir ...