Jobs
>
Vancouver

    Data Engineer - North Vancouver, Canada - CB Canada

    Cb Canada background
    Description

    Data Engineer

    On behalf of our client, Procom Consultants Group is currently looking for an Intermediate Data Engineer.

    Requested resources to provide developer expertise on coding of data transformation pipelines and systems integration tasks relating to enterprise data management applications that span across different business areas and platforms.

    Data Engineer Job Details


    • Creating mapping documentation of data elements from source to target and liaising with other Data Engineers, Data Architects and SMEs.


    • Developing & testing Data Transformation pipelines by leveraging the latest Big Data tools and technologies


    • Collaborate with upstream data teams, develop data validation and test plans, performing user acceptance testing, and provide feedback to development and sustainment teams


    • Conducting analysis for moderate to complex data requests, defining data fields and determining data availability, developing information layout, format and interactivity. Presenting findings and providing clarification.


    • Act as a lead developer to implement code changes in various environments and platforms leveraging our DevOps & DataOps


    • Work closely with the testing team to assist with issues raised in user acceptance testing (UAT) and Business Value Testing (BVT)

    Deliverables:

    Fully implement the new data format across all IM supported platforms including

    Big Data (Hadoop), Enterprise Data Warehouse (EDW) and Operational Data Store

    (ODS)

    Data Engineer Mandatory Skills

    Communication & Problem Solving Skills:


    • Communicating & presenting solutions to internal developers


    • Ability to apply critical thinking skills to develop efficient code, data transformation logic and solution design


    • Experience and/or understanding of Agile Methodologies

    Technical Skills:


    • Advanced Database Skills & SQL


    • Experience with or exposure to Big Data platforms, ideally exposure to Hadoop ecosystem (HDFS, Apache Hive, Apache Spark, SparkSQL)


    • Extensive programming experience in either Java, C++ or preferably Scala, IntelliJ, Jenkins


    • Working experience with Apache Spark Data Processing Framework, Parquet data format


    • Good understanding of Relational (Oracle/DB2) and Hadoop Big Data platforms


    • Experience working with Jira

    Data Engineer Start Date

    Oct 24, 2022

    Data Engineer Assignment Duration

    March

    Data Engineer Working Location
    Fully remote but PST hours


  • Intelliswift Software

    Data Engineer

    4 hours ago


    Intelliswift Software Vancouver, Canada Full time

    Data Engineer (Spark) · Duration: Fulltime with Intelliswift Software Inc · Location: Canada 100% remote (Needs to work in PST Hours) · Description: · Must know Big Data in depth, handled large datasets · Doing Spark Streaming · Scala good but not required · Java Exp is a ...

  • Beatdapp

    Data Engineer

    6 hours ago


    Beatdapp Vancouver, BC, Canada

    Beatdapp is a venture-backed startup delivering the most advanced music streaming fraud and audit technology in the world. Our industry-leading software helps music labels and artists fight the over $2 billion royalties stolen from them each year. Plus, who doesn't love working w ...

  • Ignite Technical

    Data Engineer

    5 days ago


    Ignite Technical British Columbia, Canada

    On behalf of our Healthcare client based inVancouver, Ignite Technical Resources is seeking an Senior Data Engineer to join our team on a contract basis. · The Data Engineer will work in a complex project environment to assess and qualify disparate data and define data models th ...

  • Zortechsolutions

    Data Engineer

    1 day ago


    Zortechsolutions Vancouver, BC, Canada Full time

    Role: Data Engineer-SQL, Python, ETL · Duration: Full Time · We are looking for Senior Data Engineering Candidates based out of the Canada. · Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipeline ...

  • GeoComply

    Data Engineer

    3 days ago


    GeoComply Vancouver, BC, Canada

    We're a market-leading technology provider with teams across five countries and three continents with a global customer base. Achieving 650% growth in annual revenue over the past three years and dubbed a tech "Unicorn," we're revolutionizing how people and businesses use the int ...

  • Sandman Hotel Group

    Data Engineer

    2 days ago


    Sandman Hotel Group Vancouver, BC, Canada

    Tuesday, February 20, 2024 · Proud to be 100% Canadian-owned,Northland Properties' are recognized as one of the most trusted names in hotels, restaurants, resorts, sports, construction, and asset management. Our well-known and loved brands have been bringing people together to c ...


  • MineSense Vancouver, BC, Canada

    Metals are necessary for our world, but mining historically faced issues with waste, sustainability, and inefficiencies. Our solutions reduce mining waste and environmental impacts while increasing profits and efficiencies. Backed by the best in venture capital and government fun ...


  • railtown Vancouver, BC, Canada

    As a Senior Machine Learning Engineer, you will work with our growing AI team in developing AI and machine learning (ML) solutions for problems in the software development domain. This position will provide a mix of research and engineering problems as you will be involved in the ...

  • Capgemini

    Data Engineer

    2 days ago


    Capgemini Vancouver, BC, Canada Temporary

    Python · Data Modeling · Building out Data Pipelines using Python · Airflow ...

  • CB Canada

    Data Engineer

    2 hours ago


    CB Canada North Vancouver, Canada

    Data Engineer (Python or Scala) · On behalf of our client, Procom Consultants Group is currently looking for a Data Engineer (Python or Scala). · This contract Data Engineer will be responsible for automating the fetching of claims documents from OpenText Content Server and usin ...

  • Microserve

    data engineer

    2 days ago


    Microserve British Columbia, Canada

    Location: Remote, British Columbia · Type: Fixed Term/Contract · Job #5 · DATA ENGINEER (6 month contract) · Location: Remote · Staffing Placement Opportunity · Responsibilities: · Analyze data from various sources. · Perform complex data analysis and report query results. ...

  • CB Canada

    Data Engineer

    2 hours ago


    CB Canada North Vancouver, Canada

    Data Engineer - Big Data Platform · On behalf of our client, Procom Consultants Group is currently searching for a Data Engineer - Big Data Platform. · The Senior Data Engineer will join the Information Management team and focus on the development of big data reporting and analyt ...

  • Insight Global

    Data Engineer

    2 weeks ago


    Insight Global Vancouver, Canada Paid Work

    Job Description · Insight Global is looking for a Data Engineer to join the Data & Solutions Infrastructure team for one of BC's leading health authorities. This resource will be instrumental in maintaining and advancing data infrastructure. Take charge of both cloud-based and lo ...


  • Insurance Corporation of British Columbia North Vancouver, BC, Canada Full time

    Also consider joining our Indigenous Peoples or People with Disabilities Talent Pool to receive information about future opportunities and to learn more about our DEI hiring. · The Data Engineer - Junior on the IM Data Services team will focus on supporting Evaluative Analytics ...

  • Brooksource

    Data Engineer II

    4 hours ago


    Brooksource Vancouver, Canada

    Data Engineer II · Vancouver, Canada – hybrid (3 days a week onsite) · Long Term Contract · $45 - $60 /hr. · Who We Are: · Our client is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics an ...


  • Knewin Vancouver, BC, Canada

    We are at the forefront of geolocation, cybersecurity, and anti-fraud innovation, developing and delivering cutting-edge technologies to help ensure regulatory compliance, combat bad online actors, alleviate user friction, and protect businesses from fraud. · Achieving significa ...


  • T-Net British Columbia Vancouver, BC, Canada

    We are at the forefront of geolocation, cybersecurity, and anti-fraud innovation, developing and delivering cutting-edge technologies to help ensure regulatory compliance, combat bad online actors, alleviate user friction, and protect businesses from fraud. · Achieving significa ...

  • Unblocked

    Senior Data Engineer

    4 hours ago


    Unblocked Vancouver, Canada

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems. · We are a small company that encourages par ...

  • Apex Systems

    Senior Data Engineer

    4 hours ago


    Apex Systems British Columbia, Canada

    Apex Systems is hiring a Senior Data Engineer for a government health service provider · Location: Remote, must work PST · Duration: 6 months with possible extensions · The Data Engineer will work in a complex project environment to assess and qualify disparate data and define da ...


  • Electronic Arts Vancouver, BC, Canada

    Frostbite is EA's proprietary game engine that comes equipped with tons of tools and technologies designed to build incredible games. Our in-house engine offers the unique ability to adapt to each game while working hand-in-hand to prioritize what to build. Our goal is to empower ...