Bigdata Platform Infrastructure engineer - Toronto, Canada - Themesoft Inc.

    Default job background
    Technology / Internet
    Description

    Position: Bigdata Platform Infrastructure engineer

    Location: Toronto – Hybrid

    Job Description:

    • Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow
    • A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data management
    • Good knowledge with Azure Databricks, Azure Data Factory, ADLS.
    • Working knowledge of data migration from HDFS to ADLS using ADF.
    • Experience with configuration management tools such as Salt, Ansible.
    • Strong scripting skills with experience of platform automation using python/bash with version control system Git/Bitbucket

    Regards

    Patrick Fernandez

    Strategic Recruitment Manager - Talent Acquisition Group