PySpark Developer - Toronto, Canada - Atlantis IT Group

    Atlantis IT Group
    Atlantis IT Group Toronto, Canada

    1 month ago

    Default job background
    Description
    Senior PySpark Developer to create a reporting platform to extract Capital Markets Surveillance reports from Enterprise data lake

    Skill Set:
    Relevant Experience(in yrs) 8+ YearsTechnical/Functional Skills

    • Big Data: Spark, Scala, Pyspark, SparkSQL, HDFS
    • Microsoft Stack: T-SQL, Good to have
    • SSIS, PowerShell
    • Scripting Languages: Batch Script, Shell Script, Python

    Additional Skills:

    • Agile, Scrum, Jira, Git, SVN, Liquibase