Senior DevOps Engineer - Toronto, Canada - ONxpress Operations Inc.

    Default job background
    Description

    Job description

    Responsibility
  • Design and develop ETL processes based on functional and non-functional requirements within Azure platform
  • Recommend and execute improvements
  • Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
  • Apply automation and innovation on new and on-going data platforms that aligned to business strategies.
  • Understand the full end to end development activities from design to go live for ETL development in Azure platform
  • Document component design for developers and for broader communication.
  • Understand and adopt an Agile (SCRUM like) software development mindset
  • Follow established processes/standards, business technology architecture for development, release management and deployment process
  • Design, develop and implement reporting platforms and complex ETL frameworks that meet business requirements.
  • Provide data analysis and requirements within enterprise platform.
  • Develop, maintain knowledge of data available from upstream sources and data within various platforms.
  • Experience and Requirements
  • Undergraduate Degree or Technical Certificate.
  • Work experience (5 years):
  • Azure platform / Big Data technologies
  • Azure platform and tools like Azure Data Factory, Azure Databricks, Azure Synapse, Azure Purview, Azure Functions
  • Data Flow Processes
  • SQL Development
  • ETL
  • Nice to have: Python, Pyspark, Spark, Sqoop, Hive, API's, APIM, REST/SOAP web services
  • Working experience with data modeling, relational modeling and dimensional modeling.
  • Working knowledge of source code control tool such as GIT
  • Implementation experience in managing and working in multiple environments, release and change management and knowledge of firewall, network work protocols, file transfer – TIBCO
  • Familiar with Agile development methodologies
  • Sound to advanced knowledge of business, standards, infrastructure, architecture and technology from a design/support/ solutions perspective
  • Readiness and motivation (as an experienced developer and subject matter expert) to address and resolve complex issues, guide/advise/support clients, partners and project teams, often working on multiple medium-to-large sized projects.