beBee background
Professionals
>
Montréal
Chand M

Chand M

Data Engineer

Banking / Loans

Montréal, Montréal

Social


About Chand M:

I have 6 years of experience and a proven knowledge of Programming, Data Engineering Concepts, ETL, Data Warehouse and Data virtualization Tools, Machine Learning, DevOps.

Experience

  • Continuously seek out and identify areas to improve our data engineering practices, our data quality and our processes.
  • Create and manage data documentation to provide transparency to users ( ERD, Data Dictionary, Lineage)
  • Perform Development and solution design from project inception through to implementation managing resources, timelines and budgets.
  • Maintain , Troubleshoot and answer hoc questions regarding current data pipelines.
  • Create, enhance and monitor data processes to ensure data data quality and consistency.
  • Deploying the data service infrastructure on kubernetes using terraform scripts
  • Creating Azure Data Bricks Notebooks based on Business requirements.
  • Creating DAX queries for developing the reports and measures in Power BI and deploying it using the Azure Devops, PowerShell Scripts.
  • Used Informatica to Collaborate with cross-functional teams to understand data requirements and design and implement data integration solutions. 
  • Used Informatica for extracting, transforming, and loading (ETL) data from various sources into target systems, ensuring data accuracy and consistency.
  • Creating MLOps application leveraging the Databricks MLFlow.
  • Model deployment and serving is created using Databricks MLflow API’s.
  • Used PySpark  in data bricks, ETL/ELT, big data
  • API's used under PySpark or RDD , SQL, structure streaming, ML.
  • The sources worked with PySpark diff type of sources like kafka, eventhub, relational database like sql server, oracle.
  • NoSQL database like cosmos db, mongo db blob storages like azure blob storage, azure data lake gen2, aws s3, file sources csv, excel, avro, parquet, xml, json.
  • Packaging the existing Python code and deploying as libraries into data bricks Filestore folder and automating it using the Git

Education

Bachelor's of Technology 

Professionals in the same Banking / Loans sector as Chand M

Professionals from different sectors near Montréal, Montréal

Jobs near Montréal, Montréal

  • Work in company

    Data Engineer

    Vensure Employer Solutions

    · About Us · Vensure Employer Solutions is the largest privately held organization in the HR technology and service sector, providing a comprehensive portfolio of solutions, including HR/HCM technology, managed services, and global business process outsourcing (BPO). The company ...

    Westmount, QC Canada

    3 days ago

  • Work in company

    Data Engineer

    Apptad

    Data Engineer role involves developing data pipelines using various technologies including Snowflake and Amazon Web Services (AWS) S3. · * Develop data pipelines using Python, Pyspark and SQL* Proficient in SQL query writing* Solid understanding of relational databases* Familiari ...

    Montreal

    1 month ago

  • Work in company

    Lead Data Engineer

    Psycho Bunny

    We're Psycho Bunny - the · rebelliously refined clothing brand turning heads with our premium quality, · vibrant style and that unmistakable logo. · The Data Engineer will drive the company's data strategy by building · and maintaining the data infrastructure necessary for advan ...

    Montreal, Quebec

    1 month ago