beBee background
Professionals
>
Mississauga
Vishalbhai Barvaliya

Vishalbhai Barvaliya

Data Engineer

Technology / Internet

Mississauga, Ontario

Social

About Vishalbhai Barvaliya:

Highly organized and detail-oriented Data Engineer associated with experience in developing and managing cloud-based databases. Skilled in Python, SQL, Spark, Hive, ETL, data modeling, ETL processing, data warehousing, and analytics. Experienced in deploying and managing Microsoft Azure cloud solutions, including Azure SQL Database, Azure Data Warehouse, Azure Data Lake, and Azure Data Factory. Proven track record of developing, optimizing, and troubleshooting data pipelines for high-volume data flow

Experience

Data Engineer Associate at Mundelbulb Technologies : Sept 2021 – Nov 2021 

• Maintained data pipeline up-time of 99.06% while ingesting streaming and transactional data across different primary data sources using Spark, Azure Data Factory, Data Lake Storage Gen2, Blob Storage, Azure SQL Database, and Python.

• Automated ETL processes across millions of rows of data, which reduced manual workload by 29% monthly. • Ingested data from disparate data sources using a combination of SQL, Event Hub, and Azure Stream Analytics using Python to create data views to be used in PowerBI. 

• Created monitoring alerts for data pipelines that improved the uptime of the network by 17% year over year.

Education

Lambton College - Big Data Analytics,  Mississauga, ON.                                      Jan 2022-Aug 2023

Professionals in the same Technology / Internet sector as Vishalbhai Barvaliya

Professionals from different sectors near Mississauga, Ontario

Jobs near Mississauga, Ontario

  • Data Engineer

    1 month ago

    Spotify Toronto, Ontario

    +We are looking for a mid level Data Engineer to join Spotify's Finance Engineering organization. · +Work with modern data processing frameworks, platforms and tooling (Python, Scala, Java , Scio , Flyte , Styx , DBT , etc . on GCP ) to build operate and own reliable data pipelin ...

  • Sr. Data Engineer

    1 month ago

    Andiamo Toronto, Ontario

    Job summary · We are looking for a Senior Data Engineer to help build the next generation of data infrastructure at a $100M+ tech startup in the data management space. · Design & Build Pipelines: Develop scalable ETL/ELT pipelines and streaming workflows that power data-driven pr ...

  • Data Engineer

    2 days ago

    CBL Solutions Mississauga

    We are looking for a Data Engineer with strong expertise in modern data platforms and engineering practices. · Design develop and maintain scalable ETL/ELT pipelines for structured unstructured data. · Implement data integration solutions using ADF Kafka stream processing framewo ...

See jobs in Mississauga, Ontario