Vishalbhai Barvaliya

Highly organized and detail-oriented Data Engineer associated with experience in developing and managing cloud-based databases. Skilled in Python, SQL, Spark, Hive, ETL, data modeling, ETL processing, data warehousing, and analytics. Experienced in deploying and managing Microsoft Azure cloud solutions, including Azure SQL Database, Azure Data Warehouse, Azure Data Lake, and Azure Data Factory. Proven track record of developing, optimizing, and troubleshooting data pipelines for high-volume data flow

Data Engineer Associate at Mundelbulb Technologies : Sept 2021 – Nov 2021 

• Maintained data pipeline up-time of 99.06% while ingesting streaming and transactional data across different primary data sources using Spark, Azure Data Factory, Data Lake Storage Gen2, Blob Storage, Azure SQL Database, and Python.

• Automated ETL processes across millions of rows of data, which reduced manual workload by 29% monthly. • Ingested data from disparate data sources using a combination of SQL, Event Hub, and Azure Stream Analytics using Python to create data views to be used in PowerBI. 

• Created monitoring alerts for data pipelines that improved the uptime of the network by 17% year over year.

Lambton College - Big Data Analytics,  Mississauga, ON.                                      Jan 2022-Aug 2023