beBee background
Professionals
>
Engineering / Architecture
>
Centretown
Hemangi Santoki

Hemangi Santoki

(Immediate joiner) Data Engineer|Spark|SQL|Python

Engineering / Architecture

Centretown, Ottawa

Social

About Hemangi Santoki:

  • Total 6 years of experience in the IT industry and 3 years of experience as a data engineer.
  • Proficient in designing and implementing Big Data projects within the Hadoop ecosystem, utilizing technologies such as MapReduce, HDFS, Hive, and Python, and performing data pipeline development and ETL operations.
  • Proficient in Spark Architecture, including Data Frame, Dataset, and RDD, as well as the Hadoop HDFS architecture and MapReduce framework.
  • Experienced in utilizing AWS services such as S3, EMR, Glue, and Airflow, demonstrating a strong understanding of cloud-based data storage, data processing, and workflow management.
  • Strong practical experience with Relational Databases, showcasing hands-on expertise.
  • Proficient in databases, Docker, Git, CI/CD, and Agile methodologies, highlighting a well-rounded skill set in essential tools and practices.

Experience

  • Led a Healthcare project involving data ingestion into Postgres and Redshift tables, implementing various events based on business requirements to enhance data evolution.
  • Actively contributed to the development of 5 number of Spark applications using Python, leveraging advanced data processing capabilities.
  • Optimized existing code in Hadoop by utilizing Spark-SQL, Data Frames, and RDD, resulting in a 50% improvement in performance and efficiency.
  • Implemented ETL processes by loading CSV data into intermediate tables, performing transformations, and persisting the results in Redshift tables.
  • Designed and implemented 6 number of Airflow pipelines to handle diverse data sources and streamline data workflows in the healthcare domain.

Education

Bachelor of Engineering in Computer Science

Professionals in the same Engineering / Architecture sector as Hemangi Santoki

Professionals from different sectors near Centretown, Ottawa

See professionals near Centretown, Ottawa

Other users who are called Hemangi

Jobs near Centretown, Ottawa

  • CanadianNanny

    Child Care Provider

    Found in: beBee S2 CA - 1 month ago

    CanadianNanny Kemptville, Canada TEMPORARY

    I'm looking for someone with early educator experience and CPR training. Looking forward to connecting · Training · Cpr · Babysitter · Work Details · Occassional · Transportation · Job Can Transport Provider · Child Age · Toddler · Criminal Record Check · Services · English · ...

  • Egg Farmers of Canada

    Agricultural Statistical Analyst

    Found in: beBee S2 CA - 3 days ago

    Egg Farmers of Canada Ottawa, Canada Full time

    Egg Farmers of Canada is presently seeking an Agricultural Statistical Analyst to join our Agricultural Policy and Costing team. Reporting to the Manager of Agricultural Policy & Costing, the primary responsibilities of the role include conducting accurate, comprehensive, and tim ...

  • 2295468 Ontario Inc

    truck and coach technician

    Found in: Talent CA 2 C2 - 20 hours ago

    2295468 Ontario Inc Ottawa, Canada

    Durée de l'emploi: Permanent · Langue de travail: Anglais · Heures de travail: 42.5 hours per week · Education: · Expérience: · Education · Other trades certificate or diploma · or equivalent experience · Work setting · In shop · Garage · Tasks · Adjust, repair or replace parts ...