beBee background
Professionals
>
Thornhill
Prudhvi R

Prudhvi R

Data Engineer

Insurance

Thornhill, Ontario

Social


About Prudhvi R:

Highly dedicated, inspiring, and expert ETL Data Engineer with over 7 years of IT industry experience exploring various technologies, tools and databases like Big Data, AWS, S3, Snowflake, Hadoop.

Experience

Highly dedicated, inspiring, and expert ETL Data Engineer with over 7 years of IT industry experience exploring various technologies, tools and databases like Big Data, AWS, S3, Snowflake, Hadoop.Over 6+ years of overall IT experience in a variety of industries, which includes hands on experience in Big Data and Data warehouse ETL technologies.2-Years hands-on expertise with Cloud including Informatica ICS and IICS, Amazon AWS and SalesforceDeveloped Informatica Cloud Data Integration mapping and task flows to extract and load data between on-premises, AWS RDS, Amazon S3, Redshift, Azure SQL Warehouse and Azure Data Lake Store; created and configured all kinds of cloud connections and runtime environments with Informatica IICSExperience in Extraction, Transformation and Loading (ETL) data from various sources into Data Warehouses, as well as data processing like collecting, aggregating, and moving data from various sources using.Good working knowledge on Clou DB, Snowflake and Teradata databases.Excellent Programming skills at a higher level of abstraction using Scala and Python.Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka, and Flume.Working knowledge of Amazon’s Elastic Cloud Compute (EC2) infrastructure for computational tasks and Simple Storage Service (S3) as Storage mechanism.Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs.Used IDEs like Eclipse, IntelliJ IDE, PyCharm IDE, Notepad ++, and Visual Studio for development.Experience working with GitHub/Git 2.12 source and version control systems.Improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frame, Pair RDD's, YARN.Hands on experience in handling Hive tables using Spark SQL.Efficient in writing MapReduce Programs and using Apache Hadoop API for analyzing the structured and unstructured data.Developed and designed automation framework using Python and Shell scriptingExperience in AWS EC2, configuring the servers for Auto scaling and Elastic load balancing.Experience with all stages of the SDLC and Agile Development model right from the requirement gathering to Deployment and production support.Involved in daily SCRUM meetings to discuss the development/progress and was active in making scrum meetings more productive.

Education

Btech in computer science engineering

Professionals in the same Insurance sector as Prudhvi R

Professionals from different sectors near Thornhill, Ontario

Other users who are called Prudhvi

Jobs near Thornhill, Ontario

  • Work in company

    Data Engineer

    Themesoft Inc.

    Data engineer position at Toronto, responsible for designing scalable data pipelines using Azure services. · ...

    Toronto

    3 days ago

  • Work in company

    Data Engineer

    Cogency

    About Cogency:Cogency is a consulting and technology services firm delivering enterprise digital transformation solutions across financial services and regulated industries. · We specialize in building scalable digital platforms, automating business processes, and enabling data-d ...

    Toronto

    1 week ago

  • Work in company

    Data Engineer

    HaknaSoft

    About Us · At HaknaSoft, we combine deep technical expertise with strong delivery capabilities to help organizations design and implement modern, cloud based solutions. Our team partners with large enterprises, particularly in financial services and wealth management, to accelera ...

    Toronto

    1 day ago