Big Data Lead - Montréal, Canada - Mphasis

Mphasis

Verified Company

Montréal, Canada

3 weeks ago

Posted by:

Sophia Lee

beBee Recruiter

Description

Position Title:
Big Data Lead

Location:
Montreal (Onsite)
Who are we looking for?

Looking for a tech-savvy professional with at least 10 years of industry experience. At least 8 years of experience working as a Lead in Big Data technologies. Should be methodical and have excellent time management skills. As a Lead, should also use your communication skills to collaborate effectively with various teams.

Technical Skills:
BIG DATA LEAD (Spark Structured Streaming + Spark SQL + Kafka)

Qualifications:

8+ Yrs exp (Internal/external) Spark with Scala, Kafka,Sql, Azure/AWS databricks
Experience in Spark with Scala, spark streaming, structured streaming with Kafka, Spark performance optimization,Sql, Azure databricks.

Experience on Databricks, Azure Data Factory, Azure Datalake service is added advantage ,

Experience in building real time data streaming pipelines from Kafka (or any message broker) using Spark Structured Streaming
Hands on experience in Spark with functional programming language like Scala development and unit testing is must.
Experience in designing and leading Big Data projects, designing data models on Hive and HBase for highperformance and storage.
Executed at least one end to end Bigdata projects (streaming real time data) and led the developers' team.
Experience in Agile methodology is a must.
Knowledge of standard methodologies, concepts, best practices, and procedures within Big Data environment
Selfstarter and able to independently implement the solution.
Good problemsolving techniques and communication
Hands on Big Data Lead role (Spark Structured streaming)
Actively participate in scrum calls, story points, estimates and own the development piece.
Provide technical assistance to team and involve in efficient design
Analyze the user stories, understand the requirements and develop the code as per the design
Develop test cases, perform unit testing and integrating testing
Support QA Testing, UAT and production deployment
Develop batch and realtime data load jobs from a broad variety of data sources into Hadoop. And design ETL jobs to read data from Hadoop and pass to variety of consumers / destinations.
Perform analysis of vast data stores and uncover insights.
Analyze the long running queries and jobs, performance tune them by using query optimization techniques and Spark code optimization.

Process Skills:

Hands on experience with project management software, like MS Project

Behavioral Skills:

Excellent verbal and written communication
Excellent organization and time management skills

Qualification:

BE (Computer Science)

What's in for you?

At Mphasis, we promise you the perfect opportunity of building technical excellence, understand business performance and nuances, be abreast with the latest happenings in technology world and enjoy a satisfying work life balance.
With the current opportunity, you will get to work with the team that has consistently been setting benchmarks for other deliveries in terms of delivery high CSATs, project completion on time and being one of the best teams to work for in the organization.
You get an open and transparent culture along with freedom to experimentation and innovation

About the practice/ Project:

Enterprise/Integration Architect in the project will play pivot role in providing architectural support in framing the business requirements.

Who are we?

Mphasis is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain and process expertise.

Over the years we have left an indelible impression in the IT solutions domain with an impressive clientele and an extensive global presence.

The accolades we have been garnering can be attributed to our undeterred focus in delivering quality solutions across verticals that meet the challenging requirements of our esteemed customers.

Our integrated solutions offering is aimed at creating value for our customers, helping them in improving their business processes with minimum hassles and capital outlays.

Benefits: