Senior Software Developer- PySpark - Ottawa, Canada - Canadian Institute for Health Information

Description

At CIHI, we recognize what matters to our employees.

Why is this role important?

The Senior Developer works on defining system solutions to acquire and share data and develop information and analyses to CIHI's clients and stakeholders. The Senior Developer operates, maintains and develops system solutions in current technologies as well as supporting and enabling initiatives on new platforms, technologies and services

What you'll bring to the table

1.Develops information systems, which may include the full range of requirements and feasibility analysis, design, coding, testing, quality assurance, implementation and documentation, as well as day-to-day application operation and end-user support, as part of a technical team.
2.Develops business processes knowledge and maintain ongoing contact, to ensure satisfaction by meeting business partner needs through information systems development, enhancements and integrations.
3.Executes the operational tasks related to incident troubleshooting and correction and scheduled product releases and works on optimizing and automating these tasks to reduce operational effort, on a rotation basis.
4.Works closely with CIHI analytical teams to develop, maintain and support products using Python and/or R and Spark programming languages.
5.Provides support and guidance on creating top-quality clean code and participates in code review.
6.Triages CIHI analysts' issues to proper administrators if required.
7.Prepares documentation, reports, and presentations related to projects and activities.
8.Shares knowledge and expertise across the organization; Provides learning opportunities and knowledge sharing to CIHI staff related to advanced analytics, machine learning methods and data visualization.
9.Analyses software deficiencies/problems and change requests, implements the changes within the production systems and may be required to oversee and ensure timely implementation of the changes for the technical team.
10.Develops, modifies and executes test plans, using automation to improve testing coverage and reduce effort.
11.Ensures the correct testing and sign-off procedures as part of CIHI's quality assurance review.
12.Ensures the promotion and implementation of applications in accordance with departmental change management processes.
13.Participates in the planning, development, and delivery of end user training.

Basic Qualifications

•A degree in Informatics, Data Science, Computing Science, Mathematics, Statistics, Biostatistics or a related field (or equivalent experience).

•3 + years of hands-on programming skills, able to write modular, maintainable code, preferably Python & SQL. Good understanding of SQL, dimensional modelling, and analytical big data warehouses

•3 + years of coding experience in Spark data frames, Spark SQL, PySpark.

•Advanced experience with Python and Spark programming languages to manipulate data and draw insights from large datasets. Working experience with SAS or R is an asset.

•Working knowledge of Visual Studio, Jupyter notebook, and Git(any one of them to create pyspark code)

•Understanding of good software engineering practices (e.g., code optimizations, version control, etc)

•Experience with AWS services such as S3, Lambda, IAM, Airflow, Glue, EMR or any similar cluster.

•Familiarity with AWS Lake Formation and Redshift is an asset.

•Experience designing and building analytical solutions to solve problems, with effective self-direction. Demonstrated ability to technically support Analysts with coding.

•Familiarity with high performance computing is an asset.

•Strong problem-solving skills, with an emphasis on product and service development for business decisions.

•Some experience with running presentations or training sessions is an asset.

•Strong interpersonal and communication skills presentation skills,

•Understanding of Canada's healthcare system is an asset.