Senior Data Engineer to develop data connections and processes for data models within an existi - Ottawa, Canada - S.i. Systems

Description

Senior Data Engineer Job Description:

Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to support and evolve the Data and Analytics Program to ensure it continues to meet the ongoing demands of the current and future business vision and strategy, as well as comply with the Government of Canada's direction for Data Strategy and Open Government.

Tasks include, but are not limited to:

1. Analyze existing data infrastructure and systems for optimization and improvements.
2. Design and develop scalable and automated data pipelines to reduce manual intervention and improve efficiency.
3. Monitor and tune data pipelines for optimal performance and scalability.
4. Implement Extract, Transform, Load (ETL) processes to ingest and transform data from various sources.
5. Optimize database performance and indexing strategies.
6. Model data structures and architectures for efficient storage and retrieval.
7. Collaborate with cross-functional teams to define data architectures, requirements, schemas, and strategies.
8. Evaluate and recommend appropriate data storage solutions (e.g., SQL, NoSQL, data lakes).
9. Integrate third-party APIs and data sources into existing processes and systems.
10. Troubleshoot and resolve data-related issues and performance bottlenecks.
11. Migrate and transfer data between different platforms or cloud services.
12. Document data engineering processes, workflows, and architecture for knowledge sharing.

Must Haves: Secret Clearance

Nice To Have: 7 years of experience in ETL, 7 years of experience in Data Architecture Diagrams, Degree, or 2-year College Diploma