- Build and maintain analytics with Python (pandas/pyspark)
- Build and maintain ETL pipelines on AWS (EC2/Glue ETLs/Airflow)
- Build and maintain Infrastructure components to support our pipelines and integrations(CDK)
- Setup and maintain integrations between different systems to enable data flow between these systems (Appflow)
- Actively contribute to shaping the direction of our data platform including architecting our data warehouse, machine learning deployment infrastructure, and ETL/ELT workflows
- Gather and understand data requirements by working with stakeholders across multiple teams
- Working closely with Engineering, IT, and Security to build processes and standards for our data science platform and how it integrates with data sources across the company
- Developing ingestion, transformation, and cleansing pipelines to prepare a variety of structured and unstructured data sources for data analytics
- Maintaining our data platform including managing and improving our redshift cluster and monitoring our data pipelines
- Developing infrastructure using CDK to deploy data products to internal and external users
- Providing operational support to the data science team
- Being a go-to person about data-related questions company-wide
- Bachelor's degree in Engineering, Computer Science, Mathematics, or a related technical discipline
- 4+ years experience in the data engineering field
- Experience in setting up and maintaining a high volume of ETL pipelines
- Experience in setting up ETL orchestration
- Familiarity with infrastructure as code (CDK or Terraform) is a plus
- Advanced knowledge of SQL and knowledge of NoSQL (MongoDB)
- Ability to communicate effectively with people who are both highly technical, and non-technical alike
- Strong analytical skills and an understanding of data science
- Driven, passionate and creative, and thrives in a fast-paced environment
- Knowledge of data modeling and system design using UML
- Experience with AWS computing (eg. EC2, Lambda) and data storage technologies (eg. Redshift)
- PostgreSQL
- Python
- Pandas
- Nice to have Pyspark
- Nice to have CDK or Terraform
- AWS
-
Data engineer
1 week ago
Société Financière Manuvie Waterloo, ON, CanadaNous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...
-
Senior Data Engineer
2 days ago
Sun Life Kitchener, Canada Temps pleinDescription · de poste: We are looking for an experienced and high-performing individual to join our Data Engineering team in Corporate IT as a Sr Data Engineer . This senior technical role is responsible for the building, deployment, and support of data integration for BI repo ...
-
REMOTE - SQL Data Engineer/Python/SQL
1 week ago
Société Financière Manuvie Waterloo, ON, CanadaNous sommes un fournisseur de services financiers qui s'emploie à faciliter les décisions de nos clients et de nos collègues partout dans le monde et à les aider à vivre mieux. De nos initiatives environnementales à nos investissements dans la collectivité, nous montrons la voie ...
-
Data Engineer
1 week ago
ApplyBoard Kitchener, CanadaThe Role:The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building ...
-
Data Engineer
3 days ago
ApplyBoard Kitchener, Canada Full timeApplyBoard simplifies the study abroad search, application, and acceptance process by connecting international students, recruitment partners, and educational institutions on one intuitive and personalized platform. ApplyBoard is a mission-driven, hyper-growth organization. It ha ...
-
Data Engineer Data Analytics
4 days ago
ApplyBoard Kitchener, ON, CanadaThe data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maint ...
-
Big Data Engineer
6 days ago
Sun Life Financial Waterloo, ON, CanadaYou'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Discover how you can make a difference in the lives of individuals, families and c ...
-
Senior Data Engineer
2 days ago
TripleLift Waterloo, CanadaThe Role · TripleLift is seeking a Senior Data Engineer to join the influential Data Engineering team within the Data Platform Engineering organization. This hire will be responsible for expanding and optimizing our distributed computing data pipeline architecture, as well as op ...
-
Senior Data Engineer
2 days ago
Sun Life Waterloo, Canada Full timeJob Description · : We are currently looking for a Senior Data Engineer with a passion for turning disparate streams of data into organized and actionable analytics services and insights. As a Data Engineer on the Data Engineering and Operations team, you will be joining a grou ...
-
Senior Data Engineer
5 days ago
Sun Life Waterloo, Canada Temps pleinDescription · de poste: We are currently looking for a Senior Data Engineer with a passion for turning disparate streams of data into organized and actionable analytics services and insights. As a Data Engineer on the Data Engineering and Operations team, you will be joining a ...
-
Sr. Data Engineer- IT
5 days ago
D2L Kitchener, Canada Full timeD2L is a cloud company that is modernizing education and building the Future of Work. The old models of teaching and learning are in the midst of the largest transformation in history, and D2L is at the heart of that fundamental shift. · New models of teaching and learning enabl ...
-
Principal Engineer, Data Streaming
2 days ago
Index Exchange Kitchener, CanadaWe shaped the earliest forms of ad tech, and we're looking for technical expertise to help shape its future. Our customers have unique problems that can only be solved at an internet scale, and that's where the technical skills of our team make a real difference. · Our exchange h ...
-
Pavement Data Technician
23 hours ago
Stantec Waterloo, CanadaPavement Data Technician CU ) · **Description** · We create great places and the connections that get people and goods moving—whether by car, bus, train, plane, or their own two feet. Working within the context of the communities we serve, we provide planning, engineering, and in ...
-
Faculty Services Manager
6 days ago
University of Waterloo Waterloo, CanadaOverview: · **Term: 18 months** · The Faculty Services Manager is responsible for ensuring the accuracy and timeliness of appointments and academic processes for the Faculty of Engineering. This position independently supports governing and administrative councils and committees, ...
-
Program Assessment Specialist
6 days ago
University of Waterloo Waterloo, CanadaOverview: · Program Assessment Specialist (PAS) monitors the outcomes-based undergraduate and graduate program curriculum of the Systems Design Engineering (SYDE) department by collecting various sources of quantitative and qualitative data, facilitating faculty collaboration, an ...
-
Geosyntec Consultants Waterloo, CanadaIf you re looking for a place to grow your career, where you can contribute to a dynamic innovative firm, tackle challenging project work, and collaborate with industry recognized professionals - Geosyntec is the place for you We are seeking an **Early-Career Environmental Data S ...
-
Geosyntec Consultants Waterloo, CanadaIf you re looking for a place to grow your career, where you can contribute to a dynamic innovative firm, tackle challenging project work, and collaborate with industry recognized professionals - Geosyntec is the place for you We are seeking an **Early-Career Environmental Data T ...
-
Faculty Financial Officer
2 hours ago
University of Waterloo Waterloo, CanadaOverview: · The Faculty Financial Officer (FFO) is accountable to the Executive Officer for achieving service excellence in a complex, decentralized environment while ensuring that all financial activities in the Faculty of Engineering are properly accounted for and that availabl ...
-
Early-career Environmental Data Technician
5 days ago
Geosyntec Consultants, Inc. Waterloo, CanadaIf you're looking for a place to grow your career, where you can contribute to a dynamic innovative firm, tackle challenging project work, and collaborate with industry recognized professionals - Geosyntec is the place for you We are seeking an **Early-Career Environmental Data T ...
-
Early-career Environmental Data Specialist
5 days ago
Geosyntec Consultants, Inc. Waterloo, CanadaIf you're looking for a place to grow your career, where you can contribute to a dynamic innovative firm, tackle challenging project work, and collaborate with industry recognized professionals - Geosyntec is the place for you We are seeking an **Early-Career Environmental Data S ...
Data Engineer - Kitchener, Canada - ApplyBoard
Description
The Role:
The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and integrations. The team is also responsible for building and maintaining data access components and providing tooling and analytics that are required for our predictive/ML models.
What you will be doing:
What you bring to this role:
Tech Stack: