- Keep the data whole, safe, and flowing with expertise on high volume data ingest and streaming platforms (like Spark Streaming, Kafka, etc)
- Make the data available for online and offline consumption by machines and humans
- Sheppard and shape the data by developing efficient structures and schema for the data in storage and transit
- Explore new technology options for data processing, storage, and share them with the team
- Degree in Computer Science, Engineering, or a related field
- You have previously worked on building serious data pipelines ingesting and transforming
- You are passionate about producing clean, maintainable, and testable code as part of a real-time data pipeline
- You understand how microservices work and are familiar with concepts of data modeling
- You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues
- You have experience implementing offline and online data processing flows and understand how to choose and optimize underlying storage technologies. You may not be a networking expert but you understand issues with ingesting data from applications in multiple data centers across geographies, on-premises, and cloud and will find a way to solve them
- Proficient in Java/Scala/Python/Spark
-
Qe Python
1 week ago
Atlantis IT group Toronto, Canada**Job Title · - QE Python / QE NFT LoadRunner** · **Location · - Toronto, (Hybrid)** · **Duration · - Long Term** · **Primary skills**: · **QE Python based scripting and Testing** · Min 5+ years of experience in testing in Python based testing Strong skills on Pyspark, SQL and Py ...
-
Bsa + Python
1 week ago
Compest Solutions Inc Toronto, Canada**BSA + Python (Policy/Billing/Claim Center Guidewire)** · **Location: Toronto - ON (client office in Toronto, twice a week)** · **Rate --CAD$60/hr --CAD$68/hr on Inc/Corp to Corp** · 1. Strong Business Systems & Data Analyst · 2. Hands-on SQL knowledge. · 3. Can extrapolate pyth ...
-
Qe - Python, Etl
1 week ago
Atlantis IT group Toronto, Canada**Title: QE Python** · **Location: Toronto, ON** · **Duration: Full Time** · **QE Big Data / Python based scripting and Testing** · Min 5+ years of experience in testing of Big Data platform in Python based testing Strong skills on Pyspark, SQL and Python scripting Hands on exper ...
-
Technical Ba with Python
2 days ago
Luxoft Toronto, Canada**Project** Description**: · **Responsibilities**: · - Partner with the business stakeholders and the team to breakdown the work and create a plan. Work with the team and execute the plan and escalate any blockers to the leadership team. · - Results driven mindset is a must to ha ...
-
Python Team Lead
1 week ago
Luxoft Toronto, Canada**Project** Description**: · - Client attracts and selects high-calibre individuals from top-tier institutions around the globe. Join our team and look forward to: · - Diverse and inspiring colleagues and approachable leaders · - Stimulating work in a fast-paced, intellectually c ...
-
Sdet (Etl/SQL/python)
2 days ago
CGI Toronto, CanadaWe're looking for software engineers with a passion for assuring quality. With this opportunity you'll support building and executing automated tests to verify ETL processes for a client in the Canadian Banking domain with Canada's largest Information Technology Outsourcing and M ...
-
Database Tester with Python Testing
1 week ago
Cognizant Toronto, Canada**Why choose cognizant?** · It takes a lot to succeed in today's fast-paced market, and Cognizant has become a leader in the industry. We love big ideas and even bigger dreams. We stand out because we put human experiences at the core. We help clients engage customers by envision ...
-
Database Tester with Python Testing
1 week ago
Cognizant Technology Solutions Toronto, CanadaWhy choose cognizant? · It takes a lot to succeed in today's fast-paced market, and Cognizant has become a leader in the industry. We love big ideas and even bigger dreams. We stand out because we put human experiences at the core. We help clients engage customers by envisioning ...
-
Qe-automation , Python,etl
2 days ago
Atlantis IT group Toronto, Canada**Role: QA Automation** · Location: Toronto, ON(Onsite / Hybrid) · Duration · - Long Term · **Responsibilities**: · **Thanks&Regards** · **PAUL.CH** · Apptoza Inc. · Phone: Ext 2910 ...
-
RPA/ QA Automation Testing with Python
1 week ago
Compest Solutions Inc Toronto, Canada**Job Posting Title**: · - RPA / QA Automation Testing with **python, robotic framework** · **Client**: Bank domain · **Location**: Toronto, ON Onsite /**Hybrid 3 days Office is MUST** · **Position Type-Regular** Full-Time Contract · **Please reply** with your **expected contract ...
-
RPA/ QA Automation Testing with Python
1 week ago
Compest Solutions Inc Toronto, Canada**Job Posting Title**: · - RPA / QA Automation Testing with **python, robotic framework** · **Client**: Bank domain · **Location**: Toronto, ON Onsite /**Hybrid 3 days Office is MUST** · **Position Type-Regular** Full-Time Contract · **Please reply** with your **expected contract ...
-
Qe - Python Based Scripting and Testing
4 days ago
Atlantis IT group Toronto, Canada**QE Python based scripting and Testing** · **Toronto, ON** · **Long Term** · **Responsibilities**: · - Min 5+ years of experience in testing of Big Data platform in Python based testing Strong skills on Pyspark, SQL and Python scripting Hands on experience in creating Automation ...
-
Compest Solutions Inc Toronto, Canada**Job Posting Title**: · - Senior Firmware Engineer / QA Automation Testing with **python, robotic framework** · **Client**: Bank domain · **Location**: Toronto, ON Onsite /**Hybrid 3 days Office is MUST** · **Position Type-Regular** Full-Time Contract · **Please reply** with you ...
-
QA Tester with Python SQL Robot Framework
1 week ago
Epsilon Solutions Toronto, Canada**Job Title: QA with Python Sql Robot framework** · **Location: Toronto, ON** · **Duration : Long Term Contract** · - **Minimum 7+ Years of IT Experience.**: · - **ROBOT Framework**: · - **Python (3+ years)**: · - **GitHub**: · - **JIRA**: · - **QTest**: · - **SQL (3+ years)** · ...
-
Edge Health Toronto, Canada**Job Title: QA Testers with Python+SQL+Robot(backend testing)** · **Location: Toronto · - HYBRID** · **Job Type: Contract** · **Must Skills**: · - QE · - SQL · - Python · **Must Have** · - **Typically requires 5+ years of QE related experience**: · - **Expert level knowledge wit ...
-
Python Developer
23 hours ago
Iris Software Inc. Toronto, CanadaIris's direct client, one of the leading Banking and Financial Company, is looking to hire a Python Developer. · Please respond back with your most recent resume if you would be interested.. · Job Title: Python Developer · Location: Toronto, ON - Hybrid · Duration: Months (Open ...
-
Python Developer
6 days ago
VXG Toronto, CanadaVXG Inc. was founded in 2016, with headquarters in Toronto, Canada by experts in Video Management Software (VMS) and Video Artificial Intelligence (AI). Founded with over 20 years of experience in the video surveillance industry and with the idea to make smart video surveillance ...
-
Python Developer
2 weeks ago
Capgemini Toronto, CanadaJob Title: Python Developer · Location:Toronto, ON or Montreal, QC · Job Description: We are seeking a talented Python developer to join our team. The ideal candidate will have a strong background in Python programming and experience working on web development projects. You will ...
-
Python Developer
1 week ago
Compunnel Inc. Toronto, CanadaEffective and clean code development based on requirements · Perform unit testing & integration testing · Optimize current ETL code · Assist support team on debugging production issues · Desired Skillsets: · Python · SQL Server · Java · Git · TDD · Scala (nice to have) · Hadoop ( ...
-
Python Developer
23 hours ago
VXG Toronto, CanadaVXG Inc. was founded in 2016, with headquarters in Toronto, Canada by experts in Video Management Software (VMS) and Video Artificial Intelligence (AI). Founded with over 20 years of experience in the video surveillance industry and with the idea to make smart video surveillance ...
Senior Data Engineer with Python - Toronto, ON, Canada - GuruLink
Description
They apply big data, artificial intelligence, and machine learning to bring the next generation of financial products and services to the Indian, Japanese and Canadian markets.
They have created the only fraud and risk management platform that orchestrates data from the entire customer journey, fighting fraud more effectively with configurable risk models in a single, easy-to-use platform.
If working with billions of events, petabytes of data, and optimizing for the last millisecond is something that excites you then read on We are looking for Data Engineers who have seen their fair share of messy data sets and have been able to structure them for further fraud detection and prevention; You will be working on writing frameworks for real-time and batch pipelines to ingest and transform events from 100's of applications every day.
These events will be consumed by both machines and people.Their ML and Software engineers consume these events to build new and optimize existing models to detect and fight new fraud patterns.
You will also help optimize the feature pipelines for fast execution and work with software engineers to build event-driven microservices.
You will get to put cutting-edge tech in production and the freedom to experiment with new frameworks, try new ways to optimize, and resources to build the next big thing in fintech using dataWork directly with the Platform Engineering Team to create reusable experimental and production data pipelines and centralize the data store