Senior Data Engineer

Kitchener
Job Type Permanent
Job ID 17078
Salary $0.00
Job Description

Title: Senior Data Engineer

Location: Kitchener-Waterloo, ON

Type: Full Time Permanent

Base Salary: TBD

Benefits: Dental Care, Vision Care, Disability Insurance, Extended Health Care, Life Insurance, Wellness Program, Company Events, Flexible Schedule, Paid Time Off, Casual

Others: Performance Bonus + Equity

Remote: Yes

Department: ML Product Team

Reports to: Director of ML Engineering

 

About
Our client develops machine learning and artificial intelligence (ML/A) solutions for automotive and manufacturing industries. 

 

Job Summary:

As a Data Engineer, you work closely with cross-functional technical teams to architect and build AI software solutions and the necessary infrastructure required for customizable and efficient Data Pipelines to supply client’s IoT ML automation solution. In addition, you maintain, optimize, and deploy new data ingestion, transformation, and ETL pipelines and strive for the long term, holistic data strategy of the business.

 

Key Responsibilities:

  • Build scalable, customizable, and efficient Data Pipelines on Distributed frameworks such as AWS/Azure/Spark/Databricks
  • Create data acquisition and preparation tools for data scientist team that assist them in building and optimizing our product.
  • Build and/or configure the necessary infrastructure required for optimal Data Pipelines.
  • Troubleshooting, tuning and optimizing Apache Spark applications
  • Build, maintain, optimize, and deploy new and existing data pipelines including ingestion, transformation, and other ETL solutions.
  • Build analytics tools and reports that utilize the data pipeline to provide actionable insights other key business performance metrics.

Key Skills

  • 5+ years of related experience
  • Strong experience with Python, Pandas, PostgreSQL, Jenkins, and Docker
  • Proficient with end-to-end Jenkins automate CI/CD pipeline deploying to docker swarm or Kubernetes
  • Solid experience with data modeling, data warehousing, and building ETL pipelines
  • Excellent SQL skills and experience working with relational databases
  • Experience with cloud services/frameworks such as Azure, AWS, Spark, Databricks
  • Experience with cloud orchestration: e.g., docker containers and Kubernetes
  • ETL Experience with time-series and operations data

Key Competencies:

  • Self-starter
  • Experienced
  • Strong oral and written communication
  • Detail oriented
  • Team player
  • Intelligent
  • Excellent analytical skills
  • Pragmatic
  • Customer focused

The interview process:

  • Round 1 – (Intro) - Director ML Engineering – 60 mins
  • Round 2 - (Technical)- Senior Data Engineer – 60 mins – Mostly Q&A with a small coding challenge, the topic can include SQL, Python, database design, data processing architecture, but will adjust based on candidate profile

If you have the skills and experience that we are looking for to be successful in this role, please submit your resume to Masood Noor by email at masood@winterstaffing.com

Apply Online

*
*
*
*
*