Terces Jobs is also available in your country: United States. Starting good opportunities here now!

Data Engineer (6 month contract) Contract Job

Jul 8th, 2024 at 14:29   IT & Telecoms   Toronto   92 views Reference: 7782
Job Details

The Data Engineering team at Kobo is responsible for extracting raw data from a variety of sources into the Kobo ecosystem, transforming it, and providing it to stakeholders for further use. We use a modern tech stack to efficiently handle data sources of different kinds, work closely with other Kobo teams as well as external parties, and focus on building robust, scalable solutions for the large datasets we work with. We are continually striving toward unlocking more potential out of data sources and enabling other Kobo teams to harness its full potential in decision making and product building.

 

Responsibilities:

  • Create & document efficient data pipelines (ETL/ELT)  moving raw data from a variety of sources, through transformation, to cleaned datasets in Cloud services.
  • Write and optimize complex transformation operations on large data sets.
  • Be able to communicate with business and then transform datasets and map them to business-friendly datasets for consumption.
  • Work with other teams (Finance, Marketing, Customer Support, etc.) to gather requirements, enable them to access curated datasets, and empower them to understand and contribute to our data processes.
  • Design and implement data retrieval, storage, and transformation systems at scale.
  • Understand and implement data lineage, data governance, and data quality practices.
  • Create tooling to help with day-to-day tasks.
  • Exhibit ownership over data quality from end-to-end.
  • Introduce new tools and technologies to the teammates through research and POCs.
     

The Ideal Candidate:

  • One who takes ownership and accountability for their work and the needs of their team.
  • A generalist who can jump on any problem where no level of work is beneath them.
  • A problem solver at heart.
  • Skilled in failing fast, iterating, and improving.
  • Believer of automation, reducer of toil.
  • Self-motivated to continually learn, improve, and be better.
  • One who enjoys sharing knowledge & mentoring other team members.
  • Highly adaptive to changes, fun and supportive.
  • Motivated, creative, organized with attention to detail.
     

Must Haves:

  • Advanced experience ( ~5 years ) with Python and SQL.
  • Experience with dbt / DataForm
  • Experience with RabbitMQ and Kubernetes
  • Experience working in hybrid environments (GCP / Azure / AWS & on-prem) and, specifically with storage, database, and distributed processing services.
  • Experience working with REST APIs and Python data tools (Pandas/SQLAlchemy).
  • Experience building ETL and data pipelines with an orchestration tool (Airflow/Dagster/Prefect).
  • Ability to read and understand existing code/scripts/logic.
  • Experience with an IaC tool (Terraform).
  • Comfortable with using a terminal/ssh /Powershell/Bash, code versioning, branching / git.
  • Experience managing a project backlog and working cross-functionally with multiple stakeholders.
  • Ability to work effectively on a self-organizing team with minimal supervision.
  • Initiative in communicating with co-workers, asking questions and learning.
  • Excellent oral and written communication skills.
     

Nice to Haves:

  • Experience with CI/CD tools (Jenkins/Github/Gitlab).
  • Experience with stream-processing systems (Storm/Flume/Kafka).
  • Experience with schema design and dimensional data modeling.
  • Experience working in an Agile environment.
Company Description
Owned by Tokyo-based Rakuten and headquartered in Toronto, Rakuten Kobo Inc. is one of the most advanced global ecommerce companies, with the worlds most innovative eReading services offering more than 6 million eBooks and audiobooks to 30 million + customers in 190 countries. Kobo delivers the best digital reading experience through creative innovation, award-winning eReaders, and top-ranking mobile apps. Kobo is a part of the Rakuten group of companies.