Description

Data Engineer

8 month contract opportunity, high potential to extend

“Hybrid” work environment – 2 times per week in downtown Vancouver office

Seeking a Data Engineer who is passionate about big data technology and delivering data solution to handle TB scale data per day and help the business meet the distinct needs of customers.

Role & responsibilities:

  • Data engineering activities including data ingestion, data modelling, data processing data governance
  • Work with team to improve the data pipeline to process large scale data efficiently
  • Be a data steward to educate and promote the data importance and data-driven culture
  • Collaborate with the key stakeholders, product owners, external vendors to define solutions for business and technical requirements
  • Be responsible for system architecture design and data engineering activities including data ingestion, data modelling, data processing and data governance
  • Work as a technical expert and strategic thought leader to the data platform by providing architectural leadership
  • Lead, participate, guide and mentor other team members on architecture and design with hands on

Desired skills & experience:

  • SQL
  • Python
  • Google Cloud (GCP)
  • Spark
  • Airflow
  • EKS
  • Experience working with data infrastructure (understand how spark runs, how airflow works with AWS)
  • Architecture design and development of large-scale data platform and data application with simple solutions
  • Have deep understanding on data engineering principles and data modeling
  • Strong knowledge of SQL (MySQL, PostgreSQL) and preferably experience with NoSQL databases
  • Experience with engineering tools such as Airflow, EKS, EMR, Redshift, Kubernetes
  • Good Hadoop ecosystem knowledge (e.g. Hadoop, Spark, Kafka, Hive, Presto)
  • Experience on large-scale multi-tier cloud applications and environments
  • Hands-on experience of high availability systems and API design
  • Experience with CICD tools such as GitHub Actions
  • Familiar with Agile/Scrum software development methodologies

$70 – $80 per hour for an INC consultant

If you’re interested, please apply with resume

If you are a strong fit, I will be in contact quickly to discuss additional details and next steps

Best regards,