Description
Position Name – Senior Data Engineer or ETL/Data Engineering Specialist
Type of hiring – Fulltime/Subcon
Location – Toronto, ON (2 days a week onsite)
Job Description:
We are seeking a highly skilled Senior Data Engineer with expertise in ETL processes, data engineering, and scheduling. The ideal candidate will design and implement robust data solutions, support existing applications, and ensure high-quality deliverables through technical leadership and code reviews.
Key accountabilities:
- Provide technical expertise in designing, coding, and documenting ETL processes for new initiatives.
- Independently support existing applications and resolve issues.
- Estimate and deliver on individual tasks within project.
- Perform code review of code developed by technical consultants and oversee their work.
- Highlight technical issues and challenges and propose creative solutions.
Core Responsibilities & Required Skills:
- 2 Years of Python experience
- Strong grasp of ETL/ELT methodologies, batch and streaming patterns, scheduling concepts, and data quality best practices.
- 5-7 Years of Unix and Windows Shell Scripting for automation, job orchestration, and system operations.
- Database skills with experience with Oracle, Postgres, SQL Server
- Containerization Technology, Docker, Kubernetes, Rancher, MinIO (S3 storage)
Nice to have:
- Experience with SAS or Talend applications
- Django experience
- Airflow Experience
- Spark
