Agilus is recruiting for
Data Engineer in Downtown Toronto for a permanent engagement for a financial service company.
WFH: 3-4 Days Post CovidLocation Option(s): Toronto/Montreal
Requirements:
- You have previously worked on building serious data pipelines ingesting and transforming > 10 ^6 events per minute and terabytes of data per day.
- You are passionate about producing clean, maintainable and testable code part of real-time data pipeline.
- You understand how microservices work and are familiar with concepts of data modelling.
- You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues.
- You have worked with Spark and Kafka before and have experimented or heard about Flink/Druid/Ignite/Presto/Athena and understand when to use one over the other.
- On a bad day maintaining zookeeper and bringing up cluster doesn’t bother you.
- You may not be a networking expert but you understand issues with ingesting data from applications in multiple data centres across geographies, on-premise and cloud and will find a way to solve them.
- Proficient in Java/Scala/Python/Spark
Nice to haves:
- Have experimented or heard about Flink/Druid/Ignite/Presto/Athena and understand when to use one over the other.
- On a bad day maintaining zookeeper and bringing up cluster doesn’t bother you.
- You may not be a networking expert but you understand issues with ingesting data from applications in multiple data centres across geographies, on-premise and cloud and will find a way to solve them.
Additional Skills:
- You can connect different services and processes together even if you have not worked with them before and follow the flow of data through various pipelines to debug data issues.
Apply:
Please apply directly online or submit your resume to Kritika Sinha at [ Email address blocked ]
We encourage you to visit www.agilus.ca regularly as new and exciting employment opportunities become available daily!
Agilus, formerly: Design Group Staffing, Inteqna, Talentcor, LucasWorks!, Lucas Professional Search Group and Braun Valley Associates.
Accommodations for job applicants with disabilities will be provided upon request during the recruitment, assessment, selection and placement process. Alternate format available upon request.
Recommended skills
Apache Spark
Data Pipeline
Real Time Data
Apache Flink
Java (Programming Language)
Scala (Programming Language)