Senior Platform Engineer - Big Data
Job Description

Senior Platform Engineer - Big Data

On behalf of our client in the Banking Sector, PROCOM is looking for a Senior Platform Engineer - Big Data.

Senior Platform Engineer - Big Data – Job Description

  • Work on a data platform that ingests a large amount of data daily to HDFS
  • Scale out clusters and services to allow for new functionality and handle increasing volume
  • Design and build resilient and highly available ingestion solutions
  • Deploy and test out new technologies such as Openshift, Graph databases and GPUs.
  • Desire to grow and learn big data technologies
  • Automate and secure everything
  • Embrace change
  • Our team believes in automating everything, making our infrastructure repeatable, maintainable and monitor-able while also being agile enough to be able to embrace new technologies.
  • We believe in collaboration, collective ownership and continuous improvement.
  • Our team is creating and supporting an ingestion and analytics platform relating to Big Data that works closely with the Hadoop Data Platform.
  • As a DevOps Engineer you will be responsible to build out a Big Data platforms using Ansible and Container based technologies for real-time stream, batch processing and analytics.
  • This role will take on challenges of maintaining and monitoring large scale data platform as well as supporting the data science team using it.

Senior Platform Engineer - Big Data – Mandatory Skills

  • Experience with distributed systems, designing and building for resiliency and performance
  • Experience with Spark, Hadoop, Kafka and Storm
  • Experience with NoSQL databases like HBase, Cassandra, SolR
  • Experience with Hortonworks Data Platform (HDP) or Hortonworks Data Flow (HDF)
  • Experience with data science platforms such as Jupyter and CDSW
  • Experience with container-based platforms
  • Experience with Ansible and Git (or something similar)
  • Automation via REST APIs and Python (or something similar)
  • Linux Administration (CentOS, RHEL, Ubuntu)
  • Experience with network administration
  • Experience with system and network security best practices.
  • Open mind, a desire to learn and to be challenged
  • Sound judgement
  • Team player
  • Ability to make a difference and lasting impact
  • Work in a dynamic, collaborative, progressive, and high-performing team

Senior Platform Engineer - Big Data - Assignment Start Date

ASAP – 6 months to start

Senior Platform Engineer - Big Data - Assignment Location

Downtown Toronto

Job Requirements


Company Overview

For 35 years, Procom has been pushing the envelope in North American IT staffing solutions. Driven by a senior management team of seasoned recruitment professionals, we have offices in 14 locations in the US and Canada and service all major IT markets.

When we started out in 1978, tech jobs were just being integrated into the workplace. We have been a part of shaping the landscape of IT in Canada ever since, placing IT consultants in major businesses in all sectors, including banking, telecommunications, and retail.

Through all the peaks and valleys of the IT industry, we have consistently done one thing: helping IT professionals discover the next chapter in their career.

Submit your email address to begin the application process for the Senior Platform Engineer - Big Data job
Email is invalid Email address is needed