Senior Data Engineer
Apply Now

Senior Data Engineer

Job Description

Our client is currently seeking a Senior Data Engineer

Here is the job description for your review:

Position Title: Senior Data Engineer

Duration: Full Time

Location: Toronto, ON

Client is seeking a Senior Data Engineer, to join our rapidly expanding IT Organization and assist us as we work to be a digital leader in our industries

•         Perform technical systems and data flow development in a variety of projects for complex front, middle and back office applications, with a focus on the reporting and analytics environment; this environment is built on a Microsoft Azure cloud and is underpinned by a Hortonworks Hadoop stack

•         Perform technical systems and data flow design for small-to-medium sized projects

•         Work with multiple project execution and deployment teams (e.g. Development Architecture, Release Management, Production Support)

•         Work closely with source system SMEs to produce source to target mappings

•         Translate business requirements to technical specifications

•         Work closely with the technical leads and architecture teams, and align solutions that meet the departmental architectural vision

•         Able to handle multiple priorities seamlessly

Requirements:

•         8+ years of hands-on development experience in multiple projects, with progressively increasing responsibility

•         5+ years of hands-on experience working with data warehousing like applications and big data.

•         Experience leveraging big data technologies (One or more of Hadoop, Python, Spark) is required.

•         Exposure to Microsoft Azure (or other cloud) platforms is preferred

•         Experience working with various data exchange formats (JSON, CSV, XML etc.)

•         Solid understanding of relational and dimensional database design and knowledge of logical and physical data models is preferred

•         Experience with SDLC and/or Agile methodologies for project development, and participation in all phases of project development, is required

•         Excellent knowledge of SQL and Linux shell scripting

•         Experience in deploying and managing SQL and NoSQL databases is preferred

•         Experience with job scheduling (TIDAL, CAWLA, Oozie) and file transfer (e.g. SFTP)

•         Excellent diagnostic, analytical and problem-solving skills are preferred

•         Experience with continuous delivery tools (Jenkins, Bamboo, Circle CI), and an understanding of the principles and pragmatics for build pipelines, artefact repositories, zero-downtime deployment, etc. is preferred

•         Experience building real-time data pipelines using Kafka or spark streaming is preferred


Job Snapshot

Employment Type Full-Time
Job Type Engineering
Education Not Specified
Experience Not Specified
Manages Others Not Specified
Industry Other Great Industries
Required Travel Not Specified
Job ID 647981
CareerBuilder Tip:
For your privacy and protection, when applying to a job online, never give your social security number to a prospective employer, provide credit card or bank account information, or perform any sort of monetary transaction. Learn more.

By applying to a job using CareerBuilder you are agreeing to comply with and be subject to the CareerBuilder Terms and Conditions for use of our website. To use our website, you must agree with the Terms and Conditions and both meet and comply with their provisions.

Senior Data Engineer


Enter notes about this job:

Cancel