This job board retrieves part of its jobs from: Toronto Jobs | Emplois Montréal | IT Jobs Canada

Find a job in the Great State of New York!

To post a job, login or create an account |  Post a Job

Lead Cloud Data Engineer

Parks, Experiences and Products

This is a Full-time position in BROOKLYN, NY posted April 30, 2021.

Job Summary:

Are you a DevOps guru who is passionate for creating solutions using cutting-edge technologies? Do you excel under pressure? Can you summarize highly complex problems so that others can help you solve them? Does everyone turn to you for answers to tough questions? Do you instrument everything, collect data about data, and look for the correlation in everything? Do you like gathering evidence to base your decisions off of, but can use your gut, intuition and experience to make quick decisions when necessary? If you smile in the face of pressure, can work independently but are also a great team player, we’re looking for you!

As a Lead Cloud Data Engineer, you will design and securely develop custom data pipelines across a wide variety of technologies. You will fully utilize your ability to rapidly ramp up on new technologies to solve complex problems at scale by implementing, troubleshooting, and optimizing code within these technologies ensuring proper security, design, and coding standards are followed.

Responsibilities:

  • Provide technical guidance and act as a point of escalation for large cloud projects
  • Develop reusable patterns and frameworks as part of the engineering process
  • Design and engineer high-performance/large scale Data Engineering projects with extensive automation capability that conform to existing software practices to produce maintainable and secure code with automated testing in a continuous integration environment.
  • Ensure solutions support all functional and non-functional requirements
  • Oversee operational support and maintenance of products and services
  • Ability to lead discovery processes with stakeholders to identify business requirements and expected outcomes
  • Ability to mentor to junior team members
  • Coordinate and collaborate with offshore teams

Basic Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or related field or equivalent work experience
  • 2 to 4 years of relevant IT work experience.
  • 2 or more years of experience with AWS Cloud Technologies
  • Leadership experience in large, cross-functional teams, influencing senior-level management and key stakeholders.
  • Ability to perform across multiple phases of development for multiple complex projects, including technical design, build, and end-to-end testing
  • Passionate about delivering data engineering projects and features in a team environment even if the team size is 1.
  • Demonstrate the ability to quickly ramp on new technologies.
  • Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in stressful situations.
  • Strong oral and written communication and interpersonal skills.

Preferred Qualifications:

  • Strong ability to rapidly ramp up on new technologies as in a day you may be using:
    • Python, Java, SQL, Shell
    • Fundamentals of Data Architecture and the Data Lifecycle
    • Database – Snowflake, Athena/Presto, Maria/PostGre
    • NoSQL – Dynamodb, HBase, Mongo
    • Queuing Technology – Kafka, RabbitMQ, Redis, SQS, Kinesis Streams, Kinesis Firehose
    • Data Processing – EMR, Spark, Glue, Spark Streaming/Flink
    • Containers – Docker, Docker Swarm, Docker Applications
    • CICD – Jenkins/Codebuild/GitLab
    • Security – IAM roles, wire encryption, KMS, Kerberos, Authz, AD
    • Infra as Code – Terraform, Cloud Formation, CDK