This job board retrieves part of its jobs from: Toronto Jobs | Emplois Montréal | IT Jobs Canada

Find a job in the Great State of New York!

To post a job, login or create an account |  Post a Job

New

Big Data Engineer

ILink Systems Inc.

This is a Contract position in Tarrytown, NY posted June 29, 2020.

Position Senior Big Data Engineer Location Tarrytown, NY Duration Full time permanent Job Description We are looking for a candidate with 5 years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following softwaretools Experience with big data tools Hadoop, Spark, Kafka, etc. (Spark with Python) Experience with relational SQL and NoSQL databases Experience with Azure cloud data services like Azure Data Factory (ADF), Azure Data Lake (ADL), Azure Data Bricks etc Preferred experience with stream-processing systems Storm, Spark-Streaming, etc. Experience with object-orientedobject function scripting languages Python, Java, C++, Scala, R etc. Experience with Elastic Search is desirable but not mandatory Expertise in data visualization like Power BI, Tableau, Grafana etc is preferred but not mandatory Working knowledge of message queuing, stream processing, and highly scalable lsquobig datarsquo data stores. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Experience building and optimizing lsquobig datarsquo data pipelines, architectures and data sets. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management. A successful history of manipulating, processing and extracting value from large disconnected datasets. Experience supporting and working with cross-functional teams in a dynamic environment.