Senior AWS Data Engineer IRC

GlobalLogic Verified

Job Description

  • Job: IRC105246
  • Location: Ukraine - Kyiv, Lviv, Kharkiv, Mykolaiv, Dnipro
  • Designation: Senior Software Engineer
  • Experience: 3-5 years
  • Function: Engineering
  • Skills: Amazon Web Service (AWS), JavaScript, Kinesis, Linux, Python, Redshift, Scala, Spark, SQL

We develop a supplier collaboration platform for ocherstrating of construction’s heavy work for US-based partner. This cloud-based platform built on AWS using Javascript and Node.JS, React frameworks. Its purpose is increasing collaboration between contractors and project owners, and their heavy material suppliers, producers and haulers. It facilitates every step in the workflow from initial orders through to paying the final bill. In addition to this platform has advanced mechanisms for revealing insights collected from a variety of sources, including IoT devices, telematics, jobsite tech, production automatics, etc. Collected analytics help making better business decisions, operate more efficiently, and see actionable info in real time. Users interact with the platform using web, and mobile applications running Apple iOS and Android devices.

Requirements:

  • Previous years of experience and a substantial understanding in
  • AWS data ingestion frameworks, such as Kinesis, DMS (in use)
  • AWS data processing (CDC,ETL) frameworks, such as EMR (in use), AWS Glue/Athena (in use), Sqoop, Spark, Zeppelin, Kinesis tools
  • AWS pipeline orchestration technologies, such as Data Pipeline(in use), Step Functions, and Lambda (in use)
  • AWS data storage engines, such as S3 (in use), HDFS (in use), Dynamo (in use)
  • AWS data access/warehousing tools, such as Athena (in use) and Redshift
  • Understanding the strengths and weaknesses of each tool/service and what it’s best used for
  • Should be comfortable in Linux and using command line
  • Proficiency in software development in Python (in use), Scala, Javascript (node in use), or Java
  • Deep familiarity with SQL (heavily used)
  • Good understanding of distributed systems in general and how they are different from traditional storage and processing systems
  • Passionate about “Big Data” and wants to expand their skills in the realm of data science infrastructure and tooling
  • Experience with data visualization tools like Tableau (in use) or ElasticSearch will be a big plus

Preferences:

  • Big Data

Job Responsibilities:

This Role:

  • We are seeking a motivated senior data engineer to architect, build and support AWS data pipelines for our corporate data strategies.
  • As a key player of a dedicated team, you will be instrumental in driving the direction of the pipeline infrastructure from ingestion through to access.
  • As our corporate data strategy evolves from business analytics to data science, there will be numerous opportunities to utilize new technology and learn new skills.

What You Will Do:

  • Architect, build and maintain data pipelines as a key player of the company long term data strategies
  • Utilizing AWS services, build and support reliable multi-tenant data pipelines combining data multiple diverse data sources
  • Providing scalable tools and mechanism for data ingestion, cleansing and ETL
  • Make pragmatic iterations of pipelines as the companies needs grow over time
  • Providing and support infrastructure for pipelines, data access, and visualization

What We Offer

  • Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
  • Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
  • Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
  • Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
  • Excellent Benefits: We provide our consultants with competitive compensation and benefits
  • Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!