AWS Data Engineer/Lead

GlobalLogic Verified

Job Description

  • Job: IRC110111
  • Location: Ukraine - Lviv, Kharkiv, Mykolaiv, Dnipro
  • Designation: Senior Software Engineer
  • Experience: 5-10 years
  • Function: Engineering
  • Skills: AWS, Data Warehousing, ETL, SQL, SQL Server, SQL Server-SSIS

The client is an industrial asset disposition and management company, that sells heavy industrial equipment and trucks through auctions and other transactional channels. The program consisting of 20+ engineers will include Architecture, Platform and Data Management teams working from offshore and nearshore locations augmenting the existing onsite engineering team.

Requirements: We are looking for an experienced Data Engineer able to lead a small team contributing to a project of modernization of the client’s Data Warehousing.

The requirements for this position are the following:

  • Good understanding of data ingestion frameworks, data processing frameworks, pipeline orchestration technologies, data storage engines, data access/warehousing tools
  • Experience with the AWS services related or used for distributed data processing and scalable data pipelines, ETL, and data warehousing, such as: S3, Glue, Lambda, Lake
  • Formation, CloudFormation, Athena
  • Deep familiarity with SQL and various DBMS
  • Good scripting skills in a modern programming language (such as Python, Java, Scala, C#, etc.)
  • Ability to lead a small team responsible for ETL and data warehousing
  • Ability to work with client’s high-level requirements, perform interpretation, detalization, implementation of the requirements, as well as demonstration of resulted solution
  • Working with Agile methodology
  • Good spoken and written English

Will be a plus:

  • Experience with data streaming via Kafka or AWS Kinenis
  • Experience data visualization tools like Tableau
  • Experience with Snowflake

Job Responsibilities:

  • Design and developemnt of data management related solutions
  • Create and maintain optimal data pipeline architecture; build data pipelines to pull data from different source systems; integrate, consolidate, transform, and cleanse data according to business rules, and structure and for use by analytics applications
  • Review business requirements; map reports, data subjects, and entities to source systems and artifacts in the Enterprise Data Warehouse (EDW) and/or Data Lake (DL)
  • Document requirements and business rules into appropriate technical specifications
  • Plan, test and implement enhancements to the EDW and DL environments on a regular release cycle
  • Participate in work planning and estimation
  • Present technical solutions to various stakeholders
  • Develop and maintain sufficient support documentation to facilitate day-to-day support of the EDW and DL environments

What We Offer

  • Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
  • Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
  • Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
  • Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
  • Excellent Benefits: We provide our consultants with competitive compensation and benefits
  • Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!