Data Engineer Databricks

Our client is one of the leaders of the industry. We are looking to create new and innovative solutions to manage service interactions from across endpoints. Our team consists of highly motivated, innovative, customer-focused engineers and engineering leaders. As a developer, you will be part of the team that will define what the future great customer service looks like around the world!

Requirements:

• 5+ years of experience in software development
• 3+ years of data engineering or ML pipelines and Apache Spark
• Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)
• Good Understanding of Modern Data Warehouse/Lakehouse Architecture, Data warehousing concepts
• Python
• Proficient in AWS (S3, Glue Data Catalog, EMR, EC2, Cloudformation, IAM)
• Ability to work with SageMaker service

Preferences:

• azure data factory, SQL, AWS IAM

Job Responsibilities:

• Take a major part in designing and implementing complex systems, data pipelines, and algorithms using a variety of technologies
• Development using Databricks (Spark) platform and its tools
• Assist with architecture and design for new workloads destined for Databricks and/or utilizing data for storage/events (Kafka, Event Hub)
• Mentor teams on Spark, and complex DataFrames and SparkSQL (developers, testers, data analysis)
• Monitor and troubleshoot Databricks workloads
• Assist with DevOps pipelines
• Help teams with data schemas, and data storage details
• Ensure applications are tested through the usage of automated test tools
• Collaborating with the Dev Leads and Product Manager to ensure that the requirements are met

What We Offer

• Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
• Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
• Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
• Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
• Excellent Benefits: We provide our consultants with competitive compensation and benefits
• Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!