Senior Java Big Data Developer

Our client delivers personalized experiences, cross-channel messaging and loyalty programs that add value to the customer relationships. The the product enables marketers to rapidly scale and meet the demands of the modern consumer. Marketers can easily deploy targeted and triggered cross-channel campaigns, compile data from multiple sources, and strategically promote desired customer behaviors – effectively increasing revenue and enhancing customer experiences.

Requirements:

• 5+ years of Java Development experience,
• 3+ years in a Big-data Engineer role;
• Sound knowledge of Hadoop Architecture and distributed data environments;
• Excellent functional knowledge and experience with big data components such as Kafka, Spark,Hadoop, Hbase, Hive;
• Experience in optimizing hadoop/hive settings for maximum throughput (includes compaction; hive metadata; TeZ Containerization;);
• Experience in shell scripting, have knowledge of scripting languages such as Python and be exposed to programming languages such as Java;
• Knowledge of Table definitions, file formats, UDF, Data Layout (Partitions and Buckets);
• Monitor Cluster performance, resource usage, backup and mirroring, provisioning and automation (Administration);
• ProdOps experience on Storm/Kafka.
• Experience in analyzing MapReduce jobs logs and error handling;
• AWS/Cloud: Sound knowledge of Cloud basics: S3, EMR. Need experience in identifying opportunities to improve processes, operations and automation using IaC;
• Experience ingesting data from multiple data sources such as REST API, SFTP flat files, Streaming data using Apache Storm, Kafka Streams or others etc.

Will be a plus:

• Degree in Computer Science, IT, or similar field; a Master’s is a plus;
• Data engineering certification (e.g AWS Certified Big Data – Specialty) is a plus;
• Experience with Agile methodology;
• English: Upper-intermediate, both verbal and written.
• Overlap minimum 4 hours with US East Coast time zone

Preferences:

• Python, Java, AWS, Hbase, Storm

Job Responsibilities:

• Improvements in the big data space; look into queries, optimization, work to make the current installation stable
• Install and deploy clusters, automate cluster creation, maintenance and assist in problem resolution

What We Offer

• Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
• Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
• Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
• Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
• Excellent Benefits: We provide our consultants with competitive compensation and benefits
• Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!