Description
The project has the aim to develop AI Infrastructure (AII) is built atop Amazon Web Services resources with a particular focus on Redshift, SNS/SQS, CloudWatch, CloudFormation, Apache Airflow, as well as processing applications running on EC2 and other compute resources in the cloud. Software is developed in Python; the AWS Redshift database implements the Postgres API. The first area will be developing, deploying, and designing monitoring for a large number of new data feeds that will be ingested into the Redshift database from internal and external data streams. The technology involved will be SNS/SQS, EC2 autoscaling cluster, AWS Redshift, CloudWatch. The code will be writing in Python, and CloudFormation will be used for deployment. Extensive unit and integrated testing, and continuous deployment will need to be improved or developed. The second area will focus on developing Airflow/Python script-driven SQL and Spark workflows that will utilize data stored in Redshift to generate appropriate downstream BI. The project will involve extensive SQL query optimizations, spinning up EMR clusters, exporting and importing data from Spark clustering, data cleaning, and validation. The final area will focus on improving continuous testing and deployment of our tools, and improving security in the AWS account
Requirements
Preferences - NoSQL, AWS Redshift, CloudFormation, AWS Cloudwatch, AWS SNS, AWS SQS, Docker, Apache Spark, Airflow Responsibilities
We Offer
Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
Excellent Benefits: We provide our consultants with competitive compensation and benefits
Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!
About GlobalLogic
GlobalLogic is a full-lifecycle product development services leader that combines chip-to-cloud software engineering expertise and vertical industry experience to help our customers design, build, and deliver their next-generation products and digital experiences. We expertly integrate design, complex engineering, and agile delivery capabilities to deliver superior business outcomes for global brands in telecom, automotive, healthcare, technology, media and entertainment, manufacturing, and semiconductor industries.
Headquartered in Silicon Valley, GlobalLogic unites over 16,000 designers and engineers across the globe. Analysts like NASSCOM and Zinnov have recognized us for being a top company in our field, and we are consistently nominated as a preferred company by both global HR consulting firms and local boards. By creating an environment that is exciting and flexible, and by fostering growth through ongoing learning and development programs, we empower our consultants to achieve both their professional and personal goals.
At GlobalLogic, we make amazing products — and careers.