Shire Jobs

Job Description Worldpay, LLC seeks Software Engineer Senior- Senior Big Data Cloud Engineer in Cincinnati, OH to Analyze, design, program, debug and modify software enhancements and/or new products used in local, networked or Internet-related computer programs. Participate in all phases of Software Development Life Cycle (SDLC) such as requirement gathering, design, development, unit testing, UAT (User Acceptance Testing), production releases, enhancements, and support. Optimize existing algorithms in Hadoop using Spark and implement Performance tuning of existing Pig, Impala and Hive Queries. Migrate complex MapReduce Java programs into Apache Spark higher order functions using Python and Scala. Extract data from Agent Nodes into HDFS (Hadoop Distributed File System) and perform UNIX shell commands using Python sub-process. Develop custom Pig Loaders and Storage classes to work with a variety of data formats including JSON, Compressed CSV, etc. Migrate data in HDFS to Snowflake using Snow Tasks and Snowflake Stored Procedures. Perform encryption and transfer files to external users from AWS (Amazon Web Services) S3 (Simple Storage Service) using Lambda functions, SQS (Simple Queue Service) and SNS (Simple Notification Service). Build Hadoop clusters on multiple EC2 (Elastic Compute Cloud) instances and use S3 and EMR (Elastic MapReduce) for storing and accessing data from Hadoop clusters. Implement advanced procedures including text analytics and processing, using in-memory computations of Spark. REQUIREMENTS: Bachelor's degree or foreign equivalent Computer Science, Information Technology, Electronic Engineering, or a related field and five (5) years of progressively responsible experience in the job offered or a related occupation: performing Data Engineering activities including ingestion, storage, querying, processing, and analysis of Big Data on cloud using Snowflake and using any combination of various Hadoop Ecosystem applications including MapReduce, Hive, Sqoop, Spark, Scala, Python, and Impala; implementing Spark, Scala and Python applications using higher order functions for both batch and interactive analysis; designing and developing products in cloud using AWS services including EMR, Lambda, EC2, S3, SQS and SNS; writing and utilizing high complexity SQL code, including data transformations for joining, aggregating, and filtering to increase the performance of data transformation processes; providing code and design review to ensure optimal / efficient processes runs and hardware utilization; and troubleshooting and resolving problems, errors, defects related to code and processes owned. In the alternative, the employer will accept a Master's degree in the above listed fields and three (3) years of experience in the above listed skills. Telecommuting and/or working from home may be permissible pursuant to company policies. QUALIFIED APPLICANTS: Please apply directly through our website. Privacy Statement Worldpay is committed to protecting the privacy and security of all personal information that we process in order to provide services to our clients. For specific information on how Worldpay protects personal information online, please see the Online Privacy Notice. EEOC Statement The EEO is the Law poster is available here supplement document available here For positions located in the US, the following conditions apply. If you are made a conditional offer of employment, you will be required to undergo a drug test. ADA Disclaimer: In developing this job description care was taken to include all competencies needed to successfully perform in this position. However, for Americans with Disabilities Act (ADA) purposes, the essential functions of the job may or may not have been described for purposes of ADA reasonable accommodation. All reasonable accommodation requests will be reviewed and evaluated on a case-by-case basis. Sourcing Model Recru