Big Data Engineer

Big Data Engineer Alpharetta, GA - hybrid 12 months+ CPS Data CoE - Big Data Engineer The department is comprised of 10 organizations: Sales, Banking & Corporate-Client Technology, Investment Products & Markets Technology, Client Reporting, Core Processing, Private and International Wealth Management Technology, Technology Integration Office, Enterprise Infrastructure & Production Management, Capital Markets Application & Data Services, Deployment Planning & Release Management, and the Chief Operating Office. Position Description: This position is for Big data engineer for Brokerage Wealth Management? Framework CoE team at Brokerage's Alpharetta or New York offices. CoE team is responsible to define and govern the data platforms. We are looking for colleagues with strong sense of ownership and ability to drive solutions. The role is primarily responsible to automate the existing process and bring new ideas and innovation. The candidate is expected to code, conduct code reviews, and test framework as needed, along with participating in application architecture and design and other phases of the automation. The ideal candidate will be a self-motivated team player committed to delivering on time and should be able to work with or without minimal supervision. ResponsibilitiesDesign & Develop new automation framework for ETL processingSupport existing framework and become technical point of contact for all related teamsEnhance existing ETL automation framework as per user requirementsPerformance tuning of spark, snowflake ETL jobsNew technology POC and suitability analysis for Cloud migrationProcess optimization with the help of automation and new utility developmentWork in collaboration for any issues and new featuresSupport any batch issueSupport application team teams with any queries Required Skills7+ years of Data engineering experienceMust be strong in UNIX Shell, Python scripting knowledgeMust be strong in SparkMust have strong knowledge of SQLHands-on knowledge on how HDFS/Hive/Impala/Spark worksStrong in logical reasoning capabilitiesShould have working knowledge of Github, DevOps, CICD/ Enterprise code management toolsStrong collaboration and communication skillsMust possess strong team-player skills and should have excellent written and verbal communication skillsAbility to create and maintain a positive environment of shared successAbility to execute and prioritize a tasks and resolve issues without aid from direct manager or project sponsorGood to have working experience on snowflake & any data integration tool i.e. informatica cloud Primary skills: Python, Big Data & Apache Spark Desired skillsSnowflake/Azure/AWS any cloudIDMC/any ETL tool

Created: 2026-03-10