Big Data Engineer
TriOptus LLC - Alpharetta, GA
Apply NowJob Description
Job Title: Big Data Engineer (Hybrid) Location: Alpharetta, Georgia (Hybrid Role) Employment Type: Contract-to-Hire (CTH) MOR2JP00017198 Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team in Alpharetta, Georgia. This hybrid role offers an exciting opportunity for candidates with hands-on experience in Hadoop, Apache Spark, and other key technologies. As a Data Engineer, you will play a critical role in the migration process from Hadoop to Snowflake, contributing to the development and optimization of our data pipelines. Responsibilities: Lead and contribute to the migration of data pipelines and workloads from Hadoop to Snowflake (approximately 50% of the role). Develop and maintain ETL processes and data transformations in a hybrid cloud environment. Work hands-on with Hadoop, Apache Spark, and other big data tools to support data processing and analysis. Create and maintain UNIX shell scripts and Python scripts for automation and data workflows. Utilize SQL for querying, manipulating, and managing large datasets. Participate in building and managing CI/CD pipelines for efficient data deployment and integration. Collaborate with cross-functional teams to optimize data architecture and ensure smooth data flow within the organization. Ensure high-quality production environments and handle production support as needed. Requirements: Education: Bachelor's degree in Computer Science, Information Technology, or a related field. Experience: At least 7 years of professional experience as a Data Engineer or similar role. Technical Expertise: Extensive hands-on experience with Hadoop. Strong proficiency in UNIX Shell scripting. Solid experience with Python scripting for automation and data processing. Proficiency in Apache Spark for distributed data processing. Experience with CI/CD pipelines for continuous integration and delivery. Strong knowledge of SQL for querying and managing large datasets. Demonstrated production environment experience. Desired Skills: Familiarity with IDMC or any other ETL tools. Prior finance industry experience is a plus. Experience with Snowflake is highly preferred. Interview Process: First Round: 1-hour Zoom interview. Second Round: Final interview
Created: 2026-03-10