Big Data Engineer

Introduction We invite you to join our team as a Big Data Developer/Engineer. We are a tight-knit, supportive community passionate about delivering the best experience for our customers while remaining sensitive to their unique needs. Required Skills & Qualifications Applicants must be able to work directly for our company on W2 Strong SQL Skills - one or more of MySQL, HIVE, Impala, SPARK SQL Data ingestion experience from message queue, file share, REST API, relational database, etc., and experience with data formats like JSON, CSV, XML Experience working with SPARK Structured Streaming Experience working with Hadoop/Big Data and Distributed Systems Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc. Hands-on programming experience in at least one of Scala, Python, PHP, or Shell Scripting Performance tuning experience with Spark/MapReduce or SQL jobs Experience and proficiency with Linux operating system is a must Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle Experience using Source Code and Version Control systems like SVN, Git, BitBucket, etc. Experience working with Jenkins and Jar management Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets Ability to comprehend customer requests and provide the correct solution Strong analytical mind to help tackle complicated problems Desire to resolve issues and dive into potential issues Ability to adapt and continue to learn new technologies is important Preferred Skills & Qualifications Experience in additional programming languages or technologies Experience with cloud platforms Advanced data analytics skills Day-to-Day Responsibilities Design, develop, and maintain data pipelines and architecture Collaborate with cross-functional teams to meet project goals Monitor and optimize system performance and data integrity Company Benefits & Culture Inclusive and diverse work environment Opportunities for professional growth and development Comprehensive benefits package For immediate consideration, please click APPLY to begin the screening process.

Created: 2026-03-04