Lead Data Engineer

Data Engineering Services_ St. Louis, MO (Hybrid, 3 Days Onsite)Must haves - Scala, Pyspark, Databricks and AWSNote: Candidate must be local to St. Louis and the final round of Interview is a On-site Interview.Role Overview:Team Focus: Supports critical data ingestion, streaming and model monitoring platforms that enable real time decisioning and fraud risk capabilities. The team contributes to enhancements & modernization. The main team focus right now is model monitoring, second is modernization of applications/legacy systems and third, leveraging AI toolsHigh level overviewEngineer with experience in Scala, Python or Java, Big Data+ AWS/Databricks. Needs AI agent knowledge to create agents within the team to automate the processesCore skills:Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI)Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks, cloudera manager platform)Production Support & Platform Reliability (using Splunk for monitoring, troubleshooting, performance tuning)Strong SQLAI agent knowledge

Created: 2026-05-09