A company is looking for a Data Engineer to design, build, and optimize scalable data pipelines and lake house architectures within the Azure ecosystem.
Key Responsibilities Design and manage scalable data ingestion pipelines using Azure Data Factory and Azure Service Bus Implement Bronze, Silver, and Gold data layer transformations using Databricks within a lakehouse architecture Establish data quality frameworks and validation processes using Databricks and Azure Data Factory Required Qualifications Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field (Master's preferred) Minimum 4-5 years of experience in a related field Substantial professional experience may be considered in lieu of a formal degree Must have AI/ML skills