Senior Azure Databricks Data Engineer (Scala & ...

Role - Senior Azure Databricks Data Engineer (Scala & Streaming) Location - Boston, MA - onsite Exp need - 8+ years Job Description Design and implement scalable| secure| and high-performance data pipelines using Azure Databricks. Develop batch and real-time data processing solutions using Apache Spark (Scala). Build and optimize complex SQL queries for large-scale analytical workloads. Design and implement streaming data pipelines using Apache Kafka and Spark Structured Streaming. Develop robust ETLELT workflows and complex data models for enterprise data platforms. Implement API-based ingestion and real-time streaming ingestion frameworks. Manage and optimize data storage solutions including Azure Data Lake Storage and Azure Cosmos DB8.Develop NoSQL data solutions leveraging Azure Cosmos DB. Ensure CICD integration and DevOps best practices using Azure DevOps and Infrastructure as Code. Monitor| troubleshoot| and optimize performance of data pipelines. Collaborate with data architects| business stakeholders| and cross-functional teams. Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Created: 2026-03-10