Data Engineer
Diverse Lynx - St Louis, MO
Apply NowJob Description
Competencies: Digital : Microsoft Azure, Digital : Application Programming Interface (API), Digital : Python for Data Science, Digital : Databricks Technical/Functional Skills • 1+ years of experience working with Matillion • 5+ years in an ETL/ELT development role utilizing industry-recognized ETL/ELT tools • 2+ years of developing and supporting a cloud-based data platform - Snowflake • Experience with AWS lambda functions and data pipeline • Experience implementing Change Data Capture (CDC) • Strong knowledge and experience with SQL programming, including stored procedures, triggers, functions, and error trapping • Demonstrated proficiency developing technical skills and performing problem-solving • Excellent verbal and written communications skills and ability to multi-task within a team-oriented environment • Demonstrated proficiency developing and supporting extract, transform, and load (ETL) and extract, load, transform (ELT) processes • Experience building self-service reporting solutions using business intelligence software (e.g., OBIEE, Looker, Power BI, etc.) • bility to maintain documentation on ELT process and procedures • Experience conducting project-specific data analysis that includes analyzing and mapping required data and supporting all facets of the ELT process • bility to assist with the creation and maintenance of ELT specifications (e.g., source-to-target maps) • bility to participate in production on-call support rotation schedule for ETL processing and completion • bility to assist with estimates for the ELT process and suggest improvements • Experience with Oracle Data Integrator also a strong advantage Experience Required 8-12 Years Roles & Responsibilities s a Senior Engineer, you will be responsible for using your technical knowledge to solve business problems. We are looking for a talented individual that can serve as a subject matter expert in their area of focus and represent their department on complex assignments. You will be responsible for evaluating elements of technologies effectiveness through requirements gathering, testing, research and investigation and make recommendations for improvements that result in increased quality and effectiveness. You will be required to listen to and evaluate customer needs to determine and provide high quality solutions that align with customer expectations. In this role on the Cloud Data Engineering team, you will be a part of a team responsible for migrating existing data platform solutions to the cloud. You will also collaborate with others to develop new data pipelines. As a data engineer in the Cloud Data Engineering team, you will need to work in a data first mindset. You will use Microsoft Azure Cloud PaaS technologies to engineer our data solutions in a way that allows for us to optimize our information, make better decisions, and meet our customer's needs. If you have a passion for engineering, working with massive amounts of data and empowering smart business decisions, this is the role for you. Required - • Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the future (as we would like the Right to Hire and we cannot convert talent that is under an E3 level - ideally this is a Senior level which is an E2ish) • Must be committed to incorporating security into all decisions and daily job responsibilities • Protects our customers, our employees, and our brands by incorporating security and compliance in all decisions; ensures security policy and procedure requirements are met; continuously identifies opportunities for improving security and implements strategies to improve our security posture • Experience with API development and support of Azure functions written in Python • 3+ years development experience in one of the following languages: Python and/or Azure SQL • 3+ years data engineering experience working with large datasets and complex data environments, processes, and associated solutions • 3+ years experience writing and tuning complex SQLs, and the ability to analyze and make recommendations on results • 3+ years experience in full lifecycle development and end-to-end testing • Experience with Microsoft Azure platform technologies like Databricks applications, Event Hub, Data Factory, Scala, Synapse Analytics, Delta Lake, Cosmos DB, or DevOps • Must have good troubleshooting and problem-solving skills, including debugging multi-threaded applications • Experience with configuration management and build automation capabilities such as Git/Jenkins • Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives • Must be able to both collaborate in a team-oriented environment and work independently with direction Preferred: • Bachelor's degree in Computer Science, Computer Information Systems, Management Information Systems, or related field preferred • Experience with Big Data solutions and no SQL DBMSs • Experience with Azure, AWS, or other Public Cloud environments • Prior experience leading large-scale projects • Knowledge and working experience with Agile methodologies Generic Managerial Skills • Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives • Must be able to both collaborate in a team-oriented environment and work independently with direction Education Bachelors Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Created: 2026-03-04