Data Engineer with Security Clearance
Karsun Solutions Llc - Herndon, VA
Apply NowJob Description
Innovate, Grow and Do Extraordinary Together, is at the core of everything we do at Karsun! We defy assumptions and enable cutting edge cloud-based transformation as IT modernization experts. Our people-first focus, innovation and performance driven culture, empowers and encourages employees to be forward-thinking, take ownership and seek advancement opportunities for personal growth. The candidate must have a successful track record in handling complex data pipelines for high transaction volume application and reporting/analytics data with minimal supervision. The candidate will be expected to support a variety of structured and semi-structured data in streaming and batch frameworks for both - migration from and synchronization with legacy systems. The Data Engineer provides support to the Application database design to aid in eliminating data duplication and enabling selective event based and schedule-based data transfer to endpoints within the cloud and legacy environment as required. The Data Engineer drives towards programmatic pipeline generation and orchestration to enhance repeatability and rapid deployment, using out of the box thinking, AWS native capabilities and CI/CD tools while utilizing established design patterns and methods. What You Will Do: * Designs, implements, and operates data management systems * Works with product and application owners, data stewards and business/data analysts to determine, create, and populate required data in an optimal, reliable and measurable manner.* Assists the Data Architects and technical leads in designing how data will be stored, accessed, used, integrated, and managed by different data regimes and digital systems* Plans, designs, and optimizes data throughput and query performance* Participates in the employment of backend database technologies (e.g. SQL, NoSQL, HPC, etc.), their configuration and utilization, and the optimization of the full data pipeline infrastructure (e.g. SQL, NoSQL, HPC, etc.) to support the actual content, volume, ETL, and periodicity of data to support the intended kinds of queries and analysis to match expected responsiveness* Utilize identified COTS, python and AWS tools and services such as TabPy and Python libraries and utilities as needed* Create and execute medium to complex SQL scripts to validate and test data prior to and during the lifecycle of reports and dataset development What You Bring to Karsun: Required: * 5+ years of hands-on experience in with python and various python toolkits and libraries for data processing and pipelines* 5+ year of experience and ability to create complex SQL queries and functions* 3+ year of work experience on AWS based datasources such as RDS, Athena, Redhsift* 2+ years of hands-on experience in creating ETL and data pipeline design patterns for modular and reliable ETL with robust error management and alerting using tools such as Pentaho PDI, Streamsets, etc.* 2+ years of hands-on experience in AWS Glue including performance tuning, best practices implementation and utilizing AWS APIs for automated pipeline configuration and management* 1+ year of experience in java and linux scripting is essential* 1+ year experience working with CI/CD tools including Git for etl and scripts repository* 1+ year of experience using complex data sets and formats such as JSON, AVRO, parquet* 1+ year of experience in data profiling and quality management* 1+ year experience working with CI/CD tools including Git for ETL and scripts repositoryDesired: * Experience of working in AWS environments and any AWS certifications is advantageous* Experience with big data tools such as EMR/Spark, Databricks/PySpark is an advantage* Experience working with database versioning tools such as Flyway is an advantage* Experience in Jenkins scripting is an advantageQualifications: * BA or BS degree in CS, Computer Engineering, Information Technology or a related field.What Karsun Offers You: * A career, more than just a job* Play a key role in the success and growth of Karsun* Do extraordinary and receive extraordinary* Work alongside seriously talented colleagues and who enjoy challenging each other* Work with integrity, honesty and fairness for customers and colleagues* Excellent Benefits from PTO, Medical Benefits, 401K Match, Health and Wellness Programs, Company Events and an overall Collegial Environment, and much moreAbout Karsun: At Karsun, we are committed to providing an environment of mutual respect where equal employment opportunities are available to all applicants and teammates without regard to race, color, religion, sex, pregnancy (including childbirth, lactation and related medical conditions), national origin, age, physical and mental disability, marital status, sexual orientation, gender identity, gender expression, genetic information (including characteristics and testing), military and veteran status, and any other characteristic protected by applicable law. Karsun believes that diversity and inclusion among our teammates is critical to our success, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Virginia Chamber of Commerce, Washington Business Journal and Inc. all recognize Karsun Solutions among the fastest-growing companies in the Washington, D.C. region. Our teams deliver modern software development, cloud solutions, and data and analytics solutions to customers at government agencies including the Department of Homeland Security, Federal Aviation Administration, and General Services Administration. We possess CMMI Level 5 - DEV appraisal, and several AWS Government Competencies.
Created: 2025-09-06