Sr. AWS Data Engineer

Please note, this role is not able to offer visa transfer or sponsorship now or in the future Role Tile: Senior AWS Data Engineer About the role Design, build, and operate scalable, cloudu2011native data platforms supporting batch and streaming use cases, with strong focus on governance, performance, and reliability. Responsibilities 1. Programming u00b7 Python: Strong hands-on experience with Python for data engineering tasks, including scripting, automation, and ETL logic development u00b7 PySpark: Proficiency in writing and optimizing PySpark jobs for large-scale data transformations u00b7 SQL: Advanced SQL skills for data querying, transformation logic, and stored procedure conversion from SQL Server 1. Big Data Processing Frameworks u00b7 Apache Spark: Strong experience with Spark core concepts u2014 RDDs, DataFrames, Datasets, partitioning, and performance tuning u00b7 Data partitioning and optimization: Experience with data skew handling, broadcast joins, caching strategies, and Spark tuning u00b7 AWS Services (Hands-On Experience Required) 1. AWS Glue ETL: Developing and deploying Glue jobs (Python Shell and Spark), job bookmarks, dynamic frames, and custom connectors u00b7 AWS Glue Data Catalog: Managing databases, tables, crawlers, classifiers, and schema versioning u00b7 AWS Lake Formation: Configuring data lake permissions, fine-grained access control, and data filtering u00b7 AWS Step Functions: Designing and implementing state machines for ETL workflow orchestration, error handling, and retry logic u00b7 AWS Lambda: Writing serverless functions for event-driven triggers, lightweight transformations, and pipeline utilities u00b7 Amazon Aurora: Working with Aurora PostgreSQL compatible for relational data storage and query optimization u00b7 Amazon DynamoDB: Designing and querying NoSQL tables u00b7 Amazon S3: Proficiency in S3 data lake design u2014 partitioning strategies, storage classes, lifecycle policies, and S3 event notifications u00b7 AWS IAM: Understanding of roles, policies, and least-privilege access patterns relevant to data pipeline security 1. ETL Development & Migration u00b7 Informatica PowerCenter (working knowledge): Ability to read and interpret Informatica workflows, sessions, mappings, and transformations to support conversion to AWS Glue u00b7 ETL framework development: Experience building reusable, configurable ETL frameworks with logging, error handling, retry mechanisms, and metadata-driven execution u00b7 Data pipeline design patterns: Familiarity with incremental loads, CDC (Change Data Capture), full loads, and SCD (Slowly Changing Dimensions) u00b7 SQL Server (working knowledge): Ability to understand SQL Server schemas, stored procedures, and SSIS packages for migration analysis 5. Data Engineering Best Practices u00b7 Data quality and validation: Implementing data quality checks, reconciliation logic, and exception handling within pipelines u00b7 Metadata-driven frameworks: Building configurable pipelines driven by metadata stored in Aurora or DynamoDB u00b7 Logging and observability: Integrating CloudWatch logging, custom metrics, and alerting into data pipelines u00b7 Unit and integration testing: Writing test cases for ETL logic using frameworks such as pytest u00b7 Version control: Proficiency with Git for source code management, branching strategies, and code reviews What you need to have to be considered u00b7 8+ years in IT related role u00b7 Strong hands on experience in AWS Cloud, SQL and Python u00b7 Good experience with Kafka/Flink, AWS Glue and Airflow Work model: On Site At Cognizant, we strive to provide flexibility wherever possible, and we are here to support a healthy work-life balance though our various wellbeing programs. Based on this roleu2019s business requirements, this is an onsite position requiring 5 days a week in a client or Cognizant office in Charlotte, NC.Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

Created: 2026-03-18