Hadoop Engineer

Job Title : Hadoop Engineer Experience Required - 10+ Years Must Have Technical/Functional Skills • Performance tuning of Hadoop clusters and Hadoop workloads. • Screen Hadoop cluster job performances and capacity planning at application/queue level • Monitor Hadoop cluster connectivity and security • Manage and review Hadoop log files. • File system management and monitoring. • implementation and ongoing administration of Hadoop infrastructure • Screen Hadoop cluster job performances and capacity planning at application/queue level • Monitor Hadoop cluster connectivity and security • Manage and review Hadoop log files. Roles & Responsibilities • Responsible for implementation and ongoing administration of Hadoop infrastructure. • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments. • Working with data delivery teams to setup new Hadoop users/applications. This job includes onboarding activities like setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig, Spark and MapReduce access for the new users/applications. • Cluster maintenance as well as creation and removal of nodes using tools like Ambari and other home-grown tools. • Performance tuning of Hadoop clusters and Hadoop workloads. • Screen Hadoop cluster job performances and capacity planning at application/queue level • Monitor Hadoop cluster connectivity and security • Manage and review Hadoop log files. • File system management and monitoring. • HDFS support and maintenance. • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability. • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required. • Optimize analytical jobs and queries against data in the HDFS/Hive environments • Develop considerable bash shell or python scripts, LINUX utilities & LINUX Commands to ease day to day operations Maintain central dashboards for all System, Data, Utilization and availability metrics Salary Range - $100000 to $150000 TCS Employee Benefits Summary Discretionary Annual Incentive Comprehensive Medical Coverage Medical and Health, Dental & Vision, Di sability Planning & Insurance, Pet Insurance Plans Family Support Maternal and Parental Leaves Insurance Options Auto and Home Insurance, Identity Theft Protection. Convenience and Professional Growth Commuter Benefits and Certification and Training Reimbursement. Time Off Vacation, Time Off, Sick Leave and Holidays. Legal and Financial Assistance Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Created: 2026-03-10