Job InformationJob ContactAbout CompanyApply Now
City: St. Louis State: MO Career Level: 2 Category: 15-1000 Occupation: 15
|
Skills: . Hortonworks, AWS Big Data
· Hadoop
· Kubernetes
· Kafka
· Object storage experience Education: 3 Requirement: Role: Big Data Admin with Kubernetes
Duration: 12+Months Description: · 7+ years’ experience in Hadoop administration activities. Exposure in AWS Big data Deploy/maintain Hadoop clusters, add/remove nodes using cluster monitoring tools, configure the NameNode high availability and keep track of all the running Hadoop jobs. Implementing, managing, and administering the overall Hadoop infrastructure
· Takes care of the day-to-day running of Hadoop clusters. Work closely with the database, network, BI, and application teams to ensure that all the big team applications are highly available and performing as expected. Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
· Decide the size of the Hadoop cluster based on the data to be stored in HDFS. Ensure that the Hadoop cluster is up and running all the time. Monitoring the cluster connectivity and performance. Manage and review Hadoop log files. Backup and recovery tasks Resource and security management Troubleshooting application errors and ensuring they do not occur again.
· This resource will be working closely with the architects. On solution and development team. Working with them to develop a solution using Kubernetes and Object Storage like Minio/ Ceph/Apache Ozone etc.
· The goal is to create a pool of niche resources, build solutions based on open source and continue to support and grow the team. Looking for someone who can be a heavy lifter.
|