Hadoop System Administrator

Profile

Hadoop System Administrator
Columbus, OH
Overview:
OCLC Online Computer Library Center, Inc. is a nonprofit, membership, computer library service and research organization dedicated to the public purposes of furthering access to the world's information and reducing information costs. Tens of thousands of libraries around the world use OCLC services to locate, acquire, catalog, lend and preserve library materials. We are currently seeking a Hadoop System Administrator
at our Corporate Headquarters located in Dublin, Ohio
You will be part of a team responsible for administration, infrastructure planning, and scaling of Hadoop and HBase technologies across OCLC’s multiple clusters while ensuring a high availability and performance. This position will also work closely with development teams to tune and troubleshoot applications to maintain high performing clusters.
This position will be responsible for the infrastructure planning, scaling and administration and support of the open source Hadoop environment. The administrator will work closely with infrastructure, network, database and application teams to insure business applications are highly available and performing within agreed on service levels.
Responsibilities
Develop and maintain operational best practices for smooth operation of HBase/Hadoop clusters
Install, manage, upgrade and backup Hadoop, HBase and related third party applications on systems
Enhance monitoring and alerting for cluster reliability focusing on preventive measures
Work with peers in development to tune infrastructure and plan for resource management including adding / removing cluster nodes for maintenance or capacity needs
Participate in on-call support rotation
Create and maintain technical documentation
Participate and present in HBase/Hadoop community and industry events
Work with Architecture and Development teams to test and benchmark new versions, patches and software components for functionality and reliability
Review existing software/hardware architecture and identify areas for improvement in the areas of scalability, maintainability, and performance
Perform tuning and troubleshooting of MapReduce Jobs
Manage and review Hadoop log files
Design, implement and maintain security with the OCLC security teams
Qualifications
Required:
3 years supporting open source Linux operating systems (CENTOS, SuSE, RedHat) and hardware in an enterprise environment
Experience managing and supporting open source environments including active participation in the community
Knowledge of java virtual machines (JVM) and multithreaded processing
Expertise in typical system administration duties such as capacity management, performance tuning, system dump analysis, and server hardening (security)
Strong understanding of computer architecture, storage and IO subsystems, network and distributed systems
A bachelor's degree or higher in computer science
Ability to read, understand, and build java code
Knowledge of Hadoop architecture, administration and support; Experience with Cloudera Hadoop preferred.
Strong knowledge of scripting with shell scripting (PHP, PERL, Python)
Experience with versioning, change control and problem management
High availability experience within and across data centers
Desired Skills/ Experience:
Experience with RDBMS technologies and SQL language; MySQL highly preferred
Hands on experience with the Hadoop stack (MapReduce, Sqoop, Pig, Hive, Flume)
Knowledge of NoSQL platforms
Hands on experience with opens source monitoring tools including Nagios and Ganglia
Company Overview
find more jobs with this company

Company info

Sign Up Now - MiamiCrossing.com