Find IT today

Hadoop Administrator

Job title: Hadoop Administrator
Department: Business Technology Group
Location: Warwick
Salary: £55,000 - £65,000 + Bonus


The UK’s fastest growing and largest independent energy supplier is looking for a talented Hadoop Administrator to lead the architecture and engineering of the next generation Big Data Environment.

First Utility is committed to helping customers reduce their energy bills through the use of innovative technology, by offering cheaper tariffs and campaigning for industry change. This opening comes at an exciting stage and offers a fantastic opportunity for you to be part of a team hungry to make a difference.

We are the ‘Growing Business Awards’ Growing Business of the Year 2014 and the only energy company to have been listed in the fast track 100 for four consecutive years. Our CTO Bill Wilkins ranks as number 10 in the top 100 CTOs to work for in the UK.

Role overview

A key role within our expanding Business Intelligence team that will build a sophisticated data management platform based around Hadoop and Spark. This role offers a unique opportunity to work on our next generation decision system.

The aim for us is to build a Hadoop Platform that will provide rich data, faster, and help us answer some really great questions about how we run our business. The work you do will enable us to quickly and efficiently gather, collect and analyse huge data sets to answer complex business questions. To facilitate this you will install, configure, and maintain multiple Hadoop Clusters. More than this you will improve and extend core components of our Hadoop Eco-system (HDFS, Yarn, Pig, Oozie, etc.) to work at scale on our multi-tenant cluster.

Our Data and Insights team enjoy a close relationships with the teams across the business, and take a collaborative and data driven approach to everything we do. Every problem encountered is considered an opportunity for innovation and good ideas are promoted quickly.

Areas of specific responsibility

  • Install, configure and maintain multiple Hadoop Clusters
  • Manage Hadoop clusters in development and production environments
  • Install new software releases, system upgrades, patches, and evaluation of stability
  • Tuning of servers, applications and Hadoop Infrastructure
  • Focus on process automation and documentation of processes and troubleshooting guides
  • Drive technical vision throughout the product development, direction and ultimately successful implementation
  • Drive the creation of new standards and best practices as technology evolves; communicate and drive adoption across the technical community
  • Work with teams across the business to understand how the Hadoop Platform can enhance what is currently in place
  • Communicate the work being done and the value it will add, sharing knowledge and building best practice across the organisation
  • Work with external service providers/vendor support for troubleshooting
  • Contribute to the Apache’s Open Source community

The desirable candidate will have

Essential Skills

  • Significant experience operating Hadoop Services, preferably in a large scale production environment
  • Demonstrable experience using Java or Python and SQL

Desirable Skills

  • Proficiency in shell scripting and other programming languages
  • Linux administration and trouble shooting skills
  • Experience with Hive, MapReduce, YARN, Impala, Oozie, Sqoop, Flume, HBase, Cassandra, Postgres, SQL Server
  • Experience in troubleshooting applications and application code
  • Experience in Cloud Hadoop Clusters
  • Experience in Hadoop Distribution (Cloudera, Hortonworks, MapR)
  • Experience with ETL and BI Tools
  • Strong SQL Server DBA Performance Tuning Skills
  • Ideally a Master’s Degree or equivalent

The Benefits

As well as a rewarding career, development opportunities and competitive salary, you’ll also enjoy 25 days holiday (plus Bank Holidays), pension, option to purchase childcare vouchers, and become eligible for our staff energy tariff along with other great ad-hoc offers

As part of the Business Technology Department you will also be encouraged to take 12 research days each year (1 per Month) to spend looking into something that is not related to your normal day to day project activities. The key here is to innovate! Try something new, explore that wacky idea you’ve always had, or play with some new hardware or device that has just hit the market.

We believe in putting energy into looking after our teams, so you’ll benefit from BUPA Private Healthcare, cycle to work scheme, a great working environment with relaxation areas to recharge your batteries and free soft drinks available all day. We also have “Fruity Friday” where fresh fruit is available every week for all employees.


Create an account within minutes and apply today!

Similar jobs