Lead Data Engineer

Information Technology National, United Kingdom


Job Title : Lead Data Engineer
Salary:  Up to £67,000 depending on skills and experience   
Contract type: Permanent appointment
Grade: MoJ Band Ab, 
Number of open roles: 1 
Location: National (with regular travel to London, Sheffield or Kirkham)
Hours: 37 hours/week (42 hours incl. lunch)
Working pattern: flexible working, full time, part time
Closing date for applications: 12 November 2019
Interview location: Sheffield Digital Studio


These are exciting times at MOJ Digital and Technology. We have a clear vision - to develop a digitally-enabled justice system that works more simply for users - and we’re looking for talented people to help us achieve it. We’re making things better by building adaptable, effective services and making systems that are simple to use for staff and citizens. It can be challenging but it’s also important and rewarding.

As well as doing great work, we’re creating a place that’s great to do work in. We offer tip-top kit, brilliant training opportunities and support from expert colleagues. On top of that, you’ll find flexible working, an inclusive culture and a place where your opinion is valued.

The Team

The National Applications Reporting Team (NART) is a small but dynamic team with good working relationships across many HMPPS digital projects within the MOJ. We are part of the Digital Studio within MOJ Digital and Technology, and support the Reporting Functions of 3 national case management systems within HMPPS, and will support new digital products when required.

The team covers a range of technology with a good understanding of the business processes and data which underpin this, and regularly adapt to many interesting and varied requests. Your knowledge and experience will be invaluable to modernise business critical systems and steer future technology requirements to provide time and cost savings for our users and the MOJ.

The reporting systems underpin the management of offenders through their journey, and have a total of approximately 70,000 endā€users across all public and private establishments and probation providers, as well as HQ offices.

The Role

Data Engineers industrialise the delivery of data products and services into systems and business processes. Data Engineers design, build, test and maintain data management systems, ensuring they meet business requirements and user needs. They deliver services that are automated, reliable and secure. They work closely with Data Architects and Data Scientists. They recommend ways to improve data efficiency and reliability.fr


  • work to deliver projects to design and implement new data solutions that support the creation of a range of data products. 
  • work collaboratively with internal and external stakeholders to understand and meet business requirements. 
  • contribute to managing system performance and maintenance of data processing to underpin routine reporting. 
  • deliver continuous improvement to processes and outputs, e.g. to data quality and output consistency. 
  • validate and quality assure new or updated functionality within the system. 
  • maintain and develop technical documentation to provide transparency and maintain knowledge base across team. 
  • line manage and develop  junior staff.
  • share knowledge and work alongside existing members of the team to help their development and understanding
  • keep SAP Business Objects software up to date
  • provide specialist, technical advice on how the various reporting systems can be rationalised and interfaced with new digital services
  • establishes standards, keeping abreast of best practice in industry and across government. keep those standards up to date and ensures adherence to them
  • recognise and share opportunities to re-use existing data flows between their teams
  • be responsible for the build of data streaming systems
  • coordinate teams and set best practice and standards
  • apply knowledge of systems integration to their work
  • champion data engineering across government

You’ll have

Specialist technical knowledge of the following technologies:

  • SAP Business Objects (including Enterprise administration and environment configuration, Data Integrator (BODI), Data Services (BODS), Web Intelligence (report writing) and Universe Design; 
  • Databases & SQL (including Data Warehousing, Oracle, Oracle Streams, Goldengate & PL/SQL)
  • Cloud hosting
  • Ability to communicate between the technical and the non-technical to manage stakeholders’ expectations and be flexible, proactive and reactive communication. Facilitate difficult discussions within the team or with diverse senior stakeholders.
  • Expertise in data analysis and synthesis to help teams apply a range of techniques for data profiling and source system analysis from a complex single source. Able to bring multiple data sources together in a conformed model for analysis.
  • Expertise in Data development design, build and testing of data products(repeatable and reusable - establishes standards, keep abreast of best practice in industry and across government, keep those standards up to date and ensure adherence to them
  • Expertise in data modelling concepts and principles to produce relevant data models. 
  • Programming and build (data engineering) of simple programs or scripts using agreed standards and tools to design, code, test, correct and document moderate to complex programs and scripts from agreed specifications and subsequent iterations. 
  • A deep understanding of the technical concepts required in their role, and understands how these fit into the wider technical landscape.
  • Ability to review requirements, specifications and define test conditions. Able to identify issues and risks associated with work whilst being able to analyse and report test activities and results


  • Data Innovation - Identified areas of innovation in data tools and techniques, and recognises appropriate timing for adoption
  • Metadata management - Designed appropriate metadata repository and.understands a range of tools for storing and working with metadata. Provided oversight and advice to more inexperienced members of the team.
  • Problem resolution (data) - Ensured that the most appropriate actions are taken to resolve problems as they occur. Coordinates teams to resolve problems and implement solutions and preventative measures

In the Civil Service, we use Success Profiles, a flexible framework, to assess candidates against a range of elements using a variety of selection methods, therefore giving you the opportunity to demonstrate the various elements required to be successful in the role.

At the interview we will be assessing your technical/specialist skills and experience, testing your ability through relevant assessments and asking you questions to around the behaviours we require to be successful in this role. The behaviours we assess are:

  • Leadership
  • Communicating and influencing
  • Working together
  • Developing self and others
  • Making effective decisions
  • Delivering at pace
  • Seeing the big picture
  • Changing and improving
  • Managing a quality service

Throughout the process we will assess your technical specialist skills and experience on the above requirements.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status or disability status.

Selection process details

Candidates must submit:

  • a current and relevant CV;
  • a Cover letter  (1 page max) setting out why you are interested in the role and how you meet the essential skills and experience required.

The job advert lists the essential, specialist skills and experience as well as key Civil Service competencies required for the role.

At the CV review/sift stage we will use the technical/specialist skills and experience to determine your suitability for the role. 

At the Interview the panel will ask you open-ended questions to which they are seeking answers/evidence of essential, previous skills, experience and behaviours in order to guide their hiring decision.

Note: due to the volume of applications we receive we are unable to provide feedback after the CV review (sift) stage.

Salary and working arrangements

If successful, the salary we offer you will be within the advertised range and will depend on the skills and experience you demonstrate at the interview. Therefore in your cover letter it would be helpful to the hiring teams if you can indicate your salary expectations and if possible your notice period.


  • A generous pension scheme on average of up to 22%
  • 25 days leave, plus bank holidays, plus 1 privilege day usually taken around the Queens’ birthday
  • 1 additional day of leave for every year you work, up to a maximum of 5 extra days
  • Flexible working - whether it’s working from home or remotely, working part-time, job sharing, or working compressed hours, we have people doing it and are happy to discuss options with you
  • Access to training and development through Civil Service Learning, GDS Academy and Pluralsight
  • Great maternity, adoption, and shared parental leave, with up to 26 weeks leave at full pay, 13 weeks with partial pay, and 13 weeks further leave. And maternity support/paternity leave at full pay for 2 weeks, too!
  • Bike loans and secure bike parking (subject to availability and location)
  • Season ticket loans, childcare vouchers, and eye-care vouchers.
  • Some offices may have a subsidised onsite Gym. 
  • Up to 5 days paid leave for voluntary work you may wish to undertake

Things you need to know

Security and Immigration checks

Successful candidates must pass a disclosure and barring security check.
Successful candidates must meet the security requirements before they can be appointed.

Candidates will be subject to
UK immigration requirements as well as Civil Service nationality rules.

If you're applying for a role requiring security clearance please be aware that foreign or dual nationality is not an automatic bar. However certain posts may have restrictions which could affect those who do not have sole British nationality or who have personal connections with certain countries outside the UK.

Nationality requirements

Open to UK, Commonwealth and European Economic Area (EEA) and certain non EEA nationals. Further information on whether you are able to apply is available here.


Candidates in their probationary period are not eligible to apply for vacancies within this department.

Working for the Civil Service

The Civil Service Code sets out the standards of behaviour expected of civil servants.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles.

The Civil Service embraces diversity and promotes equality of opportunity. There is a guaranteed interview scheme (GIS) for candidates with disabilities who meet the minimum selection criteria.

Contact point for applicants- for further information regarding this role please contact MoJ D&T Recruitment.

Further information

All Civil Servants will adhere to the 'Civil Service code’, which outlines the Civil Service's core values, and the standards of behaviour expected of all civil servants in upholding these values.

Note for current Civil Servants: If successful, the salary offered would normally be determined by applying the MoJ salary progression rules. If the appointment is on level transfer your substantive salary (excluding any allowances) will remain unchanged, unless it exceeds the maximum stated within the MoJ pay band, and unless your current salary is below the relevant MoJ grade minimum. If the appointment is on temporary or substantive promotion the salary will be increased by the appropriate promotion percentage or moved to the minimum of the relevant MoJ grade minimum, whichever is the greater.

Note for non Civil servant applicants: This post is open to UK Nationals, Commonwealth Citizens, EEA Nationals of other member states and certain non-EEA family members. There must be no employment restrictions or time limit on your permitted stay in the UK. You should normally have been resident in the United Kingdom for at least 3 years and in some cases 5 or even 10 years preceding your application due to the requirement to have a checkable history for security vetting purposes. If you answer 'No' to the questions regarding nationality then it is unlikely your application will be pursued. If you are unsure as to your eligibility on any of these points, please contact the recruitment team for clarification or advice.