Assessment method 1: Knowledge Test (This assessment method has 1 component.)
Overview
The rationale for this assessment method is:
This occupation involves the need for memory recall of fundamental knowledge areas to ensure the role is carried out safely, accurately and cost-effectively. Using a knowledge test assesses the ability for memory recall. Furthermore,
- it allows for the efficient testing of knowledge where there is a right or wrong answer
- allows for flexibility in terms of when it is taken
Test Format
The test can be:
- paper based
- computer based
It will consist of 40 questions. These questions will consist of:
- multiple-choice questions of which 5 questions based on a scenario / case study
The multiple-choice questions will have four options of which one will be correct. The questions must be varied to avoid the test becoming too predictable yet allow assessment of the relevant KSBs.
Test administration
Apprentices must have a maximum of 75 minutes to complete the test.
The test is closed book which means that the apprentice cannot refer to reference books or materials.
Apprentices must take the test in a suitably controlled environment that is a quiet space, free of distractions and influence, in the presence of an invigilator. The invigilator may be the independent assessor or another external person employed by the EPAO or specialised (proctor) software, if the test can be taken on-line. The EPAO is required to have an invigilation policy that will set out how the test/examination is to be carried out. This will include specifying the most appropriate ratio of apprentices to invigilators to best take into account the setting and security required in administering the test/examination.
The EPAO is responsible for ensuring the security of testing they administer to ensure the test remains valid and reliable (this includes any arrangements made using online tools). The EPAO is responsible for verifying the validity of the identity of the person taking the test.
The EPAO must verify the suitability of the venue for taking the test and the identity of the person taking the test.
Marking
Tests must be marked by independent assessors or markers employed by the EPAO following a marking guide produced by the EPAO. Alternatively, marking by computer is permissible where questions types allow this, to improve marking reliability.
Any incorrect or missing answers must be assigned 0 marks. Correct answers will be assigned 1 mark.
Question and resources development
Questions must be written by EPAOs and must be relevant to the occupation and employer settings. It is recommended that this be done in consultation with employers of this occupation. EPAOs should also maintain the security and confidentiality of their questions when consulting employers.
EPAOs must develop a ‘test specification’ and ‘question banks’ of sufficient size to prevent predictability and review them regularly (and at least once a year) to ensure they, and the questions they contain, are fit for purpose.
Required supporting material
As a minimum EPAOs will produce the following material to support this method:
- a test specification
- sample test and mark scheme
- live test and mark scheme
- analysis reports which show areas of weakness for completed tests/exams and an invigilation
- question banks
Assessment method 2: Observation with Questioning (This assessment method has 1 component.)
Overview
Apprentices must be observed by an independent assessor completing work in their normal workplace, in which they will demonstrate the KSBs assigned to this assessment method. The EPAO will arrange for the observation to take place, in consultation with the employer. This scheduling should consider what activities are required to be happening within the workplace to best facilitate the observation.
One independent assessor may observe up to a maximum of one apprentice at any one time, to allow for quality and rigour.
The rationale for this assessment method is:
The occupation involves practical activity best assessed through observation; it would be difficult to replicate the working environment in a valid way and employers would doubt the occupational competence of an individual not assessed in this way.
Delivery
The observation will take 3 hours. The observation may be split into discrete sections held over a maximum of 1 working day. The length of a working day is typically considered to be 7.5.hours. The independent assessor has the discretion to increase the time of the observation by up to 10% to allow the apprentice to complete a task at the end of this component of the EPA.
In advance of the observation, apprentices must be provided with information on the format of the observation, including timescales.
The observation must be of the preparation and performance of a laboratory experiment, test or task, following specified methodologies to provide reliable, accurate data.
The following activities MUST be observed during the observation:
- Working safely
- Following procedures/work instructions
- Complying with regulations
- Following quality systems
The observation should be conducted in the following way, to take account of the occupational context in which the apprentice operates:
The independent assessor must be unobtrusive whilst conducting the observation. Questions must be asked after the observation is complete. The independent assessor will ask a minimum of 5 questions in a time period not exceeding 20 minutes. They may ask additional follow up questions where clarification is required. The purpose of the questioning is to assess or clarify underpinning knowledge and behaviours based on what the assessor has observed and to assist in determining whether the apprentice has reached pass criteria. These questions may be a combination of those from the EPAO question bank and those generated by the independent assessor. Questioning should take place in a quiet room, free from distractions and influence.
KSBs observed, and answers to questions, must be documented by the independent assessor.
The independent assessor will make all grading decisions.
Other relevant information
There may be breaks during the observation to allow the apprentice to move from one location to another or for comfort breaks as required. During these breaks, the clock must be stopped and restarted to ensure that the assessment duration is not reduced. Should the assessment need to be stopped due to a situation arising in the working environment (e.g. fire alarm) the assessor has the discretion to re-start the observation in another area and/or assign an appropriate break until the situation is resolved.
Support material
EPAOs will produce the following material to support this assessment method:
- outline of the assessment method’s requirements
- marking materials
Venue
The observation can take place in:
- employer’s premises
- workplace other than the employer’s own premises (e.g. premises of a client)
Question development
EPAOs will create open questions to assess related underpinning KSBs. They must develop ‘question banks’ of sufficient size to prevent predictability and review them regularly (and at least once a year) to ensure they, and the questions they contain, are fit for purpose.
Assessment method 3: Structured Interview underpinned by a portfolio of evidence (This assessment method has 1 component.)
Overview
This assessment will take the form of an interview which must be appropriately structured to draw out the best of the apprentice’s competence and excellence and cover the KSBs assigned to this assessment method. Questioning should assess the KSBs assigned to this assessment method and the apprentice may use their portfolio to support their responses.
The rationale for this assessment method is:
- it allows the apprentice to be assessed against KSBs which may not naturally occur during the observation
- it is supported by a portfolio of evidence, enabling the apprentice to demonstrate the application of skill and behaviours as well as knowledge
- it allows for testing of responses where there are a number of potential answers that couldn’t be tested through the multiple-choice test
- it is cost effective, as apart from a venue it does not require additional resources
Delivery
The independent assessor will conduct and assess the interview.
The interview must last for 75 minutes and contain a minimum of 20 questions. The independent assessor has the discretion to increase the time of the structured interview by up to 10% to allow the apprentice to complete their last answer.
During this method, the independent assessor must combine questions from the EPAO’s question bank and those generated by themselves.
The structured interview will be conducted as set out here:
The structured interview is used to explore the areas of knowledge that would vary between organisations e.g. local procedures and skills/behaviours that may not naturally occur in the observation.
The contents of the portfolio of evidence will influence the questions selected; the assessor will review the portfolio of evidence and then select areas they wish the apprentice to expand on with reference to the identified grading descriptors. The apprentice can use the portfolio of evidence as an aide memoire and to support answers being given.
The independent assessor must use the assessment tools and procedures that are set by the EPAO to record the structured interview.
The independent assessor will make all grading decisions.
Venue
The structured interview should take place in a quiet room, free from distractions and influence.
The structured interview can take place in any of the following:
- employer’s premises
- a suitable venue selected by the EPAO (for example a training provider’s premises)
Video conferencing can be used to conduct the structured interview, but the EPAO must have processes in place to verify the identity of the apprentice and ensure the apprentice is not being aided in some way.
Other relevant information
Due to the number of specialisms this apprenticeship covers, a technical expert will be available to the assessor for consultation. See Roles and Responsibilities section for rules governing this. The technical expert cannot be from the employer in order to maintain independence and they are only required if the independent assessor does not have the technical expertise required to accurately assess the apprentice in a specialist area.
A structured test specification and question bank must be developed by EPAOs. The ‘question bank’ must be of sufficient size to prevent predictability and the EPAO must reviewed regularly (at least once a year) to ensure that it, and its content, are fit for purpose. The specifications, including questions relating to the underpinning KSBs, must be varied yet allow assessment of the relevant KSBs.
EPAOs must ensure that apprentices have a different set of questions in the case of re-sits/re-takes.
Independent assessors must be developed and trained by the EPAO in the conduct of the structured interview and reaching consistent judgement.
EPAOs will produce the following material to support this assessment method:
- outline of the assessment method’s requirements
- structured interview specification
- question bank
- recording documentation
- marking materials