A member of the public may receive the correct answer and, at the same time, have a frustrating experience. Waiting times without updates, conflicting information between service desks and websites, overly technical language, unexplained procedures: these are details that affect trust just as much as the outcome of the case. The public administration service assessment serves to examine these moments systematically, distinguishing between the intended quality of service and that actually delivered.
For a public body, this does not mean assigning generic ratings to departments or carrying out a formal audit. It means understanding whether services are accessible, comprehensible, consistent across channels and capable of meeting the needs of people with very different levels of digital literacy, time constraints and circumstances. This is where measurable improvement can begin.
Why evaluate the citizen’s experience in practice
Perceived quality arises at the points of contact. An online form may be well designed but prove difficult to complete on a smartphone. A service counter may adhere to the scheduled times but fail to clarify which documents the citizen needs for the next step. A staff member may provide accurate information but use a brusque tone that discourages those in need of assistance.
Surveys of self-reported satisfaction are useful for gauging opinions, expectations and priorities. On their own, however, they do not always reflect what happens during a real-life interaction. Citizens tend to remember the most critical or most recent incidents in particular; those who do not complete a request often leave no feedback at all. Structured observation, on the other hand, allows procedures, behaviours and friction to be assessed at the very moment they occur.
This approach is particularly useful when the administration needs to coordinate multiple offices, services outsourced to external providers, telephone channels and digital platforms. The question is not merely: ‘Is the service available?’. It is: ‘Can citizens actually use it, understand what to do and receive an appropriate response?’.
Assessing public administration services: what to measure
An effective evaluation starts with clear standards and realistic scenarios. There is no single checklist that applies to every office: a registry office, a tourist information centre, a library, a job centre or a transport service all have different objectives and challenges. The design must therefore translate the organisation’s commitments into observable elements.
Key aspects include physical and digital accessibility, the ease of finding information, perceived and actual waiting times, clarity of communication, the ability to guide users, and the correct handling of enquiries. Consistency across channels must also be assessed: what is stated on the website must correspond to what is communicated over the telephone or at the counter.
A further level concerns the quality of the interaction. A welcoming manner, active listening, the ability to manage complex situations, respect for privacy and the use of understandable language are not secondary considerations. They form part of the public service, particularly when the service concerns people in vulnerable situations, facing an emergency or experiencing uncertainty.
From abstract requirements to observable behaviour
Simply stating that staff must be ‘helpful’ leads to vague assessments. It is more useful to check whether they greet people, listen without interrupting, outline possible alternatives, highlight any restrictions and necessary documents, and check that the user has understood. Similarly, ‘reducing waiting times’ is not enough: it is necessary to record when the reception process begins, whether the service user receives updates, and whether signage allows them to prepare before their appointment.
This step is crucial because it makes the findings comparable and transforms the results into actionable guidance for service, training and quality managers. Useful data does not merely indicate that something is not working: it shows where the problem occurs, how often and under what circumstances.
Mystery shopping and open surveys: different tools to be integrated
When applied to the public sector, the mystery shopper approach involves realistic, pre-defined scenarios carried out by trained assessors. These may include a counter enquiry, a telephone call, the use of a portal, access to an information service or a journey involving multiple channels. The aim is to document the experience with precise evidence, not to replace internal control functions or to judge individual staff members in isolation.
Declared surveys, such as questionnaires and interviews, enable the views of a large number of citizens to be gathered and provide a deeper insight into overall perceptions. Field observation, on the other hand, clarifies actual behaviours and the concrete causes of a problem. The two tools are most valuable when interpreted together: a drop in satisfaction can indicate where action is needed; field verification helps to understand why.
In complex projects, it is also useful to include an analysis of digital interactions. The website, forms, automated emails and replies to messages constitute a front line in every sense. If a user finds incomplete instructions online, they will arrive at the service desk already confused. If they receive a standardised reply that does not resolve their query, they may abandon the process or generate further requests for the organisation.
How to design a survey that informs decision-making
The most delicate phase is not the data collection itself, but the set-up. Before commencing visits or making contact, it is necessary to define which services are a priority, which citizen groups to represent and which standards to verify. A scenario that is too simple may only capture the ideal case; an artificially complex scenario risks measuring situations that occur infrequently. A balance is needed between realism, repeatability and compliance with service regulations.
The selection and training of surveyors have a direct impact on reliability. They must be able to follow a scenario without altering the interaction, record facts rather than general impressions, and recognise the specific characteristics of the public setting. For this reason, the monitoring of data collection must be rigorous, with checks for consistency and supervision of the assessments made.
The sample also warrants attention. A survey concentrated within the same time slots may provide an incomplete picture. Outlying locations may have different conditions to central ones; seasonal peaks or administrative deadlines alter expectations and workloads. The interpretation of results must take these variables into account, avoiding simplistic comparisons between non-homogeneous situations.
Data to inform action, not to pad a report
An effective report links each finding to a priority for action. If preliminary information is lacking, the solution may involve web content, signage and confirmation messages. If the issue concerns conversation management, it may be necessary to focus on training, mentoring and support tools for staff. If differences emerge between branches, it is important to understand whether these stem from organisational factors, workloads, skills or inconsistent interpretations of procedures.
Not all critical issues carry the same weight. It is worth assessing the impact on the user, the frequency with which the problem occurs and the feasibility of the intervention. A small change to an automated message can reduce many repetitive enquiries; a more significant process change may be essential to remove a barrier that excludes a section of the population.
Assessment as a tool for people and the organisation
Evaluation should not become a punitive exercise. When results are used solely to rank departments or individuals, the risk of defensiveness increases and the quality of learning diminishes. The value lies in creating a concrete comparison between expected standards and operational reality, whilst also recognising effective practices that are worth sharing.
For managers, this means having specific information to define priorities, investments and training programmes. For front-line staff, it means receiving clear guidance on what to maintain and what to improve. For citizens, it means encountering services that are less fragmented, clearer and more consistent.
Mystery Man®’s ‘Mystery Public’ approach applies this logic to the public service experience: observing discreetly, assessing against criteria tailored to the context, and interpreting the data strategically. The aim is not to produce a static snapshot, but to identify the actions that will make the experience smoother the next time a citizen engages with the service.
A good starting point is to choose a high-frequency or high-impact service, define a few essential standards and measure them on an ongoing basis. When the organisation listens to what citizens actually experience, even a limited intervention can improve trust, efficiency and the quality of the relationship.