Objective Undercorrected refractive errors are the primary cause of vision impairment worldwide, including in Pakistan. However, limited data exist on the quality of refractive error care. Our study assessed the quality of refractive error care in Punjab, Pakistan by estimating the proportion of spectacles that were optimally prescribed.
Methods and analysis In this cross-sectional study, 12 unannounced standardised patients (USPs) from Jhang, Khanewal and Sahiwal districts were recruited. USPs underwent baseline subjective refraction and were trained to attend optical services, observe consultations, request spectacles and obtain prescriptions. The spectacles received were compared with baseline refraction to determine quality. We also examined the associations between spectacle quality, service and patient characteristics.
Results Out of 276 attempted visits to 69 optical services, 241 pairs of spectacles were dispensed. A population size-weighted percentage of 42.7% (95% CI 36.4% to 49.3%) of spectacles were optimal quality, with the range varying from 13.8% in Jhang to 67.0% in Khanewal. Half the suboptimal quality spectacles had horizontal prism deviations outside of tolerance limits. Optimal spectacles were associated with performing focimetry (unadjusted OR=7.15, 95% CI (3.02 to 16.94), p<0.001) and good communication (OR=2.23, 95% CI (1.06 to 4.67), p=0.03). Hyperopic USPs were less likely to receive optimal spectacles (OR=0.01 95% CI (0.00 to 0.11), p<0.001).
Conclusion The quality of refractive error care in Pakistan requires improvement, particularly in the Jhang district. Key areas for enhancing refractive error care in Pakistan include refining dispensing and refraction skills for hyperopic prescriptions, providing training on the risks of using previous spectacles, and emphasising the importance of effective communication skills.
- public health
- optics and refraction
Data availability statement
Data are available upon reasonable request.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
WHAT IS ALREADY KNOWN ON THIS TOPIC
The global health sector has acknowledged that eye care is an integral part of universal health coverage.
Limited research has investigated the quality of refractive error services, particularly in unregulated settings.
Unannounced standardised patients are increasingly used to assess the quality of healthcare.
WHAT THIS STUDY ADDS
This study provides an estimate of the proportion of spectacles in Punjab, Pakistan, that are optimal for individuals’ refractive error requirements.
This study also provides details of how to improve refractive error outcomes with enhanced dispensing and refraction skills and further training in Punjab, Pakistan.
HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY
This study provides evidence for targeted training opportunities for upskilling the workforce to improve refractive error care, as well as the potential benefit of regulating refractive error services in Pakistan.
In 2020, it was estimated that over 16 million people in Pakistan experienced vision loss at distance, while more than 10 million faced vision loss at near.1 Undercorrected refractive error is the leading cause of moderate to severe vision impairment globally,2 and its prevalence is expected to rise due to the growing and ageing population, as well as limited investments in human resources for eye health.3
Universal health coverage (UHC) aims to ensure that all individuals can access health services they require without experiencing financial hardship, with quality-of-care being a crucial component within UHC.4 Effective refractive error care (eREC) is one of two global targets endorsed by Member States at the 74th World Health Assembly to measure progress towards achieving UHC.5 This target, which entails a 40 percentage point increase in eREC, is designed to monitor both the effective coverage and quality of refractive error care (Q.REC). Recent estimates have reported that substantial improvements in the quantity and quality of refractive services will be required to meet the global target.6 7
Q.REC in Pakistan has previously been identified as an area for improvement. A scoping review identified seven inter-related research themes, one of which included the quality of eye care services.8 Although most of the studies within this theme focused on cataract surgery rather than refractive error care, the authors recommended further evaluation of current eye care service quality, exploration of patients’ perspectives and investigation of methods for improving services.8
Optometry is a relatively new field in Pakistan, and advancements have been made in the availability of optical services over the last decade.8 9 However, it is speculated that a limited number of optical services employ qualified staff to appropriately prescribe and dispense spectacles. The lack of national or provincial regulations mandating qualifications in refraction and spectacle dispensing may also contribute to poor quality spectacles in Pakistan.10 Punjab province has previously been identified as an area with unmet need for spectacles, with an estimated age-sex standardised prevalence of 9.1%, corresponding to over 2 million adults.11 Earlier estimates in Pakistan reported 25.8% of spectacle wearers had an ‘incorrect prescription’, defined as an improvement in presenting visual acuity (VA) by one or more visual impairment categories according to the WHO’s ICD-10 vision impairment classifications, with correction.11 This definition is an imprecise measure, likely to underestimate service provision errors and lacks detail about where errors occur.
Simulated patients, also known as unannounced standardised patients (USPs) are considered the gold standard for assessing quality in clinical practice,12 USPs are ‘actors’ trained to covertly pose as patients in a standardised manner while observing clinical techniques and services provided. When implemented effectively, USPs minimise observation bias, as care providers are less likely to modify their behaviours when unaware that they are being observed or examined. USPs have been employed in low-income and middle-income settings to evaluate family planning, pharmaceutical dispensing and clinical prescribing patterns.13 Studies using USPs have also assessed refractive error outcomes.14–16
A Q.REC study shows that using USPs can provide evidence on the quality of refractive services being delivered and inform decision-making, as well as recommend practice and policy changes. The primary aim of this study was to evaluate the Q.REC in Punjab, Pakistan, by employing USPs to estimate the proportion of prescribed and dispensed spectacles that are optimally prescribed. Additionally, this study aims to assess the associations between spectacle quality and optical service and USP characteristics.
Materials and methods
The protocol for this cross-sectional multisite study has been published previously.17 Briefly, we recruited 12 USPs in total, four each from Jhang, Khanewal and Sahiwal districts in Punjab province, Pakistan. Eligible USPs were aged 18 and above, fluent Urdu speakers, had not had formal refraction training, no ocular or health conditions that could affect refractive error, no previous refractive surgery, no manifest or intermittent strabismus, no amblyopia and at least one refractive profile, defined as:
Myopia : spherical equivalent<−0.50 DS in at least one eye.
Hyperopia: spherical equivalent > +0.50 DS in at least one eye.
Astigmatism: > 0.50 DC in at least one eye.
Presbyopia: ≥ 1.00 DS above the best optical distance correction.
District hospital optometrists compiled the sample frames of the eligible optical services. A minimum sample size of 64 services would achieve a maximum 7% margin of error around the estimated proportion of 50% of spectacles meeting optimal quality. Eligible optical services provided refraction and dispensing services and USPs were unknown to staff. The chosen districts were expected to be representative of other agricultural districts in Punjab but may differ from metropolitan areas such as Lahore district. The initial recruitment approach was opt out,17; however, verbal explanations were identified as more culturally appropriate. Hence, an alternative opt-in approach was additionally used.
Each USP had their baseline prescription, pupillary distances and best-corrected distance and near visual acuities measured by three qualified local optometrists, reviewed for variability, and if within our tolerance limits (0.75 D), then averaged for each measurement. USPs received standardised training through an online course and a 5-day in-person training event. Their skills on providing standardised responses, observing refraction and dispensing techniques, data recording and ability to minimise being detected were assessed by the local optometrists before data collection commenced.17
USPs were trained to visit optical services in a standardised way to request a refraction, record optical service characteristics, order and collect spectacles, and request a written prescription. They also observed if qualifications/certifications were displayed and assessed communication. Research optometrists assessed VA and spectacle comfort. This study is reported according to the Checklist for Reporting Research Using Simulated Patient Methodology.18
Spectacle quality was the primary outcome, categorised as either optimal or suboptimal according to the tolerance limits (online supplemental material 1). Optimal quality single-vision spectacles met all quality components in both lenses, with the baseline distance sphere power plus any near addition for single vision near spectacles. Bifocals required both distance and near components to meet tolerance limits. Cylindrical axis tolerance was assessed for non-zero cylinder power USPs, and induced horizontal prism was determined using Prentice’s rule, accounting for lens power at horizontal meridian and decentration from average baseline pupillary distance.
Prescription was classified as optimal or suboptimal relative to the baseline refraction based on tolerance limits for distance sphere, cylinder power and axis components (online supplemental material 1). Dispensed spectacles matched the written prescription if spherical and cylindrical power were within 0.25 D, and cylinder axis tolerance limits were met.
Good corrected VA with dispensed spectacles was less than 1.5 lines worse than baseline best-corrected VA at distance and near, assessed separately and with both eyes open. Study optometrists noted any discomfort or eye strain experienced by USPs, evaluated at distance and near for non-presbyopic USPs and only at near for USPs prescribed a near prescription.
Data analyses were conducted using Stata/BE V.17.0 (StataCorp LLC). If two pairs of spectacles were dispensed, single-vision near spectacles were excluded for primary analysis, ensuring one pair per USP visit. All dispensed glasses were included in analyses assessing the association between USP/optical service characteristics and spectacle quality.
Characteristics were compared between districts via Fisher’s exact test for categorical variables and via one-way analysis of variance for continuous variables. A p value less than 0.05 was considered significant. Unequal spectacle dispensing across districts led to weighted estimates (as percentages) based on district population size for pooled estimates: Jhang (33.5%), Khanewal (35.7%) and Sahiwal (30.7%), according to the 2017 population census.19
Proportions for outcomes (spectacle quality, prescription quality, comfort, good spectacle-corrected VA) were calculated per district with logit-transform 95% CIs and robust standard errors to account for intraservice correlation. Univariable logistic regression assessed the association between spectacle quality and USP/optical service characteristics. Multivariable logistic regression evaluated the association between spectacle quality and each of focimetry, autorefraction, distance and near subjective refraction, with separate models for each type of spectacle (single-vision distance or bifocal vs single-vision near), adjusting for USP baseline refraction type. Each of these variables were chosen a priori as potential targets for future interventions with a sufficient number of observations in each category for analysis.
The primary aim was to estimate the proportion of optimal-quality spectacles. Comparative statistics were considered exploratory analysis; therefore, no adjustment for multiple testing was applied to these estimates.20
All USPs had a baseline distance best-corrected VA of 6/6 in each eye. Baseline spherical equivalent refraction for distance ranged from −4.83 D to +2.58 D, with a maximum of 1.33 D cylinder power. Less than half of the USPs had presbyopia (5 out of 12, 41.7%). USP ages ranged from 19 to 64 years and 9 out of 12 (75.0%) of the USPs were male.
Optical service characteristics
A total of 98 optical services were identified across the 3 districts. Out of these, 69 optical services were selected and a total of 276 visits were attempted. In each district, USPs attempted to visit all selected optical services in that district. In Jhang, staff were unavailable to perform refractions at 30 visits (30.0%) from 16 optical services (64.0%), and unable to dispense spectacles at 5 visits (5.0%) from 2 optical services (8.0%). Spectacles were dispensed following all visits in Khanewal and Sahiwal (see figure 1). No USP reported being identified as a USP during their visits.
The majority of staff providing refractive error care were male (98.8%). Eye care provider qualification or registration certificates were observed by USPs at 19 of the 69 services (5 in Jhang, 14 in Sahiwal) and 15.4% (37/241) of visits. In 28.6% of visits, no distance subjective refraction was conducted. The proportion of services that used each testing procedure differed between the districts (p≤0.046, online supplemental material 2), except for checking pinhole distance VA (Jhang: 7.7% vs Khanewal: 2.0% vs Sahiwal: 1.3%, p=0.10) and near VA prior to refraction (Jhang: 36.9% vs Khanewal: 41.0% vs Sahiwal: 47.4%, p=0.45). Although USPs perceived communication to be clear for the majority of visits (>85% for each during eye test, for outcomes and spectacles recommendations), poorer communication was more commonly perceived at optical service visits in Jhang (online supplemental material 2).
Quality of spectacles and written prescriptions
Less than half the spectacles included in the primary analysis were within tolerance limits (46.1%, 95% CI 40.0% to 52.2%), with a weighted percentage of 42.7% (95% CI 36.4% to 49.3%). The percentage of optimal quality spectacles within each district ranged from 13.8% (Jhang) to 67.0% (Khanewal, table 1). Of the 130 spectacles that were of suboptimal quality, 65 (50.0%) were not considered to be of optimal quality solely due to the presence of horizontal prism (ie, the spherical, cylindrical, axis and vertical prism components of these spectacles were within tolerance limits), that ranged from 3.4Δ base-in to 7.9Δ base-out. The remaining 65 suboptimal spectacles were due to 9 different combination of component errors (online supplemental material 3).
When assessing the spectacle components of quality individually, spherical power, cylinder axis and horizontal prism were less likely to be within tolerance limits, particularly in Jhang district (table 2).
Of the 241 pairs of spectacles, all but 3 (238/241) matched the written prescription. Additionally, 71.8% (95% CI 65.6% to 77.3%) of the written prescriptions were within the tolerance limits for the sphere, cylinder and axis components of the baseline refraction.
Association between spectacle quality and optical service characteristics
Univariable logistic regression revealed that receiving optimal spectacles was associated with the following factors: having focimetry performed, checking distance VA at the beginning of the eye examination, not performing autorefraction, not testing near VA with distance refraction lenses, not measuring pupillary distance and being provided clear communication (table 3).
Hypermetropes were less likely to receive optimal single vision distance or bifocal spectacles compared with myopes, and less likely to receive optimal single vision near spectacles compared with emmetropes (table 4). After adjusting for USP refraction, receiving optimal spectacles was found to be associated with having focimetry performed (table 4).
Vision and comfort
Good distance spectacle-corrected VA for each eye (separately) was achieved in 74.7% of spectacles (weighted percentage, 95% CI 66.0% to 81.7%) with single vision distance or bifocal spectacles, and 98.6% of all spectacles (weighted percentage, 95% CI 95.7% to 99.6%) at near. A higher proportion of optimal quality single vision distance and bifocal spectacles achieved good distance VA compared with suboptimal spectacles (85.2% vs 71.1%, p=0.03). Good spectacle-corrected near VA was observed for both optimal and suboptimal spectacles (100% vs 97.7%, p=0.276).
Discomfort or eyestrain was experienced at distance in 36.8% of single vision distance or bifocal spectacles (weighted percentage, 95% CI 28.1% to 46.5%), and at near in 25.6% of all spectacles (weighted percentage, 95% CI 19.9% to 32.3%). A lower proportion of USPs experienced discomfort when wearing optimal quality single vision distance or bifocal spectacles compared with suboptimal spectacles (24.7% vs 42.3%, p=0.02). There was no evidence of a difference in comfort between optimal and suboptimal spectacles at near (27.1% vs 24.7%, p=0.77).
Refractive error quality relies on the provider’s accuracy in refraction and identifying patient needs, and the service’s ability to produce spectacles accordingly. In this Q.REC Pakistan study, we found that 42.7% of prescribed and dispensed spectacles were optimal, with quality ranging across districts. The main issue with suboptimal spectacles was horizontal prism. Hyperopes were less likely to receive optimal spectacles, while focimetry on previous spectacles and clear communication increased the odds of receiving optimal spectacles.
Suboptimal spectacles can impact patient dissatisfaction, trust and community eye care seeking behaviours. We found that 50% of suboptimal spectacles had horizontal prism values outside the acceptable tolerances. Meanwhile, over 70% of written prescriptions were within tolerance limits, suggesting dispensing appears to be a key issue in the quality of care. Similar errors involving induced prismatic effect were reported in Central Anatolia, Turkey, where pupillary distance measurements were frequently omitted by services.21 In this study, USPs observed pupillary measurements performed in 14.5% of visits (online supplemental material 2). However, pupil distances were recorded on 27% of the written prescriptions, suggesting that autorefractors may have been used to obtain some measurements. Limited evidence exists on autorefractor accuracy for measuring pupillary distance, and it would be difficult for USPs to determine whether these devices were used. Suboptimal spectacles were associated with manual pupillary distance measurement, indicating potential need for additional training.
The 2007 Pakistan National Prevention of Blindness Plan for building human resources in eye health provided limited emphasis on training qualified optical dispensing or mechanic personnel. Additionally, the plan contained few details regarding dispensing tasks for ophthalmic qualifications.22 The current curriculum offers a multiyear dispensing course, which is an important step in enhancing the skill of optical dispensing professionals in Pakistan.
Focimetry can be used by eye care providers to assist with making a clinical judgement on whether new spectacles should be recommended or whether the full difference in change should be prescribed. However, our findings suggest that patients who have never worn spectacles or those who do not bring their previous spectacles to the eye examination may be at higher risk of receiving suboptimal spectacles. Additionally, individuals with hyperopia, which has an estimated prevalence of 29.8% in Punjab adults,11 may also be at increased risk. The observed variability in testing procedures highlights the importance of providing comprehensive training to ensure consistent outcomes for all patients and refractive error types.
In a systematic review, the prevalence of spectacle non-tolerance among patients has been reported to be 2.1%.23 However, the included studies assumed patients who did not return with complaints were satisfied with their spectacles, potentially leading to an underestimation of the true prevalence of non-tolerance. Like our findings, the main factors contributing to non-tolerance were errors in refraction, communication and dispensing processes.23 Although our study included USP observations of discomfort rather than specifically assessing patient non-tolerance, the USP observations of discomfort suggest an increased risk of non-tolerance for long-term wear.
People centredness is a crucial aspect of quality of care.24 Effective communication, which encompasses providing clear instructions for accurate prescriptions, understanding wearers’ needs, and enabling patients to comprehend relevant information, is a vital competency in eye care practice.25 As demonstrated in this study, effective communication throughout the eye examination process, including discussing outcomes and recommendations, is associated with achieving optimal spectacles.
The College of Ophthalmology and Allied Vision Sciences is one of the main education facilities that provide ophthalmic courses for the Punjab region, and learning modules on communication skills in general practice, inclusive health, and medical consent have been included in the optometry curriculum. However, it is unknown whether the staff at the optical services visited in this study have had access to the optometry training course or are aware of the importance of communication in their practice. Out of the 69 stores observed, only 19 displayed registration or qualification certificates, suggesting the majority of services might lack qualified or appropriately trained staff to provide optimal care. The true extent of this may be underestimated, as the hidden nature of USP observations limits their ability to assess staff qualifications, and there is no requirement to publicly present such qualifications. Therefore, a more comprehensive understanding of human resourcing in private optical services is required.
In 2007, it was reported that individuals in Pakistan often sought refractive services from local marketplace opticians, who often operated family businesses without formal training.22 Consequently, the National Committee for the Prevention of Blindness emphasised the need for strengthened ophthalmic personnel at the district and tertiary eye care levels. Since then, there has been limited information on the growth of eye care personnel over time. However, persistent challenges in personnel appear to be present in Jhang district. Services in Jhang provided a significantly lower proportion of optimal quality spectacles compared with the other districts, indicating a need for considerable support to enhance refractive error care in the region. Additionally, the considerable variation in testing procedures across districts underscores the need for a standardised curriculum for all courses. Such a curriculum is currently being developed by the National Committee.
Naturally, this study has limitations. First, there is no established benchmark defining the ideal, or minimally acceptable proportion of optimal spectacles dispensed from optical services. Nevertheless, the characteristics identified in this study associated with optimal spectacles provide evidence and opportunities to enhance clinical care. Second, the Q.REC for children cannot be inferred, as refractive error care in children can be more challenging with clinicians having varying prescribing philosophies for hyperopia,26 27 and myopia management is still evolving.28 29 Third, although 21 pairs of bifocal spectacles were dispensed, the quality of prescribing bifocal spectacles (and progressive addition lenses) cannot be confidently assessed, as our protocol is designed for evaluating single vision lenses, and does not currently take segment height measurements into account. Fourth, the USPs recruited did not have high refractive errors limiting our understanding on the full scope of refractive error care. However, the more challenging nature of accurately refracting patients with higher refractive errors would likely decrease the percentage of optimally prescribed spectacles. In future, USPs recruited with high refractive errors would likely require back vertex distance measurements to be included in quality assessment. Fifth, spectacle frame fit could further impact comfort and long-term wear, although the focus of this study was optimal lens quality and accuracy. Hence, future studies could further explore the influence of comfort and fit on spectacle quality.
This study highlights the need for enhancing the Q.REC in Punjab, Pakistan. It also provides outlines for specific opportunities to improve the Q.REC, which may contribute to an increase in eREC targets in Pakistan. Areas of clinical improvement and regulatory changes include upskilling the workforce, improved dispensing, improved refraction skills for hyperopia, less reliance on previous spectacles, greater emphasis on effective communication skills and additional support for Jhang region.
Data availability statement
Data are available upon reasonable request.
Patient consent for publication
This research adhered to the tenets of the Declaration of Helsinki and was approved by the University of New South Wales Human Research Ethics Committee (HC210102), and the College of Ophthalmology & Allied Vision Sciences Ethical Review Board (COAVS 545/2021) in Pakistan.
We would like to thank Huma Khan, Sidra Ibrahim, Unaiza Mariam and Uswa Ramzan for assistance in USP recruitment, training and data collection.
Contributors The research was designed by AB and LL. Field work was carried out and supported by LL, MIJ, FR, FA, BV, SMH and AB. Analysis was conducted by LL and MG. All authors contributed to the drafting of the manuscript and reviewed and approved the final version of this article. LL is responsible for the overall content as guarantor.
Funding This work was funded by The Fred Hollows Foundation with support from the Australia Government through the Australian NGO Cooperation Program (ANCP).
Competing interests LL and AB are currently consultants to The Fred Hollows Foundation.
Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.