Anatomical Modeling for the Validation of Automated Measurement of the Angle of Deviation in the Strabismic Head Model ()
1. Introduction
Prism Diopter is a clinical measurement used to quantify the AOD of the eyes, dating back to its origin in the late 1870s. [1] One PD (1Δ) is defined as the bending of the beam of light by 1 cm toward the base of a prism 100 cm from the prism.
Accurate PD measurement depends heavily on the examiner’s experience and the patient’s cooperation. [2] Possible sources of error in PD measurement include patient compliance, examiner experience, stability, and the parallel orientation of the prism to the subject’s eyes. [3] As measured PD increases, the difference between repeated measurements increases, raising questions about the validity of large-angle PD values. [4] Even minor measurement errors result in significant planned operative variation. [5]
Applications for smartphones and tablet devices have been developed to measure the angle of deviation and report a calculated PD. The comparative value of these has been based on mathematical modeling that references clinical PD measurements. [6] We have previously reported on our research, both in adults and in children, comparing clinical PD measurements with results from the PinpointEyes App (PPEA). [3] [7] The principal premise of the published data is that PD measurements obtained with devices should be compared against clinical PD measurements. This assumes that the clinical PD measurements are accurate and reproducible and serve as the reference point against which all measurements are evaluated—a position not supported by the literature. [2] [8] [9] We have developed a precise testing platform to validate PPEA measurements and the calculated PD results. The designed 3-D model of an adult human head with known deviations in the eye inserts allows us to confirm the algorithm’s reported PD using a precise, known model.
2. Physiology
The process of seeing and perceiving an object begins as light rays reflect off an object and enter the eyes. The light then passes through the pupil, controlled by the surrounding-colored muscle, the iris, which adjusts pupil size to control the amount of light that enters the retina. [10] Two types of photoreceptors, cones and rods, convert light information into electrochemical signals when light hits the retina. [11]
Information from the left visual field activates the nasal retina of the left eye and the temporal retina of the right eye. [12] In contrast, information from the right visual field similarly activates the opposite regions. The upper and lower quadrants of the visual field correspond to the upper and lower areas of the retina, respectively. [13] The horizontal separation of the eyes creates differences in the images received by each retina. This results in two different but similar images that the brain processes, creating a phenomenon known as binocular disparity, which is imperative for depth perception. The image produced on the retina and perceived in the visual cortex involves the brain’s ability to merge two similar yet non-overlapping images. [14] This image processing at the brain level is crucial for depth perception and a nearly 180-degree field of vision. If the eyes are misaligned in the same gaze direction, the signals will fail to merge into a three-dimensional image. [15] Depth perception and three-dimensional visualization occur when the brain integrates images from both eyes.
Patients with strabismus experience difficulties with depth perception because the brain suppresses visual stimuli from the misaligned eye to prevent double vision. Similarly, stroke damage to the visual cortex or dorsal pathway regions interferes with depth perception and spatial orientation, despite intact eyes and optic nerve structures. [16]
3. Visual Testing
Hirshberg, Modified Krimsky, and Prism Cover tests are clinical examinations that assess AOD and PD. The accuracy of these tests largely depends on each examiner’s experience. [17] Significant limitations exist in a specific test: repeated examinations of the same subject over a very short period by the same examiner can yield results that may vary considerably. [18] [19] These variations cannot be attributed to fundamental changes in AOD or PD, particularly concerning minor differences. However small, this measurement is critical in planning corrective eye surgeries.
These tests’ limitations stem from the human factor involved in taking the measurements. The tests depend on the examiner’s estimation and observation, as well as the patient’s cooperation. [2] These human variables make the validity and reproducibility of these tests unreliable in pediatric patients and those who cannot follow instructions due to age or health conditions.
There may be several reasons for the non-reproducibility and variability of clinical PD measurement. [9] PD measurement is highly dependent on the examiner’s experience. [17] The results of the PD test are influenced by several variables, including the examiner’s position, the patient’s proximity, the prism’s position relative to the patient’s eye, and the distance measured. [19] The examiner may not be able to control some of these variables, given the patient’s very young age and inability to follow instructions, hold still, or both. The initial and repeated PD tests (one hour apart) at near and distance resulted in exact measurements in only 37% and 53% of cases, respectively. [4]
Given the broad variability in repeated testing, regardless of potential causes, one can question the validity and reliability of the PD test, since this measurement, along with other variables, is used to plan and execute the surgical approach to strabismus surgery with muscle repositioning. [20] [21]
4. Application Design
With the current Smartphone Apps, we have identified several deficiencies. Firstly, several smartphone devices have been reported to measure AOD and PD using various techniques, which may require expert training in a clinical setting and are not tested or suited for broad use in primary care or at home. [22] [23] Secondly, they validate their results against a clinician’s examination, which shows wide examiner-dependent variability. [5] [24] A smartphone device should be validated on a standardized testing platform that allows reproducibility within and across repeated examinations by different operators and smartphones.
Our solution consisted of design validation process. The first step involved modeling and 3D printing an anatomically accurate human head. A head with changeable eyes at known offsets was needed to validate measurements made by the PPEA. The test platform needed to have: 1-known tolerances to allow for precise measurement, and 2-precise offsets to ensure the measurements taken from the app could be trusted in real-world applications. Our model was built on an open-source design using computer-aided design (CAD). The optimization included exchangeable eye inserts (EEI) with different iris-pupil positions. The 3D-printed head and a series of EEIs with varying angles of deviation would enable us to model the deviated eye position at a known, precise angle. All variables- the radius of the eye and deviation in arc millimeters on horizontal and vertical planes- were established to have less than one-millimeter tolerance.
The second step used the PinpointEyes app (PPEA) to measure AOD and PD with both the non-deviated and deviated EEIs. This allowed us to verify the PPEA-reported data by confirming the accuracy of measurements against the expected values obtained during model creation in the second step.
This structured and systematic approach results in a reliable, easy-to-use, data-driven testing platform for measuring AOD and PD, accurate across all smartphones and users, using a “point and take picture” approach.
5. Design Process
5.1. Design of the Head
The design of the head began by resizing an open-source design to specific dimensions within the range of average human facial measurements. Further additions included recessed and protruded lines along the center of the face for precise positioning, a calibration 1cm square above the bridge of the nose, and Interchangeable eyes for straight and deviated gaze positions.
The design included the following parameters:
a) The pupil’s diameter was set to 2 mm (ref), and the complete set of eyes was printed for both the left and right sides.
b) Both sets also included inward (esotropia) and outward (Exotropia) deviation.
c) Horizontal deviated positions were at 2-millimeter increments.
d) The curvature of the visible part of the eyes is based on an average eye diameter of 1.125 cm (ref).
e) Design measurements are printed on the back of the head.
5.2. Design of Exchangeable Eye Inserts (EEI)
For the horizontal deviation, each set consists of 8 inserts per side in both inward (esotropia) and outward (exotropia) deviation, with deviation set in the horizontal plane from the central pupil position (+2 mm, +4 mm, +6 mm, +8 mm, −2 mm, −4 mm, −6 mm, −8 mm). For the Vertical deviation, each set consists of 4 inserts per side, in both inward (esotropia) and outward (Exotropia) deviation, with deviation set in the horizontal plane from the central pupil position (+2 mm, +4 mm, −2 mm, −4 mm).
Two additional EEIs are made for full deviation to the inner and outer Canter positions (with the whole pupil visible). The deviations are set as Arc distance on the surface of the eye. Two complete sets of the EEIs mentioned above were printed, with pupil bores to accommodate both LED lights. The distance between pupils was set at 60 mm.
This translates to the following measurements outlined in the addendum “IC_OC Offset Dimensions.xlsx”.
5.3. 3D Printing
The printer used for this project was a Creality Ender 3 (https://www.creality.com/), running its stock Marlin firmware (tolerances of ±0.1 mm, 0.4 mm nozzle, height 0.16 mm). A direct-drive extruder replaced the stock Bowden setup, improving filament control, precision, and material versatility. The bed was also upgraded to a glass plate, providing a flat, smooth surface that improves adhesion and consistency. All modeling for this project was performed using Autodesk Fusion 360 (V. 2.0.20508) and Ultimaker Cura under an educational license.
6. Method: Setup and Procedure
Using the Pinpoint Eyes smartphone application, we measured the Angle of Deviation (AOD) and Prism Diopter (PD) values from images of a 3D-printed anatomical head with preset pupil deviations, simulating varying eye deviation. The application was used to process the images and calculate the AOD and PD values. These values were compared with the known parameters and analyzed for statistical significance to evaluate the program’s efficacy.
The 3-D model was custom-engineered to feature interchangeable eye inserts with pre-defined horizontal pupil deviations. The inserts were designed to represent known displacements of the right and left pupils from a central position (0mm). These included displacements of 2 mm, 4 mm, 6 mm, and 8 mm from the center, both toward the inner canthus (labeled with a negative sign, −2mm, 4 mm, etc.) and outer canthus (labeled with a positive sign: +2 mm, +4 mm, etc.). Additionally, inserts were created to represent complete deviations toward the inner and outer canthi (labeled as 1.0 I.C., 1.0 O.C., respectively), as well as half displacements between the central position (0 mm) and the inner or outer canthus (labeled as 0.5 I.C., 0.5 O.C., respectively) (Figure 1).
Figure 2 shows a non-deviated eye insert, and Figure 3 shows a left 8mm deviation.
Figure 1. Deviated eye inserts marked with position information.
Figure 2. Non-deviated eye insert.
Figure 3. Left 8 mm—horizontal only deviated eye insert.
The anatomical model was secured onto a 3-D printed tailored platform with a rotating hook mechanism, allowing rotation of the anatomical head about the z-axis in 5˚ increments, ranging from 0˚ (centered) to ±45˚ (clockwise and counterclockwise). Two additional spirit levels were attached to the posterior of the head model, ensuring the model is aligned vertically and horizontally along the y and x-axes, respectively (Figure 4).
Figure 4. 3-D printed head with eye insert, on the rotating platform.
Photographs of the model were taken using an iPhone 13 Pro. The camera was configured to standard mode throughout the image collection. The device was secured on a fixed tripod stand with three spirit levels mounted to the iPhone case, enabling control of the x- and y-axis tilt (Figure 5). A needle was centrally positioned between the iPhone’s three rear-facing camera lenses and used to precisely align the camera with pre-defined coordinates on a gridded platform beneath the setup. The grid paper was labeled with distance and angular markers to help standardize the distance between the camera and model across trials. Images were captured at four distances from the model: 45 cm, 40 cm, 35 cm, and 30 cm. The phone stand and model were outlined on the grid paper after each repositioning to minimize inconsistencies across image sets.
Figure 5. Multi-axis tripod setup.
For image sets collected at 45 cm, 40 cm, and 35 cm, 1.4× digital magnification was applied; for images captured at 30 cm, a 1.1× magnification was used. Utilization of the magnification feature automatically engaged the iPhone’s Telephoto lens (equivalent focal length: 77 mm). All images were recorded in landscape orientation at a resolution of 4032 × 3024 pixels. Lighting conditions were controlled by manually adjusting focus and exposure before each image was captured. The Live Photo feature was enabled to allow for automatic minor post-processing adjustments.
A standardized data-collection protocol was developed. Images were captured for each deviation setting across all rotation angles and distances and labeled accordingly. The head was then rotated with the same eye insert in 5˚ increments clockwise and counterclockwise, up to 45˚, with cautious re-leveling after each adjustment. Collection for the insert with the same rotation adjustments was repeated at distances of 30 cm, 35 cm, 40 cm, and 45 cm. Photograph series were captured identically for each eye insert, representing a unique deviation setting.
The image collection was uploaded to the application in a single batch to calculate the AOD and PD values. Images were manually processed by standardly marking each eye’s inner and outer canthi, iris center, the iris inner and outer edge, and the center point along the nasal dorsum that aligns with the iris centers of both eyes. The software calculated the AOD and (PD) values as described below. The comprehensive dataset was compared to the head model’s known measurements and evaluated for statistical significance.
7. Method: The AOD and PD Calculation
The image may be tilted in the coronal plane, and the deviated eye is known (left or right). The following image points are provided: the pupil centers, and either the outer or the inner canthi. We assume that the non-deviated (normal) eye looks straight ahead (Figure 6(A)).
First, the linear disposition of the deviated eye along the tilted X and Y axes compared to the non-deviated eye, Δx and Δy, is calculated as differences between distances of the pupil centers of deviated (dxD) and non-deviated (dxN) eyes and a face centerline:
Δx = dxD – dxN, Δy = dyD – dyN, (1)
where
dxD = dxR, dyD = dyR; dxN = dxL, dyN = dyL, (right eye deviation), (2)
or
dxD = dxL, dyD = dyL; dxN = dxR, dyN = dyR, (left Eye deviation). (3)
The tilted X axis is defined by the equation of a line connecting two given points, the left and right eyes’ outer (or inner) canthi, (xL, yL) and (xR, yR):
.
The tilted Y axis is defined as perpendicular to the X axis.
Then dyL and dyR can be found as distances from the pupil centers to the X axis:
,
.
To find the dxL and dxR, we first define a center point as follows:
.
We then find the distances from the center point to pupil centers:
,
.
Finally, from the right triangle formula, we find dxL and dxR:
,
.
Then Δx and Δy are determined using (1), (2), and (3) for the correct deviated eye.
Knowing Δx and Δy and the eyeball radius R, we can calculate the AODs for the X and Y axes as
,
.
The eyeball radius, R, is maintained constant in millimeters (Figure 6(B)). In our 3D-printed head, the eyeball radius is 12.25 mm, consistent with the literature. [25] Iris diameter in the image, which is also known and varies insignificantly among individuals. [26] [27] In our 3D-printed head, the iris diameter is 11.5 mm.
The iris diameter in pixels can be calculated from the edge points (x1, y1) and (x2, y2) of the iris (Figure 6(C)):
The iris diameters are measured for both eyes, and the average is calculated.
Knowing the iris diameter in pixels and in mm, we can then calculate the scaling factor for conversion from pixels to mm as
.
We then convert the eyeball radius from mm to pixels:
,
and calculate the AODs as
,
.
The PD will then be:
,
.
Automatic detection of the deviated eye.
The deviated eye is determined by estimating the asymmetry of each eye. The asymmetry of the eyes in pixels is defined as:
,
,
where
is the distance between the right iris center and the right outer canthus,
is the distance between the right inner canthus and the right iris center,
is the distance between the left outer canthus and the left iris center,
is the distance between the left iris center and the left inner canthus.
and
are then normalized by dividing by the iris diameter:
.
The eye with greater normalized asymmetry is the deviated eye.
Figure 6. (A) Schematic representation of the eyes on an image with a slightly tilted face, coronal plane. In this example, the deviated eye is the right eye. (B) Schematic representation of eyeballs in the transverse plane. (C) The iris diameter.
8. Validation
The 3D model and PPEA accuracy were validated by taking pictures with an iPhone 13 Pro (4032 × 3024 pixels) and loading the images into the app from the photo library. To avoid examiner bias, one image was taken without a label, and a second was taken with the deviation label (Figure 7). They were then loaded into the PPEA by two research associates, and the outcomes were recorded (Table 1). Using a paired two-tailed t-test, the difference between the 3-D model PD and the measured PPEA PD for both ESO and EXO was not statistically significant (P = 0.46762).
Table 1. 3D model and PPEA Prism diopter measurements.
No |
Eye |
Label |
Deviation (mm) |
Calculated angle |
Calculated Prism diopter δ(Δ) |
PPEA Measured angle |
PPEA Measured Prism diopter δ(Δ) |
Diff. Angle |
Diff. diopter δ(Δ) |
1 |
R |
0 |
0 |
0 |
0 |
1 |
1 |
#DIV/0! |
#DIV/0! |
2 |
R-EXO |
2 |
2 |
9 |
16 |
10 |
18 |
10% |
10% |
3 |
R-EXO |
4 |
4 |
19 |
34 |
19 |
35 |
3% |
3% |
4 |
R-EXO |
6 |
6 |
28 |
53 |
27 |
51 |
5% |
−5% |
5 |
R-EXO |
8 |
8 |
37 |
77 |
36 |
72 |
4% |
−6% |
6 |
R-ESO |
-2 |
2 |
9 |
16 |
10 |
17 |
6% |
6% |
7 |
R-ESO |
-4 |
4 |
19 |
34 |
19 |
35 |
3% |
3% |
8 |
R-ESO |
-6 |
6 |
28 |
53 |
29 |
55 |
3% |
3% |
9 |
R-ESO |
-8 |
8 |
37 |
77 |
33 |
65 |
12% |
−15% |
Figure 7. Examples of non-labeled and labeled images.
9. Summary
We have built a 3-D model to accurately validate AOD and PD measurements obtained with a mobile app. This model can serve as the gold standard for measuring AOD and PD when evaluating the accuracy, reproducibility, and predictability of those measurements in a clinical setting.
Repository
The supplemental information is stored in the GitHub repository: https://github.com/hyperionlaboratories/3D-Validation-publication
Ethical, Funding, and Financial Disclosure
This research was conducted in accordance with ethical standards and did not involve any human or animal subjects. All work and analyses were completed independently, with no external funding or financial contributions exchanged. Armen Sargsyan, PhD, Jack Berglas, and Andranik Sinanyan are contracted consultants of the project. Ara Keshishian, MD, is the CEO of Hyperion Laboratories, A Delaware Corporation.