<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJMI</journal-id><journal-title-group><journal-title>Open Journal of Medical Imaging</journal-title></journal-title-group><issn pub-type="epub">2164-2788</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojmi.2023.131002</article-id><article-id pub-id-type="publisher-id">OJMI-123507</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Medicine&amp;Healthcare</subject></subj-group></article-categories><title-group><article-title>
 
 
  Quality Assuring a Ring Vortex Flow Phantom in Real-Time
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Alana</surname><given-names>S. Matthews</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Kelvin</surname><given-names>Simatwo</given-names></name><xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Andrew</surname><given-names>Narracott</given-names></name><xref ref-type="aff" rid="aff3"><sup>3</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Simone</surname><given-names>Ambrogio</given-names></name><xref ref-type="aff" rid="aff4"><sup>4</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Adrian</surname><given-names>Walker</given-names></name><xref ref-type="aff" rid="aff5"><sup>5</sup></xref></contrib><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>John</surname><given-names>W. Fenner</given-names></name><xref ref-type="aff" rid="aff1"><sup>1</sup></xref></contrib></contrib-group><aff id="aff5"><addr-line>Leeds Test Objects, Boroughbridge, UK</addr-line></aff><aff id="aff3"><addr-line>Insigneo Institute for In Silico Medicine, University of Sheffield, Sheffield, UK</addr-line></aff><aff id="aff2"><addr-line>Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield, UK</addr-line></aff><aff id="aff1"><addr-line>Department of Infection, Immunity and Cardiovascular Disease, Mathematical Modelling in Medicine Group, University of 
Sheffield, Sheffield, UK</addr-line></aff><aff id="aff4"><addr-line>Medical Physics Department, Guy’s and St Thomas’ NHS Foundation Trust, London, UK</addr-line></aff><pub-date pub-type="epub"><day>13</day><month>02</month><year>2023</year></pub-date><volume>13</volume><issue>01</issue><fpage>11</fpage><lpage>29</lpage><history><date date-type="received"><day>30,</day>	<month>November</month>	<year>2022</year></date><date date-type="rev-recd"><day>3,</day>	<month>March</month>	<year>2023</year>	</date><date date-type="accepted"><day>6,</day>	<month>March</month>	<year>2023</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  Introduction: The ring vortex phantom is a novel, cost-effective prototype which generates complex and well-characterised reference flows in the form of the ring vortex. Although its reproducibility has been demonstrated, with ring speeds routinely behaving within 10% tolerances at speeds of approximately 10 - 70 cm/s, a form of real-time QA of the device at the time of imaging is needed to confirm correct function on demand in any environment. 
  Methods: The technology described here achieves real-time QA, comprising a linear encoder, laser-photodiode array, and Doppler probe, measuring piston motion, ring speed and intra-ring velocity respectively. This instrumentation does not interfere with imaging system QA, but allows QA to be performed on both the ring vortex and the device in real-time. 
  Results: The encoder reports the reliability of the piston velocity profile, whilst ring speed is measured by laser behaviour. Incorporation of a calibrated Doppler probe offers a consistency check that confirms behaviour of the central axial flow. For purposes of gold-standard measurement, all elements can be related to previous Laser PIV acquisitions with the same device settings. 
  Conclusion: Consequently, ring vortex production within tolerances is confirmed by this instrumentation, delivering accurate QA in real-time. This implementation offers a phantom QA procedure that exceeds anything seen in the literature, providing the technology to enhance quantitative assessment of flow imaging modalities.
 
</p></abstract><kwd-group><kwd>Flow Phantom</kwd><kwd> Ring Vortex</kwd><kwd> Quality Assurance</kwd><kwd> Imaging</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>The development of complex flow phantoms is increasingly important due to the rise of quantitative flow imaging technologies capable of visualising physiological fluid behaviour in detail. State-of-the-art modalities such as 4D-MRI and Vector Flow Imaging (VFI) are being refined for widespread use both in the clinic and research. 4D-MRI has demonstrated its ability to calculate quantitative information previously unachievable [<xref ref-type="bibr" rid="scirp.123507-ref1">1</xref>] , whilst VFI has exhibited strong correlation with traditional MRA [<xref ref-type="bibr" rid="scirp.123507-ref2">2</xref>] and is capable of quantitatively visualising complex flow to high resolution [<xref ref-type="bibr" rid="scirp.123507-ref3">3</xref>] . Imaging data from these modalities are often in the form of quantitative vector flow fields, which is a significant advancement over traditional medical imaging outputs, and allows for more thorough haemodynamic analysis. With the improved visualisation capabilities of these technologies, flow phantoms should ideally generate flows with 1) sufficiently complex flows to challenge the modalities, and 2) well-characterised behaviour at both bulk and sub-mm (i.e. “micro”) scales.</p><p>The ring vortex flow phantom has been developed to generate such flows, producing reproducible ring vortices over a range of speeds and sizes [<xref ref-type="bibr" rid="scirp.123507-ref4">4</xref>] . Reproducibility is vital for application as a medical flow phantom, and its reference flows have also been demonstrated as predictable, controllable and stable [<xref ref-type="bibr" rid="scirp.123507-ref5">5</xref>] . In addition to these attributes, the complexity of the ring vortex flow is sufficiently demanding to challenge modern flow imaging systems, with flow features directly relevant to intra-cardiac flow profiles [<xref ref-type="bibr" rid="scirp.123507-ref6">6</xref>] . The ring vortex phantom in its current incarnation (as manufactured by Leeds Test Objects) is suited for use with ultrasound and CT-based imaging modalities, and has demonstrated rings with measurable, reproducible bulk behaviour in terms of ring speed and size to within 10% tolerances in a laboratory setting. There is concern however that in less controlled environments, tolerances might exceed the stated bounds and that such flows are difficult to validate. This is an important criticism since phantoms are required to reliably provide an accurate “ground truth” reference by which to judge imaging performance.</p><p>This paper describes methodology that independently confirms the quality of each ring during vortex ring propagation using dedicated instrumentation. The result is a real-time, capable of assessing imaging system performance while simultaneously providing real-time device QA and flow QA measurements to confirm correct production of the ring vortex flow. The methods section below provides details of phantom instrumentation and describes operational requirements, whilst the Results section reports the effectiveness of this approach. The discussion explores comparison to other works and considers implication for future application.</p></sec><sec id="s2"><title>2. Ring Vortex Characterisation</title><p>Ring vortex behaviour is discussed broadly in the literature, with Didden [<xref ref-type="bibr" rid="scirp.123507-ref7">7</xref>] offering quantifiable metrics, identifying that the ring vortex can be usefully characterised by ring diameter, core diameter, circulation and ring translational speed (see <xref ref-type="fig" rid="fig1">Figure 1</xref>). The ring is formed primarily of a torus of recirculating fluid layers, surrounded by a volume of fluid which propagates with the ring, known as the vortex atmosphere [<xref ref-type="bibr" rid="scirp.123507-ref8">8</xref>] . These metrics are heavily dependent on the generating conditions of orifice diameter, piston velocity profile and displacement, and fluid viscosity.</p><p>A method widely used for characterizing ring vortex behaviour is video acquisition, previously used with the ring vortex phantom. Rings are visualised with liquid dye or smoke, and their paths recorded and subsequently analysed in post-processing [<xref ref-type="bibr" rid="scirp.123507-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref9">9</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref10">10</xref>] . The method allows for bulk characterisation, with vortex size and ring speed measured. The addition of Laser Doppler velocimetry (LDV) offers micro-characterisation at the sub-mm scale, enabling velocities to be determined at specific points within the flow field. Ring vortex characterisation using LDV is evident in the literature [<xref ref-type="bibr" rid="scirp.123507-ref11">11</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref12">12</xref>] .</p><p>Increased computational power has inspired particle imaging velocimetry (PIV), an optical method that achieves vector visualisation of the flow in a short time-frame. Its results agree with LDV measurements [<xref ref-type="bibr" rid="scirp.123507-ref13">13</xref>] , and are used often for high-resolution fluid visualisation. Its application to ring vortices is broad, with both vortex formation [<xref ref-type="bibr" rid="scirp.123507-ref14">14</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref15">15</xref>] and evolution [<xref ref-type="bibr" rid="scirp.123507-ref16">16</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref17">17</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref18">18</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref19">19</xref>] imaged extensively. PIV is a powerful tool which, when combined with analysis techniques such as streamline generation (<xref ref-type="fig" rid="fig2">Figure 2</xref>(b)) or Lagrangian structures, can provide rich information concerning the intricacies of the vortex flow field. Details of PIV methodology are given below, in Methods.</p><p>However, none of the above (video, LDV, PIV) can be considered real-time since they require significant processing to quantify flow characteristics following data acquisition. The requirement for specialised equipment typically in a lab setting also restricts broader application of LDV and PIV. Despite this, the richness</p><p>of the processed data allows for direct measurement of the vortex properties as presented by Didden. An example from the ring vortex phantom is seen in <xref ref-type="fig" rid="fig2">Figure 2</xref>, where ring diameter, core diameter and circulation can be extracted from the measured PIV flow field.</p><p>Ring diameter is the distance between core centres (defined by the point of maximum absolute vorticity). Core diameter is often reported as either the distance between maximum and minimum tangential velocity [<xref ref-type="bibr" rid="scirp.123507-ref20">20</xref>] or the distance between 10% of the maximum vorticity [<xref ref-type="bibr" rid="scirp.123507-ref21">21</xref>] . In this paper, the former, velocity-derived method is used, with the radius taken as the average of axial and radial measurements from both cores. Circulation is measured by computing a line integral of the velocity vectors around a domain centred at the vortex core. Finally, ring speed can be determined by calculating the ring displacement between adjacent frames and dividing by the elapsed time. Vortex atmosphere dimensions can also be derived from streamlines; however, this characteristic is not reported in this work.</p><p>With these straightforward measurements, ring vortex characterisation is possible and can be capably delivered by PIV, arguably providing a gold standard reference that represents the ultimate in ring QA. On the other hand, PIV is not viable as a routine tool for clinical imaging systems; because of its expense, the requirement for specialist setup with intricate optical alignment, and inability to perform real-time measurements—datasets must be processed after data collection to characterise vortices. Arguably any alternative to quality assuring the ring should endeavour to be consistent with PIV. For the ring vortex phantom discussed in this paper, the primary objective is to ensure that each ring vortex generated exhibits behaviour that is within tolerances (e.g. +/−10%) in relation to the PIV gold standard. The methods for real time QA reported here employ a linear encoder, laser scattering and a Doppler probe.</p></sec><sec id="s3"><title>3. Methods</title><p>This section describes the methods implemented to achieve PIV-consistent QA. First the ring vortex generating conditions are described, then the Laser PIV methodology followed by a description of the instrumentation.</p><sec id="s3_1"><title>3.1. Ring Vortex Generation</title><p>To demonstrate real time QA of the ring vortex flows, a selection of ring vortices was generated, covering a range of generating conditions. Ten rings of each configuration (<xref ref-type="table" rid="table1"><xref ref-type="table" rid="table">Table </xref>1</xref>) were produced, and their defining characteristics determined by the three methods (linear encoder, laser scattering and Doppler probe), each of which was referenced to the PIV gold standard.</p><p>Rings were generated using the well-established piston-orifice setup used by the ring vortex phantom. <xref ref-type="fig" rid="fig3">Figure 3</xref> illustrates that the piston is driven by a bipolar</p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1"><xref ref-type="table" rid="table">Table </xref>1</xref></label><caption><title> <xref ref-type="table" rid="table">Table </xref>type styles (<xref ref-type="table" rid="table">Table </xref>caption is indispensable)</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Config</th><th align="center" valign="middle" >Orifice Diameter</th><th align="center" valign="middle" >Max Piston Speed</th><th align="center" valign="middle" >Programmed Piston Displacement</th><th align="center" valign="middle" >Re</th><th align="center" valign="middle" >PIV Speed Reproducibility</th></tr></thead><tr><td align="center" valign="middle" >1</td><td align="center" valign="middle" >10 mm</td><td align="center" valign="middle" >5.3 &#177; 0.3 cm/s</td><td align="center" valign="middle" >0.8 mm</td><td align="center" valign="middle" >13,028</td><td align="center" valign="middle" >12%</td></tr><tr><td align="center" valign="middle" >2</td><td align="center" valign="middle" >10 mm</td><td align="center" valign="middle" >4.2 &#177; 0.3 cm/s</td><td align="center" valign="middle" >0.8 mm</td><td align="center" valign="middle" >11,166</td><td align="center" valign="middle" >4.6%</td></tr><tr><td align="center" valign="middle" >3</td><td align="center" valign="middle" >15 mm</td><td align="center" valign="middle" >5.3 &#177; 0.3 cm/s</td><td align="center" valign="middle" >0.8 mm</td><td align="center" valign="middle" >8674</td><td align="center" valign="middle" >7.6%</td></tr><tr><td align="center" valign="middle" >4</td><td align="center" valign="middle" >15 mm</td><td align="center" valign="middle" >4.2 &#177; 0.3 cm/s</td><td align="center" valign="middle" >0.8 mm</td><td align="center" valign="middle" >7434</td><td align="center" valign="middle" >16%</td></tr><tr><td align="center" valign="middle" >5</td><td align="center" valign="middle" >20 mm</td><td align="center" valign="middle" >5.3 &#177; 0.3 cm/s</td><td align="center" valign="middle" >0.8 mm</td><td align="center" valign="middle" >6514</td><td align="center" valign="middle" >5.8%</td></tr><tr><td align="center" valign="middle" >6</td><td align="center" valign="middle" >20 mm</td><td align="center" valign="middle" >4.2 &#177; 0.3 cm/s</td><td align="center" valign="middle" >0.8 mm</td><td align="center" valign="middle" >5583</td><td align="center" valign="middle" >30%</td></tr></tbody></table></table-wrap><p>The generating conditions applied for validation of the real-time ring vortex quality assurance tool.</p><p>stepper motor, which is user-controlled via an Arduino Uno microcontroller. The piston speed and displacement can be dictated by the user, and the orifice size (10 mm, 15 mm, 20 mm, 25 mm are available) selected. The largest orifice was not used in this exercise, as its rings are known to be unreliable and unstable [<xref ref-type="bibr" rid="scirp.123507-ref4">4</xref>] . Rings were generated at 25 s intervals to allow the ambient fluid volume to settle between ring propagation. Characteristics were recorded using the instrumentation described below. It is worth noting here that configurations 1, 4 and 6 exceeded the ideal tolerance of 10%, removing them from contention as reference flows. In future work, configurations will be refined to ensure all exhibit ideal tolerances.</p></sec><sec id="s3_2"><title>3.2. Laser PIV</title><p>The laser PIV (the gold-standard datasets for this device) enabled characteristic parameters (ring speed, dimensions and intra-ring flow velocities) to be obtained. Ring vortex behaviour was captured over a horizontal distance 9 - 23 cm from the orifice, requiring a low concentration of 10 - 20 mm diameter, neutrally buoyant, fluorescent nylon particles to be mixed throughout the fluid volume, complemented by a double-pulse laser positioned below the tank. A laser sheet was projected vertically along the tank axis, (see <xref ref-type="fig" rid="fig3">Figure 3</xref>) cutting the rings through their centre. The use of stereoscopic cameras captured particle displacement in consecutive frames, with correlation techniques used to produce high-accuracy (&lt;+/−0.1% declared by LaVision UK) velocity vector maps of the ring vortex in cross-section (see <xref ref-type="fig" rid="fig2">Figure 2</xref>). Spatial and temporal resolution were 0.8 mm and 71.4 ms respectively. For a more thorough description, see Ambrogio et al. (2019) [<xref ref-type="bibr" rid="scirp.123507-ref4">4</xref>] . Analysis of this data offers full characterisation of the vortex flow at the scale of bulk flow and sub-mm resolution.</p></sec><sec id="s3_3"><title>3.3. Real-Time QA Instrumentation</title><p>PIV offers thorough characterisation of bulk and micro-flow after post-experiment analysis, whereas introduction of strategic instrumentation enables measurement of device and flow performance in real-time. The chosen elements—linear encoder (device QA), laser-photodiode array (flow QA) and a 1D Doppler probe (flow QA)—were used to measure piston impulse, ring speed and a flow-vector component of the micro-flow respectively (<xref ref-type="fig" rid="fig4">Figure 4</xref>).</p></sec><sec id="s3_4"><title>3.4. Linear Encoder (Device QA)</title><p>The incremental linear encoder (LM10 Incremental Encoder, RLS, Slovenia) monitors phantom function (“device QA”). Circulation of the ring vortex flow can be inferred from piston motion, but in this exercise the encoder measurements were used only to monitor piston performance. The encoder was attached to the piston guide adjacent to a 10 cm long magnetic strip embedded in the piston stem. The ring vortex is generated as the piston is propelled towards the orifice, with the encoder tracking piston motion and recording the displacement/time profile as it moves. Spatial and temporal resolution equated</p><p>to 10 μm and 1 ms respectively. Reproducibility of piston motion ensures predictability of ring vortex flows.</p></sec><sec id="s3_5"><title>3.5. Laser Array (Flow QA)</title><p>Accurate measurement of bulk ring speed is vital in characterizing the flow, as this often provides the first indication of abnormal ring behaviour. This measurement was achieved through a set of two parallel laser beams of wavelength 500 nm (2 mm diameter beam, continuous, Class 3B) projected across the tank perpendicular to the ring path, positioned to intersect the ring at distances of 8 cm and 18 cm from the orifice. The beams cut the ring through the centre of its path and fall incident on two BPW34 photodiodes on the opposing tank face. These photodiodes are powered and interfaced through an Arduino Mega board [Mega 2560 Rev3, Arduino].</p><p>In order for ring capture to be effective, the piston cylinder volume is seeded with absorbing dye and cornflour (concentration ~0.0036 g/ml), which ensure the laser beams are sufficiently attenuated as the ring travels through the beams. Passage of the ring results in a momentary dip in intensity, providing a measurable fluctuation in the photodiode signal. The time difference between the fluctuations is combined with the known laser-to-laser distance to calculate the ring’s average speed in the 8 cm - 18 cm interval. Ring propagation was also measured using video acquisition during development to validate this method.</p></sec><sec id="s3_6"><title>3.6. Doppler Probe (Flow QA)</title><p>Finally, a Doppler Probe was used to gain a measure of the micro-flow, based on a 1D 5 MHz continuous wave Hi-Dop Doppler probe (focal length approx. 4 - 8 cm, beam width approx. 5 cm) with the beam axis directed along the axis of travel of the ring. This setup was selected for its straightforward nature and proven ability to measure speeds of scatterers in fluid, providing a measure of the ring vortex micro-flow along its symmetry axis. Doppler ultrasound is widely used in medical flow imaging, with its application here determining whether intra-ring speeds lie within tolerances. The cornflour-seeded rings produce a high-quality signal, with cornflour used widely in Doppler ultrasound studies [<xref ref-type="bibr" rid="scirp.123507-ref22">22</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref23">23</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref24">24</xref>] .</p><p>The Doppler probe detects a range of velocities from both translational and rotational motion from within the ring and its surroundings. Within this signal, the axial speed of flow along the central axis of the propagating ring can be extracted, and this measure was designated “CentVect” (see <xref ref-type="fig" rid="fig2">Figure 2</xref>). CentVect is sensitive to ring energy/circulation, ring radius and core radius and is a critical parameter in respect of the ring vortex. Rather than measuring CentVect directly, the Doppler probe enables consistency checks to be undertaken by virtue of the recorded frequency spectrum. To clarify CentVect, the probe is mounted at the centre of the tank wall facing the orifice, positioned to ensure the beam is directed down the centre of the rings. Although the ring will propagate through the sample volume, with signal frequencies reflecting all micro-speeds in and around the ring. The ultrasound beam width is typically larger than the ring, but appropriate frequency analysis can highlight anomalous frequencies that are not consistent with the PIV standard (<xref ref-type="fig" rid="fig5">Figure 5</xref>). Evaluating this throughout the ring’s journey improves confidence. Incorporating such assessment into the instrumentation generates confidence of consistent ring behaviour at the micro-scale, in addition to the bulk and device measurements described above.</p></sec><sec id="s3_7"><title>3.7. User Interface</title><p>This instrumentation is controlled via a single laptop, using a custom in-house MATLAB application. The lasers, Doppler probe and encoder take readings and compute the ring speed, CentVect and velocity profile in unison, with the results and raw data displayed in an interactive user interface to allow the user to inspect the ring behaviour. This is displayed in <xref ref-type="fig" rid="fig6">Figure 6</xref>. On-screen indicators</p><p>flash green or red, indicating whether each value is within expected tolerances, given the selected phantom settings.</p></sec></sec><sec id="s4"><title>4. Results</title><p>The methods described are designed to characterise the vortex ring as it propagates along the tank length. Characteristics of interest are ring speed, piston impulse and CentVect, with an objective to compare average values and variation between gold-standard and new results. Ring behaviour is dictated by generating conditions as listed in <xref ref-type="table" rid="table1"><xref ref-type="table" rid="table">Table </xref>1</xref>.</p><sec id="s4_1"><title>4.1. Linear Encoder Results (Device QA)</title><p>The linear encoder provides a measure of device performance and reports the position/time history of the generating piston as it expels fluid through the orifice to generate the ring vortex (see <xref ref-type="fig" rid="fig7">Figure 7</xref>). Consequently, this is a QA measure of device performance rather than the flow itself. Unsurprisingly, consistent piston performance is synonymous with consistent ring behaviour. The velocity profile of the piston is fundamental to calculating the impulse responsible for generating each ring, through the use of Equation (1). The orifice then converts linear impulse into rotational fluid circulation. For completeness, the derivation for Equation (1) is included in the appendix.</p><p>I = 1 2 ρ π R P 4 L 2 R 0 2 T (1)</p><p>Equation (1) relates encoder motion to impulse (I, N∙s) where ρ is fluid density (kg∙m<sup>−3</sup>), R<sub>P</sub> is piston diameter (mm), L piston displacement (mm), R<sub>0</sub> orifice diameter (mm) and T time elapsed (s).</p><p><xref ref-type="fig" rid="fig8">Figure 8</xref> illustrates the reproducibility of the piston impulses calculated using Equation 1. Data points represent the average of ten vortex-generating impulses with error bars denoting +/−1SD. Average impulse was deemed the most appropriate measure as it is related to the integral of the velocity profile, thus quantifies both shape and magnitude.</p></sec><sec id="s4_2"><title>4.2. Laser Scattering Results (Flow QA)</title><p>As a direct measure of ring/flow behaviour, <xref ref-type="fig" rid="fig9">Figure 9</xref> demonstrates the correlation between ring translational speed when measured from Laser PIV data and from the laser array method explained above. Each datapoint depicts the average of ten generated rings for the configurations listed in <xref ref-type="table" rid="table1"><xref ref-type="table" rid="table">Table </xref>1</xref>.</p><p>Strong linearity is apparent, and error bars represent +/−1SD. The R<sup>2</sup> value for this dataset is 0.977, with a p-value of 2.06 &#215; 10<sup>−2</sup>. When fitted to a linear model, the graph gradient is 1.0205, and the intercept 4.1642, with the near unity gradient confirming the effectiveness of laser measurement to accurately capture ring speed.</p></sec><sec id="s4_3"><title>4.3. Doppler Probe Results (Flow QA)</title><p>The Doppler probe also measures ring/flow behaviour, reporting the CentVect parameter of the steadily propagating ring.</p><p><xref ref-type="fig" rid="fig1">Figure 1</xref>0 demonstrates the strong (and expected) relationship between ring translational speed and CentVect, with both measurements taken using PIV datasets. The R<sup>2</sup> for this correlation is 0.995, and the p-value 1.09 &#215; 10<sup>−5</sup>. When fitted to a linear model, its gradient is 2.54 and its intercept −7 cm/s, indicating an offset between the measurements.</p><p>The complementary data of <xref ref-type="fig" rid="fig1">Figure 1</xref>1 presents the correlation between CentVect values from the PIV datasets and values from the Doppler probe signal</p><p>analysis, producing a gradient of 1.3 and intercept of 51 cm/s. When fitted to a linear model, the R<sup>2</sup> value is 0.98 and the p-value 0.15. Error bars represent +/−1SD for both axes. Results from <xref ref-type="fig" rid="fig1">Figure 1</xref>1 can be used to refine the frequency analysis protocol, to deliver almost perfect correlation.</p></sec></sec><sec id="s5"><title>5. Discussion</title><p>This paper has presented three methods for quality assessing a complex flow phantom for medical imaging, as it operates and in real-time. The method instrumentation exploits (encoder, lasers and Doppler probe) that can collectively provide data consistent with a gold-standard method, such as Laser PIV, confirming satisfactory generation of the ring vortex to within pre-determined tolerances as listed in <xref ref-type="table" rid="table1"><xref ref-type="table" rid="table">Table </xref>1</xref>.</p><p>The instrumentation pack demonstrates its ability to characterise rings, with strong linear correlation to PIV measurements for ring speed. Configurations 1 - 5 (ring speeds 12 - 69 cm/s) report tolerances at &lt;+/−15% from the average, reflecting previous findings from PIV datasets. In addition, piston impulse is observed to vary by &lt;10% across all configurations. <xref ref-type="fig" rid="fig1">Figure 1</xref>0 demonstrates the strong correlation (R<sup>2</sup> = 0.99) between ring speed and CentVect in PIV datasets, indicating the importance of CentVect as a defining ring characteristic and its reliability as a QA parameter. For measurements of CentVect, data analysis is complicated by volumetric acquisition that encompasses rotational core velocities. Nonetheless, suitable analysis demonstrates strong correlation of R<sup>2</sup> = 0.98 across all configurations.</p><p>The addition of instrumentation doesn’t disturb phantom performance, rather it increases confidence and workflow efficiency by assessment of individual rings and drastically reducing post-processing time. Given the novel design of the phantom, this is worth pursuing and could help to ease acceptance in assessing medical imaging technologies.</p></sec><sec id="s6"><title>6. Broader Implications</title><p>Arguably, dynamic phantoms in general should incorporate adequate QA to ensure that their moving parts are functioning to specification. Confidence in the device and its performance can be heightened through varying levels of QA, as is reported in the peer reviewed literature. The most basic level is checking that an actuator/pump/motor is functioning as expected before commencing data collection [<xref ref-type="bibr" rid="scirp.123507-ref25">25</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref26">26</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref27">27</xref>] . An improvement on this is device QA performed in real-time, for instance monitoring motor speed throughout the experiment [<xref ref-type="bibr" rid="scirp.123507-ref28">28</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref29">29</xref>] .</p><p>The desire for real-time flow QA raises some interesting challenges. Pursuit of device QA is relatively straightforward, whereas QA of the flow directly is more difficult, particularly with complex flows. Phantoms in the literature employ reference flows ranging from laminar, parabolic flow to complex profiles incorporating eddies and recirculation zones. Simple flows are famously well-behaved and have been shown to be accurately predicted using analytical [<xref ref-type="bibr" rid="scirp.123507-ref28">28</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref29">29</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref30">30</xref>] or CFD methods [<xref ref-type="bibr" rid="scirp.123507-ref31">31</xref>] [<xref ref-type="bibr" rid="scirp.123507-ref32">32</xref>] . These will rarely deviate from reference behaviour due to tightly constrained and simple geometries, hence non-real-time fluid predictions are sufficient, particularly when combined with real-time motor QA. Occasionally examples are presented in the literature in which real-time flow QA for a simple flow is performed [<xref ref-type="bibr" rid="scirp.123507-ref33">33</xref>] , but this is rare and a more frequent approach is analytical or numerical predictions, or on occasion no flow QA at all [<xref ref-type="bibr" rid="scirp.123507-ref34">34</xref>] . <sup> </sup></p><p>Increasing the flow complexity improves physiological relevance, however the transition to disturbed flow introduces uncertainty about the intricacies of flow behaviour. Accurate analytical formulations often don’t exist for such flows, and CFD simulations can be prone to errors, thus visualisation is a necessity. Often QA at this level is impractical/impossible for real-time use, because the images from scanners and the QA (e.g. PIV) of the flow can’t be obtained simultaneously. Pre-collected visualisation datasets must therefore be trusted as the “ground truth” for the flow field which, as flows increase in complexity, is in danger of becoming an invalid assumption, since complex flow behaviour is rarely predictable.</p><p>Application of pre-collected visualisation data is reported in Bock et al. [<xref ref-type="bibr" rid="scirp.123507-ref35">35</xref>] , whilst Meagher et al. [<xref ref-type="bibr" rid="scirp.123507-ref36">36</xref>] demonstrate an interesting approach by imaging identical phantoms simultaneously. There is no evidence of both real-time device and real-time flow QA beyond Vali, [<xref ref-type="bibr" rid="scirp.123507-ref28">28</xref>] Durand [<xref ref-type="bibr" rid="scirp.123507-ref29">29</xref>] and Tuncay [<xref ref-type="bibr" rid="scirp.123507-ref37">37</xref>] , whose phantoms exhibit fairly simple flow profiles. This forms part of a trend presented in <xref ref-type="fig" rid="fig1">Figure 1</xref>2 and <xref ref-type="fig" rid="fig1">Figure 1</xref>3 below, which is that the more complex the flow, the less confidence is achieved through real-time flow QA. Phantoms suitable for a variety of modalities and applications are included in this review and</p><p>QA protocol is judged for measures used in regular use, not for a one-off validation exercise.</p><p>The aspirational QA standard for a dynamic, complex flow phantom would entail real-time device QA and flow QA. This would ordinarily be difficult, due to complex flow unpredictability and inability to produce analytical or numerical predictions. The ring vortex, however, is a complex flow that exhibits consistent behaviour and can be characterised using clear, measurable properties. Measurements collected in this paper and in previous work [<xref ref-type="bibr" rid="scirp.123507-ref4">4</xref>] demonstrate how well behaved the flow is, and the consistency of the device. Any abnormality in function is immediately apparent and in such cases, the ring vortex can be excluded from contributing to the flow imaging QA. <xref ref-type="fig" rid="fig1">Figure 1</xref>2 and <xref ref-type="fig" rid="fig1">Figure 1</xref>3 clarify that this is currently unique in respect of other phantoms in the literature.</p><p>In the event of a malfunction, the instrumentation pack would allow for immediate response. For example, if an incorrect setting is selected by the user resulting in a ring propagating at 70% of its desired speed, both the impulse and ring speed measurements would be below tolerances, resulting in “red” output on the user interface indicators (<xref ref-type="fig" rid="fig6">Figure 6</xref>). This would impact the CentVect value also, and the user would immediately discount the vortex and troubleshoot the problem.</p><p>Whilst each component produces meaningful information regarding the phantom and its flow, the pack as a whole (encoder, laser, probe) would be required only for specific circumstances, such as research work and assessing new technologies. A reduced requirement based on the encoder alone would suffice for regular clinical use on established technologies. This would be complemented by regular calibration to deliver consistent performance and promote user confidence.</p></sec><sec id="s7"><title>7. Conclusion</title><p>A novel approach to QA diagnostic flow imaging is described, incorporating real-time QA of the ring vortex flow phantom, with broader implications for complex flow phantoms. This relies on assessment of device and flow behaviour during operation, which in our case has involved three components—linear encoder (device QA), laser array (flow QA) and Doppler probe (flow QA). Together these were used to measure piston impulse, ring speed and an aspect of ring micro-flow respectively. Strong correlation was observed between reference measurements from all three methods and the Laser PIV measurements, confirming reproducibility of phantom flows within tolerances of +/−10% for rings of speeds 12 - 69 cm/s. These techniques increase confidence in phantom operation, offering a means for assessing high-resolution vector maps provided by techniques such as 4D MRI and VFI.</p></sec><sec id="s8"><title>Acknowledgements</title><p>This work was funded by EPSRC under Grant Code 2278818. The ring vortex phantom has been manufactured using the facilities of Leeds Test Objects.</p></sec><sec id="s9"><title>Conflicts of Interest</title><p>The authors report there are no competing interests to declare.</p></sec><sec id="s10"><title>Cite this paper</title><p>Matthews, A.S., Simatwo, K., Narracott, A., Ambrogio, S., Walker, A. and Fenner, J.W. (2023) Quality Assuring a Ring Vortex Flow Phantom in Real-Time. Open Journal of Medical Imaging, 13, 11-29. https://doi.org/10.4236/ojmi.2023.131002</p></sec><sec id="s11"><title>Appendix</title><p>Derivation of Impulse delivered by piston:</p><p>T—Piston Pulse Time Duration</p><p>R<sub>0</sub>—Piston Radius</p><p>L—Piston Displacement</p><p>r—Orifice Radius</p><p>ρ—Density of water</p><p>Fluid Slug Volume = V = π R 0 2 L</p><p>Jet Length = L s = V π r 2 = R 0 2 L r 2</p><p>Jet Speed = S = L s T = R 0 2 L r 2 T</p><p>Jet Energy = E = 1 2 m v 2 = 1 2 ρ V S 2 = 1 2 R 0 6 L 3 ρ π r 4 T 2 <sub> </sub></p><p>Force of Jet = Energy/Distance = E L s = 1 2 R 0 6 L 3 ρ π r 2 r 4 T 2 R 0 2 L <sub> </sub></p><p>Jet Impulse = Force * Time = 1 2 R 0 4 L 2 ρ π r 2 T</p></sec></body><back><ref-list><title>References</title><ref id="scirp.123507-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Azarine, A., Gar&amp;#231;on, P., Stansal, A., et al. (2019) Four-Dimensional Flow MRI: Principles and Cardiovascular Applications. RadioGraphics, 39, 632-648. https://doi.org/10.1148/rg.2019180091</mixed-citation></ref><ref id="scirp.123507-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Brandt, A.H., Olesen, J.B., Moshavegh, R., et al. (2021) Common Carotid Artery Volume Flow: A Comparison Study between Ultrasound Vector Flow Imaging and Phase Contrast Magnetic Resonance Imaging. Neurology International, 13, 269-278. https://doi.org/10.3390/neurolint13030028</mixed-citation></ref><ref id="scirp.123507-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Goddi, A., Bortolotto, C., Fiorina, I., et al. (2017) High-Frame Rate Vector Flow Imaging of the Carotid Bifurcation. Insights into Imaging, 8, 319-328. https://doi.org/10.1007/s13244-017-0554-5</mixed-citation></ref><ref id="scirp.123507-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Ambrogio, S., Walker, A., Narracott, A., et al. (2019) A Complex Flow Phantom for Medical Imaging: Ring Vortex Phantom Design and Technical Specification. Journal of Medical Engineering &amp; Technology, 43, 190-201. https://doi.org/10.1080/03091902.2019.1640309</mixed-citation></ref><ref id="scirp.123507-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Ferrari, S., Ambrogio, S., Walker, A., et al. (2017) The Ring Vortex: Concepts for a Novel Complex Flow Phantom for Medical Imaging. Open Journal of Medical Imaging, 7, 28-41. https://doi.org/10.4236/ojmi.2017.71004</mixed-citation></ref><ref id="scirp.123507-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Arvidsson, P., Kovács, S., T&amp;#246;ger, J., et al. (2016) Vortex Ring Behavior Provides the Epigenetic Blueprint for the Human Heart. Scientific Reports, 6, Article No. 22021. https://doi.org/10.1038/srep22021</mixed-citation></ref><ref id="scirp.123507-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Didden, N. (1979) On the Formation of Vortex Rings: Rolling-Up and Production of Circulation. Journal of Applied Mathematics and Physics (ZAMP), 30, 101-116. https://doi.org/10.1007/BF01597484</mixed-citation></ref><ref id="scirp.123507-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Maxworthy, T. (1977) Some Experimental Studies of Vortex Rings. Journal of Fluid Mechanics, 81, 465-495. https://doi.org/10.1017/S0022112077002171</mixed-citation></ref><ref id="scirp.123507-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Lim, T.T. (1989) An Experimental Study of a Vortex Ring Interacting with an Inclined Wall. Experiments in Fluids, 7, 453-463. https://doi.org/10.1007/BF00187063</mixed-citation></ref><ref id="scirp.123507-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Naitoh, T. (2002) Experimental Study of Axial Flow in a Vortex Ring. Physics of Fluids, 14, 143. https://doi.org/10.1063/1.1420745</mixed-citation></ref><ref id="scirp.123507-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Widnall, S.E., Sullivan, J.P. (1973) On the Stability of Vortex Rings. Proceedings of the Royal Society of London A, 332, 335-353. https://doi.org/10.1098/rspa.1973.0029</mixed-citation></ref><ref id="scirp.123507-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Glezer, A. and Coles, D. (1990) An Experimental Study of a Turbulent Vortex Ring. Journal of Fluid Mechanics, 211, 243-283. https://doi.org/10.1017/S0022112090001562</mixed-citation></ref><ref id="scirp.123507-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Saga, T., Hu, H., Kobayashi, T., et al. (2002) A Comparative Study of the PIV and LDV Measurements on a Self-Induced Sloshing Flow. Journal of Visualization, 3, 145-156. https://doi.org/10.1007/BF03182407</mixed-citation></ref><ref id="scirp.123507-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Arakeri, J.H., Das, D., Krothapalli, A., et al. (2004) Vortex Ring Formation at the Open End of a Shock Tube: A Particle Image Velocimetry Study. Physics of Fluids, 16, 1008. https://doi.org/10.1063/1.1649339</mixed-citation></ref><ref id="scirp.123507-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Olcay, A.B. and Krueger, P.S. (2008) Measurement of Ambient Fluid Entrainment during Laminar Vortex Ring Formation. Experiments in Fluids, 44, 235-247. https://doi.org/10.1007/s00348-007-0397-9</mixed-citation></ref><ref id="scirp.123507-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Wang, X.K., Su, B.Y., Li, Y.L., et al. (2019) Vortex Formation and Evolution Process in an Impulsively Starting Jet from Long Pipe. Ocean Engineering, 176, 134-143. https://doi.org/10.1016/j.oceaneng.2019.02.041</mixed-citation></ref><ref id="scirp.123507-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Weigand, A. and Gharib, M. (1997) On the Evolution of Laminar Vortex Rings. Experiments in Fluids, 22, 447-457. https://doi.org/10.1007/s003480050071</mixed-citation></ref><ref id="scirp.123507-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Murugan, T., De, S., Dora, C.L., et al. (2012) Numerical Simulation and PIV Study of Compressible Vortex Ring Evolution. Shock Waves, 22, 69-83. https://doi.org/10.1007/s00193-011-0344-9</mixed-citation></ref><ref id="scirp.123507-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Ma, X., Tang, Z. and Jiang, N. (2020) Visualization of Lagrangian Fluid Transport of a Vortex Ring Based on Time-Resolved PIV. Journal of Visualization, 23, 559-564. https://doi.org/10.1007/s12650-020-00650-1</mixed-citation></ref><ref id="scirp.123507-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Sun, Z.Z. and Brücker, C. (2017) Investigation of the Vortex Ring Transition Using Scanning Tomo-PIV. Experiments in Fluids, 58, Article No. 36. https://doi.org/10.1007/s00348-017-2322-1</mixed-citation></ref><ref id="scirp.123507-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Fernandez, J.J.P. and Sesterhenn, J. (2019) Axial and Radial Dynamics of Compressible Vortex Rings. European Journal of Mechanics-B/Fluids, 76, 303-315. https://doi.org/10.1016/j.euromechflu.2019.03.007</mixed-citation></ref><ref id="scirp.123507-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Sahn, D.J. and Yoganathan, A.P. (1989) Seminar on in Vitro Studies of Cardiac Flow and Their Applications for Clinical Doppler Echocardiography—IV. JACC, 12, 1343-1376.</mixed-citation></ref><ref id="scirp.123507-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Herr, M.D., Hogeman, C.S., Koch, D.W., et al. (2010) A Real-Time Device for Converting Doppler Ultrasound Audio Signals into Fluid Flow Velocity. American Journal of Physiology Heart and Circulatory Physiology, 298, 1626-1632. https://doi.org/10.1152/ajpheart.00713.2009</mixed-citation></ref><ref id="scirp.123507-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Li, Y.L., Hyun, D., Abou-Elkacem, L., Willmann, J.K., et al. (2016) Visualisation of Small-Diameter Vessels by Reduction of Incoherent Reverberation with Coherence Flow Power Doppler. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 63, 1878-1889. https://doi.org/10.1109/TUFFC.2016.2616112</mixed-citation></ref><ref id="scirp.123507-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Ebel, S., Hübner, L., K&amp;#246;hler, B., et al. (2019) Validation of Two Accelerated 4D Flow Mri Sequences at 3T: A Phantom Study. European Radiology Experimental, 3, Article No. 10. https://doi.org/10.1186/s41747-019-0089-2</mixed-citation></ref><ref id="scirp.123507-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Lai, S.S., Yiu, B.Y., Poon, A.K., et al. (2013) Design of Anthropomorphic Flow Phantoms Based on Rapid Prototyping of Compliant Vessel Geometries. Ultrasound in Medicine and Biology, 39, 1654-1664. https://doi.org/10.1016/j.ultrasmedbio.2013.03.015</mixed-citation></ref><ref id="scirp.123507-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Raine-Fenning, N.J., Nordin, N.M., Ramnarine, K.V., et al. (2008) Determining the Relationship between Three-Dimensional Power Doppler Data and True Blood Flow Characteristics: An In-Vitro Flow Phantom Experiment. Ultrasound in Obstetrics &amp; Gynecology, 32, 540-550. https://doi.org/10.1002/uog.6110</mixed-citation></ref><ref id="scirp.123507-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Vali, A., Schmitter, S., Ma, L., et al. (2020) Development of a Rotation Phantom for Phase Contrast MRI Sequence Validation and Quality Control. Magnetic Resonance in Medicine, 84, 3333-3341. https://doi.org/10.1002/mrm.28343</mixed-citation></ref><ref id="scirp.123507-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Durand, E.P., Jolivet, O., Itti, E., et al. (2001) Precision of Magnetic Resonance Velocity and Acceleration Measurements: Theoretical Issues and Phantom Experiments. Journal of Magnetic Resonance Imaging, 13, 445-451. https://doi.org/10.1002/jmri.1064</mixed-citation></ref><ref id="scirp.123507-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Nordell, B., St&amp;#229;hlberg, F., Ericsson, A., et al. (1988) A Rotating Phantom for the Study of Flow Effects in MR Imaging. Magnetic Resonance Imaging, 6, 695-705. https://doi.org/10.1016/0730-725X(88)90094-X</mixed-citation></ref><ref id="scirp.123507-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Yiu, B.Y.S. and Yu, A.C.H. (2017) Spiral Flow Phantom for Ultrasound Flow Imaging Experimentation. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 64, 1840-1848. https://doi.org/10.1109/TUFFC.2017.2762860</mixed-citation></ref><ref id="scirp.123507-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Chee, A.J.Y., Ishii, T., Yiu, B.Y.S., et al. (2021) Helical Toroid Phantom for 3D Flow Imaging Investigations. Physics in Medicine &amp; Biology, 66. 045029. https://doi.org/10.1088/1361-6560/abda99</mixed-citation></ref><ref id="scirp.123507-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Kenwright, D.A., Laverick, N., Anderson, T., et al. (2015) Wall-Less Flow Phantom for High-Frequency Ultrasound Applications. Ultrasound in Medicine and Biology, 41, 890-897. https://doi.org/10.1016/j.ultrasmedbio.2014.09.018</mixed-citation></ref><ref id="scirp.123507-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Zhou, X.W., Kenwright, D.A., Wang, S., et al. (2017) Fabrication of Two Flow Phantoms for Doppler Ultrasound Imaging. IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 64, 53-65. https://doi.org/10.1109/TUFFC.2016.2634919</mixed-citation></ref><ref id="scirp.123507-ref35"><label>35</label><mixed-citation publication-type="other" xlink:type="simple">Bock, J., T&amp;#246;ger, J., Bidhult, S., et al. (2019) Validation and Reproducibility of Cardiovascular 4D-Flow MRI from Two Vendors Using 2 × 2 Parallel Imaging Acceleration in Pulsatile Flow Phantom and in vivo with and without Respiratory Gating. Acta Radiologica, 60, 327-337. https://doi.org/10.1177/0284185118784981</mixed-citation></ref><ref id="scirp.123507-ref36"><label>36</label><mixed-citation publication-type="other" xlink:type="simple">Meagher, S., Poepping, T.L., Ramnarine, K.V., et al. (2007) Anatomical Flow Phantoms of the Nonplanar Carotid Bifurcation, Part II: Experimental Validation with Doppler Ultrasound. Ultrasound in Medicine and Biology, 33, 303-310. https://doi.org/10.1016/j.ultrasmedbio.2006.08.004</mixed-citation></ref><ref id="scirp.123507-ref37"><label>37</label><mixed-citation publication-type="other" xlink:type="simple">Tuncay, V., Zijlstra, J., Oudkerk, M., et al. (2020) Design, Implementation, and Validation of a Pulsatile Heart Phantom Pump. Journal of Digital Imaging, 33, 1301-1305. https://doi.org/10.1007/s10278-020-00375-5</mixed-citation></ref></ref-list></back></article>