Primary hyperthyroidism (PHPT) is characterized by unregulated excessive secretion of parathyroid hormone (PTH) resulting in hypercalcemia, most often due to a single parathyroid adenoma (85%), and less frequently by multiple adenomas/hyperplasia (10% - 15%) and carcinomas (<1%) . Secondary hyperparathyroidism (SHPT) occurs when the parathyroid glands are stimulated by chronic hypocalcemia, usually in the setting of chronic renal failure . Parathyroidectomy is the only curative treatment for symptomatic PHPT  and medically refractory SHPT . Historically, this was carried out through bilateral neck exploration to identify the hyperfunctioning lesions. Although effective from a therapeutic standpoint, this technique is associated with higher rates of complications compared to focused surgical approaches .
In an effort to decrease the rates of complications as well as the length of hospital stays and medical costs, less invasive surgical procedures have been developed. Directed parathyroidectomy is one such technique, which is frequently combined with pre-operative and intra-operative localization of parathyroid lesions and intra-operative parathyroid hormone (PTH) levels . A serial decrease in PTH levels over 50% and eucalcemia at six months after parathyroidectomy are diagnostic for cure . Imaging modalities traditionally used for preoperative localization include technetium-99 m labeled sestamibi-SPECT (MIBI) and ultrasound (US). Although both modalities exhibit good specificity, they have relatively low sensitivity for lesion detection especially in multigland disease . Ultrasound is further limited in its ability to assess mediastinal lesions and is highly operator-dependent, while sestamibi-SPECT is limited by spatial resolution and variabilities in imaging techniques .
Interest in new imaging techniques that offer increased anatomic coverage as well as improved spatial resolution has led to the development of 4D-CT. This dynamic multiphase CT imaging technique is based on the principle of altered attenuation of parathyroid lesions (adenoma(s) and hyperplasia) during noncontrast, arterial and venous phases . In theory, 4D-CT may provide precise localization of lesions allowing for minimally invasive surgery, detect ectopic lesions (such as mediastinal lesions) that may alter the surgical approach, and also enhance the evaluation of nearby structures (such as thyroid glands) for preoperative planning . Multiple previous studies have shown a high accuracy of 4D-CT in localizing abnormal glands up to 93.7%  with a sensitivity of 89% and a positive predictive value up to 93.5% .
Our goal is to evaluate the diagnostic accuracy and inter-observer agreement of 4D CT parathyroid scan in preoperative localization of parathyroid lesions in patients with primary and secondary hyperparathyroidism.
2. Materials and Methods
This Institutional Review Board-approved retrospective study was performed with a waiver of informed consents in accordance with the Health Insurance Portability and Accountability Act. Inclusion criteria were patients with biochemically confirmed primary and secondary hyperparathyroidism without previous neck surgeries, had preoperative 4D-CT parathyroid scans performed between June 2011 to September 2017, parathyroidectomy, and pathologically confirmed parathyroid adenoma(s) or hyperplasia. A decrease of intra-operative PTH (IOPTH) > 50% from the baseline and eucalcemia at six months after parathyroidectomy confirm cure status . A total of 67 patients met inclusion criteria (50 women, 17 men; mean age, 55 years; age range, 31 - 74 years).
2.2. 4D-CT Parathyroid Scan
Patients were imaged in the supine position with head first, arms down using a 64-slice CT scanner (Philips, Brilliance 128 slice scanner). The scanning parameters were as follows: field of view covered from the mandibular angle to the tracheal bifurcation parallel to the hard palate, 140 kVp, mA adjusted by automatic exposure control (AEC) with a range of 180 - 280 mA, 1.25 mm slice thickness (reconstructed into 1-mm), 0.4 second rotation time, 3.1 sec scan time, and a pitch of 1.265. Dynamic three phases included precontrast, immediate or arterial (25 seconds) and venous phases (85 seconds) after intravenous administration of 100 - 120 ml of iodinated contrast material (Omnipaque 300; GE Healthcare Inc., Princeton, NJ), rate 4 ml per second, followed by 25 ml of saline chaser, via 18 gauge needles placed at the antecubital fossa. All phases were performed with breath holding techniques to reduce motion artifacts. Axial, coronal and sagittal 1-mm reformations were generated and sent to PACS for interpretation.
2.3. Image Interpretation and Analysis
4D-CT studies were retrospectively reviewed independently by three neuroradiologists (B.T., W.B.A., and A.C. with 7, 5 and 4 years of neuroradiology experience; B.T. and W.B.A. have Certificates of Added Qualification). The readers were aware that the cases had clinical HPT but were blinded to the final lesion location and pathology results. If there were discrepancies among the readers, the final read was determined by consensus. The following data was recorded: presence or absence of parathyroid lesion, location (right, left, upper pole, and lower pole relative to the thyroid glands, or ectopic locations), size, fat plane between the lesions and the thyroid gland, and density (Housefield unit) of the candidate lesions relative to the thyroid gland. Positive findings for parathyroid adenomas/hyperplasia are soft tissue masses that are intrinsically hypodense compared to the thyroid, intense enhancement on arterial phase, and washout on venous phase. Lesions were classified as lymph nodes if they show progressive enhancement, or thyroid nodules if they were isodense to thyroid and adhered to the thyroid glands. If streak artifacts from the intravenous contrast compromised visualization of the lesions, and falsely decreased the density of the lesion in the arterial phase, the lesions were carefully inspected on noncontrast and venous phases.
2.4. Statistical Analysis
Performance of 4D-CT was evaluated based on the determination of the presence of the parathyroid lesions, laterality (right or left), and quadrant (right superior, right inferior, left superior and left inferior) with respect to the operative and histological findings.
2.4.1. Lateralization Analysis
The performance of 4D-CT in the localization of the lesion to the right or left side of the neck was evaluated. If the lesion on 4D-CT was found to be ipsilateral to the surgical finding, the 4D-CT result was considered as a true positive on that side and true negative on the contralateral side. On the other hand, if the surgical and imaging findings were incongruent, the 4-D CT finding was considered as false positive on that side and false negative on the other. If the lesions are bilateral but the 4-D CT localized the lesion to only one side, the 4-D CT result was considered true positive on that side and false negative on the other. If there was only one lesion but 4-D CT finding was bilateral, the 4-D CT result was considered true positive on the side of the actual lesion and false positive on the other.
2.4.2. Quadrant Localization Analysis
The performance of 4-D CT in the localization of the lesion to the level of the quadrant (right upper, right lower, left upper and left lower quadrant) was analyzed in a similar fashion as lateralization.
Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), accuracy and 95% confidence interval were calculated by utilizing Excel 2010 (Microsoft, Redmond, Wash). The causes of all false negative or false positive results were determined (patient factors, technical factors or lesion factors). Fleiss’ kappa was used to assess the inter-observer agreement.
Demographic information of the 67 patients included in the studies is shown in Table 1. Sixty-two patients (93%) had single-gland adenomas. Of the five patients (7%) with multiple-gland lesions, four had double adenomas, and one had 4-gland hyperplasia. Diagnostic performance of 4D-CT in lesion lateralization and quadrant determination is shown in Table 2. The sensitivity, specificity, PPV, NPV and accuracy are 85%, 97%, 96%, 87% and 91% for lateralization and 76%, 96%, 85%, 92% and 90% for quadrant localization, respectively in single-gland disease. The sensitivity, specificity, PPV, NPV and accuracy are 88%, 100%, 100%, 50% and 90% for lateralization and 71%, 100%, 100%, 60% and 80% for quadrant localization respectively in multiple-gland disease. The three neuroradiologists reached moderate inter-observer agreement with an overall
Table 1. Patient, lesion and laboratory data.
Table 2. Diagnostic performance analysis.
TP true positive, TN true negative, FP false positive, FN false negative, CI confidence interval, PPV positive predictive value, NPV negative predictive value.
Fleiss’ kappa of 0.56. False positive and false negative findings occurred in 17 patients (25.3%) and 19 lesions (25%). Multiple factors were responsible for the misinterpretation of the 4D-CT imaging. These factors may be classified into lesion, patient, and technical factors, and more than one factor as shown in Table 3. Patient factors include large body habitus (29% of the patients, 26% of the lesions) and motion artifact (5% of the patients, 5% of the lesions). Technical factors include suboptimal bolus injection (18% of patients, 16% of lesions) and streak artifact (18% of patients, 16% of lesions). Major lesion factors are small lesions (24% of patients, 32% of lesions) and lack of fat planes between the lesions and the thyroid gland (29% of patients, 37% of lesions).
Parathyroidectomy is the only curative treatment for PHPT and medically intractable SHPT with a greater than 95% success rate when performed by experienced surgeons . Historically, bilateral neck exploration (BNE) was performed to remove the culprit hyperfunctioning parathyroid glands . With current intraoperative PTH measurements and preoperative localizing 4D-CT parathyroid scans, surgeons can now perform minimally invasive parathyroidectomy (MIP) focusing on only one quadrant of the neck or even specific locations. Although the success rate of BNE and MIP is equivalent, the operative time, hospital stay, operative pain, and complication rates is significantly less for MIP .
Multiple studies have shown that the 4D-CT has high sensitivity (77% - 92%; 85% our study) and accuracy (80% - 97%; 91% our study) in lateralizing single gland lesions     . The diagnostic performance is slightly lower for precisely localizing a single lesion to a quadrant, with a sensitivity and accuracy of 57% - 98% (76% our study) and 79% - 92% (90% our study), respectively. Compared to single-gland localization, the diagnostic performance for lateralizing and localizing multiple gland lesions is lower. Chazen and Galvin et al. reported overall sensitivity and accuracy of 43% - 53% (71% - 88% our study) and 89% (80% - 90% our study), respectively  .
Table 3. Factors causing 4D CT misinterpretation.
Multiple challenging factors potentially limit the diagnostic performance of 4D-CT which may be classified into three main categories: patient, technique and lesion factors. More than one factor could be responsible for incorrect lesion localization. Large body habitus may result in beam hardening artifact and increased image noise making separation of the lesion from the adjacent normal structures difficult. The lesion would also appear to enhance less than usual. Increasing tube current (mAs) and decreasing rotation speed will decrease image noise at the expense of increased radiation . For patients with thick shoulders, we request the individual to relax and position their shoulders downwards while placing towels between the scapulae as suggested by Hoang et al. . Motion artifact is common in daily practice but contributed to only 5% of missed lesions in our study. This may be addressed by coaching the patient for breath holding/quiet breathing and abstaining from swallowing during scanning.
Sixteen percent of missed lesions were due to suboptimal opacification during the arterial and venous phases. This may be attributed to incorrect placement of the region of interest, small intravenous access cannula (22 G), and low rate of injection (less than 3 ml/sec) which lead to suboptimal enhancement of the lesions. Solutions are to correctly identify the location of the region of interest (aorta) as well as using appropriate cannula size (18 - 20 G) and appropriate rate of injection (5 ml/sec).
Streak artifact from the presence of intravenous iodinated contrast in the subclavian vein, brachiocephalic vein, and superior vena cava during arterial phase also limits visualization of lesions (Figure 1), falsely decreasing the density of arterially enhancing lesions. Two lesions in our study were missed due to such streaking artifact from the intravenous contrast. The saline chasing technique has been proposed to address this pitfall and can be performed by injecting 25 ml of normal saline after intravenous contrast injection  . One lesion was obscured by streak artifact from metallic plates and screws (previous anterior cervical discectomy and fixation). In this scenario, patients with metallic prosthesis in the lower neck may benefit from ultrasound and Tc-99 m Sestamibi.
The multigland disease has been found to be a significant lesion factor that decreases the diagnostic performance of 4D-CT   . As such, we suggest that if one lesion is found, the radiologist should continue to search for other
Figure 1. Beam hardening artifact limits adenoma detection on arterial phase. Axial noncontrast (A), arterial (B), and venous (C) CT images showed beam hardening artifact from the IV contrast obscuring the right superior mediastinal adenoma (arrow). The classic intense arterial enhancement of the lesion is not demonstrated due to the artifact.
Figure 2. Zuckerkandl tubercle. The normal thyroid gland protruded at the posterolateral aspect (arrow) mimics a parathyroid lesion.
lesions especially in cases of SHPT. Although the small size of the glands is known to be a lesion factor, 4D-CT is less affected than Tc-99 m Sestamibi due to higher intrinsic special resolution .
The most common pitfalls (37%) in our study were lesions that adhered to the posterior capsule of the thyroid (i.e., lack of fat plane between the lesions and the thyroid gland), especially for small lesions that were isodense to the thyroid in all phases. The classic enhancement pattern of parathyroid adenoma/hyperplasia is an avid enhancement on arterial phase followed by contrast wash out on the venous phase. Two lesions were misinterpreted as lymph nodes due to minimal enhancement on the arterial phase and progressive enhancement on the venous phase. Hypodense pedunculated thyroid nodules may simulate parathyroid lesions which accounted for two false positive findings in our cohort.
Zuckerkandl tubercles are protuberances at the posterolateral aspect of a normal thyroid gland that can potentially mimic a parathyroid lesion (Figure 2) . These are isodense to the thyroid gland on all phases. Typically, parathyroid lesions are posterior to the thyroid glands; however, ectopic or unusual locations (6% - 16%) are challenging to detect. These include but are not limited to the following locations: immediately inferior or lateral to the thyroid glands, mediastinum, retropharyngeal space, retroesophageal space, paraesophageal space, carotid space, tracheoesophageal groove, thyroid gland, thymus, and submandibular gland .
Our study has some limitations. The radiologists realized that all cases were proven to have positive surgical and pathological findings, and therefore they would try their best to select the location of the lesions rather than providing negative results. Including studies with negative findings would decrease this bias. We did not re-image studies that had artifacts―in so doing, we believe this provided a more realistic situation where radiologists have to make a final decision even when there may be pronounced artifacts. Finally, the number of cases with multigland diseases was relatively small and may not represent the true performance of 4D-CT across all practice setting.
4D CT parathyroid is a highly accurate imaging method that can facilitate minimally invasive parathyroidectomy in cases of hyperparathyroidism. Improvements in diagnostic performance could be realized through optimization of imaging techniques and familiarity with potential pitfalls.
 Chen, J. and Wang, J.D. (2014) Radioguided Parathyroidectomy in Patients with Secondary Hyperparathyroidism Due to Chronic Renal Failure. Nuclear Medicine Communications, 35, 391-397.
 Cappello, Z.J. and Bumpous, J.M. (2013) Is Bilateral Exploration Still the Standard of Care for Primary Hyperparathyroidism? Outcomes of Focused Radio-Guided Parathyroidectomy and Bilateral Explorations. The Laryngoscope, 123, 2587-2588.
 Sosa, J.A. and Udelsman, R. (2003) New Directions in the Treatment of Patients with Primary Hyperparathyroidism. Current Problems in Surgery, 40, 812-849.
 Lee, S., Ryu, H., Morris, L.F., Lee, S., Ryu, H., Morris, L.F., Grubbs, E.G., Lee, J.E., et al. (2014) Operative Failure in Minimally Invasive Parathyroidectomy Utilizing an Intraoperative Parathyroid Hormone Assay. Annals of Surgical Oncology, 21, 1878-1883.
 Cheung, K., Wang, T.S., Farrokhyar, F., Roman, S.A. and Sosa, J.A. (20212) A Meta-Analysis of Preoperative Localization Techniques for Patients with Primary Hyperparathyroidism. Annals of Surgical Oncology, 19, 577-583.
 Krakauer, M., Wieslander, B., Myschetzky, P.S., Lundstrøm, A., Bacher, T., Sørensen, C.H., et al. (2016) A Prospective Comparative Study of Parathyroid Dual-Phase Scintigraphy, Dual-Isotope Subtraction Scintigraphy, 4D-CT, and Ultrasonography in Primary Hyperparathyroidism. Clinical Nuclear Medicine, 41, 93-100.
 Mallette, L.E., Gomez, L. and Fisher, R.G. (1981) Parathyroid Angiography: A Review of Current Knowledge and Guidelines for Clinical Application. Endocrine Reviews, 2, 124-135.
 Hunter, G.J., Schellingerhout, D., Vu, T.H., Perrier, N.D. and Hamberg, L.M. (2012) Accuracy of Four-Dimensional CT for the Localization of Abnormal Parathyroid Glands in Patients with Primary Hyperparathyroidism. Radiology, 264, 789-795.
 Laird, A.M. and Libutti, S.K. (20016) Minimally Invasive Parathyroidectomy versus Bilateral Neck Exploration for Primary Hyperparathyroidism. Surgical Oncologyclinics of North America, 25, 103-118.
 Chazen, J.L., Gupta, A., Dunning, A. and Phillips, C.D. (2012) Diagnostic Accuracy of 4D-CT for Parathyroid Adenomas and Hyperplasia. American Journal of Neuroradiology, 33, 429-433.
 Campbell, M.J., Sicuro, P., Blackmore, C.C. and Ryan Jr., J.A. (2015) Two-Phase (Low-Dose) Computed Tomography Is as Effective as 4D-CT for Identifying Enlarged Parathyroid Glands. International Journal of Surgery. 14, 80-84.
 Rodgers, S.E., Hunter, G.J., Hamberg, L.M., Schellingerhout, D., Doherty, D.B. and Ayers, G.D. (2006) Improved Preoperative Planning for Directed Parathyroidectomy with 4-Dimensional Computed Tomography. Surgery, 140, 932-940.
 Mortenson, M.M., Evans, D.B., Lee, J.E., Hunter, G.J., Shellingerhout, D., Vu, T., et al. (2008) Parathyroid Exploration in the Reoperative Neck: Improved Preoperative Localization with 4D-Computed Tomography. Journal of the American College of Surgeons, 206, 888-895.
 Galvin, L., Oldan, J.D., Bahl, M., Eastwood, J.D., Eastwood, J.D., Sosa, J.A. and Hoang, J.K. (2016) Parathyroid 4D CT and Scintigraphy: What Factors Contribute to Missed Parathyroid Lesions? Otolaryngology—Head and Neck Surgery, 154, 847-853.
 Hoang, J.K., Sung, W.K., Bahl, M. and Phillips, C.D. (2014) How to Perform Parathyroid 4D CT: Tips and Traps for Technique and Interpretation. Radiology, 270, 15-24.
 Lubitz, C.C., Hunter, G.J., Hamberg, L.M., Parangi, S., Ruan, D., Gawande, A., et al. (2010) Accuracy of 4-Dimensional Computed Tomography in Poorly Localized Patients with Primary Hyperparathyroidism. Surgery, 148, 1129-1137.
 Lee, T.C., Selvarajan, S.K., Curtin, H. and Mukundan, S. (2012) Zuckerkandl Tubercle of the Thyroid: A Common Imaging Finding That May Mimic Pathology. American Journal of Neuroradiology, 33, 1134-1138.