Research Paper Volume 12, Issue 16 pp 16357—16367
Association between Nrf2 and CDKN2A expression in patients with end-stage renal disease: a pilot study
- 1 Division of Nephrology, Department of Medicine, University of Tennessee Health Science Center, Memphis, TN 38163, USA
- 2 Institute for Health Outcomes and Policy, College of Graduate Health Sciences, University of Tennessee Health Science Center, Memphis, TN 38163, USA
- 3 Nephrology Section, Memphis VA Medical Center, Memphis, TN 38104, USA
Received: May 13, 2020 Accepted: June 29, 2020 Published: July 13, 2020
https://doi.org/10.18632/aging.103685How to Cite
Copyright © 2020 Sumida et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY 3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Abstract
Patients with end-stage renal disease (ESRD) display phenotypic features of premature biological aging, characterized by disproportionately high morbidity and mortality at a younger age. Nuclear factor erythroid 2-related factor 2 (Nrf2) activity, a master regulator of antioxidative responses, declines with age and is implicated in the pathogenesis of age-related disorders; however, little is known about the association between Nrf2 and premature biological aging in ESRD patients. In a cross-sectional pilot cohort of 34 ESRD patients receiving maintenance hemodialysis, we measured the expression of Nrf2 and cyclin-dependent kinase inhibitor 2A (CDKN2A, or p16INK4a, a biomarker of biological aging) genes in whole blood and examined the association of Nrf2 with CDKN2A expression, using Spearman’s rank correlation and multivariable linear regression models with adjustment for potential confounders. There was a significant negative correlation between Nrf2 and CDKN2A expression (rho=-0.51, P=0.002); while no significant correlation was found between Nrf2 expression and chronological age (rho=-0.02, P=0.91). After multivariable adjustment, Nrf2 expression remained significantly and negatively associated with CDKN2A expression (β coefficient=-1.51, P=0.01), independent of chronological age, gender, race, and diabetes status. These findings suggest a potential contribution of Nrf2 dysfunction to the development of premature biological aging and its related morbidities in ESRD patients.
Introduction
End-stage renal disease (ESRD) is a condition characterized by a disproportionately high risk of morbidity and mortality, which is almost exclusively seen at a much younger age [1, 2]. This distinct nature of ESRD closely resembles the phenotypic features of premature biological aging, which, in contrast to chronological aging, is characterized by progressive loss of physical and neurological functions, energy balance, and homeostatic mechanisms, often in combination with various organ disorders such as muscle wasting, osteoporosis, vascular calcification, and cardiovascular disease (CVD) [3, 4]. Increased oxidative stress and persistent systemic inflammation induced by several ESRD-related factors (e.g., uremic toxins, bio-incompatibility of dialysis membranes, intravenous iron treatment, and activation of the renin–angiotensin system) have been implicated in the pathogenesis of premature biological aging and multiple age-related comorbidities commonly observed in this population [3, 5].
The nuclear factor erythroid 2-related factor 2 (Nrf2), a transcription factor regulating the expression of an array of cytoprotective genes, has emerged as a key molecule in the adaptive stress response mechanisms against oxidative stress and inflammation [6–10]. In the nucleus, the Nrf2 interacts with small musculoaponeurotic fibrosarcoma (Maf) and co-activator proteins, and activates transcription of Nrf2 target genes by binding to the antioxidant response elements (ARE) in their promoter regions [11, 12]. This Nrf2 signaling leads to the upregulation of various antioxidant and phase 2 detoxifying enzymes, such as NAD(P)H: quinone-oxidoreductase-1 (NQO1), γ-glutamyl cysteinyl synthetase (γ-GCS), and hemeoxygenase-1 (HO-1), which exert antioxidative and anti-inflammatory effects [13–15]. The dysregulation of Nrf2 activation therefore makes cells more sensitive to a variety of stressors, which in turn promotes several key pathological features associated with aging, such as genomic instability, loss of proteostasis, and mitochondrial dysfunction (a.k.a. the hallmarks of aging) [16]. Growing evidence indicates that Nrf2 dysfunction contributes to the development and progression of age-related pathologies, including neurodegeneration, cardiovascular disorders, and cancer [17–20]. Furthermore, a few recent studies have demonstrated reduced expression of Nrf2 in patients with ESRD, potentially mediated in part by chronic systemic inflammation and uremic toxins [21–23].
At a cellular level, aging is associated with accumulation of senescent cells, characterized by an irreversible cell-cycle arrest and increased expression of cyclin-dependent kinase inhibitor 2A (CDKN2A, a.k.a. p16INK4a) [24–26], along with several other biological features such as stem cell exhaustion, systemic klotho deficiency, and telomere attrition [27]. As supported by recent evidence indicating the association between senescent cell accumulation and loss of functional capacity in organs [28, 29], CDKN2A is currently considered a validated biomarker of biological aging superior to telomere length that has long been recognized as a relevant measure of aging [25, 30–32]. Recently, a few studies have revealed the biological link between increased CDKN2A expression and Nrf2 dysfunction in age-related pathologies, such as cerebrovascular disorders [33, 34].
Given the unique phenotypic features of increased oxidative stress and premature biological aging in patients with ESRD, it seems plausible that reduced expression of Nrf2 is mechanistically involved in the development of their accelerated biological aging along with increased CDKN2A expression. However, little is known about the association between Nrf2 and CDKN2A expression in the ESRD population. In this pilot study, we therefore aimed to measure the expression of Nrf2 and CDKN2A genes in whole blood of patients with ESRD that were receiving maintenance hemodialysis (HD) and examine the association between Nrf2 and CDKN2A expression in these patients.
Results
Baseline characteristics
Patients’ baseline characteristics in the overall cohort and stratified by median Nrf2 expression level are presented in Table 1. Overall, the mean age was 62.6±9.8 years; 52.9% of patients were male; 70.6% were African American; and 70.6% were diabetic. The mean Nrf2 gene expression levels in patients with lower and higher median Nrf2 expression were 6.2±0.5 and 8.1±0.2 (x10-2, relative expression quantity), respectively. Compared to patients with higher Nrf2 expression, those with lower Nrf2 expression had significantly higher levels of hemoglobin (11.1±0.9 vs. 10.6±1.5 g/dL, P<0.01) and CDKN2A expression (median relative expression quantity 0.14 vs. 0.09, P<0.01). No statistically significant differences were observed in demographics, vascular access type, comorbidities, and inflammatory markers between the two groups (Table 1).
Table 1. Baseline patient characteristics overall and stratified by median Nrf2 level.
Characteristics | Total (N = 34) | Lower Nrf2 (n =17) | Higher Nrf2 (n = 17) | P | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Age (years) | 62.6 ± 9.8 | 63.4 ± 9.9 | 61.9 ± 10.0 | 0.58 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Male sex | 18 (52.9) | 8 (47.0) | 10 (58.8) | 0.49 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Race | 0.72 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
White | 8 (23.5) | 5 (29.4) | 3 (17.7) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
African American | 24 (70.6) | 11 (64.7) | 13 (76.5) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Others | 2 (5.9) | 1 (5.9) | 1 (5.9) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Dialysis vintage (years) | 5.3 ± 2.8 | 5.1 ± 3.3 | 5.6 ± 2.3 | 0.43 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Vascular access type | 0.82 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Arteriovenous fistula | 24 (70.6) | 12 (70.6) | 12 (70.6) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Arteriovenous graft | 5 (14.7) | 3 (17.6) | 2 (11.8) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Catheter | 5 (14.7) | 2 (11.8) | 3 (17.6) | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Charlson Comorbidity Index | 5.9 ± 1.7 | 5.9 ± 1.8 | 5.8 ± 1.7 | 0.78 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Diabetes mellitus | 24 (70.6) | 10 (58.8) | 14 (82.4) | 0.13 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ischemic heart disease | 6 (17.7) | 3 (17.7) | 3 (17.7) | - | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Congestive heart failure | 4 (11.8) | 2 (11.8) | 2 (11.8) | 0.29 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Cancer | 0 (0) | 0 (0) | 0 (0) | - | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Laboratory markers | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Hemoglobin (g/dL) | 10.9 ± 1.2 | 11.1 ± 0.9 | 10.6 ± 1.5 | 0.025 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Albumin (g/dL) | 4.0 ± 0.3 | 4.0 ± 0.3 | 4.0 ± 0.3 | 0.56 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
LPS (EU/mL) | 0.11 [0.07, 0.15] | 0.11 [0.08, 0.15] | 0.11 [0.05, 0.13] | 0.62 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CRP (mg/L) | 1.8 [0.9, 3.7] | 1.3 [0.7, 3.7] | 2.1 [1.3, 3.6] | 0.20 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TNF-α (pg/mL) | 9.4 ± 3.0 | 8.9 ± 2.8 | 9.8 ± 3.2 | 0.33 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
IL-6 (pg/mL) | 3.2 [2.2, 7.4] | 3.0 [2.0, 8.9] | 3.2 [2.3, 7.4] | 0.87 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
MCP-1 (ng/mL) | 165.3 ± 53.8 | 167.2 ± 60.5 | 163.4 ± 47.9 | 0.97 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CDKN2A expression (x10-1, RQ) | 1.0 [0.8, 1.4] | 1.4 [0.9, 1.8] | 0.9 [0.6, 1.1] | <0.01 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Nrf2 expression (x10-2, RQ) | 7.2 ± 1.1 | 6.2 ± 0.5 | 8.1 ± 0.2 | <0.01 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Note: Data are presented as number (percentage), mean ± SD, or median [IQI]. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Abbreviations: CDKN2A = cyclin dependent kinase inhibitor 2A; CRP = C-reactive protein; IL-6 = interleukin-6; IQI = interquartile interval; LPS = lipopolysaccharide; MCP-1 = monocyte chemoattractant protein-1; Nrf2 = nuclear factor-erythroid 2-related factor 2; RQ = relative quantity; SD = standard deviation; TNF-α = tumor necrosis factor alpha |
Association between Nrf2 and CDKN2A expression
As depicted in Figure 1, there was a significant negative correlation between Nrf2 and CDKN2A expression levels in whole blood of 34 HD patients (rho=-0.51, P=0.002); while no significant correlation was found between Nrf2 expression level and chronological age (rho=-0.02, P=0.91; Figure 2).
Figure 1. Correlation between Nrf2 and CDKN2A expression levels in 34 HD patients. Abbreviation: CDKN2A = cyclin dependent kinase inhibitor 2A, Nrf2 = nuclear factor erythroid 2 related factor 2, RQ = relative quantity.
Figure 2. Correlation between Nrf2 expression level and chronological age in 34 HD patients. Abbreviation: Nrf2 = nuclear factor erythroid 2 related factor 2, RQ = relative quantity.
Table 2 shows the association between Nrf2 and CDKN2A expression levels using univariable and multivariable linear regression analyses. In the univariable linear regression model, a significant negative association was observed between Nrf2 and CDKN2A expression levels (β coefficient=-1.98, P=0.002). A statistically significant association with CDKN2A expression was also observed for higher age (β coefficient=0.00177, P=0.018), male gender (β coefficient=0.0300, P=0.040 [vs. female]), and African American race (β coefficient=-0.0378, P=0.031 [vs. white]). After adjustment for variables that were statistically significant in the univariable model (i.e., Nrf2 expression, age, gender, and race), only Nrf2 expression was found to be significantly associated with the CDKN2A expression level (β coefficient=-1.84, P=0.001, in Model 1). The negative association between Nrf2 and CDKN2A expression remained statistically significant even after additionally accounting for the variable significant at P<0.1 in the univariable analysis (i.e., diabetes) (β coefficient=-1.51, P=0.010, in Model 2; Table 2). Similar results were observed when we replaced diabetes with inflammatory markers (i.e., C-reactive protein [CRP], tumor necrosis factor alpha [TNF-α], interleukin-6 [IL-6], and monocyte chemoattractant protein-1 [MCP-1]) or serum albumin concentration.
Table 2. Association between Nrf2 and CDKN2A expression levels in univariable and multivariable models.
Characteristics | Univariable | Model 1 | Model 2 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
β | Std. Err. | P | β | Std. Err. | P | β | Std. Err. | P | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Nrf2 expression (RQ) | -1.98 | 0.598 | 0.002 | -1.84 | 0.520 | 0.001 | -1.51 | 0.547 | 0.010 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Age (years) | 0.00177 | 0.000709 | 0.018 | 0.000774 | 0.000794 | 0.34 | 0.00144 | 0.000878 | 0.11 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Male (vs. female) | 0.0300 | 0.0140 | 0.040 | 0.0239 | 0.0141 | 0.10 | 0.0162 | 0.0145 | 0.28 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Race (vs. white) | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
African American | -0.0378 | 0.0167 | 0.031 | -0.0233 | 0.0153 | 0.14 | -0.00922 | 0.0172 | 0.60 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Others | -0.0452 | 0.0324 | 0.17 | -0.0526 | 0.0267 | 0.059 | -0.0633 | 0.0268 | 0.026 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Dialysis vintage (year) | -0.00267 | 0.00264 | 0.32 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Vascular access (vs. AVF) | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
AVG | 0.0359 | 0.0209 | 0.87 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Catheter | -0.0328 | 0.0209 | 0.13 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Charlson Comorbidity Index | 0.0288 | 0.00442 | 0.52 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Diabetes | -0.0311 | 0.0155 | 0.053 | -0.0268 | 0.0167 | 0.12 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Ischemic heart disease | 0.0205 | 0.0193 | 0.295 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Laboratory markers | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Hemoglobin (g/dL) | 0.00126 | 0.00632 | 0.84 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Albumin (g/dL) | -0.0277 | 0.0241 | 0.26 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
LPS (EU/mL)* | 0.0438 | 0.108 | 0.69 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
CRP (mg/L)* | -0.0174 | 0.0121 | 0.16 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TNF-α (pg/mL) | -0.00334 | 0.00249 | 0.19 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
IL-6 (pg/mL)* | -0.00163 | 0.0102 | 0.87 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
MCP-1 (ng/mL) | 0.000229 | 0.000135 | 0.10 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
*Values were log-transformed | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Note: Regression coefficients for each covariate (for a one unit increase in continuous variables) are presented for every one unit increase in log-transformed CDKN2A expression levels. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Model 1 is adjusted for only variables that were statistically significant in univariate analysis (i.e., Nrf2, age, gender, and race); and model 2 is adjusted for the variables in model 1 plus diabetes (i.e., the variable significant at P <0.1 in univariate analysis). | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Abbreviations: AVF = arteriovenous fistula; AVG = arteriovenous graft; CDKN2A = cyclin dependent kinase inhibitor 2A; CRP = C-reactive protein; IL-6 = interleukin-6; LPS = lipopolysaccharide; MCP-1 = monocyte chemoattractant protein-1; Nrf2 = nuclear factor-erythroid 2-related factor 2; RQ = relative quantity; SD = standard deviation; Std. Err. = standard error; TNF-α = tumor necrosis factor alpha |
Discussion
In this cross-sectional pilot study of 34 ESRD patients receiving maintenance HD, we found that whole blood Nrf2 expression was negatively correlated with CDKN2A expression, but not with chronological age. We also demonstrated that the negative association between Nrf2 and CDKN2A expression was independent of chronological age, gender, race, diabetes status, and inflammatory markers.
With a growing recognition of increased oxidative stress and inflammation as key determinants of aging (a.k.a. “inflammaging”) [35, 36], Nrf2 has recently received special attention to its pivotal role in the development of a wide range of aging phenotypes [18]. Emerging evidence has indicated that the transcriptional activity of Nrf2 declines with age in several tissues and organs such as vasculature [37] and brain [38], and currently the induction of cellular senescence, which is an evolutionarily conserved cellular stress response mechanism, is considered a fundamental aging process mediated by Nrf2 dysfunction [39]. In an animal study investigating age-related changes in the expression of senescence markers, CDKN2A expression was found to be upregulated in cerebral arteries of aged (vs. young) mice, which was further exacerbated by genetic depletion of Nrf2, along with an increase in gene expression of several pro-inflammatory senescence-associated secretory phenotype (SASP) factors (e.g., IL-1β and TNF-α) [33]. A recent experimental study using human epidermal keratinocytes also demonstrated that genetic silencing of Nrf2 enhanced the accumulation of CDKN2A protein in keratinocytes, suggesting the mechanistic involvement of Nrf2 dysregulation in the process of cellular senescence in human epidermis [34].
In line with these previous findings, our results showed for the first time, to the best of our knowledge, that lower Nrf2 expression was associated with higher CDKN2A expression in whole blood of patients with ESRD. Of note, this negative Nrf2-CDKN2A association was independent of chronological age, implying that the age-related morbidities commonly seen in patients with ESRD may not necessarily be a consequence of their chronological aging but rather result from other factors linked to Nrf2 signaling specific to this patient population. In ESRD, over half of the patients are reported to have serologic evidence of an active inflammatory response (a.k.a. “uremic inflammation”) [40, 41], which has also been implicated in the pathogenesis of premature biological aging and age-related comorbidities [3, 25]. In this study, however, there was no significant association between inflammatory markers and CDKN2A, which appear to contradict prior evidence. Although it is possible that the non-significant association with inflammatory markers was merely due to the small sample size of this study, there may be a plausible explanation for this observation. Recently, studies have revealed that Nrf2 lies at the center of a complex regulatory network and is involved in a wide range of cellular processes, including not only redox regulation and pro-inflammatory response, but also DNA repair, mitochondrial function, proteostasis, proliferation, and iron, lipid, carbohydrate, and drug/xenobiotic metabolisms, all of which contribute to cell survival [42]. It is therefore possible that the cellular senescence associated with Nrf2 dysfunction in ESRD is predominantly meditated by the alterations of these latter cellular processes, such as mitochondrial dysfunction and metabolic imbalance, rather than enhanced pro-inflammatory response. Another ESRD-specific factor linked to Nrf2 signaling may be the toxic internal milieu, characterized by the accumulation of a variety of uremic toxins, such as indoxyl sulfate (IS), p-cresyl sulfate (p-CS), and indole-3-acetic acid (IAA) [43]. A previous experimental study demonstrated that IS, one of the potent uremic toxins, induced endothelial cell senescence by increasing reactive oxygen species production and p53 activity [44]. In another recent study examining the correlation between plasma uremic toxins and Nrf2 expression in peripheral blood mononuclear cells (PBMCs) of HD patients, plasma IS was shown to be negatively correlated with Nrf2 expression in PBMCs [21]. Given these findings and the lack of significant correlation between Nrf2 and chronological age observed in our study, it is possible that Nrf2 dysfunction induced by uremic toxins promotes cellular senescence independently of chronological age, leading to the development of premature biological aging and so-called “age-related” comorbidities in ESRD (as these may not actually be related to chronological age). This may also be supported by a recent finding that high arterial CDKN2A expression was significantly associated with severe arterial vascular calcification, a hallmark of premature aging, in uremic patients undergoing living donor kidney transplantation, independently of their chronological age [45]. The study also demonstrated that the arterial CDKN2A expression increased with the degree of medial calcification and was negatively associated with carboxylated osteocalcin levels, suggesting the pathogenic contribution of impaired vitamin K-mediated carboxylation to premature vascular senescence [45]. Furthermore, increasing evidence indicates that the Nrf2 plays a key role in the process of vascular calcification, partly through its regulatory effect of osteoblastic differentiation [46, 47]. In this context, our findings on the chronological age-independent Nrf2-CDKN2A association in ESRD patients may be of particular value, with several potential clinical and research implications. Although previous studies consistently revealed that the Nrf2 expression declines with age, this may not necessarily apply to the ESRD population. While it is broadly accepted that chronological age is a well-established risk factor for many age-related diseases, biomarkers of biological aging, such as whole blood expression of CDKN2A gene, could also have the potential to serve as novel noninvasive prognostic markers of adverse events associated with age-related diseases (e.g., CVD and mortality) in patients with ESRD. Given the potential contribution of a repressed Nrf2 system to premature biological aging in ESRD, both synthetic (e.g., bardoxolone methyl) [48] and natural nutrigenomic compounds (e.g., sulforaphane) [49] that have been shown to restore Nrf2 expression could be novel therapeutic options against premature morbidity and mortality in patients with ESRD. All of these possibilities may deserve further investigation.
The study results must be interpreted in light of several limitations. Our study sample was small and not representative of patients with ESRD who are heterogeneous with respect to various etiologies and comorbidities. Due to the small sample size, we were unable to fully account for potential confounders. In addition, we cannot eliminate the possibility of unmeasured confounders, such as diet and lifestyle, that might have influenced the association between Nrf2 and CDKN2A expression. Since RNA was prepared from a homogenized whole blood sample, this procedure precludes any knowledge on how the expression varied between different cell types in whole blood, although no data are currently available regarding the expression variation of Nrf2 and CDKN2A genes across different blood cell types of ESRD patients. Furthermore, blood samples in this cohort were collected before the start of dialysis treatment, and thus we could not compare the difference of whole blood Nrf2 expression between pre- and post-dialysis. Lastly, it should also be noted that the gene expression levels of Nrf2 and CDKN2A may vary depending on different tissues or organs. It is therefore important to examine the Nrf2-CDKN2A association in other tissues or organs, such as arteries, muscle, and fat, of patients with ESRD in future studies. Nevertheless, given the non-invasive nature of blood sampling, our study results using whole blood samples would still be of value in terms of potential applications for research and clinical purposes, particularly if our findings are confirmed in other tissue specimens of ESRD patients.
In conclusion, in this cross-sectional pilot study of 34 prevalent HD patients, we found a significant negative association between the whole blood expression of Nrf2 and CDKN2A genes, independent of chronological age. Our findings suggest a potential contribution of Nrf2 dysfunction to the development of premature biological aging and age-related morbidities in patients with ESRD. Further in-depth basic and clinical studies are needed to clarify the underlying pathophysiologic mechanisms for the Nrf2-CDKN2A association and examine if Nrf2-targeted interventions could retard the progression of biological aging and its related complications in ESRD patients.
Materials and Methods
Study design
This was a prospective study of anonymized samples and statistically de-identified clinical data obtained from a biorepository assembled by DaVita Clinical Research (Minneapolis, MN, USA). Anonymized samples and statistically deidentified data were made available to the researcher for academic research via a grant program called BioReG.
Study population
The DaVita Clinical Research biorepository comprises blood samples and clinical data from 4,028 individuals with prevalent end-stage renal disease who received hemodialysis at a large dialysis organization (LDO) between May 2011 and October 2013. The biorepository sampling protocol was reviewed and approved by an Institutional Review Board (IRB) (Quorum IRB, Seattle, WA, USA) and patients provided written informed consent prior to the initiation of sample collection. Patients with hemoglobin <8.0 g/dL, who were <18 years of age, who were pregnant, or who had any physical, mental, or medical condition which prohibited the ability to provide informed consent were excluded from participation.
For the present cross-sectional pilot study, we used biospecimens and data at baseline (i.e., first blood sampling date) from 34 HD patients within the repository housed at the University of Tennessee Health Science Center (UTHSC) (UT-DaVita HD cohort; n=978). The study was approved by the IRB of the UTHSC (IRB protocol numbers: 16-04357-XP and 17-05299-XP).
Biorepository biospecimen and clinical data collection
Under the biorepository study protocol, blood samples were collected from each subject at baseline and, thereafter, every 3 months for up to one year. Pre-dialysis blood samples were collected and processed according to a standardized protocol: specimens were shipped on refrigerated packs on the day of collection to a centralized laboratory, where they were aliquotted and stored at -80°C. Specimens with cause for rejection (e.g., unspun tubes, insufficient volume, or thawed specimens) or that were received >48h from the time of collection were rejected. Anonymized plasma samples were shipped from the centralized laboratory to the researchers on dry ice at -80°C.
Clinical and hemodialysis treatment data for each biorepository subject were collected by the LDO during the course of routine care and were maintained in the LDO electronic health record. Clinical and hemodialysis treatment data were provided to the researchers by DaVita Clinical Research in statistically deidentified form.
Biomarker measurements
In addition to the variables available from the laboratory measurements obtained during routine care, plasma lipopolysaccharide (LPS) and specific inflammatory markers including CRP, TNF-α, IL-6, and MCP-1 were additionally measured in our pilot study. Plasma LPS levels (EU/mL) were quantified in duplicate using a Pierce LAL Chromogenic Endotoxin Quantitation Kit (ThermoFisher Scientific, Waltham, MA, USA) as per the manufacturer’s protocol. Plasma levels of CRP, TNF-α, IL-6, and MCP-1 were measured and verified using the Magnetic Luminex (Magpix) platform from R&D systems (R&D Systems, Inc., Minneapolis, MN) following the manufacturer’s recommendations [50].
RNA preparation and gene expression analysis
The PAXgene blood RNA kit (Qiagen, Hilden, Germany) was used to perform total RNA extraction from whole blood samples according to the manufacturer’s recommendations. The RNA samples were reverse transcribed into cDNA using Transcriptor First Strand cDNA synthesis kit (Roche, Basel, Switzerland), and a 500 ng total RNA sample was used for the single strand cDNA synthesis. Gene transcript level was quantified using LightCycler® 480 System (Roche, Basel, Switzerland). TaqMan Gene Expression Assays specific to Nrf2 (Hs00975961_g1, Applied Biosystems, Carlsbad, CA) and CDKN2A (Hs00923894_m1, Applied Biosystems, Carlsbad, CA) were used to determine Nrf2 and CDKN2A expression levels. Relative expression levels of Nrf2 and CDKN2A were normalized against GAPDH (Hs02758991_g1, Applied Biosystems, Carlsbad, CA) [51] and HPRT (Universal Probe Library Human HPRT gene assay, Roche, Basel, Switzerland) [45, 52], respectively. All assays were performed in triplicate, and the comparative threshold cycle (CT) method was used to quantify relative gene expression [53]. To ensure the rigor of our measurements, the intra-assay coefficient of variation for the gene expression levels of Nrf2 and CDKN2A was tested respectively using the TaqMan Gene Expression Assays which demonstrated good reproducibility (3.8% and 5.1% for Nrf2 and CDKN2A, respectively).
Statistical analysis
Baseline patient characteristics were presented as number (percentages) for categorical variables and mean (standard deviation [SD]) for continuous variables with a normal distribution or median (interquartile interval [IQI]) for those with a skewed distribution. Differences between groups were assessed using the chi-squared test or Wilcoxon rank-sum test, as appropriate. Spearman’s rank correlation (rho) was used to determine the correlations of Nrf2 expression with CDKN2A expression and chronological age. We preformed univariable and multivariable linear regressions to examine the association between Nrf2 and CDKN2A expression levels. Variables with a skewed distribution were treated as log-transformed continuous variables, as appropriate. Given the limited sample size in this pilot study, the following two incremental models were used based on theoretical consideration and data availability: model 1 included variables that were statistically significant in the univariable analysis; and model 2 additionally accounted for the variables that were significant at P<0.1 in the univariable analysis. The regression coefficients for each covariate were presented for every one-unit increase in log-transformed CDKN2A expression levels. A threshold of statistical significance was set at the level of P<0.05 for all analyses unless otherwise specified. Statistical analyses were conducted in STATA/MP Version 15 (STATA Corporation, College Station, TX).
Acknowledgments
Dr. Kovesdy is an employee of the US Department of Veterans affairs. The interpretation and reporting of these data are the responsibility of the authors and in no way should be seen as official policy or interpretation of the Department of Veterans Affairs or the US government. The results of this paper have not been published previously in whole or part.
Conflicts of Interest
None of the authors have relevant conflicts of interest.
Funding
This research received no external funding.
References
- 1. Go AS, Chertow GM, Fan D, McCulloch CE, Hsu CY. Chronic kidney disease and the risks of death, cardiovascular events, and hospitalization. N Engl J Med. 2004; 351:1296–305. https://doi.org/10.1056/NEJMoa041031 [PubMed]
- 2. Foley RN, Parfrey PS, Sarnak MJ. Clinical epidemiology of cardiovascular disease in chronic renal disease. Am J Kidney Dis. 1998; 32:S112–19. https://doi.org/10.1053/ajkd.1998.v32.pm9820470 [PubMed]
- 3. Kooman JP, Kotanko P, Schols AM, Shiels PG, Stenvinkel P. Chronic kidney disease and premature ageing. Nat Rev Nephrol. 2014; 10:732–42. https://doi.org/10.1038/nrneph.2014.185 [PubMed]
- 4. Margolick JB, Ferrucci L. Accelerating aging research: how can we measure the rate of biologic aging? Exp Gerontol. 2015; 64:78–80. https://doi.org/10.1016/j.exger.2015.02.009 [PubMed]
- 5. Kooman JP, Dekker MJ, Usvyat LA, Kotanko P, van der Sande FM, Schalkwijk CG, Shiels PG, Stenvinkel P. Inflammation and premature aging in advanced chronic kidney disease. Am J Physiol Renal Physiol. 2017; 313:F938–50. https://doi.org/10.1152/ajprenal.00256.2017 [PubMed]
- 6. Ruiz S, Pergola PE, Zager RA, Vaziri ND. Targeting the transcription factor Nrf2 to ameliorate oxidative stress and inflammation in chronic kidney disease. Kidney Int. 2013; 83:1029–41. https://doi.org/10.1038/ki.2012.439 [PubMed]
- 7. Howden R. Nrf2 and cardiovascular defense. Oxid Med Cell Longev. 2013; 2013:104308. https://doi.org/10.1155/2013/104308 [PubMed]
-
8.
Cardozo LF, Pedruzzi LM, Stenvinkel P, Stockler-Pinto MB, Daleprane JB, Leite M
Jr , Mafra D. Nutritional strategies to modulate inflammation and oxidative stress pathways via activation of the master antioxidant switch Nrf2. Biochimie. 2013; 95:1525–33. https://doi.org/10.1016/j.biochi.2013.04.012 [PubMed] - 9. Choi BH, Kang KS, Kwak MK. Effect of redox modulating NRF2 activators on chronic kidney disease. Molecules. 2014; 19:12727–59. https://doi.org/10.3390/molecules190812727 [PubMed]
- 10. Yamazaki H, Tanji K, Wakabayashi K, Matsuura S, Itoh K. Role of the Keap1/Nrf2 pathway in neurodegenerative diseases. Pathol Int. 2015; 65:210–19. https://doi.org/10.1111/pin.12261 [PubMed]
- 11. Takaya K, Suzuki T, Motohashi H, Onodera K, Satomi S, Kensler TW, Yamamoto M. Validation of the multiple sensor mechanism of the Keap1-Nrf2 system. Free Radic Biol Med. 2012; 53:817–27. https://doi.org/10.1016/j.freeradbiomed.2012.06.023 [PubMed]
- 12. Slocum SL, Kensler TW. Nrf2: control of sensitivity to carcinogens. Arch Toxicol. 2011; 85:273–84. https://doi.org/10.1007/s00204-011-0675-4 [PubMed]
- 13. Baird L, Dinkova-Kostova AT. The cytoprotective role of the Keap1-Nrf2 pathway. Arch Toxicol. 2011; 85:241–72. https://doi.org/10.1007/s00204-011-0674-5 [PubMed]
- 14. Singh S, Vrishni S, Singh BK, Rahman I, Kakkar P. Nrf2-ARE stress response mechanism: a control point in oxidative stress-mediated dysfunctions and chronic inflammatory diseases. Free Radic Res. 2010; 44:1267–88. https://doi.org/10.3109/10715762.2010.507670 [PubMed]
- 15. Jung KA, Kwak MK. The Nrf2 system as a potential target for the development of indirect antioxidants. Molecules. 2010; 15:7266–91. https://doi.org/10.3390/molecules15107266 [PubMed]
- 16. López-Otín C, Blasco MA, Partridge L, Serrano M, Kroemer G. The hallmarks of aging. Cell. 2013; 153:1194–217. https://doi.org/10.1016/j.cell.2013.05.039 [PubMed]
- 17. Kloska D, Kopacz A, Piechota-Polanczyk A, Nowak WN, Dulak J, Jozkowicz A, Grochot-Przeczek A. Nrf2 in aging - focus on the cardiovascular system. Vascul Pharmacol. 2019; 112:42–53. https://doi.org/10.1016/j.vph.2018.08.009 [PubMed]
- 18. Silva-Palacios A, Ostolga-Chavarría M, Zazueta C, Königsberg M. Nrf2: molecular and epigenetic regulation during aging. Ageing Res Rev. 2018; 47:31–40. https://doi.org/10.1016/j.arr.2018.06.003 [PubMed]
- 19. Schmidlin CJ, Dodson MB, Madhavan L, Zhang DD. Redox regulation by NRF2 in aging and disease. Free Radic Biol Med. 2019; 134:702–07. https://doi.org/10.1016/j.freeradbiomed.2019.01.016 [PubMed]
- 20. Ungvari Z, Tarantini S, Nyúl-Tóth Á, Kiss T, Yabluchanskiy A, Csipo T, Balasubramanian P, Lipecz A, Benyo Z, Csiszar A. Nrf2 dysfunction and impaired cellular resilience to oxidative stressors in the aged vasculature: from increased cellular senescence to the pathogenesis of age-related vascular diseases. Geroscience. 2019; 41:727–38. https://doi.org/10.1007/s11357-019-00107-w [PubMed]
- 21. Stockler-Pinto MB, Soulage CO, Borges NA, Cardozo LF, Dolenga CJ, Nakao LS, Pecoits-Filho R, Fouque D, Mafra D. From bench to the hemodialysis clinic: protein-bound uremic toxins modulate NF-κB/Nrf2 expression. Int Urol Nephrol. 2018; 50:347–54. https://doi.org/10.1007/s11255-017-1748-y [PubMed]
-
22.
Pedruzzi LM, Cardozo LF, Daleprane JB, Stockler-Pinto MB, Monteiro EB, Leite M
Jr , Vaziri ND, Mafra D. Systemic inflammation and oxidative stress in hemodialysis patients are associated with down-regulation of Nrf2. J Nephrol. 2015; 28:495–501. https://doi.org/10.1007/s40620-014-0162-0 [PubMed] - 23. Bolati D, Shimizu H, Yisireyili M, Nishijima F, Niwa T. Indoxyl sulfate, a uremic toxin, downregulates renal expression of Nrf2 through activation of NF-κB. BMC Nephrol. 2013; 14:56. https://doi.org/10.1186/1471-2369-14-56 [PubMed]
- 24. van Deursen JM. The role of senescent cells in ageing. Nature. 2014; 509:439–46. https://doi.org/10.1038/nature13193 [PubMed]
- 25. Shiels PG, McGuinness D, Eriksson M, Kooman JP, Stenvinkel P. The role of epigenetics in renal ageing. Nat Rev Nephrol. 2017; 13:471–82. https://doi.org/10.1038/nrneph.2017.78 [PubMed]
- 26. Hernandez-Segura A, de Jong TV, Melov S, Guryev V, Campisi J, Demaria M. Unmasking transcriptional heterogeneity in senescent cells. Curr Biol. 2017; 27:2652–60.e4. https://doi.org/10.1016/j.cub.2017.07.033 [PubMed]
- 27. Stenvinkel P, Larsson TE. Chronic kidney disease: a clinical model of premature aging. Am J Kidney Dis. 2013; 62:339–51. https://doi.org/10.1053/j.ajkd.2012.11.051 [PubMed]
- 28. Field AE, Adams PD. Targeting chromatin aging - the epigenetic impact of longevity-associated interventions. Exp Gerontol. 2017; 94:29–33. https://doi.org/10.1016/j.exger.2016.12.010 [PubMed]
- 29. Sturmlechner I, Durik M, Sieben CJ, Baker DJ, van Deursen JM. Cellular senescence in renal ageing and disease. Nat Rev Nephrol. 2017; 13:77–89. https://doi.org/10.1038/nrneph.2016.183 [PubMed]
- 30. McGlynn LM, Stevenson K, Lamb K, Zino S, Brown M, Prina A, Kingsmore D, Shiels PG. Cellular senescence in pretransplant renal biopsies predicts postoperative organ function. Aging Cell. 2009; 8:45–51. https://doi.org/10.1111/j.1474-9726.2008.00447.x [PubMed]
- 31. Koppelstaetter C, Schratzberger G, Perco P, Hofer J, Mark W, Ollinger R, Oberbauer R, Schwarz C, Mitterbauer C, Kainz A, Karkoszka H, Wiecek A, Mayer B, Mayer G. Markers of cellular senescence in zero hour biopsies predict outcome in renal transplantation. Aging Cell. 2008; 7:491–97. https://doi.org/10.1111/j.1474-9726.2008.00398.x [PubMed]
- 32. Gingell-Littlejohn M, McGuinness D, McGlynn LM, Kingsmore D, Stevenson KS, Koppelstaetter C, Clancy MJ, Shiels PG. Pre-transplant CDKN2A expression in kidney biopsies predicts renal function and is a future component of donor scoring criteria. PLoS One. 2013; 8:e68133. https://doi.org/10.1371/journal.pone.0068133 [PubMed]
- 33. Fulop GA, Kiss T, Tarantini S, Balasubramanian P, Yabluchanskiy A, Farkas E, Bari F, Ungvari Z, Csiszar A. Nrf2 deficiency in aged mice exacerbates cellular senescence promoting cerebrovascular inflammation. Geroscience. 2018; 40:513–21. https://doi.org/10.1007/s11357-018-0047-6 [PubMed]
- 34. Hashimoto-Hachiya A, Tsuji G, Furue M. Antioxidants cinnamaldehyde and galactomyces fermentation filtrate downregulate senescence marker CDKN2A/p16INK4A via NRF2 activation in keratinocytes. J Dermatol Sci. 2019; 96:53–56. https://doi.org/10.1016/j.jdermsci.2019.09.002 [PubMed]
- 35. Franceschi C, Garagnani P, Parini P, Giuliani C, Santoro A. Inflammaging: a new immune-metabolic viewpoint for age-related diseases. Nat Rev Endocrinol. 2018; 14:576–90. https://doi.org/10.1038/s41574-018-0059-4 [PubMed]
- 36. Harman D. Aging: a theory based on free radical and radiation chemistry. J Gerontol. 1956; 11:298–300. https://doi.org/10.1093/geronj/11.3.298 [PubMed]
- 37. Ungvari Z, Bailey-Downs L, Sosnowska D, Gautam T, Koncz P, Losonczy G, Ballabh P, de Cabo R, Sonntag WE, Csiszar A. Vascular oxidative stress in aging: a homeostatic failure due to dysregulation of NRF2-mediated antioxidant response. Am J Physiol Heart Circ Physiol. 2011; 301:H363–72. https://doi.org/10.1152/ajpheart.01134.2010 [PubMed]
- 38. Duan W, Zhang R, Guo Y, Jiang Y, Huang Y, Jiang H, Li C. Nrf2 activity is lost in the spinal cord and its astrocytes of aged mice. In Vitro Cell Dev Biol Anim. 2009; 45:388–97. https://doi.org/10.1007/s11626-009-9194-5 [PubMed]
- 39. Baker DJ, Childs BG, Durik M, Wijers ME, Sieben CJ, Zhong J, Saltness RA, Jeganathan KB, Verzosa GC, Pezeshki A, Khazaie K, Miller JD, van Deursen JM. Naturally occurring p16(Ink4a)-positive cells shorten healthy lifespan. Nature. 2016; 530:184–89. https://doi.org/10.1038/nature16932 [PubMed]
- 40. Carrero JJ, Stenvinkel P. Inflammation in end-stage renal disease—what have we learned in 10 years? Semin Dial. 2010; 23:498–509. https://doi.org/10.1111/j.1525-139X.2010.00784.x [PubMed]
- 41. Leurs P, Lindholm B, Stenvinkel P. Effects of hemodiafiltration on uremic inflammation. Blood Purif. 2013 (Suppl 1); 35:11–17. https://doi.org/10.1159/000346359 [PubMed]
- 42. Dodson M, de la Vega MR, Cholanians AB, Schmidlin CJ, Chapman E, Zhang DD. Modulating NRF2 in disease: timing is everything. Annu Rev Pharmacol Toxicol. 2019; 59:555–75. https://doi.org/10.1146/annurev-pharmtox-010818-021856 [PubMed]
- 43. Borges NA, Barros AF, Nakao LS, Dolenga CJ, Fouque D, Mafra D. Protein-bound uremic toxins from gut microbiota and inflammatory markers in chronic kidney disease. J Ren Nutr. 2016; 26:396–400. https://doi.org/10.1053/j.jrn.2016.07.005 [PubMed]
- 44. Adelibieke Y, Shimizu H, Muteliefu G, Bolati D, Niwa T. Indoxyl sulfate induces endothelial cell senescence by increasing reactive oxygen species production and p53 activity. J Ren Nutr. 2012; 22:86–89. https://doi.org/10.1053/j.jrn.2011.10.027 [PubMed]
- 45. Stenvinkel P, Luttropp K, McGuinness D, Witasp A, Qureshi AR, Wernerson A, Nordfors L, Schalling M, Ripsweden J, Wennberg L, Söderberg M, Bárány P, Olauson H, Shiels PG. CDKN2A/p16INK4a expression is associated with vascular progeria in chronic kidney disease. Aging (Albany NY). 2017; 9:494–507. https://doi.org/10.18632/aging.101173 [PubMed]
- 46. Hinoi E, Fujimori S, Wang L, Hojo H, Uno K, Yoneda Y. Nrf2 negatively regulates osteoblast differentiation via interfering with Runx2-dependent transcriptional activation. J Biol Chem. 2006; 281:18015–24. https://doi.org/10.1074/jbc.M600603200 [PubMed]
- 47. Arefin S, Buchanan S, Hobson S, Steinmetz J, Alsalhi S, Shiels PG, Kublickiene K, Stenvinkel P. Nrf2 in early vascular ageing: calcification, senescence and therapy. Clin Chim Acta. 2020; 505:108–18. https://doi.org/10.1016/j.cca.2020.02.026 [PubMed]
- 48. Noel S, Hamad AR, Rabb H. Reviving the promise of transcription factor Nrf2-based therapeutics for kidney diseases. Kidney Int. 2015; 88:1217–18. https://doi.org/10.1038/ki.2015.328 [PubMed]
- 49. Stenvinkel P, Meyer CJ, Block GA, Chertow GM, Shiels PG. Understanding the role of the cytoprotective transcription factor nuclear factor erythroid 2-related factor 2-lessons from evolution, the animal kingdom and rare progeroid syndromes. Nephrol Dial Transplant. 2019. [Epub ahead of print]. https://doi.org/10.1093/ndt/gfz120 [PubMed]
- 50. Atamaniuk J, Kopecky C, Skoupy S, Säemann MD, Weichhart T. Apoptotic cell-free DNA promotes inflammation in haemodialysis patients. Nephrol Dial Transplant. 2012; 27:902–05. https://doi.org/10.1093/ndt/gfr695 [PubMed]
- 51. Janić M, Lunder M, Novaković S, Škerl P, Šabovič M. Expression of longevity genes induced by a low-dose fluvastatin and valsartan combination with the potential to prevent/treat “aging-related disorders”. Int J Mol Sci. 2019; 20:1844. https://doi.org/10.3390/ijms20081844 [PubMed]
- 52. Sawicka-Gutaj N, Waligórska-Stachura J, Andrusiewicz M, Biczysko M, Sowiński J, Skrobisz J, Ruchała M. Nicotinamide phosphorybosiltransferase overexpression in thyroid Malignancies and its correlation with tumor stage and with survivin/survivin DEx3 expression. Tumour Biol. 2015; 36:7859–63. https://doi.org/10.1007/s13277-015-3506-z [PubMed]
- 53. Schmittgen TD, Livak KJ. Analyzing real-time PCR data by the comparative CT method. Nat Protoc. 2008; 3:1101–08. https://doi.org/10.1038/nprot.2008.73 [PubMed]