Skip to main content

Evaluation of coagulation activation after Rhinovirus infection in patients with asthma and healthy control subjects: an observational study

Abstract

Background

Asthma exacerbations are frequently triggered by rhinovirus infections. Both asthma and respiratory tract infection can activate haemostasis. Therefore we hypothesized that experimental rhinovirus-16 infection and asthmatic airway inflammation act in synergy on the haemostatic balance.

Methods

28 patients (14 patients with mild allergic asthma and 14 healthy non-allergic controls) were infected with low-dose rhinovirus type 16. Venous plasma and bronchoalveolar lavage fluid (BAL fluid) were obtained before and 6 days after infection to evaluate markers of coagulation activation, thrombin-antithrombin complexes, von Willebrand factor, plasmin-antiplasmin complexes, plasminogen activator inhibitor type-1, endogenous thrombin potential and tissue factor-exposing microparticles by fibrin generation test, in plasma and/or BAL fluid. Data were analysed by nonparametric tests (Wilcoxon, Mann Whitney and Spearman correlation).

Results

13 patients with mild asthma (6 females, 19-29 y) and 11 healthy controls (10 females, 19-31 y) had a documented Rhinovirus-16 infection. Rhinovirus-16 challenge resulted in a shortening of the fibrin generation test in BAL fluid of asthma patients (t = -1: 706 s vs. t = 6: 498 s; p = 0.02), but not of controls (t = -1: 693 s vs. t = 6: 636 s; p = 0.65). The fold change in tissue factor-exposing microparticles in BAL fluid inversely correlated with the fold changes in eosinophil cationic protein and myeloperoxidase in BAL fluid after virus infection (r = -0.517 and -0.528 resp., both p = 0.01).

Rhinovirus-16 challenge led to increased plasminogen activator inhibitor type-1 levels in plasma in patients with asthma (26.0 ng/mL vs. 11.5 ng/mL in healthy controls, p = 0.04). Rhinovirus-16 load in BAL showed a linear correlation with the fold change in endogenous thrombin potential, plasmin-antiplasmin complexes and plasminogen activator inhibitor type-1.

Conclusions

Experimental rhinovirus infection induces procoagulant changes in the airways of patients with asthma through increased activity of tissue factor-exposing microparticles. These microparticle-associated procoagulant changes are associated with both neutrophilic and eosinophilic inflammation. Systemic activation of haemostasis increases with Rhinoviral load.

Trial registration

This trial was registered at the Dutch trial registry (http://www.trialregister.nl): NTR1677.

Introduction

It is increasingly recognized that inflammation and haemostasis are interdependent and closely linked processes that can stimulate each other [1, 2]. Many chronic inflammatory diseases, including inflammatory bowel diseases [3, 4], rheumatic arthritis [5, 6], COPD [7–9], and sarcoidosis [10], are associated with increased coagulability of blood. This procoagulant state has also been observed in the airways of patients with stable asthma as reflected by increased levels of tissue factor (TF), thrombin-antithrombin complexes (TATc) and the plasminogen activator inhibitor-1 (PAI-1), as well as decreased levels of the natural anticoagulant protein C [11]. Local activation of coagulation may be clinically relevant for asthmatic individuals, because we have recently shown that the risk of pulmonary embolism (PE) is increased in severe asthma [12]. Recently a second study on pulmonary embolism and asthma showed not only that there is an increased risk to develop PE but that PE was associated with disease exacerbations [13].

In addition to chronic inflammatory conditions of the lung, viral and bacterial infections have been shown to induce pulmonary coagulation as well [14]. For example, elderly patients with proven respiratory viral infection had activated coagulation, as shown by increased levels of von Willebrand factor (vWF), plasmin-α2-antiplasmin complexes (PAPc), D-dimer and endogenous thrombin potential (ETP) [15]. In addition, respiratory infections were a risk factor for venous thromboembolic events in a large cohort from the general population [16].

Asthma exacerbations are most often caused by respiratory viruses [17, 18], in particular rhinovirus [19]. Whether rhinovirus induced airway inflammation synergistically affects the haemostatic balance in patients with asthma is as yet unknown.

We hypothesized that rhinovirus infection enhances coagulation and reduces fibrinolysis in patients with asthma to a larger extent than in healthy control subjects. Therefore, the aim of the present study was to determine the effect of experimental rhinovirus infection on coagulation (TATc, TF-activity of microparticles, D-dimer and ETP), endothelial activation (vWF) and fibrinolysis (PAPc and PAI-1) in peripheral blood and bronchoalveolar lavage (BAL) fluid of patients with mild allergic asthma and healthy control subjects. The second aim was to assess the relationship between coagulation and fibrinolytic parameters and markers of airway inflammation in BAL fluid.

Methods

Subjects

Patients with mild asthma had a doctor’s diagnosis of asthma and had to meet the following criteria: baseline FEV1 > 80% predicted, PC20 (methacholine) < 8.0 mg/ml, skin-prick test positive for at least one out of 12 common aeroallergens. Healthy control subjects had the following criteria: baseline FEV1 > 80% predicted, PC20 (methacholine) > 16.0 mg/ml, skin-prick test negative for 12 common aeroallergens. All volunteers were aged between 18 and 40 years, were non-smoking or had stopped smoking more than 12 months ago with ≤ 5 pack years (PY), were negative for neutralizing antibodies against rhinovirus type 16 and did not have concomitant disease or (chronic) inflammatory condition that would interfere with this study, according to the judgment of a pulmonary physician. Patients with asthma were not allowed to use asthma medication other than short-acting β2-agonists within 2 weeks prior to the start of this study until day 6 after rhinovirus infection. Informed consent was obtained from each individual before inclusion.

Design and procedure

In a prospective parallel design single center study all volunteers were experimentally infected with rhinovirus type 16 (RV16) as described previously [20], but now with low-dose rhinovirus (10TCID50). In brief, upon retrieval of informed consent and subsequent screening, volunteers who met the inclusion criteria for healthy inviduals or volunteers who met the criteria for mild allergic asthma patients underwent a bronchoscopy for baseline measurements. One day later, volunteers were experimentally infected with RV16, which has been shown to cause mild common-cold symptoms in both healthy individuals and stable allergic asthma patients and to evoke a transient exacerbation of asthma symptoms. All volunteers were requested to report common cold and asthma symptoms daily until day 14 after rhinovirus challenge [20]. Diaries were collected at the final visit. Venous plasma and BAL fluid were obtained the day before and 6 days after infection. Before bronchoscopy all volunteers had used short-acting β2-agonists. Nasal swabs, brushes and BAL fluid to determine rhinovirus infection by PCR were obtained the day before and 6 days after infection. Venous blood to check for seroconversion was drawn at day 42. See Figure 1 for a flow chart of the study. More details are provided in the Additional files 1.

Figure 1
figure 1

Study design (adapted from ref. [21]).

The study was approved by Medical Ethics Committee of the Academic Medical Centre in Amsterdam, The Netherlands. The study was registered at The Netherlands Trial Register (no. 1677). Written informed consent was obtained from all volunteers.

The primary objective of the study was to evaluate tryptophan catabolism in patients with allergic asthma and healthy subjects and the change in this metabolism after experimental rhinovirus infection [21]. Coagulation was defined as a secondary endpoint for this study. Therefore dedicated frozen citrate plasma and BAL fluid samples from patients with positive PCR or seroconversion for RV-16 after infection were analysed [21].

Measurement of coagulation parameters

Measurements of TATc (Siemens Healthcare Diagnostics, Marburg, Germany), PAPc (DRG, Marburg, Germany) and PAI-1 (Hyphen BioMed, Andrésy, France), were performed by ELISA. D-dimer levels were determined with a particle-enhanced immunoturbidimetric assay (Innovance D-Dimer, Siemens Healthcare Diagnostics, Marburg, Germany). vWF was determined by ELISA with a polyclonal rabbit anti-human vWF antibody (A0082) as catching antibody and a horse radish peroxidase-labeled rabbit anti-human vWF antibody (P0226) as detecting antibody (both from DAKO, Glostrup, Denmark).

The presence of coagulant TF-exposing microparticles in BAL fluid was measured by a fibrin generation test (FGT) in autologous vesicle-depleted pool plasma as described before [22]. In brief, this assay determines the intrinsic capacity of the procoagualant TF-exposing microparticles in any fluid. Microparticles are isolated from the fluid by ultracentrifuge. After isolation the microparticles are added to autologous vesicle-depleted pool plasma to initiate fibrin formation. The time to clot formation decreases with increased procoagulant activity of the TF-exposing microparticles in the investigated fluid. The procoagulant activity of microparticles (time to clot formation) was measured by a Spectramax microplate reader [22]. ETP was assayed using the Calibrated Automated Thrombogram®. This assay determines the generation of thrombin in clotting plasma using a microtiter plate reading fluorometer (Fluoroskan Ascent, ThermoLab systems, Helsinki, Finland) and Thrombinoscope® software (Thrombinoscope BV, Maastricht, The Netherlands). The assay was carried out as described by Hemker et al. [23] and the Thrombinoscope® manual. More details are provided in the Additional file 1.

Measurement of inflammatory parameters in BAL fluid

Leukocytes in BAL fluid were counted and differentiated on Quick Diff stained cytospin preparations. IL-8 was determined by Luminex according to the manufacturer's protocol (single-plex IL-8 antibody and reagent kit from Bio-Rad Laboratories, Veenendaal, The Netherlands). Myeloperoxidase (MPO) was measured by ELISA (Costar, EIA/RIA high-binding plate) using a rabbit anti-MPO (Dako A0398) as capture antibody and the biotinylated antibody as detection antibody with a well-characterised sample as MPO standard. Eosinophil cationic protein (ECP) was measured by ELISA (Nunc, Maxisorp plate) using a monoclonal mouse-anti-human ECP capture antibody (clone 614, Diagnostics Development, Uppsala Sweden), ECP standard (ImmunoCAP ECP Calibrator. Phadia, Nieuwegein, The Netherlands) and a biotinylated polyclonal rabbit-anti-human ECP detection antibody (batch ECP03-091; Diagnostics Development, Uppsala, Sweden). Both ELISAs were developed using streptavidin poly-HRP (M2051, Sanquin, Amsterdam, The Netherlands) and tetramethyl-benzidine (TMB, Merck, Darmstadt, Germany).

Statistical analysis

Coagulation was defined as a secondary endpoint. These endpoints were defined as the changes from baseline in TATc, vWF, D-dimer, PAPc, PAI-1, and ETP in plasma and changes from baseline in TATc, vWF, FGT, D-dimer, PAPc, and PAI-1 in BAL fluid. Changes from baseline were calculated by calculating the fold change, which is the ratio of pre- and post-interventional scores (for which the following formula was used: post-interventional score/ pre-interventional score). Comparisons between both time points for each group were calculated by Wilcoxon signed rank test. Fold changes between both groups were analyzed by Mann–Whitney U test. Spearman rho correlations were used to determine associations between the fold changes of coagulation and inflammatory markers in BAL fluid. Linear correlations were calculated for the fold changes of coagulation in plasma and BAL fluid and the viral load detected in BAL-fluid. Differences were considered significant for all statistical tests at p-values less than 0.05. All reported p-values are two-sided. Analyses were performed with SPSS 18.0 (Chicago, IL, USA).

Results

In total 28 volunteers (14 patients with mild asthma and 14 healthy controls) were included in the study. Out of the 28 patients infected with RV16, 13 patients with mild asthma and 11 healthy control subjects had a positive PCR at day 6 (either in BAL fluid or in nasal swabs or both) and/or a serologic conversion for RV16 at day 42. Two BAL fluid samples were excluded from the analysis as these samples contained >15% bronchial and squamous epithelial cells. Therefore disruption of the epithelial barrier and subsequent contamination of BAL fluid with plasma cannot be excluded for these samples. Clinical and virologic characteristics of patients and controls are shown in Table 1.

Table 1 Demographic data of participants*

Evaluation of haemostasis and fibrinolysis

Venous plasma

Measurements of haemostatic and fibrinolytic markers in venous plasma at baseline and after viral infection are shown in Table 2. Of the procoagulant markers TATc was significantly higher in healthy control subjects as compared to patients with mild asthma at baseline (p = 0.02) as well as after viral infection (p = 0.03), whereas D-dimer, ETP and the marker of endothelial activation, vWF, did not differ at both time points. RV16 did not induce procoagulant changes in plasma as measured by the calculated fold changes (Figure 2A–D).

Table 2 Haemostatic proteins in plasma
Figure 2
figure 2

Fold changes in haemostatic proteins and endogenous thrombin test in venous plasma after RV16-infection. Plasma levels in healthy (white) and asthmatic (grey) individuals. of A: vWF, B: TATc, C: F: ETP, D: D-dimer, E: PAP-complexes, F: PAI-1. Box and Whisker diagram with medians and interquartile ranges.

The fibrinolytic marker PAP and PAI-1 did not differ between both groups at baseline. Although the fold changes of the fibrinolytic parameters did not change significantly (Figure 2E and F), PAP levels were significantly lower (p = 0.047) and PAI-1 levels significantly higher (p = 0.04) after RV16 infection in asthma patients than in healthy individuals.

BAL-fluid

Amongst the procoagulant markers (TATc, D-dimer), the endogenous capacity of the TF-exposing microvesicles (FGT) and the marker of endothelial activation (vWF) only TATc and FGT were detectable in BAL-fluid (Table 3). TATc levels in BAL-fluid were not different between both groups at baseline and after RV16 challenge nor did the fold change from baseline differ between both groups. However, FGT being similar in both groups at baseline, shortened in patients with asthma after viral infection (t = -1: 706 s vs. t = 6: 498 s; p = 0.02), but not in healthy control subjects (t = -1: 693 s vs. t = 6: 636 s; p = 0.65; Table 3) Change from baseline of FGT after RV16 challenge did significantly differ between patients with mild asthma and healthy control subjects (p = 0.04; Figure 3A and B).

Table 3 Haemostatic proteins and fibrin generation test in BAL-fluid
Figure 3
figure 3

Fold changes in haemostatic proteins and fibrin generation test in BAL-fluid after RV16-infection. BALF levels in healthy (white) and asthmatic (grey) individuals of A: FGT, B: TATc, C: PAPc. Box and Whisker diagram with medians and interquartile ranges.

Of the fibrinolytic markers, only PAPc was detectable in BAL-fluid. PAPc levels did not differ between both time points nor did the fold change from baseline differ between both groups.

Associations between coagulation and inflammatory parameters

As compared to healthy control subjects, patients with mild asthma had significantly higher levels of eosinophils (Median 1.0% vs. 0.25%, resp. p < 0,01) and ECP (Median 286 pg/ml vs. 159 pg/ml, resp. p < 0,05) at both timepoints. Asthmatic individuals showed an increase in ECP (Median 286 pg/ml to 507 pg/ml after viral infection, p = 0,04) and IL-8 (Median 0.34 pg/ml to 1.42 pg/ml after viral infection, p = 0,04) in BALF after rhinovirus exposure [21]. However the fold changes from baseline after infection did not change significantly between both groups (ECP p = 0,10 and for IL-8 p = 0,10). Spearman correlations were calculated to explore possible associations between haemostatic and inflammatory markers. At baseline, both FGT and TATc showed a weak correlation with IL-8 (RIL-8 = -0.455 for FGT (p = 0.03) and RIL-8 = 0.461 for TATc, both p = 0.02). No correlations were found for ECP nor for MPO. After viral infection, the fold changes of FGT and TATc in BAL-fluid showed a significant correlation with ECP and MPO, while TATc also correlated with IL-8 in BAL-fluid (Table 4). Figures of these associations are shown in the Additional file 2.

Table 4 Correlations between fold changes of inflammatory and haemostatic parameters in BAL-fluid after viral infection

Associations between RV-load in BAL fluid and haemostatic proteins in plasma and BAL fluid

RV-16 was detected in BAL fluid in 7 asthmatic patients and 3 healthy controls. Only the mild asthmatic patients were analysed as the group of healthy controls was too small. ETP showed a significant linear correlation with RV16-load in BAL fluid (Figure 4, R2 = 0.7409 p = 0.01). PAI-1 also showed a significant positive linear correlation with RV16-load (R2 = 0.8559, p = 0.003), while an inverse linear correlation with PAPc was found (R2 = 0.5283, p = 0.06). vWF did not show a significant correlation, because of a single outlier (Figure 4A, R2 = 0,1176, p = 0,46) When the outlier was omitted from the analyses, the relationship was very significant (R2 = 0.982, p = 0,0001). The fold change in TATc and D-dimer did not correlate in these patients with the RV16-load in BAL fluid, nor did the haemostatic markers in BAL fluid correlate with the viral load in BAL fluid.

Figure 4
figure 4

Fold changes in haemostatic proteins and endogenous thrombin test in venous plasma versus RV-16 load in BAL fluid. A: vWF, B: ETP, C: PAI-1 and D: PAPc. Scatter-dot diagram with interpolation line. (*p < 0.05, **p < 0.01).

Discussion

This study shows that rhinovirus infection in patients with mild asthma, but not in healthy subjects, increases procoagulant activity in the pulmonary environment as evidenced by increased microparticle-associated TF activity (FGT) in BAL fluid. Moreover, fold changes in eosinophil cationic protein and myeloperoxidase were both associated with the fold changes in FGT and TATc levels in BAL fluid after viral infection. This suggests that rhinovirus infection increases the local procoagulant activity in the airways through both eosinophilic and neutrophilic airway inflammation. In addition to local procoagulant activity, RV16-load showed linear correlations with markers of fibrinolysis and haemostatic activity in plasma.

This is the first study investigating the effect of experimental virus infection on activation of coagulation in patients with asthma. We observed an increase in the intrinsic capability to coagulate in BAL fluid, which is associated with eosinophilic and neutrophilic inflammation. This confirms previous studies showing that inflammatory and allergic asthma exacerbations induce coagulation in the airways as reflected by increased levels of TATc, TF activity and factor Xa [24–34]. Both fibrin and thrombin have been implicated in airway hyperresponsiveness and allergic airway inflammation [35], which may be the result of inactivation of surfactant and/or the formation of sputumplugs [36].

The increase in procoagulant activity in patients with asthma after rhinovirus infection can be explained by several mechanisms. Firstly, coagulant TF-exposing microparticles are likely to play a key role in the local activation of coagulation in the airways of asthmatic individuals, since these microparticles have been shown to be indispensable to initiate coagulation through the extrinsic pathway [22]. Besides activation of coagulation, microparticles have been shown to be mediators of inflammation during infection [6, 37].

TF-exposing microparticles derived from eosinophils and neutrophils have been described in related eosinophilic diseases, like Churg Strauss vasculitis and bullous pemphigoid [38–40]. However, eosinophils as the potential source of coagulant TF-exposing microparticles remain controversial, since TF mRNA is below the detection limit in both resting and stimulated eosinophils [41, 42]. Monocytes may be able to transfer TF to microparticles originating from eosinophils and neutrophils. This may explain the associations we observed in BAL-fluid between FGT and TATc with ECP and MPO and fits with the observation by Bouwman et al. [25] that virus-infected monocytes show a higher TF expression.

This study extends the role of increased procoagulant activity as described in previous studies to infectious aetiologies of asthma exacerbation [31, 32]. For example, we observed a decreased fibrinolysis in plasma of patients with mild asthma after RV16 infection, while markers of fibrinolysis were undetectable in BAL fluid. In addition, we observed linear correlations between RV16-load in BAL-fluid and systemic PAI-1 and ETP and an inverse correlation with systemic PAPc were found. Two possible explanations could be provided for these differences in plasma. First, IFN-γ treatment has been shown to decrease levels of PAI-1 in healthy controls [43, 44]. Since interferon production in patients with asthma has been shown to be impaired [45–47] this might explain the increased levels of PAI-1 in the present study. Although systemic fibrinolysis is impaired in patients with mild asthma, TATc levels in plasma were higher in healthy control subjects, while the systemic fold changes from baseline in TATc, ETP, vWF and PAI-1 are increased in the mild asthmatic group. A possible explanation may be that there is no suitable trigger at baseline leading to decreased TATc levels in plasma of patients with mild allergic asthma. Whether there are compensatory mechanisms leading to lower TATc levels in plasma of asthmatic individuals as compared to healthy individuals is as yet unknown and may be subject for further research. It is important to note that after infection with a mild rhinovirus infection the changes from baseline in plasma are larger in the mild asthma group than in the healthy group and illustrates the increased capability for coagulation.

Secondly, the linear correlations between RV16-load in BAL-fluid and systemic PAI-1 and ETP and inverse correlation with systemic PAPc observed for patients with mild asthma point towards endothelial activation by RV16. vWF and PAI-1 are stored in endothelial cells [48]. Quiescent endothelial cells are generally driving the haemostatic balance in favour of fibrinolysis through activated protein C generation and production of tissue-type plasminogen activator. Upon a stimulus, for example an infection, this balance is changed into a procoagulant state by release of amongst others vWF and expression of PAI-1 [48, 49]. Our current study points towards activation of endothelial cells by rhinovirus, although it is unclear whether the activation is directly or indirectly. Endothelial cells express intercellular adhesion molecule 1 (ICAM-1), which is not only an important molecule for leukocyte adhesion [48], it is also the receptor for rhinovirus to infect human cells [50]. However, the linear correlation between rhinovirus in the airway lumen and procoagulant activity in plasma points towards indirect activation of endothelial cells by rhinovirus, for example through an inflammatory mediators produced by airway epithelial cells [50]. Either way, activation of the endothelium results in an increase of PAI-1 and vWF. The increase in PAI-1 may explain the decrease in PAPc [51], while the increase in ETP might be explained by the increased levels of factor VIII [3, 52] commonly associated with an increase in vWF and other pro-coagulants [53]. Both impaired IFN production and endothelial activation may play a role in the increased systemic haemostatic activity found in patients with mild asthma. Our results are in line with previous studies about the activation of haemostasis in healthy controls in vitro (viral infection of endothelial cells and monocytes) [54, 55] and in vivo (elderly patients with acute respiratory tract infections) [56].

The strength of our study is the experimental design, which provided standardized exposure and comparable time points of post-infection sampling. In addition, the patients were free of steroids, which may affect inflammatory and coagulant outcomes. However, we cannot exclude the influence of potential confounding factors in the present outcomes. First, the male/female ratio was different between the two groups, with more female subjects in the control group than in the group of patients with asthma. Since many women used oral contraceptives, this might have influenced coagulation activity [57, 58]. However, we do not think that this factor biased our results since oral contraceptive users were equally distributed between the two groups and fibrinolysis was only impaired in patients with asthma.

Secondly, we did not observe significant changes for some relevant coagulation parameters in BAL fluid and plasma. This might relate to the mild nature of the experimental rhinovirus infection (i.e. low infectious dose and mild rhinovirus strain). We used this method to infect volunteers because it most closely resembles the natural course of rhinovirus infection. In addition, the procedure has been proven to be safe in patients with mild asthma and resulted in increase in common cold symptoms in both asthmatic and healthy individuals. The effects on coagulation are likely more pronounced after a rhinovirus-induced exacerbation in patients with moderate to severe asthma or in more severe disease exacerbations (i.e. influenza).

Another explanation for the non significant changes of coagulant parameters in BAL fluid and plasma could be the use of short-acting beta-2-agonists. Although it is suggested that beta-2 agonists may have a small anti-inflammatory effect [59, 60], we believe this has not influenced our results as both groups of volunteers used salbutamol during the spirometry test just before the bronchoscopy with BAL.

Thirdly, the study was limited by the fact that some haemostatic parameters were below the detection limit in BAL fluid which could be explained by the timing of the second bronchoscopy and/or the dilution involved with bronchoalveolar lavage. This is a common problem often encountered and difficult to circumvent in this type of studies due to the dilution involved with bronchoalveolar lavage. Still, our data provides evidence of increased procoagulant activity in the airways of patients with asthma after viral infection, which correlates with inflammation, and thus matches with our hypothesis.

And finally, one could argue that a larger study population would have shown more procoagulant activity and systemic procoagulant changes. Based on our present findings, we calculated that we would need more than 1000 volunteers to reach statistical significance, which is neither ethical nor feasible. Evaluation of coagulation after rhinovirus infection in patients with more severe asthma would be more relevant as these patients are more at risk for venous thromboembolism [12].

Although this study is observational in nature, the findings of the present study may have important clinical implications. Patients with asthma have an increased risk of pulmonary embolism [12, 13] which is associated with asthma exacerbations [13]. Our results indicate for the first time that even a mild rhinovirus infection in patients with mild asthma induces procoagulant activity in the airways and a possible systemic increase in haemostatic activity. One could hypothesize that patients with severe asthma have more procoagulant activity and could therefore be at increased risk to develop acute thromboembolic events due to rhinovirus infections. In this perspective, it would be required to further investigate a potential causal relationship between coagulation and eosinophilic inflammation in asthmatic airways and to further explore the nature of TF-bearing microparticles in patients with asthma. Furthermore, follow-up studies should focus on activation of haemostasis in patients with moderate to severe asthma as well as procoagulant changes induced by influenza and respiratory syncytial virus (RSV), as both influenza and RSV are frequently isolated in patients that are hospitalized for their asthma exacerbation [18].

Conclusions

In conclusion we have provided evidence of local procoagulant activity after rhinovirus infection in the airways of patients with asthma, which is associated with the intensity of eosinophilic and neutrophilic airway inflammation. As rhinovirus infection is a very common trigger of asthma exacerbations the clinical consequences of this induction of procoagulant activity deserve further investigation, in particular in patients with severe asthma who have already an increased risk of myocardial infarction, stroke and venous thromboembolism [12, 61].

Abbreviations

BAL:

Bronchoalveolar lavage

COPD:

Chronic obstructive pulmonary disease

DD:

Doubling doses of methacholine

ECP:

Eosinophil cationic protein

ELISA:

Enzyme-linkes immunosorbant assay

ETP:

Endogenous thrombin potential

FENO:

Fraction of exhaled Nitric oxide

FEV1:

Forced expiratory volume in 1 second

FGT:

Fibrin generation test

ICAM-1:

Intercellular adhesion molecule 1

IFN-γ:

Interferon gamma

IL-8:

Interleukin 8

IQR:

Interquartal range

mRNA:

Messenger ribosomal nucleic acid

MPO:

Myeloperoxidase

pb:

Post bronchodilator

PAI-1:

Plasminogen activator inhibitor-1

PAPc:

Plasmin-α2-antiplasmin complexes

PC20:

Provocative concentration of inhaled methacholine to cause a 20% falling in FEV1

PCR:

Polymerase chain reaction

PE:

Pulmonary embolism

PY:

Packyears

RSV:

Respiratory syncytial virus

RV16:

Rhinovirus type 16

TATc:

Thrombin-antithrombin complexes

TF:

Tissue factor

vWF:

von Willebrand factor.

References

  1. Esmon CT: The interactions between inflammation and coagulation. Br J Haematol. 2005, 131: 417-430. 10.1111/j.1365-2141.2005.05753.x.

    Article  PubMed  CAS  Google Scholar 

  2. van der Poll T, de Boer JD, Levi M: The effect of inflammation on coagulation and vice versa. Curr Opin Infect Dis. 2011, 24: 273-278. 10.1097/QCO.0b013e328344c078.

    Article  PubMed  CAS  Google Scholar 

  3. Saibeni S, Saladino V, Chantarangkul V, Villa F, Bruno S, Vecchi M, de Franchis R, Sei C, Tripodi A: Increased thrombin generation in inflammatory bowel diseases. Thromb Res. 2010, 125: 278-282. 10.1016/j.thromres.2009.10.012.

    Article  PubMed  CAS  Google Scholar 

  4. Alkim H, Ayaz S, Alkim C, Ulker A, Sahin B: Continuous active state of coagulation system in patients with nonthrombotic inflammatory bowel disease. Clin Appl Thromb Hemost. 2011, 17: 600-604. 10.1177/1076029611405034.

    Article  PubMed  CAS  Google Scholar 

  5. Del Rosso M, Fibbi G, Matucci CM: The urokinase-type plasminogen activator system and inflammatory joint diseases. Clin Exp Rheumatol. 1999, 17: 485-498.

    PubMed  CAS  Google Scholar 

  6. Knijff-Dutmer EA, Koerts J, Nieuwland R, Kalsbeek-Batenburg EM, van de Laar MA: Elevated levels of platelet microparticles are associated with disease activity in rheumatoid arthritis. Arthritis Rheum. 2002, 46: 1498-1503. 10.1002/art.10312.

    Article  PubMed  CAS  Google Scholar 

  7. Vaidyula VR, Criner GJ, Grabianowski C, Rao AK: Circulating tissue factor procoagulant activity is elevated in stable moderate to severe chronic obstructive pulmonary disease. Thromb Res. 2009, 124: 259-261. 10.1016/j.thromres.2008.12.030.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  8. Ashitani J, Mukae H, Arimura Y, Matsukura S: Elevated plasma procoagulant and fibrinolytic markers in patients with chronic obstructive pulmonary disease. Intern Med. 2002, 41: 181-185. 10.2169/internalmedicine.41.181.

    Article  PubMed  CAS  Google Scholar 

  9. Alessandri C, Basili S, Violi F, Ferroni P, Gazzaniga PP, Cordova C: Hypercoagulability state in patients with chronic obstructive pulmonary disease. Chronic obstructive bronchitis and haemostasis group. Thromb Haemost. 1994, 72: 343-346.

    PubMed  CAS  Google Scholar 

  10. Gunther A, Mosavi P, Ruppert C, Heinemann S, Temmesfeld B, Velcovsky HG, Morr H, Grimminger F, Walmrath D, Seeger W: Enhanced tissue factor pathway activity and fibrin turnover in the alveolar compartment of patients with interstitial lung disease. Thromb Haemost. 2000, 83: 853-860.

    PubMed  CAS  Google Scholar 

  11. de Boer JD, Majoor CJ, van't Veer C, Bel EH, van der Poll T: Asthma and coagulation. Blood. 2012, 119: 3236-3244. 10.1182/blood-2011-11-391532.

    Article  PubMed  Google Scholar 

  12. Majoor CJ, Kamphuisen PW, Zwinderman AH, Ten BA, Amelink M, Rijssenbeek-Nouwens L, Sterk PJ, Buller HR, Bel EH: Risk of deep-vein thrombosis and pulmonary embolism in asthma. Eur Respir J. 2013, 42: 655-661. 10.1183/09031936.00150312.

    Article  PubMed  Google Scholar 

  13. Chung WS, Lin CL, Ho FM, Li RY, Sung FC, Kao CH, Yeh JJ: Asthma increases pulmonary thromboembolism risk: a nationwide population cohort study. Eur Respir J. 2013, Aug 29 Epub ahead of print

    Google Scholar 

  14. Glas GJ, van der Sluijs KF, Schultz MJ, Hofstra JJ, van der Poll T, Levi M: Bronchoalveolar hemostasis in lung injury and acute respiratory distress syndrome. J Thromb Haemost. 2013, 11: 17-25. 10.1111/jth.12047.

    Article  PubMed  CAS  Google Scholar 

  15. van Wissen M, Keller TT, van Gorp EC, Gerdes VE, Meijers JC, van Doornum GJ, Buller HR, Brandjes DP: Acute respiratory tract infection leads to procoagulant changes in human subjects. J Thromb Haemost. 2011, 9: 1432-1434. 10.1111/j.1538-7836.2011.04340.x.

    Article  PubMed  CAS  Google Scholar 

  16. Smeeth L, Cook C, Thomas S, Hall AJ, Hubbard R, Vallance P: Risk of deep vein thrombosis and pulmonary embolism after acute infection in a community setting. Lancet. 2006, 367: 1075-1079. 10.1016/S0140-6736(06)68474-2.

    Article  PubMed  Google Scholar 

  17. Busse WW, Lemanske RF, Gern JE: Role of viral respiratory infections in asthma and asthma exacerbations. Lancet. 2010, 376: 826-834. 10.1016/S0140-6736(10)61380-3.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Wark PA, Johnston SL, Moric I, Simpson JL, Hensley MJ, Gibson PG: Neutrophil degranulation and cell lysis is associated with clinical severity in virus-induced asthma. Eur Respir J. 2002, 19: 68-75. 10.1183/09031936.02.00226302.

    Article  PubMed  CAS  Google Scholar 

  19. Sykes A, Johnston SL: Etiology of asthma exacerbations. J Allergy Clin Immunol. 2008, 122: 685-688. 10.1016/j.jaci.2008.08.017.

    Article  PubMed  Google Scholar 

  20. Grunberg K, Sharon RF, Sont JK, In’t Veen JC, Van Schadewijk WA, De Klerk EP, Dick CR, Van Krieken JH, Sterk PJ: Rhinovirus-induced airway inflammation in asthma: effect of treatment with inhaled corticosteroids before and during experimental infection. Am J Respir Crit Care Med. 2001, 164: 1816-1822. 10.1164/ajrccm.164.10.2102118.

    Article  PubMed  CAS  Google Scholar 

  21. van der Sluijs KF, van de Pol MA, Kulik W, Dijkhuis A, Smids BS, van Eijk HW, Karlas JA, Molenkamp R, Wolthers KC, Johnston SL, et al: Systemic tryptophan and kynurenine catabolite levels relate to severity of rhinovirus-induced asthma exacerbation: a prospective study with a parallel-group design. Thorax. 2013, 68: 1122-30. 10.1136/thoraxjnl-2013-203728.

    Article  PubMed  Google Scholar 

  22. Berckmans RJ, Sturk A, van Tienen LM, Schaap MC, Nieuwland R: Cell-derived vesicles exposing coagulant tissue factor in saliva. Blood. 2011, 117: 3172-3180. 10.1182/blood-2010-06-290460.

    Article  PubMed  CAS  Google Scholar 

  23. Hemker HC, Giesen P, Al Dieri R, Regnault V, de Smedt E, Wagenvoord R, Lecompte T, Beguin S: Calibrated automated thrombin generation measurement in clotting plasma. Pathophysiol Haemost Thromb. 2003, 33: 4-15. 10.1159/000071636.

    Article  PubMed  CAS  Google Scholar 

  24. Fujiwara A, Taguchi O, Takagi T, D’Alessandro-Gabazza CN, Boveda-Ruiz D, Toda M, Yasukawa A, Matsushima Y, Miyake Y, Kobayashi H, et al: Role of thrombin-activatable fibrinolysis inhibitor in allergic bronchial asthma. Lung. 2012, 190: 189-198. 10.1007/s00408-011-9337-9.

    Article  PubMed  CAS  Google Scholar 

  25. Gabazza EC, Taguchi O, Tamaki S, Takeya H, Kobayashi H, Yasui H, Kobayashi T, Hataji O, Urano H, Zhou H, et al: Thrombin in the airways of asthmatic patients. Lung. 1999, 177: 253-262. 10.1007/PL00007645.

    Article  PubMed  CAS  Google Scholar 

  26. Yuda H, Adachi Y, Taguchi O, Gabazza EC, Hataji O, Fujimoto H, Tamaki S, Nishikubo K, Fukudome K, D’Alessandro-Gabazza CN, et al: Activated protein C inhibits bronchial hyperresponsiveness and Th2 cytokine expression in mice. Blood. 2004, 103: 2196-2204. 10.1182/blood-2003-06-1980.

    Article  PubMed  CAS  Google Scholar 

  27. Cho SH, Hall IP, Wheatley A, Dewar J, Abraha D, Del MJ, Lee H, Oh CK: Possible role of the 4G/5G polymorphism of the plasminogen activator inhibitor 1 gene in the development of asthma. J Allergy Clin Immunol. 2001, 108: 212-214. 10.1067/mai.2001.117260.

    Article  PubMed  CAS  Google Scholar 

  28. Kowal K, Zukowski S, Moniuszko M, Bodzenta-Lukaszyk A: Plasminogen activator inhibitor-1 (PAI-1) and urokinase plasminogen activator (uPA) in sputum of allergic asthma patients. Folia Histochem Cytobiol. 2008, 46: 193-198.

    PubMed  CAS  Google Scholar 

  29. Rhim T, Choi YS, Nam BY, Uh ST, Park JS, Kim YH, Paik YK, Park CS: Plasma protein profiles in early asthmatic responses to inhalation allergen challenge. Allergy. 2009, 64: 47-54. 10.1111/j.1398-9995.2008.01817.x.

    Article  PubMed  CAS  Google Scholar 

  30. Schouten M, van de Pol MA, Levi M, van der Poll T, van der Zee JS: Early activation of coagulation after allergen challenge in patients with allergic asthma. J Thromb Haemost. 2009, 7: 1592-1594. 10.1111/j.1538-7836.2009.03523.x.

    Article  PubMed  CAS  Google Scholar 

  31. Brims FJ, Chauhan AJ, Higgins B, Shute JK: Up-regulation of the extrinsic coagulation pathway in acute asthma-a case study. J Asthma. 2010, 47: 695-698. 10.3109/02770901003682802.

    Article  PubMed  CAS  Google Scholar 

  32. Tutluoglu B, Gurel CB, Ozdas SB, Musellim B, Erturan S, Anakkaya AN, Kilinc G, Ulutin T: Platelet function and fibrinolytic activity in patients with bronchial asthma. Clin Appl Thromb Hemost. 2005, 11: 77-81. 10.1177/107602960501100109.

    Article  PubMed  CAS  Google Scholar 

  33. Terada M, Kelly EA, Jarjour NN: Increased thrombin activity after allergen challenge: a potential link to airway remodeling?. Am J Respir Crit Care Med. 2004, 169: 373-377. 10.1164/rccm.200308-1156OC.

    Article  PubMed  Google Scholar 

  34. Brims FJ, Chauhan AJ, Higgins B, Shute JK: Coagulation factors in the airways in moderate and severe asthma and the effect of inhaled steroids. Thorax. 2009, 64: 1037-1043. 10.1136/thx.2009.114439.

    Article  PubMed  CAS  Google Scholar 

  35. Miyake Y, D'Alessandro-Gabazza CN, Takagi T, Naito M, Hataji O, Nakahara H, Yuda H, Fujimoto H, Kobayashi H, Yasuma T, et al: Dose-dependent differential effects of thrombin in allergic bronchial asthma. J Thromb Haemost. 2013, 11: 1903-15.

    PubMed  CAS  Google Scholar 

  36. Wagers SS, Norton RJ, Rinaldi LM, Bates JH, Sobel BE, Irvin CG: Extravascular fibrin, plasminogen activator, plasminogen activator inhibitors, and airway hyperresponsiveness. J Clin Invest. 2004, 114: 104-111. 10.1172/JCI200419569.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  37. van der Pol E, Boing AN, Harrison P, Sturk A, Nieuwland R: Classification, functions, and clinical relevance of extracellular vesicles. Pharmacol Rev. 2012, 64: 676-705. 10.1124/pr.112.005983.

    Article  PubMed  CAS  Google Scholar 

  38. Marzano AV, Tedeschi A, Berti E, Fanoni D, Crosti C, Cugno M: Activation of coagulation in bullous pemphigoid and other eosinophil-related inflammatory skin diseases. Clin Exp Immunol. 2011, 165: 44-50. 10.1111/j.1365-2249.2011.04391.x.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  39. Ames PR, Margaglione M, Mackie S, Alves JD: Eosinophilia and thrombophilia in churg strauss syndrome: a clinical and pathogenetic overview. Clin Appl Thromb Hemost. 2010, 16: 628-636. 10.1177/1076029609348647.

    Article  PubMed  CAS  Google Scholar 

  40. Moosbauer C, Morgenstern E, Cuvelier SL, Manukyan D, Bidzhekov K, Albrecht S, Lohse P, Patel KD, Engelmann B: Eosinophils are a major intravascular location for tissue factor storage and exposure. Blood. 2007, 109: 995-1002.

    Article  PubMed  CAS  Google Scholar 

  41. de Waard V, Hansen HR, Spronk HH, Timmerman JJ, Pannekoek H, Florquin S, Reitsma PH, ten Cate H: Differential expression of tissue factor mRNA and protein expression in murine sepsis. The role of the granulocyte revisited. Thromb Haemost. 2006, 95: 348-353.

    PubMed  CAS  Google Scholar 

  42. Sovershaev MA, Lind KF, Devold H, Jorgensen TO, Hansen JB, Osterud B, Egorina EM: No evidence for the presence of tissue factor in high-purity preparations of immunologically isolated eosinophils. J Thromb Haemost. 2008, 6: 1742-1749. 10.1111/j.1538-7836.2008.03105.x.

    Article  PubMed  CAS  Google Scholar 

  43. de Metz J, Hack CE, Romijn JA, Levi M, Out TA, ten Berge IJ, Sauerwein HP: Interferon-gamma in healthy subjects: selective modulation of inflammatory mediators. Eur J Clin Invest. 2001, 31: 536-543. 10.1046/j.1365-2362.2001.00833.x.

    Article  PubMed  CAS  Google Scholar 

  44. Gluszko P, Undas A, Amenta S, Szczeklik A, Schmaier AH: Administration of gamma interferon in human subjects decreases plasminogen activation and fibrinolysis without influencing C1 inhibitor. J Lab Clin Med. 1994, 123: 232-240.

    PubMed  CAS  Google Scholar 

  45. Wark PA, Johnston SL, Bucchieri F, Powell R, Puddicombe S, Laza-Stanca V, Holgate ST, Davies DE: Asthmatic bronchial epithelial cells have a deficient innate immune response to infection with rhinovirus. J Exp Med. 2005, 201: 937-947. 10.1084/jem.20041901.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  46. Contoli M, Message SD, Laza-Stanca V, Edwards MR, Wark PA, Bartlett NW, Kebadze T, Mallia P, Stanciu LA, Parker HL, et al: Role of deficient type III interferon-lambda production in asthma exacerbations. Nat Med. 2006, 12: 1023-1026. 10.1038/nm1462.

    Article  PubMed  CAS  Google Scholar 

  47. Message SD, Laza-Stanca V, Mallia P, Parker HL, Zhu J, Kebadze T, Contoli M, Sanderson G, Kon OM, Papi A, et al: Rhinovirus-induced lower respiratory illness is increased in asthma and related to virus load and Th1/2 cytokine and IL-10 production. Proc Natl Acad Sci U S A. 2008, 105: 13562-13567. 10.1073/pnas.0804181105.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  48. Aird WC: Phenotypic heterogeneity of the endothelium: I. Structure, function, and mechanisms. Circ Res. 2007, 100: 158-173. 10.1161/01.RES.0000255691.76142.4a.

    Article  PubMed  CAS  Google Scholar 

  49. Page AV, Liles WC: Biomarkers of endothelial activation/dysfunction in infectious diseases. Virulence. 2013, 4: 507-516. 10.4161/viru.24530.

    Article  PubMed  Google Scholar 

  50. Kelly JT, Busse WW: Host immune responses to rhinovirus: mechanisms in asthma. J Allergy Clin Immunol. 2008, 122: 671-682. 10.1016/j.jaci.2008.08.013.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  51. Fay WP, Garg N, Sunkar M: Vascular functions of the plasminogen activation system. Arterioscler Thromb Vasc Biol. 2007, 27: 1231-1237. 10.1161/ATVBAHA.107.140046.

    Article  PubMed  CAS  Google Scholar 

  52. Duchemin J, Pan-Petesch B, Arnaud B, Blouch MT, Abgrall JF: Influence of coagulation factors and tissue factor concentration on the thrombin generation test in plasma. Thromb Haemost. 2008, 99: 767-773.

    PubMed  CAS  Google Scholar 

  53. Stouthard JM, Levi M, Hack CE, Veenhof CH, Romijn HA, Sauerwein HP, van der Poll T: Interleukin-6 stimulates coagulation, not fibrinolysis, in humans. Thromb Haemost. 1996, 76: 738-742.

    PubMed  CAS  Google Scholar 

  54. Bouwman JJ, Visseren FL, Bosch MC, Bouter KP, Diepersloot RJ: Procoagulant and inflammatory response of virus-infected monocytes. Eur J Clin Invest. 2002, 32: 759-766. 10.1046/j.1365-2362.2002.01041.x.

    Article  PubMed  CAS  Google Scholar 

  55. Visseren FL, Bouwman JJ, Bouter KP, Diepersloot RJ, de Groot PH, Erkelens DW: Procoagulant activity of endothelial cells after infection with respiratory viruses. Thromb Haemost. 2000, 84: 319-324.

    PubMed  CAS  Google Scholar 

  56. Keller TT, van Wissen M, Mairuhu AT, van Doornum GJ, Brandjes DP: Acute respiratory tract infections in elderly patients increase systemic levels of hemostatic proteins. J Thromb Haemost. 2007, 5: 1567-1569. 10.1111/j.1538-7836.2007.02580.x.

    Article  PubMed  CAS  Google Scholar 

  57. Meijers JC, Middeldorp S, Tekelenburg W, van den Ende AE, Tans G, Prins MH, Rosing J, Buller HR, Bouma BN: Increased fibrinolytic activity during use of oral contraceptives is counteracted by an enhanced factor XI-independent down regulation of fibrinolysis: a randomized cross-over study of two low-dose oral contraceptives. Thromb Haemost. 2000, 84: 9-14.

    PubMed  CAS  Google Scholar 

  58. Middeldorp S, Meijers JC, van den Ende AE, van Enk A, Bouma BN, Tans G, Rosing J, Prins MH, Buller HR: Effects on coagulation of levonorgestrel- and desogestrel-containing low dose oral contraceptives: a cross-over study. Thromb Haemost. 2000, 84: 4-8.

    PubMed  CAS  Google Scholar 

  59. Li X, Ward C, Thien F, Bish R, Bamford T, Bao X, Bailey M, Wilson JW, Haydn WE: An antiinflammatory effect of salmeterol, a long-acting beta(2) agonist, assessed in airway biopsies and bronchoalveolar lavage in asthma. Am J Respir Crit Care Med. 1999, 160: 1493-1499. 10.1164/ajrccm.160.5.9811052.

    Article  PubMed  CAS  Google Scholar 

  60. Uzkeser H, Cadirci E, Halici Z, Odabasoglu F, Polat B, Yuksel TN, Ozaltin S, Atalay F: Anti-inflammatory and antinociceptive effects of salbutamol on acute and chronic models of inflammation in rats: involvement of an antioxidant mechanism. Mediators Inflamm. 2012, 2012: 438912-

    Article  PubMed  PubMed Central  Google Scholar 

  61. Iribarren C, Tolstykh IV, Miller MK, Sobel E, Eisner MD: Adult asthma and risk of coronary heart disease, cerebrovascular disease, and heart failure: a prospective study of 2 matched cohorts. Am J Epidemiol. 2012, 176: 1014-1024. 10.1093/aje/kws181.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank H.W. van Eijk, and J.A. Karlas (Dept. of Virology, Academic Medical Centre, Amsterdam, The Netherlands), B.S. Dierdorp and T. Dekker (Dept. of Experimental Immunology, Academic Medical Centre, Amsterdam, The Netherlands), C. Hau and A. Boïng (Dept. of Clinical Chemistry, Academic Medical Centre, Amsterdam, The Netherlands) and M. Weijne and W.F. Kopatz (Dept. of Experimental Vascular Medicine, Academic Medical Centre, Amsterdam, The Netherlands) for their help with this study.

Funding

This study was supported by a grant from the Dutch Asthma Foundation (grant 3-2-07-012 to KvdS), The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christof J Majoor.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

Conception and design: KS, RL, PS, CJM, PWK, and EHDB. Data collection: KS, MP CJM Analysis and interpretation: CJM, PWK, JCMM, RM, KCW, TP, RN, EHDB, SLJ, KS, Drafting and editing manuscript: all authors. All authors read and approved the final manuscript.

Electronic supplementary material

12931_2013_1462_MOESM1_ESM.doc

Additional file 1: Evaluation of coagulation activation after Rhinovirus infection in patients with asthma and healthy control subjects: an observational study.(DOC 48 KB)

12931_2013_1462_MOESM2_ESM.bmp

Additional file 2: Figure E1: Associations between fold changes of inflammatory parameters and hemostatic proteins and fibrin generation test in BAL-fluid after RV16-infection. (BMP 181 KB)

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Cite this article

Majoor, C.J., van de Pol, M.A., Kamphuisen, P.W. et al. Evaluation of coagulation activation after Rhinovirus infection in patients with asthma and healthy control subjects: an observational study. Respir Res 15, 14 (2014). https://0-doi-org.brum.beds.ac.uk/10.1186/1465-9921-15-14

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1465-9921-15-14

Keywords