Oxygen Saturation or breathlessness? – how best to predict pneumonia in patients presenting with a cough to primary care
==========================================================================================================================

* Elspeth Chambers
* Beth Stuart
* Michael Moore
* Mark Lown

## SYNOPSIS

**Background** Distinguishing pneumonia from acute bronchitis has an important bearing on treatment decisions. The best validated diagnostic decision rule was derived from the GRACE-09 study. The 3Cs study provides oxygen saturations in addition to clinical signs and symptoms. Oxygen saturation is a predictor in hospital settings and may be beneficial in primary care.

**Objectives** This project evaluates whether the data from GRACE-09 and 3Cs studies can be mapped onto each other and be combined dataset to refine the diagnostic accuracy of the GRACE-09 clinical prediction rule for the diagnosis of pneumonia.

**Patients and Methods** GRACE-09 included 3106 patients with acute cough in a multicentre European study. 3Cs is a UK based study of 28883 patients with acute cough.

Binary logistic regression was used in the 3Cs dataset to determine which variables significantly predicted low oxygen saturation (<95%). Statistically significant predictors were determined using area under curve (AUC). This equation was used to model the probability of low oxygen saturation in the GRACE-09 dataset and subsequently included in the GRACE-09 model to determine whether low oxygen saturation is a comparable predictor to breathlessness in predicting pneumonia.

**Results** For 3Cs, using all seven variables achieved an AUC for low oxygen saturation of 0.73 (95% CI 0.72-0.74). Substituting low oxygen saturation into GRACE-09 model gives AUC 0.75 (95% CI 0.69-0.82) compared to original GRACE-09 using breathlessness and gives AUC 0.77 (95% CI 0.73-0.82).

**Conclusions** Low oxygen saturation and breathlessness are similarly predictive and could be used interchangeably in a modified GRACE-09 prediction model.

**KEY MESSAGES** Can pulse oximetry replace subjective breathlessness assessment in the GRACE-09 prediction rule? Pulse oximetry gives an objective measurement that can be used to assist the diagnosis of pneumonia in primary care.

KEY WORDS
*   Pneumonia
*   primary health care
*   acute cough
*   breathlessness
*   adult
*   oxygen saturation

## INTRODUCTION

Acute lower respiratory tract infections (LRTI) are a major cause of preventable deaths worldwide.1 It has been found that the majority of patients who present to primary care with an acute cough or LRTI are diagnosed as having acute bronchitis and the minority as having pneumonia.2–6 Acute bronchitis is a self-limiting condition with limited benefit from antibiotics, whereas pneumonia is a more serious illness that requires treatment with antibiotics as, if left untreated, it can be fatal.6–9

The yearly prevalence of community acquired pneumonia (CAP) in adults in the UK is 0.3% in a primary care setting.10–12

Many of the symptoms of pneumonia are non-specific and shared with other conditions, such as bronchitis and asthma, consequently the clinical diagnosis of pneumonia is difficult and is likely to miss many radiographic diagnoses.6, 13 Whilst NICE suggests that chest x-ray (CXR) is considered to be the gold standard for the diagnosis of pneumonia this is not routinely available in primary care.14 Patients with pneumonia often present with raised temperature (≥37.8°C), crackles on auscultation, raised pulse (>100 beats/min) and reduced blood oxygen saturation (< 95%), but these may also be signs of acute bronchitis or other self-limiting illnesses.6, 15, 16 Clinically distinguishing between pneumonia and other conditions in primary care without further investigations is challenging. With this diagnostic uncertainty GPs opt to over-treat rather than undertreat.13, 17–19 In addition any short-term benefits of antibiotic treatments should be balanced against the risks of side-effects (21% of people reported moderate side effects and 5% major side effects) and possible increase in resistance due to overuse or misuse.3, 20, 21 A British primary care systematic review suggested that GPs prescribe an antibiotic if there is diagnostic uncertainty.22 The fear of missing an important diagnosis results in increased antibiotic prescribing, exacerbated by the absence of effective predictor algorithms.6, 22 Diagnostic uncertainty is one of the drivers of antibiotic overprescribing and hence improved precision in diagnostic algorithms may be helpful to counter this.14

Prediction rules can be used to guide clinical decision making about antibiotic prescribing.23, 24 Currently point of care tests are not widely used in the UK. Therefore, prediction rules which enable decision-making based on a combination of signs and symptoms rather than diagnostic tests, may be more useful.18, 25 Prediction rules are useful in increasing diagnostic accuracy for pneumonia and assist by excluding those patients at low risk of pneumonia, thus reducing inappropriate antibiotic prescribing.13 Two prediction rules currently available to aid in the diagnosis of pneumonia in primary care are Genomics to combat Resistance against Antibiotics in Community-acquired LRTI in Europe (GRACE-09) and Cough Complication Cohort (3Cs). These both combine physical signs and symptoms with blood test results.6, 15, 16

Previous paediatric studies have investigated the clinical signs predictive of low oxygen saturation. In children the best predictors of hypoxaemia, are accessory muscle use and pulsus paradoxus.29 Other signs predictive of low oxygen saturation are cyanosis (highly specific but low sensitivity) and increased respiratory rate of ≥60 breaths/min.1, 29–31 These clinical signs are different to those found to be predictive of hypoxaemia in adults so are of limited applicability in an adult population.

The 3Cs prediction rule includes pulse oximetry, now widely available in primary care but not available during the earlier GRACE-09 study. Instead, the GRACE-09 study included information on breathlessness. As recruitment was from routine consultations involving a wide range of doctors and practices, it is felt to be a large generalisable cohort study.16

In the time limited GP consultation, a prediction rule assisting in the identification of highest risk patients for pneumonia could improve antibiotic stewardship.20, 32 There are limitations to both of the existing prediction rules. A more complete dataset would include pulse oximetry and a CXR for every participant. Both the 3Cs and GRACE-09 studies are important investigations which have potential to significantly influence appropriate primary care prescribing for LRTIs.

This project seeks to evaluate whether the data from these two studies can be mapped onto each other and if the combined information can improve the accuracy of the diagnosis of pneumonia.

Our objective was to evaluate whether the data from GRACE-09 and 3Cs studies can be mapped onto each other and whether the combined dataset can be used to refine the diagnostic accuracy of the GRACE-09 clinical prediction rule for the diagnosis of pneumonia.

## PATIENT AND METHODS

### Study Design

This study sought to determine which variables, present at initial consultation, were best predictive of oxygen saturation in the 3Cs dataset and whether this modelled value of oxygen saturation could be used in the GRACE dataset to predict pneumonia.

### Participants - GRACE

A cohort of 3106 patients with acute cough were recruited from 294 GPs in 16 primary care research networks in 12 European countries during three winters between 2007 and 2010.6

The presenting features of the patient’s signs and symptoms, comorbidities, medication use and the working clinical diagnosis at presentation was documented. Patients had a CXR within 7 days, which was reported by a radiologist’s blind to the patient’s clinical information. The report was categorised as: “normal CXR”, “acute bronchitis”, “lobar or bronchopneumonia” or “other”. GPs were not informed of the diagnosis until after the study was completed unless the CXR found consolidation or any other diagnosis that required further investigation.6

### Inclusion Criteria

Patients were included if they were aged 18 and older, presented with an acute or worsened cough (≤28-day duration) that was considered to be caused by LRTI by the GP.6

### Exclusion Criteria

They were excluded if this was a second presentation for this same illness episode, if they were pregnant, breastfeeding or were immunocompromised.6

### Participants - 3Cs

A cohort of 28883 patients were recruited between 2009-13 from 522 practices in the UK that presented with an acute cough that was recognised as a LRTI. Of these patients 720 (2.4%) had a CXR within the first 7 days.16

3Cs is a prospective cohort study. The presenting features and management were documented by the physician. Data was collected on age, smoking history, prior duration of symptoms, nature and the severity of symptoms, examination as well as a rating of illness severity and antibiotic prescribing.16, 21

Medical records were reviewed to determine CXR results and additional data on re-consultations and hospitalisation or death during the 30 days after the initial consultation.16

### Inclusion Criteria

Patients were included if they were aged 16 and older who presented with a new illness. The main presenting symptom was a new or worsening cough for 3 weeks or less (acute cough), that was judged to be infective in origin by the physician.9, 16

### Exclusion Criteria

Patients were excluded if they presented to the physician with other causes of acute cough, such as heart failure; they were unable to complete a patient diary, due to severe mental illness or dementia; had presented previously with the same episode of illness; were immunocompromised.16

Characteristics in the derived decision rules from the two studies are shown in Table 1.

View this table:
[Table 1](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/T1)

Table 1 
Comparison of clinical findings predictive of pneumonia in GRACE-09 and 3Cs cohort studies6, 15, 16

### Statistical Analysis

#### Step 1 – Prediction of oxygen saturation in the 3Cs study

Oxygen saturation was assessed in the 3Cs study using pulse oximetry. The distribution of oxygen saturations recorded in primary care is a highly skewed variable, with most values being 97% or higher (Figure 1) so it is inappropriate to use a linear model. Given the need for GPs to rule out those at low risk and rule in those at high risk for further investigation or treatment, it was appropriate to treat oxygen saturation as a binary variable. For the purposes of this study, impaired oxygen saturation was defined as a value of less than 95% (as in the 3C study).16 Potential predictors included patient characteristics (age, gender and medical history), patient reported symptoms at presentation and clinical signs found on examination of the patient at the primary consultation.

![Figure 1](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2020/09/11/2020.09.09.20191650/F1.medium.gif)

[Figure 1](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/F1)

Figure 1 
Histogram showing distribution of oxygen saturation in the 3Cs dataset

To determine which variables were statistically significant in the prediction of low oxygen saturation, a binary logistic regression model was used. The predictive value of statistically significant predictors from the logistic regression model was then determined using area under the receiver operating curve (AUC). Variables were sequentially added to the receiver operating characteristic (ROC) curve analysis starting with the most predictive in a univariate analysis.

#### Step 2 – Prediction of oxygen saturation in the GRACE study

The regression equation from the model developed from the 3Cs study was then applied to the participant data in the GRACE dataset to model probability of low oxygen saturation. The output of logistic regression is the predicted probability of low oxygen saturation.

To determine the optimal cut-point for low oxygen saturation the Liu method was used to select the point that maximised the sensitivity and specificity.33

This imputed probability of low oxygen saturation was then included in the prediction rule and the AUC analysed to determine whether it improved the ability of the GRACE-09 prediction model to rule in and rule out pneumonia.

The calibration of both the models was assessed using the Hosmer-Lemeshow statistic.34

## RESULTS

### Participant Characteristics

Both the 3Cs and GRACE datasets are from existing completed prospective cohort studies. The key characteristics of the study populations are summarised below in Table 2. The patient characteristics in both datasets are similar. In both there was an over representation of female participants. The majority in both datasets were below 60 years old.

View this table:
[Table 2](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/T2)

Table 2 
Baseline characteristics of study participants in 3Cs and GRACE cohort studies

Overall, whilst there was a higher prevalence of some signs and symptoms in 3Cs than in GRACE-09, given that the inclusion and exclusion criteria are broadly similar it seems unlikely that the populations examined are significantly different.

### Predictors of low oxygen saturation in the 3Cs dataset

Logistic regression analysis of 3Cs data suggested that the significant predictors of a low oxygen saturation were “ever smoked”, wheeze, lung comorbidity (asthma, COPD or other lung disease), confusion, gender, respiratory rate and age (Table 3).

View this table:
[Table 3](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/T3)

Table 3 
Variables predictive of low oxygen saturation in 3Cs dataset

![Formula][1]</img> 
The variables were added sequentially into an AUC curve analysis, beginning with the most predictive and the AUC is presented for each step in Table 4.

View this table:
[Table 4](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/T4)

Table 4 
AUC of successive statistical models combining the significantly predictive clinical signs from 3Cs dataset

The final model including all seven variables gave an AUC of 0.73 (95% CI 0.72-0.74) (Figure 2). The Hosmer-Lemeshow test value of p = 0.581 indicates that this data is well calibrated for determining low oxygen saturation.

![Figure 2](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2020/09/11/2020.09.09.20191650/F2.medium.gif)

[Figure 2](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/F2)

Figure 2 
ROC curve showing AUC of variables predictive of low oxygen saturation in 3Cs dataset.

The equation for predicting a low oxygen saturation that was generated by the AUC analysis (Table 3) and is shown above in Equation 1.

### Predicting low oxygen saturation in the GRACE dataset

Using the equation derived from the 3Cs dataset above (Equation 1) enabled prediction of the probability of low oxygen saturations in the GRACE dataset. With this modelled value of low oxygen saturation, the GRACE-09 prediction rule was re-run (raised pulse (>100 bpm), raised temperature (≥37.8°C), raised CRP (>30mg/L), diminished breath sounds on auscultation, absence of runny nose, breathlessness, crackles on auscultation), but substituting low oxygen saturation in the revised rule for breathlessness in the original GRACE rule. The revised rule generates an AUC of 0.76 (95% CI 0.69-0.82) (Figure 4).

![Figure 3](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2020/09/11/2020.09.09.20191650/F3.medium.gif)

[Figure 3](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/F3)

Figure 3 
AUC using GRACE-09 prediction rule with breathlessness.

![Figure 4](http://medrxiv.org/http://medrxiv.stage.highwire.org/content/medrxiv/early/2020/09/11/2020.09.09.20191650/F4.medium.gif)

[Figure 4](http://medrxiv.org/content/early/2020/09/11/2020.09.09.20191650/F4)

Figure 4 
AUC using revised GRACE-09 prediction rule with binary value of low oxygen saturation

The revised rule replacing breathlessness with oxygen saturation can be compared to the original published GRACE-09 prediction rule which gave an AUC of 0.76 (95% CI 0.71-0.80) (Figure 3). The confidence intervals for these two rules are similar, suggesting there is no statistically significant difference between them.

The Hosmer-Lemeshow test value of p = 0.394 indicates that this revised GRACE-09 prediction rule (using a binary value for oxygen saturation) is well calibrated.

The original GRACE-09 prediction rule included measurement of CRP which is not routinely measured in a primary care setting in the UK.35 Therefore, further modelling using the GRACE dataset, but omitting the CRP test was undertaken and the AUC reduced to 0.71 (95% CI 0.66-0.76). Similar manipulation of the revised GRACE-09 prediction rule decreases the AUC to 0.70 (95% CI 0.63-0.77).

## DISCUSSION

### Main Findings

The research suggests that it is possible to map low oxygen saturation onto a combination of signs and symptoms, including age, gender, presence of wheeze, increased respiratory rate, history of smoking, lung comorbidity (asthma, COPD or other lung disease) and presence of confusion.

This study (using the GRACE dataset) concludes that when using a prediction rule for the diagnosis of community acquired pneumonia substituting low oxygen saturation for breathlessness results in a decision rule with similar performance to the original rule.

### Strengths and Limitations

Both the 3Cs and the GRACE are large cohort studies with large datasets including a significant number of signs, symptoms and clinical findings. Both studies recruited patients presenting in primary care, but it is impossible to exclude some selection bias due to the process of recruitment of participants.

The adult study population mean that findings should not be generalised to the paediatric population without further study. Whilst removing CRP from of the GRACE-09 prediction rule reduced the predictive value, it more accurately represents current practice in the UK.18 Similarly, treating low oxygen saturation as a binary variable means that this is an imputed value rather than an actual measured value. Further studies are required to confirm whether using measured values of oxygen saturation would give similar results. Ideally, such studies would need to collect data correlating oxygen saturations, breathlessness and CXRs. Some variables are missing for participants in both the GRACE and 3Cs datasets, potentially introducing bias, however when values were imputed in the original 3Cs study, this made no significant difference to the results generated.16 Whilst an AUC above 0.9 would be considered outstanding, the value of 0.76 is considered to be good.34.

### Overall Implications

There is currently poor correlation between the clinical and radiographic diagnosis of pneumonia. Whilst breathlessness is an important symptom for the patient to report, it is a subjective assessment and lacks objective correlation.36 The pulse oximeter however, assuming it is appropriately calibrated and accurate, will give a specific value which is indisputable. Pulse oximetry is an easily measured and robust technology. It is widely available in UK primary care and has few limitations (severe anaemia, hypovolemia, arrhythmias).16, 37–39

### Clinical Implications

A rule which is recognised as being highly predictive and easily utilised would assist in the accurate diagnosis and appropriate treatment of community acquired pneumonia. Diagnostic accuracy can be improved using a prediction rule based on a combination of the clinical signs and symptoms. Increasing the use of objective measurable variables such as oxygen saturation and reducing reliance on subjective symptoms increases the value of this predictive rule.16 This is relevant as an increasing number of clinical assessments are being performed by less experienced clinicians.

Antibiotic prescribing in patients presenting with cough to primary care should be limited to those with high risk of a diagnosis of community acquired pneumonia. Limiting the use of antibiotics to those at highest risk of pneumonia would lead to a reduction in the utilisation of antibiotics and reduce the threat of developing antimicrobial resistance.19

## Conclusion

Modification of an existing clinical decision rule to incorporate oxygen saturation in place of breathlessness has similar test performance. It is likely that breathlessness and oxygen saturation can be used interchangeably in the GRACE-09 prediction rules (original and revised) depending on the clinical situation.

## Data Availability

all data referred to in the manuscript is available

## FUNDING

This was an unfunded student project.

## TRANSPARENCY DECLARATION

None to declare

## ACKNOWLEDGEMENTS

This project was undertaken as a research project at University of Southampton Medical School and would not have been possible without the support, guidance and advice of all of my supervisors, Dr Beth Stuart, Dr Mark Lown and Professor Michael Moore.

*   Received September 9, 2020.
*   Revision received September 9, 2020.
*   Accepted September 11, 2020.


*   © 2020, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)

## REFERENCES

1.  1.Onyango FE, Steinhoff MC, Wafula EM, et al. Hypoxaemia in young Kenyan children with acute lower respiratory infection. BMJ: British Medical Journal 1993;306:612–615. 1993/03/06.
    
    

2.  2.Diehr P, Wood RW, Bushyhead J, et al. Prediction of pneumonia in outpatients with acute cough--a statistical approach. Journal of Chronic Diseases 1984;37:215–225. 1984/01/01.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/0021-9681(84)90149-8&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=6699126&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1984SK17000007&link_type=ISI) 

3.  3.Whaley LE, Businger AC, Dempsey PP, et al. Visit complexity, diagnostic uncertainty, and antibiotic prescribing for acute cough in primary care: a retrospective study. BMC Family Practice 2013;14.
    
    

4.  4.Teepe J, Broekhuizen BDL, Loens K, et al. Predicting the presence of bacterial pathogens in the airways of primary care patients with acute cough. Canadian Medical Association Journal 2017; 189:E50–e55. 2016/10/26. DOI: 10.1503/cmaj.151364.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czo5OiIxODkvMi9FNTAiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8xMS8yMDIwLjA5LjA5LjIwMTkxNjUwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

5.  5.Meili M, Kutz A, Briel M, et al. Infection biomarkers in primary care patients with acute respiratory tract infections–comparison of Procalcitonin and C-reactive protein. BMC Pulmonary Medicine 2016;16.
    
    

6.  6.van Vugt SF, Verheij TJ, de Jong PA, et al. Diagnosing pneumonia in patients with acute cough: clinical judgment compared to chest radiography. European Respiratory Journal 2013; 42: 1076–1082. 2013/01/26. DOI: 10.1183/09031936.00111012.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiZXJqIjtzOjU6InJlc2lkIjtzOjk6IjQyLzQvMTA3NiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzA5LzExLzIwMjAuMDkuMDkuMjAxOTE2NTAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

7.  7.Moberg AB, Taleus U, Garvin P, et al. Community-acquired pneumonia in primary care: clinical assessment and the usability of chest radiography. Scandinavian Journal of Primary Health Care 2016; 34:21–27. 2016/02/06. DOI: 10.3109/02813432.2015.1132889.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3109/02813432.2015.1132889&link_type=DOI) 

8.  8.Altiner A, Knauf A, Moebes J, et al. Acute cough: a qualitative analysis of how GPs manage the consultation when patients explicitly or implicitly expect antibiotic prescriptions. Family Practice 2004;21:500–506. 2004/09/16. DOI: 10.1093/fampra/cmh505.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/fampra/cmh505&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15367471&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000223940400005&link_type=ISI) 

9.  9.Smith SM, Fahey T, Smucny J, et al. Antibiotics for acute bronchitis. Cochrane Database of Systematic Reviews 2017. DOI: 10.1002/14651858.CD000245.pub4.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/14651858.CD000245.pub4&link_type=DOI) 

10. 10.National Institute for Health and Care Excellence (NICE). Pneumonia in adults: diagnosis and management., [https://www.nice.org.uk/guidance/cg191/chapter/1-Recommendations#presentation-with-lower-respiratory-tract-infection-2](https://www.nice.org.uk/guidance/cg191/chapter/1-Recommendations#presentation-with-lower-respiratory-tract-infection-2)(2014, accessed 28th March 2018).
    
    

11. 11.Capelastegui A, España PP, Bilbao A, et al. Study of community-acquired pneumonia: incidence, patterns of care, and outcomes in primary and hospital care. Journal of Infection 2010;61:364–371.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jinf.2010.07.015&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20692290&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000283848500002&link_type=ISI) 

12. 12.Schierenberg A, Minnaard MC, Hopstaken RM, et al. External Validation of Prediction Models for Pneumonia in Primary Care Patients with Lower Respiratory Tract Infection: An Individual Patient Data Meta-Analysis. PLOS ONE 2016;11.
    
    

13. 13.National Health Service (NHS). Pneumonia, [https://www.nhs.uk/conditions/pneumonia/](https://www.nhs.uk/conditions/pneumonia/) (2016, accessed 28th September 2018).
    
    

14. 14.Evertsen J, Baumgardner DJ, Regnery A, et al. Diagnosis and management of pneumonia and bronchitis in outpatient primary care practices. Primary Care Respiratory Journal 2010;19:237–241. 2010/05/22. DOI: 10.4104/pcrj.2010.00024.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.4104/pcrj.2010.00024&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=20490437&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 

15. 15.van Vugt SF, Broekhuizen BDL, Lammens C, et al. Use of serum C reactive protein and procalcitonin concentrations in addition to symptoms and signs to predict pneumonia in patients presenting to primary care with acute cough: diagnostic study. BMJ: British Medical Journal 2013;346.10.1136/bmj.f2450.
    
    

16. 16.Moore M, Stuart B, Little P, et al. Predictors of pneumonia in lower respiratory tract infections: 3C prospective cough complication cohort study. European Respiratory Journal 2017;50.
    
    

17. 17.National Health Service (NHS). Bronchitis, [https://www.nhs.uk/conditions/bronchitis/](https://www.nhs.uk/conditions/bronchitis/) (2018, accessed 6th December 2018).
    
    

18. 18.Ward C. Point-of-care C-reactive protein testing to optimise antibiotic use in a primary care urgent care centre setting. BMJ Open Quality 2018;7:e000391. DOI: 10.1136/bmjoq-2018-000391.
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiYm1qcWlyIjtzOjU6InJlc2lkIjtzOjExOiI3LzQvZTAwMDM5MSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzA5LzExLzIwMjAuMDkuMDkuMjAxOTE2NTAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

19. 19.Curtis HJ, Walker AJ, Mahtani KR,et al. Time trends and geographical variation in prescribing of antibiotics in England 1998-2017. The Journal of antimicrobial chemotherapy 2019;74:242–250. 2018/09/22. DOI: 10.1093/jac/dky377.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/jac/dky377&link_type=DOI) 

20. 20.McNulty CA, Nichols T, French DP, et al. Expectations for consultations and antibiotics for respiratory tract infection in primary care: the RTI clinical iceberg. The British journal of general practice: the journal of the Royal College of General Practitioners 2013;63:e429–436. 2013/07/10. DOI: 10.3399/bjgp13X669149.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMToiNjMvNjEyL2U0MjkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8xMS8yMDIwLjA5LjA5LjIwMTkxNjUwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

21. 21.Little P, Stuart B, Smith S, et al. Antibiotic prescription strategies and adverse outcome for uncomplicated lower respiratory tract infections: prospective cough complication cohort (3C) study. BMJ: British Medical Journal 2017;357. DOI: 10.1136/bmj.j2148.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNTcvbWF5MjJfNS9qMjE0OCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzA5LzExLzIwMjAuMDkuMDkuMjAxOTE2NTAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

22. 22.Teixeira Rodrigues A, Roque F, Falcao A, et al. Understanding physician antibiotic prescribing behaviour: a systematic review of qualitative studies. International Journal of Antimicrobial Agents 2013;41:203–212. 2012/11/07. DOI: 10.1016/j.ijantimicag.2012.09.003.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ijantimicag.2012.09.003&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23127482&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 

23. 23.Wootton D and Feldman C. The diagnosis of pneumonia requires a chest radiograph (x-ray)—yes, no or sometimes? pneumonia 2014;5:1–7. journal article. DOI: 10.15172/pneu.2014.5/464.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.15172/pneu.2014.5/464&link_type=DOI) 

24. 24.Lim WS, Baudouin SV, George RC, et al. BTS guidelines for the management of community acquired pneumonia in adults: update 2009. Thorax 2009;64:iii1. doi 10.1136/thx.2009.121434.
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6OToidGhvcmF4am5sIjtzOjU6InJlc2lkIjtzOjE1OiI2NC9TdXBwbF8zL2lpaTEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8xMS8yMDIwLjA5LjA5LjIwMTkxNjUwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

25. 25.Graffelman AW, le Cessie S, Knuistingh Neven A, et al. Can history and exam alone reliably predict pneumonia? The Journal of family practice 2007;56:465–470. 2007/06/05.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17543257&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000248119200011&link_type=ISI) 

26. 26.Bruyndonckx R, Hens N, Verheij TJ, et al. Development of a prediction tool for patients presenting with acute cough in primary care: a prognostic study spanning six European countries. The British journal of general practice: the journal of the Royal College of General Practitioners 2018;68:e342–e350 2018/04/11. DOI: 10.3399/bjgp18X695789.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMToiNjgvNjcwL2UzNDIiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8xMS8yMDIwLjA5LjA5LjIwMTkxNjUwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

27. 27.Algorithm to predict poor outcomes from cough. Drug and Therapeutics Bulletin 2018;56:99. DOI: 10.1136/dtb.2018.9.000018.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiZHRiIjtzOjU6InJlc2lkIjtzOjc6IjU2LzkvOTkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8xMS8yMDIwLjA5LjA5LjIwMTkxNjUwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

28. 28.Dwyer R, Hedlund J, Henriques-Normark B, et al. Improvement of CRB-65 as a prognostic tool in adult patients with community-acquired pneumonia. BMJ Open Respiratory Research 2014;1:e000038. 2014/12/06. DOI: 10.1136/bmjresp-2014-000038.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qcmVzcCI7czo1OiJyZXNpZCI7czoxMToiMS8xL2UwMDAwMzgiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wOS8xMS8yMDIwLjA5LjA5LjIwMTkxNjUwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

29. 29.Rahnama’i MS, Geilen RP, Singhi S, et al. Which clinical signs and symptoms predict hypoxemia in acute childhood asthma? Indian Journal of Pediatrics 2006;73:771–775. 2006/09/29.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/BF02790383&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=17006033&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 

30. 30.Laman M, Ripa P, Vince J, et al. Can clinical signs predict hypoxaemia in Papua New Guinean children with moderate and severe pneumonia? Annals of Tropical Paediatrics 2005;25:23–27. 2005/04/09. DOI: 10.1179/146532805x23317.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1179/146532805X23317&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=15814045&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000227537500004&link_type=ISI) 

31. 31.Dyke T, Lewis D, Heegaard W, et al. Predicting Hypoxia in Children with Acute Lower Respiratory Infection: a Study in the Highlands of Papua New Guinea. Journal of Tropical Pediatrics 1995;41:196–201. DOI: 10.1093/tropej/41.4.196.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/tropej/41.4.196&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=7563269&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1995RT73900002&link_type=ISI) 

32. 32.Tonkin-Crine S, Anthierens S, Francis NA, et al. Exploring patients’ views of primary care consultations with contrasting interventions for acute cough: a six-country European qualitative study. NPJ Primary Care Respiratory Medicine 2014; 24: 14026. 2014/07/18. DOI: 10.1038/npjpcrm.2014.26.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/npjpcrm.2014.26&link_type=DOI) 

33. 33.Liu X. Classification accuracy and cut point selection. Statistics in medicine 2012;31: 2676–2686. 2012/02/07. DOI: 10.1002/sim.4509.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/sim.4509&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22307964&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 

34. 34. DW Hosmer and Lemeshow S. Applied Logistic Regression. 2nd ed.: John Wiley and Sons, New York (NY), 2000, pp.160–164.
    
    

35. 35.Eley CV, Sharma A, Lecky DM, et al. Qualitative study to explore the views of general practice staff on the use of point-of-care C reactive protein testing for the management of lower respiratory tract infections in routine general practice in England. BMJ Open 2018;8:e023925. 2018/10/27. DOI: 10.1136/bmjopen-2018-023925.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiOC8xMC9lMDIzOTI1IjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMDkvMTEvMjAyMC4wOS4wOS4yMDE5MTY1MC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

36. 36.Berliner D, Schneider N, Welte T, et al. The Differential Diagnosis of Dyspnea. Deutsches Arzteblatt international 2016;113:834–845.
    
    

37. 37.DeMeulenaere S. Pulse Oximetry: Uses and Limitations. Journal for Nurse Practitioners 2007;3:312–317.
    
    

38. 38.Mardirossian G and Schneider RE. Limitations of pulse oximetry. Anesthesia Progress 1992;39:194–196. 1993/01/01.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=8250340&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom) 

39. 39.Chan ED and Chan MM. Pulse oximetry: understanding its basic principles facilitates appreciation of its limitations. Respiratory Medicine 2013;107:789–799. 2013/03/16. DOI: 10.1016/j.rmed.2013.02.004.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.rmed.2013.02.004&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23490227&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F09%2F11%2F2020.09.09.20191650.atom)

 [1]: /embed/graphic-6.gif