Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Bias in nutrition-health associations is not eliminated by excluding extreme reporters in empirical or simulation studies

Nao Yamamoto, View ORCID ProfileKeisuke Ejima, View ORCID ProfileRoger S. Zoh, View ORCID ProfileAndrew W. Brown
doi: https://doi.org/10.1101/2022.10.16.22281148
Nao Yamamoto
1School of Human Evolution and Social Change, Arizona State University, Tempe, AZ, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Keisuke Ejima
2Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, IN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Keisuke Ejima
  • For correspondence: ejimakeisuke{at}gmail.com
Roger S. Zoh
2Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, IN, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Roger S. Zoh
Andrew W. Brown
3Department of Biostatistics, University of Arkansas for Medical Sciences, Little Rock, AR, USA
4Arkansas Children’s Research Institute, Little Rock, AR, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Andrew W. Brown
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Self-reported nutrition intake (NI) data are prone to reporting bias that may induce bias in estimands in nutrition studies; however, they are used anyway due to high feasibility. We examined whether applying Goldberg cutoffs to remove “implausible” self-reported NI could reliably reduce bias compared to biomarkers for energy, sodium, potassium, and protein. Using IDATA data, significant bias in mean NI was removed with Goldberg cutoffs (120 among 303 participants excluded). Associations between NI and outcomes (weight, waist circumference, heart rate, systolic/diastolic blood pressure, and VO2 max) were estimated, but sample size was insufficient to evaluate bias reductions. We therefore simulated data based on IDATA. Significant bias in simulated associations using self-reported NI was reduced but not eliminated by Goldberg cutoffs in 14 of 24 nutrition-outcome pairs; bias was not reduced for remaining cases. 95% coverage probabilities were improved by applying Goldberg cutoffs in most cases but underperformed compared with biomarker data. Although Goldberg cutoffs may achieve bias elimination in estimating mean NI, bias in estimates of associations between NI and outcomes will not necessarily be reduced or eliminated after application of Goldberg cutoffs. Whether one uses Goldberg cutoffs should therefore be decided based on research purposes and not general rules.

Impact Statement Elimination of extreme reporters using Goldberg cutoffs does not always produce unbiased estimates of associations between nutrition intakes and health outcomes.

Competing Interest Statement

AWB declares: in the past three years (since 2019-09-19), Dr. Brown has received travel expenses from International Food Information Council; speaking fees from Eastern North American Region of the International Biometric Society, Purchaser Business Group on Health, Purdue University, and University of Arkansas for the Medical Sciences; monetary awards from American Society for Nutrition; consulting fees from LA NORC, Pennington Biomedical Research Center, and Soy Nutrition Institute Global; and grants through his institution from Alliance for Potato Research & Education, American Egg Board, National Cattlemen's Beef Association, NIH/NHLBI, NIH/NIDDK, and NIH/NIGMS. In addition, he has been involved in research for which his institution or colleagues have received grants or contracts from Center for Open Science, Gordon and Betty Moore Foundation, Hass Avocado Board, Indiana CTSI, NIH/NCATS, NIH/NCI, NIH/NHLBI, NIH/NIA, NIH/NIGMS, NIH/NLM, and Sloan Foundation. His wife is employed by Reckitt Benckiser. NY, KE, and RZ declare that they have no competing interests.

Funding Statement

NIH grants R25HL124208, R25DK099080, R25GM141507, 1R01DK132385-01, U01-CA057030-29S1. Japan Society for Promotion of Science (JSPS) KAKENHI grant 18K18146. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or any other organization.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Not Applicable

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

IRB approval was not necessary as we used deidentified data.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Not Applicable

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Not Applicable

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Not Applicable

Footnotes

  • Sources of Support: NIH grants R25HL124208, R25DK099080, R25GM141507, 1R01DK132385-01, U01-CA057030-29S1. Japan Society for Promotion of Science (JSPS) KAKENHI grant 18K18146. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or any other organization.

  • Data sharing: Code book and analytic code will be made publicly and freely available without restriction at http://doi.org/10.5281/zenodo.7013204. Data described in the manuscript are available through the National Cancer Institute per their terms of use.

  • Competing Interests: AWB declares: in the past three years (since 2019-09-19), Dr. Brown has received travel expenses from International Food Information Council; speaking fees from Eastern North American Region of the International Biometric Society, Purchaser Business Group on Health, Purdue University, and University of Arkansas for the Medical Sciences; monetary awards from American Society for Nutrition; consulting fees from LA NORC, Pennington Biomedical Research Center, and Soy Nutrition Institute Global; and grants through his institution from Alliance for Potato Research & Education, American Egg Board, National Cattlemen’s Beef Association, NIH/NHLBI, NIH/NIDDK, and NIH/NIGMS. In addition, he has been involved in research for which his institution or colleagues have received grants or contracts from Center for Open Science, Gordon and Betty Moore Foundation, Hass Avocado Board, Indiana CTSI, NIH/NCATS, NIH/NCI, NIH/NHLBI, NIH/NIA, NIH/NIGMS, NIH/NLM, and Sloan Foundation. His wife is employed by Reckitt Benckiser. NY, KE, and RZ declare that they have no competing interests.

Data Availability

Code book and analytic code will be made publicly and freely available without restriction at http://doi.org/10.5281/zenodo.7013204. Data described in the manuscript are available through the National Cancer Institute per their terms of use (https://biometry.nci.nih.gov/cdas/idata/).

https://biometry.nci.nih.gov/cdas/idata/

  • Abbreviations

    AARP
    American Association of Retired Persons
    ASA24
    Automated Self-Administered 24-Hour Dietary Assessment Tool
    BIO
    biomarker
    BW
    body weight
    DBP
    resting diastolic blood pressure
    DHQ-II
    Diet History Questionnaire
    DLW
    doubly labeled water
    EI
    energy intake
    EE
    energy expenditure
    FFM
    fat-free mass
    FM
    fat mass
    G
    Goldberg cutoffs
    HO
    health outcome
    HR
    heart rate
    IDATA
    Interactive Diet and Activity Tracking in American Association of Retired Persons
    MSE
    mean squared error
    NI
    nutrition intake
    PoI
    potassium intake
    PrI
    protein intake
    SI
    sodium intake
    SBP
    resting systolic blood pressure
    SR
    self-reported
    VO2
    VO2 max
    WC
    waist circumference.
  • Copyright 
    The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
    Back to top
    PreviousNext
    Posted October 23, 2022.
    Download PDF
    Data/Code
    Email

    Thank you for your interest in spreading the word about medRxiv.

    NOTE: Your email address is requested solely to identify you as the sender of this article.

    Enter multiple addresses on separate lines or separate them with commas.
    Bias in nutrition-health associations is not eliminated by excluding extreme reporters in empirical or simulation studies
    (Your Name) has forwarded a page to you from medRxiv
    (Your Name) thought you would like to see this page from the medRxiv website.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Share
    Bias in nutrition-health associations is not eliminated by excluding extreme reporters in empirical or simulation studies
    Nao Yamamoto, Keisuke Ejima, Roger S. Zoh, Andrew W. Brown
    medRxiv 2022.10.16.22281148; doi: https://doi.org/10.1101/2022.10.16.22281148
    Twitter logo Facebook logo LinkedIn logo Mendeley logo
    Citation Tools
    Bias in nutrition-health associations is not eliminated by excluding extreme reporters in empirical or simulation studies
    Nao Yamamoto, Keisuke Ejima, Roger S. Zoh, Andrew W. Brown
    medRxiv 2022.10.16.22281148; doi: https://doi.org/10.1101/2022.10.16.22281148

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Subject Area

    • Nutrition
    Subject Areas
    All Articles
    • Addiction Medicine (349)
    • Allergy and Immunology (668)
    • Allergy and Immunology (668)
    • Anesthesia (181)
    • Cardiovascular Medicine (2648)
    • Dentistry and Oral Medicine (316)
    • Dermatology (223)
    • Emergency Medicine (399)
    • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (942)
    • Epidemiology (12228)
    • Forensic Medicine (10)
    • Gastroenterology (759)
    • Genetic and Genomic Medicine (4103)
    • Geriatric Medicine (387)
    • Health Economics (680)
    • Health Informatics (2657)
    • Health Policy (1005)
    • Health Systems and Quality Improvement (985)
    • Hematology (363)
    • HIV/AIDS (851)
    • Infectious Diseases (except HIV/AIDS) (13695)
    • Intensive Care and Critical Care Medicine (797)
    • Medical Education (399)
    • Medical Ethics (109)
    • Nephrology (436)
    • Neurology (3882)
    • Nursing (209)
    • Nutrition (577)
    • Obstetrics and Gynecology (739)
    • Occupational and Environmental Health (695)
    • Oncology (2030)
    • Ophthalmology (585)
    • Orthopedics (240)
    • Otolaryngology (306)
    • Pain Medicine (250)
    • Palliative Medicine (75)
    • Pathology (473)
    • Pediatrics (1115)
    • Pharmacology and Therapeutics (466)
    • Primary Care Research (452)
    • Psychiatry and Clinical Psychology (3432)
    • Public and Global Health (6527)
    • Radiology and Imaging (1403)
    • Rehabilitation Medicine and Physical Therapy (814)
    • Respiratory Medicine (871)
    • Rheumatology (409)
    • Sexual and Reproductive Health (410)
    • Sports Medicine (342)
    • Surgery (448)
    • Toxicology (53)
    • Transplantation (185)
    • Urology (165)