#511: Null By Design – When “No Effect” Doesn’t Mean No Effect

Listen Here:

Click or simply search “Sigma Nutrition” on your podcast platform of choice.

Or listen directly on the Sigma website here.

Introduction

Numerous nutrition studies present findings of “no effect,” but interpreting such results requires caution. A null finding, indicating an absence of impact from a nutrient or exposure, may not necessarily suggest a lack of effect overall. Instead, it could stem from issues related to the study’s design, the nature of the exposure, or participant characteristics.

We’ve often referred to such studies as being “null by design”.

These studies, often termed “null by design,” may yield inconclusive results due to insufficient contrast in exposure levels to reveal a significant effect size. Additionally, participants’ baseline nutrient status or intake can contribute to false negatives. For instance, if a study provides a nutrient to individuals already replete in that nutrient, it may lead to an erroneous conclusion. This phenomenon can be understood by considering the bell curve of activity for a nutrient.

Moreover, a lack of methodological rigor can generate ‘false negatives.’ If previous literature indicates associations between high intake of a specific food or nutrient and certain outcomes, a study comparing levels of intake well below that threshold may produce a misleading result.

Some challenges arise from an overly reductionist perspective. In disease processes, reductionism simplifies diseases to a single primary source at the cellular and molecular level. This perspective assumes that if a nutrient shows a relationship with health or disease outcomes at a population level, its biological activity should manifest in isolation. However, applying such assumptions to exposures like diet may not be tenable.

In this discussion, we delve into the concept of “null by design” and present three specific studies with null findings, emphasizing the need for careful interpretation.

Related resources

Overview

The Hosts

Click through to your app of choice to listen and subscribe:

Dr. Alan Flanagan has a PhD in nutrition from the University of Surrey, where his doctoral research focused on circadian rhythms, feeding, and chrononutrition.

This work was based on human intervention trials. He also has a Masters in Nutritional Medicine from the same institution.

Dr. Flanagan is a regular co-host of Sigma Nutrition Radio. He also produces written content for Sigma Nutrition, as part of his role as Research Communication Officer.

Dr. Alan Flanagan
a PhD in nutrition from the University of Surrey

Danny Lennon has a master’s degree (MSc.) in Nutritional Sciences from University College Cork, and he is the founder of Sigma Nutrition.

Danny is currently a member of the Advisory Board of the Sports Nutrition Association, the global regulatory body responsible for the standardisation of best practice in the sports nutrition profession.

Danny Lennon
MSc. in Nutritional Sciences from University College Cork
Useful Terminology for this Episode
  • Exposure: a factor or variable that researchers investigate to determine its relationship with a particular health outcome.
  • Reductionism: the approach of breaking down complex biological systems or phenomena into simpler, isolated components for study. This method involves focusing on individual nutrients, isolated compounds, or specific dietary factors to understand their effects on health or disease.
  • WHI: Womenʼs Health Initiative – a series of clinical studies by the National Institutes of Health (NIH) looking at major health issues in postmenopausal women.
  • HOPE: Heart Outcomes Prevention Evaluation trial – RCT looking at whether long-term supplementation with vitamin E decreases the risk of cancer, cancer death, and major cardiovascular events.
  • ATBC: The Alpha-Tocopherol, Beta Carotene Cancer Prevention Study – RCT looking at supplementation with alpha-tocopherol, beta carotene, or both on the incidence of lung cancer in male smokers.

Introduction to this Episode

Numerous nutrition studies present findings of “no effect,” but interpreting such results requires caution. A null finding, indicating an absence of impact from a nutrient or exposure, may not necessarily suggest a lack of effect overall.

Instead, it could stem from issues related to the studyʼs design, the nature of the exposure, or participant characteristics.

Weʼve o en referred to such studies as being “null by design”.

These studies, o en termed “null by design,” may yield inconclusive results due to insufficient contrast in exposure levels to reveal a significant effect size. Additionally, participantsʼ baseline nutrient status or intake can contribute to false negatives.

For instance, if a study provides a nutrient to individuals already replete in that nutrient, it may lead to an erroneous conclusion. This phenomenon can be understood by considering the bell curve of activity for a nutrient.

Moreover, a lack of methodological rigor can generate ʻfalse negatives.ʼ If previous literature indicates associations between high intake of a specific food or nutrient and certain outcomes, a study comparing levels of intake well below that threshold may produce a misleading result.

Some challenges arise from an overly reductionist perspective. In disease processes, reductionism simplifies diseases to a single primary source at the cellular and molecular level. This perspective assumes that if a nutrient shows a relationship with health or disease outcomes at a population level, its biological activity should manifest in isolation. However, applying such assumptions to exposures like diet may not be tenable.

In this discussion, we delve into the concept of “null by design” and present three specific studies with null findings, emphasizing the need for careful interpretation.

Premium Content

You are currently not signed-in as a Premium subscriber.

To view our Premium content, please log-in to your account or subscribe to Premium.

Explore

Unlock the Power of Sigma Nutrition with Premium

Significantly deepen your understanding of nutrition science and become truly confident in your knowledge.