Diabetes Self-Management Blog

Don’t you hate it when a new food or drug study comes out, telling you that all previous studies were wrong? How are you supposed to trust studies, or even make sense of them, when they disagree with each other?

In May, I reported on some food studies that contradicted earlier studies of the same things. In one, a Boston-based research team found that egg consumption did not appear to have an association with the development of Type 2 diabetes. An earlier study by the same lead researcher had claimed that eggs were a sure path to diabetes.

Studies of herbs and drugs can also contradict each other. Studies can draw huge amounts of media attention and can shape diabetes treatment and self-management, without necessarily proving anything.

Why are studies so confusing? Isn’t science the most reliable path to the truth? Not always. A number of things can skew study results one way or another. For one thing, who was being studied? Do those subjects’ results reflect what will happen to you if you do the same thing?

Trials of cinnamon for glucose control differ based on the population studied. In Pakistan, researchers found a big benefit, but in Oklahoma there was no significant effect. Is this a surprise? The people were different; their diets were different; their medicines were probably different, so why should the results be the same?

Drugs work better for some people than others, too. The journal BMJ confirms that African-Americans with high blood pressure usually do better with diuretics (water pills). White Americans tend to do better with beta blockers. It’s not true for everyone; there are larger differences within ethnic groups than between them, but you want to know if the people being studied were people like you. Were people of your age, gender, ethnic background, and medical history included in the study group?

Can Studies Show Causes?
In media stories, studies often show cause. A Harvard group reported that eating white rice contributed to Type 2 diabetes. People who ate brown rice were less likely to develop Type 2. The story said that replacing white rice with brown rice could drastically reduce the risk of diabetes.

But how do they know what caused the difference? Most likely, the brown rice eaters had higher economic and educational levels, and were perhaps more health conscious, because that’s who eats brown rice. The researchers didn’t look at subjects’ socioeconomic status (SES), and SES has a strong association with diabetes.

This happens all the time. We’ll read that “being overweight causes diabetes,” for example. But all we know is that overweight people are more likely to develop diabetes. We don’t know why. There is a correlation between weight and T2D, but we don’t know what causes what.

A study that looks at a large group of people and finds that, for example, those who drink red wine have less heart disease is called a population study. Such a study can show correlation but cannot show causation. An article describing some different kinds of studies is available here.

Are Studies Honest?
Many studies are biased. A study might find that people who stayed on a drug had better results than people who quit. But most likely, the people who quit were the ones who weren’t getting much benefit anyway. This is called “attrition bias.” There may be “selection bias” when people who volunteer or are chosen for a study are different in some way than the general population. There may also be “observation bias” when observers see what they thought they would see or what they wanted to see, instead of what is actually happening.

Some studies are biased because of who is paying for them. According to this Veterans Administration paper, you want to know if the researchers have a reason for bias. Were they pushing some kind of an agenda, like a milk researcher who consults for the Dairy Council? Are the drug researchers paid by the drug company?

Sometimes study abstracts disclose information about such conflicts of interest. You can find abstracts at the government research site, PubMed. Just type in a study name, author, or a keyword and you’ll be able to find them.

The bottom line is that we should be skeptical towards studies, and even more so toward media reports. A drug trial might show that people who took Drug X had reduced A1C levels. The media will say “new breakthrough for people with diabetes!” But the actual study might say that the subjects were Ugandan tribesmen and the A1C reduction was .1%, so you might decide not to ask your doctor about this new drug yet.

Or you might see an article that says, “never eat another egg.” Two years later, the same team might come out and say the reverse. I think it’s best to wait for observations to be repeated by different researchers in different places with different populations, before acting on them. This is especially true with drugs, where dangerous side effects might not become known until the drug has been in use for a few years.

A site that has good analysis of diabetes-related studies and often debunks them is Diabetes Update. Are there other sites or resources that you have found helpful?

POST A COMMENT       
  

Comments
  1. The so called medical science tries to find truth by correlation. This is not science. Ultimately we will find how the human body works with biochemistry but don’t hold your breath.

    Posted by calgarydiabetic |
  2. What I find truly frustrating is when the results of a very well done study never see the light of day with the public. It is usually because the outcome has no financial benefit for a commercial concern who would spend money to get it out there.

    So much of what we see and read is “canned”… meaning someone (like pharmaceuticals) has paid for the polished media package, complete with video and “paid” experts to interview. Can’t really blame (well not too much) a media outlet for saving thousands of dollars on doing their own production.
    However the public is not well serve — some of the information expressed is marginal at best and often very misleading.

    Posted by John_C |

Post a Comment

Note: All comments are moderated and there may be a delay in the publication of your comment. Please be on-topic and appropriate. Do not disclose personal information. Be respectful of other posters. Only post information that is correct and true to your knowledge. When referencing information that is not based on personal experience, please provide links to your sources. All commenters are considered to be nonmedical professionals unless explicitly stated otherwise. Promotion of your own or someone else's business or competing site is not allowed: Sharing links to sites that are relevant to the topic at hand is permitted, but advertising is not. Once submitted, comments cannot be modified or deleted by their authors. Comments that don't follow the guidelines above may be deleted without warning. Such actions are at the sole discretion of DiabetesSelfManagement.com. Comments are moderated Monday through Friday by the editors of DiabetesSelfManagement.com. The moderators are employees of Madavor Media, LLC., and do not report any conflicts of interest. A privacy policy setting forth our policies regarding the collection, use, and disclosure of certain information relating to you and your use of this Web site can be found here. For more information, please read our Terms and Conditions.


Diabetes Research
Shift Work Tied to Increased Type 2 Diabetes Risk (07/31/14)
High-Salt Diet Doubles Heart Risk in Type 2 Diabetes (07/25/14)
Whey Protein to Prevent After-Meal Blood Sugar Spikes? (07/18/14)
Metformin More Effective in African-Americans (07/10/14)

 

 

Disclaimer of Medical Advice: You understand that the blog posts and comments to such blog posts (whether posted by us, our agents or bloggers, or by users) do not constitute medical advice or recommendation of any kind, and you should not rely on any information contained in such posts or comments to replace consultations with your qualified health care professionals to meet your individual needs. The opinions and other information contained in the blog posts and comments do not reflect the opinions or positions of the Site Proprietor.