Another Regnerus-Like “Research” Paper On Gay Parents Making the Rounds

Jim Burroway

July 7th, 2016

Paul Sullins, defending a flawed paper by Mark Regnerus.

Paul Sullins, defending a flawed paper by Mark Regnerus in 2013.

The Federalist website is giving this research significant play:

The study by sociology professor Paul Sullins found that “[a]t age 28, the adults raised by same-sex parents were at over twice the risk of depression as persons raised by man-woman parents.” In addition, there was an “elevated risk associated with imbalanced closeness and parental child abuse in family of origin; depression, suicidality, and anxiety at age 15; and stigma and obesity.”

Given these findings, Sullins concluded that “[m]ore research and policy attention to potentially problematic conditions for children with same-sex parents appears warranted.” This study is significant, Sullins writes, because other studies that have “reported ‘no differences’ in well-being” most often use “psychometric measures of depression or anxiety,” which has led to “a lapse in policy attention to the potential needs of such children.” Sullins’ research challenges the “benign findings” of these other studies.

“Reanalyses have confirmed, not surprisingly, the presence in such samples of strong ascertainment bias, social desirability bias, and/or positive reporting bias” in studies that have concluded there are no differences between children of same-sex couples and those of opposite-sex parents.

Let’s go to that paper, shall we? First of all, the good thing here is that the paper, published in the Egyptian journal Depression Research and Treatment, is available online for free. That’s also the bad thing, which I’ll get to later. Second, this paper has many of the same problems with the widely-panned 2012 paper by Mark Regnerus that purported to show that children of parents in same-sex relationships fared significantly more poorly than children who were raised in homes by their biological opposite-sex parents. In fact, Regnerus’s paper found no such thing, although he did his best to make his turd look nice and shiny.

Like Regnerus’s paper, Sullins says that he based his research on a nationally-represented sample from the US National Survey of Adolescent to Adult Health. He combed through 15,701 respondents, at ages 15, 22, and 28. But like Regnerus, Sullins quickly ran into a problem. Remember, Regnerus could only find two same-sex couples in his sample who had actually raised their children as a couple. Two! So he stacked the deck by re-defining “children,” “raised,” “by,” and “same-sex couples.” Sullins had a similar problem: out of a sample of 15,701 respondents, he could only find 23 adolescents raised by just 20 same-sex couples, “consisting of 17 lesbian partners and 3 gay male partners.”

And what do we know about those families? Not much. We don’t know how much time those children spent with their same-sex parents. We don’t know whether they spent the most formative periods of their lives with opposite-sex parents who then got divorced, or whether they were children of a single parent who had gone through multiple parters over time. We know nothing about the stability, or lack there-of, of either the opposite-sex or same-sex parenting that these children experienced.

But let those numbers sink in: Sullins is basing his entire eight page on those tiny numbers. Twenty same-sex couples.

Out of how many? In 2013, Gary J. Gates at the Williams Institute combed through census data and found that “more than 111,000 same-sex couples are raising an estimated 170,000 biological, step, or adopted children.” Sullins found just twenty out of 111,000 couples. That would be about 0.018% of the total. Which means that if this were a poll, Sullins’s margin of error would be, at best, plus or minus 18.4 percent at a 90% confidence level.


Click to enlarge.

Click to enlarge.

But let’s also look at it a different way. The Standard Error (SE) that Sullins calculated for outcome measures of the children of those twenty same-sex couples is huge when compared to the the data set for opposite-sex couples. What this means is that it only takes one or two individual adverse scores coming from one or two dysfunctional families to throw off those averages. When you see such large swings in the data, you know right away that you need a larger sample to get a clearer picture of what’s going on. Any small sample can sweep up significant anomalies that diminish or disappear once the sample size gets larger. A sample size of 2,000 gay- or lesbian-led families could decrease that standard error by a factor of ten. At least then, you’d start to look at something that can approximate the rest of the 109,000 same-sex couples raising children. Running the numbers again, an opinion poll of 2,000 respondents would have a margin of error of ±1.8%.

How does this scale up to the 111,000 same-sex couples raising children? Well, because it’s supposed to be a peer-reviewed paper — more on that in a moment — Sullins covers himself here somewhat:

Limitations. Despite the signal strengths of Add Health as a large nationally representative longitudinal dataset and notwithstanding the strong significance for contrast effects reported above, the very small size of the sample of children raised by lesbians imposes important limits and prompts great caution regarding the conclusions of this study. As with all observational studies, causal inference is not possible. Moreover, many subtle distinctions and pathways of influence simply cannot be addressed with only 20 cases, and unobserved differences between the parent comparison groups may well confound some or all of the child differences observed. In particular, the lack of useful measures for parent mental distress, depression, family history of violence, alcohol consumption, and substance abuse precluded examination of important familial risk factors which may be associated with child distress. For these reasons, the findings of this study should be considered only provisional and exploratory until and unless they are confirmed by further research.

I wonder if Sullins would be so careful when he’s interviewed about this. Somehow, I doubt it. After all, he’s a research fellow at the Marriage and Religion Research Institute, which is an arm of the Family “Research” Council.

So how did a paper with such sweeping conclusions make it into a professional journal? Well the biggest problem with professional publishing these days is that there are literally thousands of medical and social science journals around the world begging for papers to fill their issues. A few are influential because they can attract the best of the best. And because they can attract the best of the best, they can by very selective about which papers they publish. Many of them reject far more papers than they publish. Other journals however are left fighting over scraps.

Cairo-based Hindawi Publishing Corporation, which publishes Depression Research and Treatment, has been criticized for using spam email to solicit manuscripts (PDF: 111KB/2 pages). What’s more, it’s a pay-to-publish journal, charging its authors about US$1,000 as an “article processing fee.” Truly reputable journals don’t rely on charging authors to submit their manuscripts for their profits, not when they can charge a subscription or they sell the articles on a per-article basis because the quality of their content justifies the price.But Hindawi is among the new class of “Open Access” free journals, which advertises its bug as a feature. It gives away its articles for free, in exchange for charging authors exorbitant “fees” on the front end. Naturally, this creates an incentive  to publish more articles already paid for by authors –especially from those who can’t get their papers published elsewhere — with little regard to whether the article has any merit in the first place.

And Hindawi goes a step further. They increase their profit margins by not employing editors for their journals. Editors fill a critical function. An editor is ordinarily a recognized subject matter expert who can act as a gatekeeper to ensure the quality of the journal’s content. More critically, that editor is also tasked with overseeing the peer-review process, which involves knowing which reviewers are qualified to review a paper. Instead, the editorial role at Hindawi is handled by staff members at the company’s headquarters in Cairo, which leaves the most critical task of peer review in the hands of those who may know little or nothing about the paper’s subject. That is, if Hindawi actually has a peer review process. Many open access journals use the practice of publishing now (and collecting the author’s “processing fee”) and letting people ask questions later.

Those problems at Hindawi are evident not only with Sullins’s paper itself, but with the overall reputation of Depression Research and Treatment. Among the 1,061 psychology journals listed at Scimago Journal and Country Rank, Depression Research and Treatment is ranked at number 380. From a top-to-bottom perspective, they can at least brag that they’re in the top half. Unfortunately, Hindawi’s poor publishing practices have become far more common in the publishing world as newcomers to professional publishing scramble to find manuscripts to publish.

So the real question is this: what do other professionals think of the kinds of papers that Hindawi publishes in Depression Research and Treatment. One key measure is to count how many times other researchers cite papers in a given journal when they’re writing their papers. Articles in the top twenty psychology journals are cited, on average, 8.8 times for each paper. For the top fifty, each paper on average gets 6.1 cites. For Depression Research and Treatment, that average is just 1.7.

So there you have it: Sullins had to pay $1,000 to publish a flawed paper using flawed methodology in a pay-to-publish journal with no editor to oversee a questionable peer-review process, and that is generally ignored by his peers.


July 7th, 2016

A couple of points (not about this paper but about academic publishing generally).

1) Whether or not you have to pay page charges is highly field specific. In my own field of biochemistry, all reputable journals charge page fees, including the Really Big Journals like Science and Nature. However, they are also rigorously reviewed and have low success rates–Most papers are rejected– meaning that they are definitely NOT “pay to play”.

2) Hindawi is not noted as being a particularly reputable firm, and they definitely solicit manuscripts with spam. These are bottom-feeder journals with often suspect reviewing standards looking to make a buck.

3) A key measure in addition to citation rate and editorial staff, is the quality of the editorial board. Names should be known scholars in reputable universities and institutes. If the names are largely unknown, that’s also an indication of low quality.

4) The REgnerus paper shows us that even generally reputable journals can be gamed. At least they went and did a post-mortem .

Timothy Kincaid

July 7th, 2016

Well researched and written, Jim


July 7th, 2016

I want to share this but can’t find the share links for Facebook.

Jim Burroway

July 7th, 2016

Alvin, it’s right there at the end if the article, after the tags.

Ben in oakland

July 7th, 2016

Thanks for doing this, Jim. I certainly wouldn’t have had the patience. As I commented on another thread, re this study, praising Regnerus publicly when regnerus admitted publicly that he didn’t study the people whom he claimed he was studying told me all I needed to know about this joker.

“Studying” three gay male couples and claiming anything is true about them!!! How can he be a scientist and live with himself? How can he be a Jesus lover and lie through his yellowed teeth?


July 7th, 2016

Jim, this is just great. Thanks so much for researching the latest anti-gay scam disguised as research. I will save this post for the next time my anti-PC (and hence, anti-gay) friends cute Sullins’ paper.

Although I would like to piggy-back off of it’s comment and also say that open access doesn’t always imply poor quality. Although it certainly suggests the possibility. The low rank and spam advertisements (!!) are what confirm the journal’s poor status.


July 8th, 2016

Just tell the RWNJ that this “study” was “published” in a “jounal” from the muslin country where the muslin brotherhood is active.

Then watch the ‘splodey heads start ‘sploding!

Erica Cook

July 8th, 2016

I would like to add that, in psychology, the minimum number of participants in a study that can be considered significant is 30. In a study like this that wouldn’t mean a total of 30 participants, that would mean a minimum of 30 family units headed by a same sex couple with children of an old enough age to asses their upbringing, likely between 25 and 30 years old, and a criteria defining the concept of same sex couple would have to be defined, ideally a couple that was monogamous, with both parents involved in the majority of the responsibilities in bringing up the children. A definition for being a child in a same sex couple would also have to be clearly defined. Again, Ideally stating that children raised in the home, spending more than 50% of their time in said same sex household from the ages of 3 years and younger.

You would then have to have a control group with the same number of family units with different sex couple headed households with children meeting identical criteria. You would then have to decide a numerical value for different criteria regarding child outcomes. Assigning value to things like education, marriage, arrests, drug abuse, and regarding families with more than one child you would have to choose if you would count each child as a separate family unit or average out the outcomes between them. That, or limit participants to families with one child. Perhaps you could randomly select only one child from each household.

Basically, this “study” in no way resembles any of these steps. he does not even appear to define a control or test group. I would not even call it a study. I’m not sure what I’d call it but the word farce come to mind.

Leave A Comment

All comments reflect the opinions of commenters only. They are not necessarily those of anyone associated with Box Turtle Bulletin. Comments are subject to our Comments Policy.

(Required, never shared)

PLEASE NOTE: All comments are subject to our Comments Policy.


Latest Posts

The Things You Learn from the Internet

"The Intel On This Wasn't 100 Percent"

From Fake News To Real Bullets: This Is The New Normal

NC Gov McCrory Throws In The Towel

Colorado Store Manager Verbally Attacks "Faggot That Voted For Hillary" In Front of 4-Year-Old Son

Associated Press Updates "Alt-Right" Usage Guide

A Challenge for Blue Bubble Democrats

Baptist Churches in Dallas, Austin Expelled Over LGBT-Affirming Stance

Featured Reports

What Are Little Boys Made Of?

In this original BTB Investigation, we unveil the tragic story of Kirk Murphy, a four-year-old boy who was treated for “cross-gender disturbance” in 1970 by a young grad student by the name of George Rekers. This story is a stark reminder that there are severe and damaging consequences when therapists try to ensure that boys will be boys.

Slouching Towards Kampala: Uganda’s Deadly Embrace of Hate

When we first reported on three American anti-gay activists traveling to Kampala for a three-day conference, we had no idea that it would be the first report of a long string of events leading to a proposal to institute the death penalty for LGBT people. But that is exactly what happened. In this report, we review our collection of more than 500 posts to tell the story of one nation’s embrace of hatred toward gay people. This report will be updated continuously as events continue to unfold. Check here for the latest updates.

Paul Cameron’s World

In 2005, the Southern Poverty Law Center wrote that “[Paul] Cameron’s ‘science’ echoes Nazi Germany.” What the SPLC didn”t know was Cameron doesn’t just “echo” Nazi Germany. He quoted extensively from one of the Final Solution’s architects. This puts his fascination with quarantines, mandatory tattoos, and extermination being a “plausible idea” in a whole new and deeply disturbing light.

From the Inside: Focus on the Family’s “Love Won Out”

On February 10, I attended an all-day “Love Won Out” ex-gay conference in Phoenix, put on by Focus on the Family and Exodus International. In this series of reports, I talk about what I learned there: the people who go to these conferences, the things that they hear, and what this all means for them, their families and for the rest of us.

Prologue: Why I Went To “Love Won Out”
Part 1: What’s Love Got To Do With It?
Part 2: Parents Struggle With “No Exceptions”
Part 3: A Whole New Dialect
Part 4: It Depends On How The Meaning of the Word "Change" Changes
Part 5: A Candid Explanation For "Change"

The Heterosexual Agenda: Exposing The Myths

At last, the truth can now be told.

Using the same research methods employed by most anti-gay political pressure groups, we examine the statistics and the case studies that dispel many of the myths about heterosexuality. Download your copy today!

And don‘t miss our companion report, How To Write An Anti-Gay Tract In Fifteen Easy Steps.

Testing The Premise: Are Gays A Threat To Our Children?

Anti-gay activists often charge that gay men and women pose a threat to children. In this report, we explore the supposed connection between homosexuality and child sexual abuse, the conclusions reached by the most knowledgeable professionals in the field, and how anti-gay activists continue to ignore their findings. This has tremendous consequences, not just for gay men and women, but more importantly for the safety of all our children.

Straight From The Source: What the “Dutch Study” Really Says About Gay Couples

Anti-gay activists often cite the “Dutch Study” to claim that gay unions last only about 1½ years and that the these men have an average of eight additional partners per year outside of their steady relationship. In this report, we will take you step by step into the study to see whether the claims are true.

The FRC’s Briefs Are Showing

Tony Perkins’ Family Research Council submitted an Amicus Brief to the Maryland Court of Appeals as that court prepared to consider the issue of gay marriage. We examine just one small section of that brief to reveal the junk science and fraudulent claims of the Family “Research” Council.

Daniel Fetty Doesn’t Count

Daniel FettyThe FBI’s annual Hate Crime Statistics aren’t as complete as they ought to be, and their report for 2004 was no exception. In fact, their most recent report has quite a few glaring holes. Holes big enough for Daniel Fetty to fall through.