Box Turtle Bulletin

Box Turtle BulletinNews, analysis and fact-checking of anti-gay rhetoric
“Now you must raise your children up in a world where that union of man and box turtle is on the same legal footing as man and wife…”
This article can be found at:
Latest Posts

Posts for March, 2013

Nation’s Largest Pediatrics Organization Supports Same-Sex Marriage, Criticizes Regnerus Study

Jim Burroway

March 21st, 2013

The American Academy of Pediatrics issued a policy statement today putting the nation’s largest professional organization of pediatricians firmly in support of same-sex marriage.

In a policy statement issued today, the AAP says (PDF: 684KB/6 pages):

All children need support and nurturing from stable, healthy, and wellfunctioning adults to become resilient and effective adults. On the basis of a review of extensive scientific literature, the American Academy of Pediatrics (AAP) affirms that “children’s well-being is affected much more by their relationships with their parents, their parents’ sense of competence and security, and the presence of social and economic support for the family than by the gender or the sexual orientation of their parents.”

…Public policy related to marriage and family is largely a state function. Consequently, the laws across the country that regulate marriage, adoption, and foster parenting by gay men and lesbians are an inconsistent patchwork. Even civil marriage in a state that permits it does not ensure access to federal benefits. The federal Defense of Marriage Act (1996; Pub. L. No. 104-199) denies members of married samegender households access and benefits equivalent to those available to households headed by married parents of different genders, such as (1) Social Security and related programs, (2) housing and food stamps, (3) federal civilian and military service benefits, (4) employment benefits, (5) immigration and nationality status, (6) remedies and protections for crimes and family violence, and (7) certain loans and financial guarantees. For this reason, the AAP has joined with other national organizations in support of the position that the Defense of Marriage Act is unconstitutional.

A core mission of the AAP is to support the best interests of all children, regardless of their home or family structure, on the basis of the common principles of justice. If a child has 2 living and capable parents who choose to create a permanent bond by way of civil marriage, it is in the best interests of their child(ren) that legal and social institutions allow and support them to do so. If 2 parents are not available to the child, adoption or foster parenting remain acceptable options to provide a loving home for a child and should be available without regard to the sexual orientation of the parent(s).

Recommendations:
The AAP works to ensure that public policies help all parents, regardless of sexual orientation and other characteristics, to build and maintain strong, stable, and healthy families that are able to meet the needs of their children. In particular, the AAP supports:

1. Marriage equality for all capable and consenting couples, including those who are of the same gender, as a means of guaranteeing all federal and state rights and benefits, and long-term security for their children.

2. Adoption by single parents, coparents adopting together, or a second parent when 1 parent is already a legal parent by birth or adoption, without regard to the sexual orientation of the adoptive parent(s).

The policy statement was accompanied by a tachnical report by Drs. Ellen C. Perrin, Benjamin S. Siegel, and the Committee on Psychosocial Aspects of Child and Family Health. Titled “Promoting the Well-Being of Children Whose Parents are Gay or Lesbian” (PDF: 736KB/12 pages), the report lists a whole range of legal disparities created by various state laws addressing the rights and responsibilities of parenthood, as well as legal disparities created by federal laws and regulations. The technical report also lists several disparities which directly imact the child’s health, including barriers which may prohibit one parent from making medical decisions for their children in emergency situations or accompanying their children in the hospital. Othe barriers stand in the way of a working parent obtaining employer-provided health insurance for his or her children.

The technical report also examines some thirty years of research on gay and lesbian parenting, including last year’s deeply flawed study by Mark Regnerus claiming to demonstrate negative outcomes for children of same-sex parents:

A recent publication was based on a large national sample of US adults who were asked whether their parents had ever had a relationship with a person of the same gender while they were growing up and whether they had ever lived with that parent while the parent was involved in such a relationship. Parents who were said to have had a same-gender relationship were categorized as lesbian or gay parents, although their sexual orientation was not directly determined. In comparison with those who did not report that a parent had had a same-gender relationship, a number of adverse outcomes were identified, including being on public assistance, being unemployed, and having poorer educational attainment. Extensive critique of this study has pointed out that:

  • It is well known that family instability, and in particular divorce, is a risk factor for children, and almost all of the respondents whose parent had had a same-gender relationship had also experienced the divorce of their parents.
  • These data reflect an era when stigmatization and discrimination toward same-gender couples and their children were strong and were likely to have contributed to less-than-optimal child-rearing environments.
  • Respondents were certainly not children “raised by” lesbian or gay parents, because only half were living with these parents, and the sexual orientation of the parents was not determined.
  • The great variability in the form and characteristics of both same-gender and heterosexual relationships, combined with the small number of those relationships, even in a large data set like this one, makes it impossible to sort out true evidence of causality.

The Regnerus Study, which was mostly paid for by some $700,000 in grants from the anti-gay Witherspoon Institute, was released last year to great fanfare in the conservative press. BTB was the first to debunk the study on the same morning in which it was released to the public.

The technical report went on to review some thirty years’ worth of studies, and concluded:

On the basis of this comprehensive review of the literature regarding the development and adjustment of children whose parents are the same gender, as well as the existing evidence for the legal, social, and health benefits of marriage to children, the AAP concludes that it is in the best interests of children that they be able to partake in the security of permanent nurturing and care that comes with the civil marriage of their parents, without regard to their parents’ gender or sexual orientation.

The policy statement and technical report will appear in the April 2013 issue of the AAP’s journal Pediatrics.

Internal Documents Confirm Regnerus Study’s Political Origins, Conflicts of Interest

Jim Burroway

March 11th, 2013

Last summer’s study in the previously obscure journal Social Science Research by Mark Regnerus claiming to demonstrate that children of gay and lesbian parents fare much worse than children of heterosexual parents raised quite a number of eyebrows, beginning with the bizarre apples-to-elephants comparison he had to contort his data into performing in order to attempt such a claim. While the logical fallacy was, appropriately, the main focus of criticisms of his so-called study, it was noted that the expensive study was paid for largely by $700,000 in grants from the staunchly anti-gay Witherspoon Institute, giving Regnerus a level of funding that few researchers — and, let’s say it, none with his previously unknown stature — would even dare to dream of. This guy was entrusted with a hell of a lot of money, and if it’s not plainly obviously by now, someone managed to grease the skids at the middling-ranked Social Science Research to give the study preferential treatment so that it could be fast tracked to publication. The paper itself was withheld for as long as possible from those whom might give it a critical eye in an attempt to make sure that the first press reports were favorable.

Earlier this month, the University of Texas, Regmerus’s employer, began releasing documents and emails related to the study in response to a Freedom of Information Act request from The American Independent. At least some of those documents are now posted online. The American Independent’s Sofia Resnick went through those documents and found that the Witherspoon Institute, which provided three-quarters of the study’s overall funding, communicated its expectations of the study’s results ahead of time, and even provided an analyst to help manipulate the data to generate the foregone conclusion:

Records show that an academic consultant hired by UT to conduct data analysis for the project was a longtime fellow of the Witherspoon Institute, which shelled out about $700,000 for the research. Documentation about University of Virginia associate sociology professor W. Bradford Wilcox’s dual roles contradict Regnerus’ assertions that the think tank wasn’t involved with how the study was designed or carried out.

The records also confirm what I noticed last June: the “expediency” with which the study was conducted and published. And what what the driving force for that “expediency”? Why, the Supreme Court, of course:

In the early stages of the New Family Structures Study – before data was collected and long before any results were known – the Witherspoon Institute’s president, Luis Tellez, made it clear to Regnerus that expediency was paramount.

“Naturally we would like to move along as expeditiously as possible but experience suggests we ought not to get hung up with deadlines, do what is right and best, move on it, don’t dilly dolly, etc.,” Tellez wrote in a Sept. 22, 2010 email. “It would be great to have this before major decisions of the Supreme Court but that is secondary to the need to do this and do it well. I would like you to take ownership and think of how would you want it done, rather than someone like me dictating parameters but of course, here to help.”

…“As you know, the future of the institution of marriage at this moment is very uncertain,” Tellez wrote in the letter, dated April 5, 2011. “It is essential that the necessary data be gathered to settle the question in the forum of public debate about what kinds of family arrangement are best for society. That is what the NFSS is designed to do. Our first goal is to seek the truth, whatever that may turn out to be. Nevertheless, we are confident that the traditional understanding of marriage will be vindicated by this study as long as it is done honestly and well.”

The study’s purpose, as you can see, wasn’t to advance science, but to influence the Supreme Court. Also, those last two sentences can be seen as a classic cover-my-ass statement from Witherspoon, because, of course, we know that the study was certainly not done “honestly and well.” In fact, as I noticed when the study first came out, “If one wanted to intentionally create Lesbian Mothers and Gay Fathers groups which were least likely to look like an intact biological family, I can’t imagine a better way to do so than to take the steps Regnerus has taken here.” And if there is any question about whether Witherspoon was communicating its expectations about the study’s outcomes before it was even conducted, consider this fundraising plea from Witherspoon to the Bradley Foundation, which ended up kicking in $200,000 for the study before it was even launched:

“The [University of Texas at Austin’s Population Research] Center has requested that The Witherspoon Institute work with it in raising the necessary funds, and given the importance of the project, the Institute has committed to doing so, with Dr. Mark Regnerus’ assistance,” Tellez wrote, “We are quite sure that if we do not intervene, the project will not be funded in a timely fashion. And this is a project where time is of the essence.”

Tellez went on to explain that the crux of the New Family Structures Study – whether kids raised by gay parents fare as well as those raised by straight parents – “is the question that must now be answered – in a scientifically serious way – by those who are in favor of traditional marriage.”

On June 15 of last year, I noticed that the Regnerus paper was rushed to print in an unusually expedited manner. In fact, the paper itself, it turns out, was submitted before the study was even completed. And as I noted before, the study’s data was withheld from those who might give the report a critical eye:

Michael Rosenfeld, a social demographer who teaches at Stanford University, said the journal had asked him to write a commentary of the paper but gave him a two-week deadline – a time frame Rosenfeld said is unusually short in the academic world. Rosenfeld told The American Independent that he still doesn’t know why Regnerus’ paper was seemingly rushed.

“One of the things about academic publishing is that it’s not in a hurry,” Rosenfeld said. “It’s more important to get it right than to rush it into print. So, I was sort of perplexed as to what the hurry was about.”

Rosenfeld said he agreed to review the paper on the condition that he could see the data. But Regnerus’ team refused.

“I’m a data-analysis person,” Rosenfeld said. “So, for me I wasn’t going to have anything to say about Regnerus’ paper until I could actually see the data and figure out for myself whether what he had done was reasonable or not. And I didn’t want to have a debate with him about the data when he could see the data and I couldn’t. That didn’t seem like it was going to go very far.”

Regnerus originally invited Rosenfeld to participate in the study, but Rosenfeld declined, citing “he unusual way the project is funded.” The journal’s editor, James D. Wright, continues to deny that Regnerus’s paper received special treatment, despite an independent audit criticizing the journal for overlooking serious flaws and Wright’s own admission that he was enticed, at least partly, by the opportunity to raise his journal’s relatively low Impact Factor.

Resnick’s full report is required reading and provides essential information describing how the study came into being and the alarm bells it raised among those who came to understand its origins long before it was published.

American Sociological Association Takes On Regnerus Study in Prop 8 Brief

Jim Burroway

March 1st, 2013

Another Amicus brief filed with the U.S. Supreme Court urging the court to strike down California’s Prop 8 comes from the American Sociological Association, which tackles the social science arguments made by Prop 8 supporters. After noting that many of Prop 8 proponents’ briefs includes citations of the the study by Mark Regnerus — which, by mixing apples with elephants, came to the unsupported conclusion that children raise by “gay” and “lesbian” parents — his terms — fared poorly when compared to those raised by intact, never-divorced, never-adopted heterosexual families — the ASA set about to destroy that argument. Here is that section in full (PDF: 214KB/42 pages):

A) THE REGNERUS STUDY DOES NOT SUPPORT CONCLUSIONS REGARDING THE IMPACT OF BEING RAISED BY SAME-SEX PARENTS

The Regnerus study—the principal study relied on by the amici of BLAG and the Proposition 8 Proponents—did not specifically examine children raised by same-sex parents, and provides no support for the conclusions that same-sex parents are inferior parents or that the children of same-sex parents experience worse outcomes.

The Regnerus Study Offers No Basis for Conclusions About Same-Sex Parents

First, the Regnerus study does not specifically examine children born or adopted into same-sex parent families, but instead examines children who, from the time they were born until they were 18 or moved out, had a parent who at any time had “a same-sex romantic relationship.” Regnerus 2012a at 75. As Regnerus noted, the majority of the individuals characterized by him as children of “lesbian mothers” and “gay fathers” were the offspring of failed opposite- sex unions whose parent subsequently had a same-sex relationship. Id. In other words, Regnerus did not study or analyze the children of two same-sex parents.

Second, when the Regnerus study compared the children of parents who at one point had a “same-sex romantic relationship,” most of whom had experienced a family dissolution or single motherhood, to children raised by two biological, married opposite-sex parents, the study stripped away all divorced, single, and stepparent families from the opposite-sex group, leaving only stable, married, opposite-sex families as the comparison. . Id. at 757 (the comparison group consisted of individuals who “[l]ived in intact biological famil[ies] (with mother and father) from 0 to 18, and parents are still married at present”). Thus, it was hardly surprising that the opposite-sex group had better outcomes given that stability is a key predictor of positive child wellbeing. By so doing, the Regnerus study makes inappropriate apples-to-oranges comparisons.
Third, Regnerus’s first published analysis of his research data failed to consider whether the children lived with, or were raised by, the parent who was, at some point, apparently involved in “a romantic relationship with someone of the same sex” and that same-sex partner. Id. at 756. Instead, Regnerus categorized children as raised by a parent in a same-sex romantic relationship regardless of whether they were in fact raised by the parent and the parent’s same-sex romantic partner and regardless of the amount of time that they spent under the parent’s care. As a result, so long as an adult child believed that he or she had had a parent who had a relationship with someone of the same sex, then he or she was counted by Regnerus as having been “raised by” a parent in a same-sex relationship.

Fourth, in contrast to every other study on same-sex parenting, Regnerus identified parents who had purportedly engaged in a same-sex romantic relationship based solely on the child’s own retrospective report of the parent’s romantic relationships, made once the child was an adult. This unusual measurement strategy ignored the fact that the child may have limited and inaccurate recollections of the parents’ distant romantic past. Id.

Finally, the study fails to account for the fact that the negative outcomes may have been caused by other childhood events or events later in the individual’s adult life, particularly given that the vast majority (thirty-seven of forty) of the outcomes measured were adult and not childhood outcomes. Factors other than same-sex parenting are likely to explain these negative outcomes in the Regnerus study. Regnerus himself concludes that “I am thus not suggesting that growing up with a lesbian mother or gay father causes suboptimal outcomes because of the sexual orientation or sexual behavior of the parent.” Id. at 766.

In sum, by conflating (1) children raised by same-sex parents with (2) individuals who reportedly had a parent who had “a romantic relationship with someone of the same sex,” and referring to such individuals as children of “lesbian mothers” or “gay fathers,” the Regnerus study obscures the fact that it did not specifically examine children raised by two same-sex parents. Accordingly, it cannot speak to the impact of same-sex parenting on child outcomes.  Accordingly, it cannot speak to the impact of same-sex parenting on child outcomes. As discussed above, amici in support of BLAG and the Proposition 8 Proponents have themselves rejected such “inappropriate comparisons” between stable and unstable family structures, see Brief for American College of Pediatricians at 4-5, as did the district court in Perry, see 704 F.Supp. 2d at 981 (studies that make apples-to-oranges comparisons are of no moment).

The “Re-Stated” Regnerus Study Offers No Basis for Conclusions About Same-Sex Parents

Regnerus acknowledged the merit of a series of scholarly critiques regarding underlying aspects of his research and subsequently published a second analysis of the data. Among others, a group of over one hundred social scientists signed an article faulting the Regnerus study for failing to take account of family structure and family instability. Gary J. Gates et al., Letter to the Editor and Advisory Editors of Social Science Research, 41 Social Science Research 1350 (2012). The article specifically criticized the Regnerus study’s failure to “distinguish between the impact of having a parent who has a continuous same-sex relationship from the impact of having same-sex parents who broke-up from the impact of living in a same sex step-family from the impact of living with a single parent who may have dated a same-sex partner.” Id. Regnerus tried to remedy the fact that his initial published research did not analyze whether the children had actually lived with the parent who, according to the adult child, had at some point, been “romantically involved” with someone of the same sex. See Mark Regnerus, Parental Same-Sex Relationships, Family Instability, and Subsequent Life Outcomes for Adult Children: Answering Critics of the New Family Structures Study with Additional Analyses, 41 Social Science Research 1367, 1369 (2012) (“Regnerus 2012b”).

Nevertheless, Regnerus’s follow-up analysis does not resolve the problems inherent in his initial analysis and contains many of the same shortcomings. The follow-up analysis maintained the flawed and extremely broad definition of what constitutes “lesbian mothers” and “gay fathers”—a mother or father who ever had a romantic relationship with someone of the same-sex during the period from the birth of the child until the child turned eighteen (or left home to be on their own). Id. at 1368. Accordingly, Regnerus’s analysis continues to ignore stability as a factor in child outcomes—a factor that explains many of the differences among its subjects. And Regnerus still fails to account for the duration of time spent with a mother who was “romantically involved” with a same-sex partner and that partner. See id. at 1372. Only two of the eighty-five children who at some point lived with a mother who was “romantically involved” with another woman reported that they did so for the entire duration of their childhood. Finally, Regnerus’s follow-up analysis is still not reflective of same-sex parenting because Regnerus could not remedy the fact that he recorded experiences that occurred either during the time the child lived with his or her mothers’ same-sex partner or during another childhood time period.

If any conclusion can be reached from Regnerus’s study, it is that family stability is predictive of child wellbeing. As Regnerus himself notes, family structure (for instance whether the family has a single parent or two parents), matters significantly to child outcomes. Regnerus 2012a at 761. As the social science consensus described in Part I demonstrates, the evidence regarding children raised by same-sex parents overwhelmingly indicates that children raised by such families fare just as well as children raised by opposite-sex parents, and that children raised by same-sex parents are likely to benefit from the enhanced stability the institution of marriage would provide to their parents and families. All told, the Regnerus study, even as revised, does not undermine the consensus that children raised by same-sex parents fare just as well as those raised by opposite-sex parents.

BTB was the first to debunk Regnerus’s study. Our review came out just before news of the study broke in theDeseret News. Rob Tisinai’s reaction can be foundherehere and here; Timothy Kincaid’s reaction is here and here. Regnerus’s response to a BTB reader can be found here. Flaws found in an independent audit of the study can be found here. You can follow everything we’ve posted about the study by following this tag.

A quick and simple illustration of Mark Regnerus’ ignorance and bias

Timothy Kincaid

November 12th, 2012

In June Mark Regnerus thrust his absurd and fatally-flawed study on the world, claiming that his research clearly revealed that children did better with married parents than with parents of which one had a same-sex relationship, “How Different are the Adult Children of Parents Who Have Same-Sex Relationships?” And anti-gay activists, being little constrained by logic or ethical considerations, pretended that this study (which did not look at same-sex couples) is a scientific condemnation of same-sex couples.

All the while, Regnerus pretended to stand above the fray, never correcting the false interpretations of his study but claiming nevertheless to be the unbiased and honest statistician seeking truth.

Hogwash.

I don’t know if Regnerus is a bigot or just a self-important fool. But I do know that he knows virtually nothing about gay people and has little interest in doing so. Regnerus doesn’t study gay people, he looks for validation of his presumptions. And, just in case I needed confirmation of that fact, consider his rant objecting to the National Longitudinal Lesbian Family Study.

The NLLFS employs a convenience sample, recruited entirely from announcements posted “at lesbian events, in women’s bookstores, and in lesbian newspapers” in Boston, San Francisco, and Washington, D.C. As the late family sociologist Steven Nock warned, the level of sample bias such an approach introduces is significant. The lesbian parents whose children are being studied are whiter (94 percent), more educated (67 percent college graduates), of higher socioeconomic status (82 percent held professional or managerial positions), and more politically motivated than lesbians who do not frequent such “events” or bookstores, or who live in cities like San Antonio or Kansas City, or in smaller towns across the country.

Regnerus does make a valid point. The NLLFS is not a statistically valid random sample. It is not demographically representational. And it’s findings are, indeed, limited (though valuable). It’s not his noting these limitations that reveals his ignorance and bias, rather the following bald assumption.

And yet all this is not actually why I think it’s time for the NLLFS to shutter its operation. No, the reason is that its sample — 78 kids growing up in activist households — is no longer a source for valid, reliable information.

Wait, what’s that description again?

78 kids growing up in activist households

Got that? To Mark Regnerus, being a lesbian that participates in a study makes one an “activist”.

Now I am sure that if this were a study of, say, children of Catholics who were recruited at Knights of Columbus events, they would just be “people of faith” or “devout Catholics”. He might note the limitations of studying Catholics who were only recruited at such events, but he would certainly not dismiss the kids as “growing up in activist households”.

It appears that Regnerus falls into the group of people who think that gay people fall into two categories: embarrassed and shame-filled individuals who are trapped in a homosexual lifestyle, and ‘homosexual activists’. And if you go to ‘lesbian events’ and, especially if you participate in a study, you are an activist.

And this is a presumption that no one who actually knows anything about lesbians – or human beings – would make. It does suggest a higher level of social consciousness and a willingness to help a researcher and probably even a desire to make the world a more-informed place. And it may well even indicate a confidence that your family can hold its own. However, many people participate in research who are anything but activists.

But ignorance and bias are not holding Regnerus back, he seems to think that he need know nothing about real lesbians to wage his war on statistical lesbians. And his willingness to broadcast his ignorance and bias do not bode well for his professional future or career.

I hope Mark Regnerus is enjoying his moment in the sun. Because it doesn’t take too much discernment to see that his future is running parallel to that of Paul Cameron.

Debunking the Regnerus Study

Jim Burroway

October 1st, 2012
YouTube Preview Image

Marriage is on the ballot in four states this year. Voters in Maine, Maryland, and Washington will decide whether same-sex couples will be allowed to marry, while Minnesota voters will determine whether to write discrimination into their state’s constitution. The National Organization for Marriage (NOM), the Witherspoon Institute, and many, many other organizations are mobilizing their resources to push their anti-gay arguments.  Professor John Corvino is intimately familiar with those arguments, having just published a book with NOM’s co-founder Maggie Gallagher titled Debating Same-Sex Marriage, the only book ever endorsed both by Rick Santorum and Dan Savage. Corvino has also posted a valuable series of videos taking apart those arguements, one by one. You can see the entire series here.

BTB was the first to debunk Regnerus’s study. Our review came out just before news of the study broke in the Deseret News. Rob Tisinai’s reaction can be found herehere, and here; Timothy Kincaid’s here. Regnerus’s response to a BTB reader can be found here. You can follow everything we’ve written about the study by following this tag.

Journal Audit Finds Severe Flaws In Regnerus “Gay Parenting” Study

Jim Burroway

July 27th, 2012

The Chronicle of Higher Education has obtained a copy of a highly critical audit showing that Mark Regnerus’s widely discussed paper on gay and lesbian parenting underwent a flawed peer-reviewed process which failed to find significant methodological problems and conflicts of interest. BTB was the first to review many of those methodological problems here on the day the study first appeared in the journal Social Science Research. According to The Chronicle:

Like Regnerus, the editor of Social Science Research, James D. Wright, has been at the receiving end of an outpouring of anger over the paper. At the suggestion of another scholar, Wright, a professor of sociology at the University of Central Florida, assigned a member of the journal’s editorial board—Darren E. Sherkat, a professor of sociology at Southern Illinois University at Carbondale—to examine how the paper was handled.

Sherkat was given access to all the reviews and correspondence connected with the paper, and was told the identities of the reviewers. According to Sherkat, Regnerus’s paper should never have been published. His assessment of it, in an interview, was concise: “It’s bullshit,” he said.

The audit criticized the paper’s identification of “lesbian mothers” and “gay fathers,” which was at the heart of our criticism of the report when the paper first appeared. Sherkat found the those labels for the categories of families that Regnerus created “extremely misleading.” He added: “Reviewers uniformly downplayed or ignored the fact that the study did not examine children of identifiably gay and lesbian parents, and none of the reviewers noticed that the marketing-research data were inappropriate for a top-tier social-scientific journal.” Sherkat found that that fact alone should have “disqualified it immediately” from publication.

The audit also found conflicts of interests among the reviewers and states that “scholars who should have known better failed to recuse themselves from the review process,” according to The Chronicle. Three of the six reviewers were on record as opposing same-sex marriage and were “not without some connection to Regnerus.” Sherkat did not however find that the paper had been inappropriately expedited as I questioned. But Sherkat did question the paper’s funding — $785,000 from the conservative Whiterspoon Institute and Bradly Foundation — and the study’s timing auspicious timing ahead of the 2012 elections, were serious concerns.

“There should be reflection about a conservative scholar garnering a very large grant from exceptionally conservative foundations,” he writes in the audit, “to make incendiary arguments about the worthiness of LGBT parents—and putting this out in time to politicize it before the 2012 United States presidential election.”

Journals are judged and scored according to what’s known as an “Impact Factor” by Journal Citation Reports. The Impact Factor identifies the number of times articles are cited by other journals over a period of time. Higher Impact Factors are earned when other authors more frequently cite journal articles in their published papers, and the higher the Impact Factor, the greater the journal’s prestige. Social Science Research’s Five-Year Impact Factor is 1.994, which is considered low for social science research journals. Wright admitted to Sherkat that he believed the Regnerus paper would generate a high level of discussion and possibly elevate the journal’s Impact Factor, and admits that “perhaps this prospect caused me to be inattentive to things I should have kept a keener eye on.”

Wright told The Chronicle that he has experienced “sleepless nights” and angry emails, both from colleagues and strangers. Wright told The Chronnicle that he supports civil rights for gays and lesbians, and found accusations that he was fostering an anti-gay climate “hurtful and preposterous.” (You can read one email exchange between Wright and a BTB reader here.)

Editor James Wright provided a copy of the audit to The Chronicle, and it will appear in the November edition of Social Science Research. The September issue of the bi-monthly journal has already been issued and posted online.

Tools of the Trade

Jim Burroway

June 21st, 2012

Many, many years ago, a co-worker decided to take up woodworking as a hobby. He moved his cars out of his suburban garage — there would no longer be any room for them there — and purchased some of the finest sets of tools and machinery available: band saw, jig saw, router, drill press, and a few others I couldn’t tell you the names of because I’m not a woodworker. He went top of the line, too (or so he assured me, and I believe him), making sure he had the best bells and whistles. That was just his machinery. His array of hand tools was equally impressive lined up on his shiny new cabinets where, in each drawer, he laid a piece of foam with cut-outs in the shape of his tools. This way, there would be a place for every tool and a tool in every place. It was, all in all, a weekend warrior’s dream.

And then he built his book cases and media center. They weren’t awful by any means, but they weren’t spectacular either. I had a hard time seeing how they were much better than what I could have made with my far humbler collection of mismatched and somewhat rusty tools laying around the house. Assuming I could find them.

My co-worker’s dazzling workshop and my mess of a garage come to mind as I read some Mark Regnerus’s postings defending — no, not defending, but bragging about — his purported study on gay and lesbian parenting I reviewed last week. I say purported because with most of the adult children studied spending much less than three years with their gay or lesbian parent, it seems to me to be a study that is not about gay parenting but about children of divorce, separation, parental infidelity, and a host of other sources of instability. Gay parents, it turns out, are barely in the picture at all.

Regnerus blithely ignores this criticism. Instead, he distinguishes his study by the shiny $785,000 worth of tools that he assembled to produce it. It’s often the first point he mentions when he talks about it, like in his defense posted on the Baptist-affiliated Baylor University web site:

By contrast, Regnerus relies on a large, random, and representative sample of more than 200 children raised by parents who have had same-sex relationships, comparing them to a random sample of more than 2,000 children raised in heterosexual families, to reach his conclusions. This is why sociology professor Paul Amato, chair of the Family section of the American Sociological Association and president of the National Council on Family Relations, wrote that the Regnerus study was “better situated than virtually all previous studies to detect differences between these [different family] groups in the population.”

National random samples are inordinately expensive. It is why they are so rare in social science research. It’s every social scientist’s wet dream to be able to assemble a garage like Regnerus’s, but for almost every one of them such a tool set is way out of their reach. So having a tool as shiny and impressive as a nationally random sample is a really big deal. I’d say that it would probably very difficult for most people to resist showing it off.

But what I see happening is that Regnerus wants us to be dazzled by his tools — and they are truly dazzling — and not look too closely at the book case he built with them. And if that book case looks a little off kilter, maybe its because he used his tools incorrectly. If you use a drill press when you really needed a router, you’re going get results that fall short of what you promised. If you ask adults between 18 and 39 if either of their parents ever had a same-sex relationship and leave it up to the responder to ponder whether a short tryst counts, then you are going to get a sample that doesn’t resemble anything like the kind of relationship that is comparable to any kind of marriage, gay or straight.

And as his study has little to say about anything close to resembling marriage, it also says almost nothing about parenting. In his study, only 57% said they had lived with their mother and her partner for at least four months before the age of 18, and only 23% reported living with their father and his partner for the same length of time. Only 23% of children of so-called “Lesbian Mothers” and 2% of children of so-called “gay fathers” — both loosely defined — reported living with their parents and their parents’ same-sex partners for three years or more. If this is any kind of a study about gay parenting, it is even more so a study about the fifteen-plus years these kids spent outside of that so-called relationship.

And so after constructed a sample that was guaranteed to look nothing like a stable family environment, and then compared it to a sample that was specifically constructed to be a stable as possible, he found differences. That happens when you compare apples to orangutangs. And what else would you expect? When you build an unlevel shelf, you shouldn’t be surprised to see all of the results sliding off to one end. Sure, he may have started with a nationally representative sample, but that doesn’t give him license to move populations around within his samples with the purpose of achieving his aims, or to make claims about what his sample represents when his sample wasn’t constructed to represent what he claims.

And these issues point to a much bigger problem with Regnerus’s study. He wanted to examine the impact of gay parenting on children, but his tools, as impressive and expensive as they were, turned out to be the wrong tools for the job. As powerful as they otherwise would have been, they lacked the critical features that he needed to do the job correctly. And so lacking those important features, he does what a lot of weekend hobbyists in a hurry end up doing: he kludges it and hopes nobody notices. Except they have, and those kludges have been the crux of the criticisms against his study.

His response so far has boiled down to this: don’t pay any attention to how he used his tools. Just look at how shiny and expensive they are. But as every craftsman will tell you, it’s not the tools that make the better product, but the care of the craftsman who uses them wisely.

Regnerus’ Defenders Miss the Point

Rob Tisinai

June 20th, 2012

A group of professors has issued a statement responding to critics of the recent study by Mark Regnerus. Unfortunately, they miss the point entirely. To recap, the criticism is that:

  • Regnerus claims his study improves on previous research on same-sex parenting.
  • Regnerus has been using his study to make claims in the conservative media about same-sex parenting.
  • However, rather than surveying people who were raised by same-sex parents, Regnerus studied people who say one of their parents had a same-sex relationship, whether they were raised by those same-sex partners or not.
  • Regnerus has collected a sample of kids who spent more than three years being raised by actual same-sex parents, but it is so small that it represents no improvement on previous studies, and by Regnerus’ own statement is too small to offer statistically significant conclusions.

That’s egregious. Regenus’ defenders offer three points in response. Or do they? Their introduction does not bode well:

It is perhaps in part for that reason that the new study on same-sex parenting by University of Texas sociology professor Mark Regnerus, which finds that young-adult children of parents who have had same-sex relationships are more likely to suffer from a range of emotional and social problems…

Immediately we find his defenders confusing “same-sex parenting” with “children of parents who have had same-sex relationships.” That doesn’t help their case.

The first of their three points is that prior research on same-sex parenting is flawed. Perhaps it is. But I don’t need to explore that to see this offers Regnerus no defense against charges of misrepresentation, and wouldn’t do so even if  he didn’t repeat the flaws he calls out in those studies (which he does).

Their second point is that Regnerus had trouble finding adults who had been raised by same-sex parents, and was forced to base his study on less stable family structures:

Thus, Regnerus should not be faulted for drawing a random, representative sample of young-adult children of parents who have had same-sex romantic relationships and also happened to have experienced high levels of family instability growing up.

But we’re not faulting him for that. To be clear: We’re faulting him for presenting his work as a (better!) study on same-sex parenting, and for making claims to the media about same parenting, even as he admits he was not able to study same-sex parenting!

His defenders’ first point was irrelevant. This one is actually damning.

Their third and final point is that a new study in a different journal seems to back up Regnerus’ conclusions. I haven’t looked at it yet, but even this, even if true, is irrelevant to the charge that Regnerus’ study does not examine what it claims to examine, and that his statements to the media are unsupported by his work.

The authors conclude by hoping that

[F]uture journalistic coverage of such studies, and this contentious topic, will be more civil, thorough, and thoughtful than has been the coverage of the new study by Professor Mark Regnerus.

I can only hope that future studies — and their defenders — will be more honest, thorough, and thoughtful than this work by Regnerus and those who claim to answer his critics.

Thanks to Box Turtle Bulletin reader Straight Grandmother for directing us to this statement.

Where Have All the Straight People Gone?

Rob Tisinai

June 19th, 2012

The enemies of marriage equality are pushing Mark Regneres’ recent study as a sterling scientific achievement, but it contains a landmine that they’re either ignoring or just blundering past: There are a lot more non-straight folk out there than they want to admit.

We used to toss around Kinsey’s 10% figure as the percentage of people who are LGB. Lately that’s been revised to 4 or 5%. Our opponents have even tried to knock it down to 1.4%. It’s part of their argument: Why are we spending so much time on such a tiny segment of the population? As though the Constitution listed some numerical requirement before individual rights kicked in.

But the Regnerus study knocks all that to hell. It holds two surprises, one small and one big.

First, the small surprise. Of the folks who specified their orientation (42 declined to answer), 6.6% said they were bi, mostly gay, or 100% gay. That’s higher than expected. But here’s the shocker:

Of the people who gave an answer, only 80.1% called themselves completely straight.

80.1%.

80.1%!

Regnerus claims this of his study:

“[I]t is a random, nationally-representative sample of the American population. At last count, over 350 working papers, conference presentations, published articles, and books have used Knowledge Networks’ panels, including the 2009 National Survey of Sexual Health and Behavior, whose extensive results were featured in an entire volume of the Journal of Sexual Medicine—and prominently in the media—in 2010.

And perhaps he’s right. We’ve slammed him for his strange definitions of “gay” and “lesbian,” for his strange sorting criteria, and for his strange claims that he’s collected a significant sample of “same-sex parents,” but those are different issues. Anyway, the real quandary here is for those who are desperately pushing his results.

Keep in mind that these Regnerus’ sample only covers 18-39-year-olds. I’d love to dig into the data and break it down into smaller age groups (18-23, 23- 28, etc), but that won’t be possible until he makes the details available this fall. Personally, my theory is that surveys of sexual orientation have traditionally undercounted the minority, and we may be seeing a correction of that as the stigma of non-heterosexuality continues to fade.

But in any case, one thing is clear: If our opponents accept the Regnerus study, they have to accept that America is far more sexually diverse than they cared to believe.

I don’t know why this is so funny to me.

Rob Tisinai

June 19th, 2012

Maybe I have the emotional maturity of 13-year-old, but I keep snickering at this question from the Regneres study.

Q115 Have you ever had anal intercourse? (By anal intercourse, we mean when a man inserts his penis into his partner’s anus or butt hole.)

Maybe it’s the utter earnestness of the question and (especially) the clarification; or the look I imagine on someone’s face on hearing the question and (especially) the clarification; or the splitting of “butthole” into two words – what kind of hole? a butt kind of hole; or it’s the nonsensical “or” — his partner’s anus or butt hole (but not both?).

Or maybe it’s just funny.

An interesting note, though. Of the survey’s 2988 respondents, 2361 called themselves 100% heterosexual (that’s 79%), and 2729 were “mostly heterosexual” (or 91%).

Yet an ass-smacking 1145 said they’d had anal sex — almost 40%!

Keep that figure in mind next time you hear someone talking about the disgusting practices of the male homosexual. It ain’t a gay thing. It’s a human thing.

And now I offer my apologies and return you to usual gravitas and decorum of Box Turtle Bulletin.

I Don’t Care Who Financed Prof. Regnerus

Rob Tisinai

June 15th, 2012

I’m confident we’ve exposed Prof. Mark Regnerus’ study as a mess. We’ve ripped him for so many flaws. His sorting of its respondents; his definitions of “gay,” “lesbian,” and “same-sex parenting”; his sample size; his statistical significance; his unsupported statements to the popular press.

In doing so, we’ve haven’t simply torn holes in his work. We’ve legitimately questioned his integrity as a scientist.

And yet some folks believe we’re on the wrong track. The New Civil Rights Movement points out the study was financed by right-wing groups with ties to the National Organization for Marriage:

Mark Regnerus‘s recently-released, anti-gay, Republican political propaganda was a trap set by the malicious anti-gay bigots at the National Organization for Marriage.

Where NOM intended to trap people, and, so far, has largely succeeded in trapping people, is in getting them to blah-blah-blah about the details of Regnerus’s junk findings, instead of talking very pointedly about the genesis of the junk…

…The words in Regnerus’s junk study — and in Marks’s equal heap of anti-gay junk — should not be dignified by repeating them in order to rebut them.

I respectfully disagree. When it comes to who funded the study…I mostly don’t care.

Not that it’s completely irrelevant. It heightens our scrutiny. It provides an answer for the good-hearted and incredulous who object, But why would a scientist do such bad work? (Timothy Kincaid has a good piece on that.)

Ultimately, though, it’s not merely a fallacy to focus so much on the personalities and motivations behind a study. It’s also a trap you set for yourself. I see this scenario all too often in our opponents:

A scientist makes an objective study of gays and lesbians and announces favorable results. Our opponents seize on that as proof that the scientist is a pro-homosexual activist, and therefore fatally tainted with bias.

It’s an odd bit of illogic to dismiss your opponents’ arguments simply because they come from your opponents. And it hurts you. Outside views can never challenge you. You’ve limited your own thinking with a habit of epistemic closure. You’ve even given fair-minded folk a rationale for ignoring gay-positive science done by gay researchers or funded by gay groups.

Worst of all, the undecided middle now has reason to think you don’t have a genuine reply. Some might be impressed by: It was funded by an anti-gay group. But how much more effective to say:  My god, his whole $800,000 study only looked at two — yes, two — kids who were raised entirely by same-sex couples, and he won’t even say how those two turned out!

The first reply questions the study’s integrity. The second demolishes it. Why would you merely question if you have the power to demolish?

And here’s a secret. For all their talk of being “silenced” by homosexual activists, our opponents don’t want an open conversation. We saw this, hilariously, in the Prop 8 proceedings. A number of their expert witnesses backed out of testifying, allegedly because they feared for their safety. So how did our own all-star legal team respond? By calling one of these hostile witnesses to the stand, and by showing videotaped pre-trial depositions from two others.

It was a huge win for us: their testimony highlighted the irrationality and ignorance of our opponents. And don’t forget about David Blankenhorn, the opposition witness with enough foolhardy courage to take the stand. He ended up having to admit he’d once written, “We would be more American on the day we permitted same-sex marriage than we were on the day before.”

You only find this out through dialog, through analysis, through holding responsible for what they’ve said and done. The other side wants to side-step all that. Too many of them positively thrive on shadowy innuendo about hidden agendas driven by secret motives. Don’t take the conversation to that world.

The average undecided person isn’t going to remember who financed which study. The average undecided person is going to remember their reaction on hearing the stupid crap the researchers tried to pull off. That feeling of disgusted wonderment will stick with them, even if the details do not.

Editor of “Gay Parenting” paper responds to BTB reader

Timothy Kincaid

June 15th, 2012

Andrew, a reader and regular commenter at Box Turtle Bulletin, emailed James Wright, the editor of Social Science Research. Citing his own experience as a published author of scientific articles, Andrew expressed concern about Mark Regnerus’ article, its failure to address its objectives, and the careless way in which it lends itself to political abuse (snippet):

In short, the author ultimately fails to address the question he seeks to any reasonable degree. In the past days, Regnerus himself has publicly acknowledged that acquiring some of the data necessary to arrive at the conclusions he does is a “methodological impossibility” at present, and that there’s a “low ceiling to what’s possible” with this information. Given the critical impact of frankly inadequate work funded by an ultraconservative think tank, I question the ethics of publishing such incomplete (some might argue shoddy) work. This will have significant real-world impact, given the political salience of the issue.

James Wright responded (in full):

The paper to which you refer was vetted, reviewed and revised following exactly the same processes that all SSR submissions go through. None of the three external reviewers of the paper, nor any of the three formal commenters, raised any prohibitive concerns about any aspect of the study. Some suggestions for revisions were made in the first round of reviews and those suggestions were followed in the published version.

For the record, Dr. Regnerus is a well-known, respected, and widely cited member of the social science community. A check this morning of the Publish or Perish data base shows 2,415 scientific citations to his papers, which generally appear in high-quality social science journals.

I am told that Professor Regnerus intends to release the raw data for reanalysis sometime in the fall, and I expect those data to be pored over very carefully by a large number of investigators. Any possibly erroneous conclusions that come to light as a result of this process are certain to be reported. This is what makes science self-correcting.

Since we followed the same procedures that are followed for all submissions (some three-quarters of which are rejected, by the way), I would not call the decision to publish the paper “an editorial oversight,” although I am quick to admit that peer review is not a perfect process. As for seeking publicity, be assured that I much prefer the relative anonymity within which my journal editing normally takes place.

I will indulge myself in one final point. The children studied in this survey were raised in an era when it was legally impossible for their parents to form normal marital unions, when gay people were subjected to hostilities and prejudices of the worst imaginable sort, and where their children would have been stereotyped and vilified by their peers and others. The hypothesis that these children would not suffer lasting effects from this sort of social environment seems implausible in the extreme. I do not see that is damaging either to the parents or the children to call attention to the formidable difficulties gay parents must have faced (and still face) in trying to raise their children, or to the consequences for these children that are still detectable years and even decades later. To the contrary, these strike me as precisely the realities that must be acknowledged and faced if we are ever to progress beyond our current heteronormative bigotries.

With best wishes,

Jim Wright

Perhaps Mr. Wright simply doesn’t understand the objections to the article. Hearing complaints about how the conclusions are not supported, it seems that he thinks that it is the conclusions themselves that are causing concern – that if they had been glowing then the report would be accepted. And besides, the conclusions confirm what his presumptions already know.

Wright’s discussion about the likelihood of children of gay parents growing up in the 80′s and 90′s having detectable negative social consequences is not a bad hypothesis. It would not surprise me to find that there were some differences between those children raised by intact same-sex families and intact opposite-sex families, especially in socially hostile locations. But we don’t know that to be true and, despite its pretensions and Regnerus’ media claims, his study tells us nothing whatsoever about that possibility. Besides, difference does not necessitate negative consequences (for example, children of Orthodox Jews tend to have much lower drop-out rates).

While Wright sees logical and predictable results about “the children studied in this survey”, he misses the point that there weren’t any. Of all the children in the survey, only two were raised for their entire childhood by a female same-sex couple and none were raised for their entire childhood by a male same-sex couple.

We do know that Dr. Wright is not unaware of proper sampling techniques or the limitations of inadequate data. In 2010, he co-edited The Handbook of Survey Research, Second Edition, a synopsis of which describes the book thusly:

Detailed chapters include: sampling; measurement; questionnaire construction and question writing; survey implementation and management; survey data analysis; special types of surveys; and integrating surveys with other data collection methods. This handbook is distinguished from other texts by its greater comprehensiveness and depth of coverage including topics such as measurement models, the role of cognitive psychology, surveying networks, and cross-national/cross-cultural surveys. Timely and relevant it includes materials that are only now becoming highly influential topics.

So it’s hard to say at this point exactly why Wright rushed to publish this obviously flawed study. Perhaps he was impressed by the scientific citations that Regnerus has generated (Dr. Wright is not, himself, affiliated with a prestigious social science program and his publication, while carrying the Elsevier name, is not sufficiently important, for example, to be carried by the University of California).

It may be that he was blinded by his presumptions and green-lighted a paper that confirmed what ‘everyone knows’. Or maybe his desire that we progress beyond our heteronormative bigotries doesn’t extend to full social and legal equality and he felt it important that Regnerus’ “findings” be presented with politically expedient timing.

I will resist guessing as to his motives. But I do hope that in his continuing conversation with Andrew he will give serious thought to the matter and will be open to rethinking the wisdom of his decision.

Express Delivery: The Regnerus “Gay Parenting” Paper Took The Fast Lane To Publication

Jim Burroway

June 15th, 2012

One of the things that a few researchers have commented privately to me about concerning Mark Regnerus’s much-dissected study on so-called gay and lesbian parenting (you can read my dissection here), is the amazing speed with which the paper was submitted, peer reviewed and accepted for publication by the journal Social Science Research. The typical process is measured in months, if not years in some cases. But for Regnerus’s paper, only 41 days passed from the time the manuscript was submitted to the day the editors accepted it for publication. This accomplishment is notably rare for journal publication, and it has left quite a few researchers I’ve talked to scratching their heads.

To be sure, not everything about the paper could be measured in days. Regnerus reported in his paper that the survey firm he hired, Knowledge Networks, had a hard time finding adult children with parents who fit his peculiar definition of being lesbian or gay. One solution was spend more time to keep looking:

Thus in order to boost the number of respondents who reported being adopted or whose parent had a same-sex romantic relationship, the screener survey (which distinguished such respondents) was left in the field for several months between July 2011 and February 2012, enabling existing panelists more time to be screened and new panelists to be added.

Altogether, those extended efforts combined with the originally drawn sample yielded 236 adult children whose mother or father “ever [had] a romantic relationship with someone of the same sex.” Regnerus has, when asked directly, admitted that those numbers are much too small to make adequate comparisons to determine their fitness as parents — even though he nevertheless made those comparisons in his paper. When BTB reader StraightGrandmother pressed him in an email exchange on this point, he responded:

I maxed what Knowledge Networks could do with their panel, and no research firm out there is in a position to generate a larger N. Perhaps I could’ve left it in the field for another year, but that is quite awhile, and wouldn’t have doubled the sample size of LMs or GFs.

I’m not following why he doesn’t believe he couldn’t have significantly increased his sample size if the question had been held open for another year. If it is true that, as he acknowledged, that he was hampered by the difficulty of finding enough people to fit his definitions, then the only statistically relevant solution is to keep looking, and not to construct an arbitrarily heterogeneous category to contrast against a homogeneous one and falsely claim that the comparison is legitimate.

And so why not wait? Why not do the only statistically proper thing to do and hold the question open for a year? We’re talking about a paper that was intended to either validate or destroy 30 years of social science research on gay and lesbian parenting. What’s another year more?

What’s the rush?

And rush is clearly the right word. Just look a this the timeline:

July 2011-February 2012: As Regnerus recounted in his paper and I quoted above, Knowledge Networks, the company which conducted the survey and gathered the raw data, held the data collection process open during this period in order to find enough adult children of “Lesbian Mothers” or “Gay Fathers” (terminology that I always find difficult writing out when one considers how loosely he defined those categories)

February 1, 2012: The article is submitted to Social Science Research for consideration. This date is given on the paper’s front page. If the previous time period he gave for collecting his samples is correct, then he had only days to get the last of his data in, the numbers crunched, and the nineteen-page article completed. That alone is pretty remarkable.

February 29, 2012: The article is revised for publication. This typically occurs due to feedback from peer reviews. Taking only one month for others to review the study, get the feedback back to him and for him to incorporate revisions, again, is a remarkable turnaround.

March 12, 2012: The article is accepted for publication.

But then, from the time the article was accepted for publication until mention of it suddenly appeared in the Deseret News and The Washington Times, the article was never posted on Social Science Research’s Articles In Press section. After the incredible speed with which the data was gathered, article written, reviewed, revised, and accepted for publication, the article just sat there, hidden, available only to the select few that Regnerus chose to make it available to. In fact, one potential critic of that Deseret News contacted to comment on the study couldn’t because he had not seen it and Deseret News refused to provide him with a copy.

As of today, Social Science Research lists 33 articles as being in press. Three of those articles have been in the queue since before March 12 when Regnerus’s paper was accepted. And as you can see, none of the other articles were prepared with the lightning speed which Regnerus’s paper enjoyed.

Received Revised Accepted Available
In Press
York Feb 1, 2012 May 4, 2012 May 31, 2012 Jun 13, 2012
Krumpal Jul 13, 2011 May 24, 2012 May 31, 2012 Jun 13, 2012
Price & Collett Sep 5, 2011 May 15, 2012 May 31, 2012 Jun 13, 2012
Alvarado & Turley Nov 11, 2011 May 10, 2012 May 31, 2012 Jun 13, 2012
Schmidt & Danziger Jul 18, 2011 May 31, 2012 Jun 4, 2012 Jun 12, 2012
Warner & Adams Jun 10, 2011 May 23, 2012 May 31, 2012 Jun 11, 2012
Kreisman Oct 22, 2011 Feb 23, 2012 May 10, 2012 May 31, 2012
Högnäs & Carlson Jul 25, 2011 Mar 7, 2011 May 10, 2012 May 30, 2012
Arnio, et al. Jul 10, 2011 Jan 18, 2012 May 10, 2012 May 22, 2012
Kye & Mare Apr 5, 2011 Feb 20, 2012 May 10, 2012 May 18, 2012
Cor, et al. Aug 10, 2011 Apr 26, 2012 May 2, 2012 May 16, 2012
Daw & Hardie Feb 5, 2011 Apr 20, 2012 May 2, 2012 May 14, 2012
Yan, et al. Jul 7, 2011 Dec 15, 2011 May 2, 2012 May 11, 2012
Shu & Zhu Feb 23, 2011 Jan 4, 2012 May 1, 2012 May 11, 2012
Seltzer, et al. Aug 23, 2011 Apr 24, 2012 May 2, 2012 May 11, 2012
Klugman, et al. Jul 1, 2011 Apr 25, 2012 May 2, 2012 May 10, 2012
Felson & Painter-Davis Sep 19, 2011 Apr 15, 2012 Apr 23, 2012 May 2, 3012
Lancee & Van de Werfhorst Jun 22, 2011 Mar 25, 2012 Apr 16, 2012 Apr 26, 2012
Marquart-Pyatt Jan 24, 2011 Mar 27, 2012 Apr 2, 2012 Apr 17, 2012
Brauner-Otto, et al. Jun 10, 2011 Mar 30, 2012 Apr 2, 2012 Apr 16, 2012
Mollborn, et al. Sep 1, 2011 Mar 23, 2012 Apr 2, 2012 Apr 16, 2012
Xie, et al. Sep 4, 2009 Feb 12, 2012 Apr 1, 2012 Apr 10, 2012
Cheadle & Sittner Hartshorn Jul 8, 2011 Mar 18, 2012 Mar 27, 2012 Apr 3, 2012
Logan & Zhang Oct 11, 2011 Feb 13, 2912 Mar 14, 2012 Apr 3, 2012
Cheadle & Schwadel Sep 23, 2011 Mar 18, 2012 Mar 27, 2012 Apr 1, 2012
Sonnenberg, et al. Jul 7, 2011 Nov 2, 2011 Mar 19, 2012 Mar 27, 2012
Zhou Apr 15, 2011 Jan 15, 2012 Jan 2, 1900 Mar 27, 2012
Teney & Hanquinet Jul 31, 2011 Mar 7, 2012 Mar 15, 2012 Mar 23, 2012
Thornton, et al. Aug 24, 2011 Jan 18, 2012 Mar 12, 2012 Mar 21, 2012
Guzzo & Hayford Mar 9, 2011 Dec 22, 2011 Mar 12, 2012 Mar 21, 2012
Villareal & Hamilton Jan 6, 2011 Feb 15, 2012 Feb 21, 2012 Mar 7, 2012
Smith, et al. May 17, 2011 Feb 13, 2012 Feb 14, 2012 Feb 27, 2012
Logan & Shin Apr 8, 2011 Jan 29, 2012 Jan 31, 2012 Feb 7, 2012

And how does the timeline for Regnerus’s paper stack up with the others appearing in the July 2012 issue? Have a look:

Received Revised Accepted Available
In Press
Marks Oct 3, 2011 Mar 8, 2012 Mar 12, 2012
Regnerus Feb 1, 2012 Feb 29, 2012 Mar 12, 2012
Zuberi Jan 28, 2010 Jan 13, 2012 Jan 17, 2012 Jan 29, 2012
Casciano & Massey Apr 5, 2011 Feb 11, 2012 Feb 14, 2012 Mar 3, 2012
Schmeer Oct 28, 2010 Jan 20, 2012 Jan 23, 2012 Feb 2, 2012
Treas & Tai May 31, 2011 Jan 26, 2012 Jan 30, 2012 Feb 13, 2012
Ehlert Nov 10, 2010 Jan 10, 2012 Feb 7, 2012 Feb 17, 2012
Manlove Jan 21, 2010 Feb 2, 2012 Feb 7, 2012 Feb 21, 2012
Henretta, et al. Feb 10, 2011 Dec 15, 2011 Feb 21, 2012 Mar 2, 2012
Flashman Feb 5, 2011 Jan 15, 2012 Mar 1, 2012 Mar 13, 2012
Béteille, et al. Jul 18, 2011 Mar 1, 2012 Mar 12, 2012 Mar 27, 2012
Pharris-Ciurej, et al. May 21, 2009 Mar 1, 2012 Mar 12, 2012 Mar 21, 3012
Skaggs, et al. Aug 4, 2010 Jan 17, 2012 Jan 17, 2012 Jan 26, 2012
Foschi & Valenzuela Jul 25, 2011 Feb 1, 2012 Feb 2, 2012 Feb 11, 2012
Ergas & York Nov 17, 2011 Feb 2, 2012 Mar 12, 2012 Mar 17, 2012
Maimon & Browning Apr 16, 2011 Jan 25, 2012 Jan 30, 2012 Feb 8, 2012
Leopold, et al. Jul 16, 2011 Feb 20, 2012 Mar 12, 2012 Mar 21, 2012

You will notice that the only other article which didn’t appear in press before showing up in the July issue is a paper by Loren Marks which criticizes virtually every other study about gay and lesbian parenting from the past 30 years. (I hope to review that article over the weekend.) It too, along with Regnerus’s study, has been hailed by anti-gay activists and discussions of it appeared alongside Regnerus’s study in the Deseret News and The Washington Times.

By the standards of Social Science Research, it looks like the skids were well greased to get Regnerus’s article through the process as quickly as possible, and then to carefully control its release afterward. With these kinds of dates, it’s very difficult to believe that Regnerus’s article did not receive special treatment throughout the processes.

And so this brings up the obvious question: Why?

There are two major sets of events this year which might provide an answer. By the time this year is over, it looks like there will have been a total of five ballot initiatives on same-sex marriage.  We had one constitutional amendment passed in North Carolina, and there will be another on the ballot in Minnesota. Maine and Washington will vote on whether to allow same-sex marriages in those states, and it looks all but certain that a similar question will be put to voters in Maryland. And if history is any guide, one important topic in these debates will be whether gay and lesbian couples are fit to raise children.

And that’s in addition to the four federal court cases challenging the Defense of Marriage Act — all of them successful so far. At least two of them, along with the pending Prop 8 case, are likely to go to the U.S. Supreme Court very soon. Arguments over whether gays and lesbians can be good parents have figured in many of those cases as well. You can count on this paper showing up in briefs and filings as these cases move forward.

The conservative Whiterspoon Institute and Bradly Foundations together threw $785,000 at this study. They purchased a potent weapon, notwithstanding Regnerus’s protestations that the study says nothing about the fitness of gay or lesbian couples to raise children. And Social Science Review has been co-opted into that fight. Which goes to show that money doesn’t but good research, but it does buy politically useful research just when you need it.

Regnerus Admits He Lacks the Data to Critique Same-Sex Parenting (*so why is he doing it?)

Rob Tisinai

June 13th, 2012

This is getting uglier.

Prof. Mark Regnerus has been giving interviews about his study on parents who’ve had same-sex relationships, saying things like this:

Well, in the generation that are adults now, kids raised in a same-sex household were more likely to experience instability and shifting household arrangements. For example, 14 percent of kids whose moms had a lesbian relationship reported spending more time in foster care, well above the average of 2 percent among all respondents.

That leapt out at me because the error is obvious: The second sentence in no way supports the first. Children whose “moms had a lesbian relationship” weren’t necessarily “raised in a same-sex household” — the children might have never even met their mother’s lesbian partner, much less have been raised by her. Jim Burroway has done some great work pointing this out, and I’d like to extend it. In fact, I’d like to go so far as to show that Regnerus himself admits that he has, well, nothing.

Regnerus’s team interviewed 15,058 people. Few of them had a gay parent; even fewer lived with their gay parent’s partner for a significant time; and fewer still came from what Regnerus calls a “‘planned’ gay family.”

Respondents who: “Lesbian” mother “Gay” father
Had a parent in a same-sex relationship 175 73
Lived with parent’s same-sex partner more than 3 years 40 1
Came from “planned” gay families (estimated) 30 – 45 less than 1

A couple points:

  • Regnerus is fond of talking about “lesbian mothers” and “gay fathers,” but he defines them as adults who have ever had a same-sex romantic relationship, even if it only happened once, even if it only lasted a few days.
  • Regnerus has no data on “planned gay families.” He derived those numbers from looking at “respondents who claimed that (1) their biological parents were never married or lived together, and that (2) they never lived with a parental opposite-sex partner or with their biological father.” The numbers are a guess.

Back to those numbers, though. Regnerus obviously can’t draw any conclusions male same-sex parenting based on a sample of less than 1. How about lesbian same-sex parenting? Is his sample of 30-45 respondents enough to significantly describe the broader population?

No. Not unless the total nation-wide population of adults raised by two lesbian parents is about 50 or fewer. And I suspect it’s more.

Here’s the kicker: Regnerus agrees with me. His article bemoans the low sample sizes of studies that offered up good results for same-sex parenting:

It is not surprising that statistically-significant differences would not emerge in studies employing as few as 18 or 33 or 44 cases of respondents with same-sex parents, respectively…Even analyzing matched samples, as a variety of studies have done, fails to mitigate the challenge of locating statistically-significant differences when the sample size is small.

Look at the numbers in that quote. Now look back at the numbers in the table. This is Regnerus telling us he’s got, as I said, nothing.

Now here’s why this is so ugly.

  • In the study’s introduction, Regnerus frames it as an examination of same-parenting and a corrective to flaws in earlier, positive studies on same-sex parenting.
  • But Regnerus’s data on same-sex parenting contains the same sample-size flaws for which he which criticized those other studies.
  • So once he leaves his introduction and enters analysis, he abandons all pretense of studying same-sex parenting and focuses instead on parents who have ever had a same-sex romantic relationship, regardless of whether they raised a child with that same-sex partner.
  • Nevertheless, he does not correct his introduction in order to frame the issue properly.
  • And finally, he grants interviews to conservative outlets, claiming that his study shows the harm of same-sex parenting, even though his own words, in his own study, demonstrate that he knows his sample size is just too damn small to say anything with confidence.

Am I wrong to call this ugly? Prof. Regnerus could well be following this blog, given Jim’s excellent and well-publicized work. I hope the professor provides us an explanation and justification for what he’s telling the press.

Why We Talk about Anti-Gay Bias

Rob Tisinai

June 12th, 2012

The Washington Times has (indirectly) declared that not being “entirely heterosexual” is a negative outcome. And it did this in a news article, not an editorial.

In a widely-quoted piece on Mark Regnerus’ gay-parenting study, the Washington Times wrote:

He found that, when compared with adults raised in married, mother-father families, adults raised by lesbian mothers had negative outcomes in 24 of 40 categories…

Actually, no. Regnerus didn’t find that at all. Rather he found 24 statistically-significant differences, and of those differences he wrote:

…in the vast majority of cases the optimal outcome—where one can be readily discerned—favors [intact biological families].

Emphasis added. See what the Times did? It put words into Regnerus’s mouth. Regnerus did not say all these outcomes were negative. That was invented by the Times.

Here’s the kicker. One of the those differences is whether someone “identifies as entirely heterosexual.” Regneros didn’t classify this was positive or negative. He gives a few examples of outcomes that are “obviously suboptimal (such as education, depression, employment status, or marijuana use),” but sexual orientation isn’t on that list.

By now, though, this Washington Times falsehood has been widely reported as truth when it’s nothing of the sort.

What makes this so insidious is that it’s unstated. In one place the reader hears that all the differences were negative. In another, that one of those differences was sexual orientation. The association sinks in without ever being explicitly connected.

But it’s still there, a little splash of anti-gay bias that lands in the article almost unnoticed, one more drop of rain added to the river of homophobia.

My take on the “Children of Gay Parents” study

Timothy Kincaid

June 12th, 2012

The key to understanding Mark Regnerus’ study – and to understanding it’s failure – is understanding the motivations of the author and his funders. And, sadly, this is something that I think we fail to grasp with subtlety.

We tend to look at individuals and organizations who oppose our equality as being “anti-gay” and, as that is important to us, we elevate it’s importance to them. We see them as primarily and “anti-gay organization” and attribute motives and malices to them. This may not always be accurate. Anti-gay malice may simply be but a small – incidental even – part of their motivation.

Let me give an illustration: If one is Jewish, then it can be easy to see the Ku Klux Klan’s efforts over the years through the lens of how it impacts you. If one is insufficiently aware of the totality of their endeavors, one might confuse them of being an “anti-Jewish organization”. If one is black, that is not at all how they are perceived.

We need to understand that Regnerus’ study was not necessarily to prove that gay families are inferior. Rather, his goal was to prove that married heterosexual biological parents (intact biological families – “IBFs”) are superior. Not just superior to gays, but superior to everyone else. Gays are just one group, joining divorced parents, single parents, widows, adoptive parents, and all who aren’t IBF.

Children appear most apt to succeed well as adults when they spend their entire childhood with their married mother and father, and especially when the parents remain married to the present day.

Regnerus did not set out to say anything about orientation, he simply set out to prove that a certain family structure is superior. And that’s where he failed.

When discussing heterosexual parents, he did compare family structures. The distinctions and differences between the groups were determined by marital status, divorce, step-parentage and the like, all of which address the structure of the families. However when it came time to discuss children of parents in which one was same-sex attracted, Regnerus played a sleight of hand. He redefined his terms such that ‘having a gay parent’ became in and of itself a family structure.

Regnerus did the same thing for adopted children. The stability of the family, divorce, age of adoption, prior trauma, nothing at all was important other than the way in which they differed from IBF, and as they violated the “B” (biological) then that is the only measure that was important. Regnerus’ “family structures” became defined not by what they were, but by what they were not. There were the Not-I’s: divorce, step-family, single; and the Not-B’s: adopted by ‘strangers’, gay fathers, lesbian mothers (and especially violates the unstated but underlying requirement that the IBF be heterosexual).

Oddly enough, while claiming that he didn’t “go into orientation of parents in this study”, that is precisely what he did. Should one parent have had a same-sex relationship of any sort, that was the determinant that pulled them out of whatever family structure they might have been included in and placed them, de facto, into a non-IBF family structure.

(Imagine if he had done a study in which some other situation were used to create a new family structure: “Families in which the parents are married fare better than ones in which one parent abuses drugs.” Or perhaps “Families in which the parents are married fare better than ones in which both parents work.” It sounds meaningful until you try find the meaning.)

So what is Regnerus to do with this data? He didn’t get the data he hoped for. He didn’t get meaningful data to address the premise he wished to support. He can’t break up the same-sex attracted parents into statistically meaningful family structure groups; he doesn’t have sufficient sample size.

So he has two choices:

He can eliminate the same-sex attracted parents from the study (or put them in comparable family structure groups) or even report that sample sizes disallowed any meaningful conclusions about the comparisons between IBFs and gay families. But then he’s left with a study that says “married parents do better than divorced parents” and that wouldn’t generate headlines in his mother’s Christmas letter, much less in mainstream press. And his funders would object to three quarters of a million bucks being spent on something that has been shown to be true in many studies before this one.

They know that they are superior (and just a bit more special) than divorced parents or those slutty single mothers (who surely are all on welfare). They have studies to prove it. But so far they didn’t have anything to point to which would prove them to be superior to same-sex families.

So instead he chose to play word games. He decided to claim that “one parent is same-sex attracted” is a family structure in the same way that married or separated is a family structure. And, of course, this could be presented (with lots of “oh, no, really”) as implied evidence that IBF is superior to same-sex married couples. Which is precisely what Regnerus did when he said:

In fact, the most significant story in this study is arguably not about the differences among young–adult children whose parents who have had same-sex relationships and those whose parents are married biological mothers and fathers, but between the latter and nearly everyone else.

But, ultimately, once one says “oh, but being gay is not a family structure” then his study becomes meaningless. As Mark Regnerus is discovering.

“Children of Gay Parents” Author Responds To BTB Reader

Jim Burroway

June 12th, 2012

Whoever invented the term “crowd-sourcing” was onto something, and the BTB crowd is among the best. Regular commenter StraightGrandmother had an interesting email exchange which she posted in the comments section. I want to bring up those email responses here.

Her first email began: “You can’t just force all the Children of Parents who had a same sex relationship into one bucket. it is not representative of what that respondent grew up in for a home life,” She then peppered him with several questions: How many LM/GF had biological parents who were married and stay married, how many were married then divorced, were never married, had a “fling”, etc. In other words, how many LM/GF people fit the more homogenous categories that he created for adult children of heterosexual couples. You can read her full email here. Regnerus replied:

Dear Ms. _______,

I will do my best to get answers to most if not all of your questions, hopefully in the next few days. However, there is not data on “flings,” only the presence or absence of relationships, and whether the respondent lived with the parent and their same-sex partner, and at what age (plumbing the calendar data is time-consuming work, however.)

I believe the article should be publicly available for free on Monday, from the publisher’s website. That is my understanding. I’m sorry you paid for it. I could’ve sent you a copy upon request.

People of good will (and some without) have and will continue to have lots of comments on measurement decisions, etc. Is understandable. Your comments are well-taken. A key priority, however, was always sample size. Curb it too much by slicing groups (wisely, even) into different categories and statistical power drops precipitously. With a much larger sample size, I would’ve done that. Was a judgment call with which some disagree. I maxed what Knowledge Networks could do with their panel, and no research firm out there is in a position to generate a larger N. Perhaps I could’ve left it in the field for another year, but that is quite awhile, and wouldn’t have doubled the sample size of LMs or GFs.

The study was reviewed the regular way, with multiple blind reviews to which I was required to respond.

I added some commentary about the study background, context, at the place where I blog once a week:http://www.patheos.com/blogs/blackwhiteandgray/2012/06/q-a-with-mark-regnerus-about-the-background-of-his-new-study/.

You can cut, paste, and post whatever you wish…

Sincerely yours,

Mark Regnerus

StraightGrandmother thanked him and clarified why she asked about “flings” :

There is something much much different about a home environment where the parents are in a Mixed Orientation Marriage and one spouse has an extra marital affair with someone of their same sex. The troubling part is the extra marital affair not just the fact that it was with a person of the same sex.

This situation is much different than a sole lesbian who establishes a same sex relationship. See the difference between an extra marital fling and a normal two person relationship?

Regnerus responded:

Please post…

By the way, one of the key methodological criticisms circulating is that–basically–in a population-based sample, I haven’t really evaluated how the adult children of stably-intact coupled self-identified lesbians have fared. Right? Right. And I’m telling you that it cannot be feasibly accomplished. It is a methodological (practical) impossibility at present, for reasons I describe: they really didn’t exist in numbers that could be amply obtained *randomly*. It may well be a flaw–limitation, I think–but it is unavoidable. We maxxed Knowledge Networks’ ability, and no firm is positioned to do better. It would have cost untold millions of dollars, and still may not generate the number of cases needed for statistical analyses. If randomness wasn’t the key priority, then we could’ve done it. And we’d have had a nonrandom sample that was no better than anything before it. So, while critics are taking potshots, they should remember that there’s a (low) ceiling to what’s possible here. My team of consultants elected to go with the screener questions (including the one about same-sex relationships) that we did, anticipating–accurately, too–that there would be no way of generating ample sample size if we narrowed the criteria (for who counts as a lesbian parent) to the sort that critics are calling for. We figured that, with the household roster/calendar offering the opportunity to identify who you lived with, we’d comfortably get enough cases wherein the respondent reported living with mom and her partner for many consecutive years. But few did.

Ergo, in contrast to some impressions, I didn’t construct the study to tell the sort of story I wanted.

I hope that people read the three comments that were also published with the study. They voice confidence in the data, while asserting ample concerns about its use.

Sincerely yours,

Mark

You can read an overview of those three commentaries published in Social Science Review here.

In the third email, StraightGrandmother emphasized her concerns about mixed orientation marriages being included in the LM and GF categories:

If your gay/lesbian population primarily produced children in a Mixed Orientation marriage then I feel you should have clearly said that. Because then your research is showing what I believe to be true, Mixed Orientation Marriages are very hard on children. We know that only 1/3 of Mixed Orientation Marriages attempt to stay together after disclosure and of that 1/3 only half manage to stay together for 3 years or more (and it goes really down hill after 7 years).

IF your gay/lesbian population primarily produced children in a Mixed Orientation marriage then I feel you should have clearly said that. Because then your research is showing what I believe to be true, Mixed Orientation Marriages are very hard on children. We know that only 1/3 of Mixed Orientation Marriages attempt to stay together after disclosure and of that 1/3 only half manage to stay together for 3 years or more (and it goes really down hill after 7 years).

She mentioned Zach Wahls, the young man who was raised by two mothers as the only family he ever knew and who testified about his family before an Iowa statehouse hearing to consider rescinding same-sex marriages in that state, as an example of someone who was really the product of Lesbian Mothers. StraightGrandmother castigated Regnerus for what she saw as carelessness with how he described his “lesbian mothers” category. “You were not up front saying, ’99.5% of the respondents with a gay or lesbian parent were raised in a home where the parents had a Mixed Orientation Marriage.’ Just that simple sentence would have made everything right. …Because of that one missing sentence clearly stating the Mixed Orientation Status you are being attacked instead of being praised.”

Regnerus replied:

Well, it was quite unlikely that I would be praised in the scholarly community. Nor did I expect to be. Trust me, I’m not surprised by the antagonism, but nor does it feel like a badge of honor to me.

The Daddy donor study, with which I am familiar, is not a population-based random sample. It’s an opt-in sample. I even inquired about this study with Abt SRBI and it was apparent that they couldn’t handle it like KN could. They didn’t randomly survey 1,000,000 people. Only the Census–or some precious few deep-pocketed federal studies–contacts that many. The research team discussed an opt-in sample supplement to boost N, and advised against it because the probability of respondents’ inclusion could not be ascertained. Been there, discussed that, elected not to go there in order to preserve the quality of the sample.

I don’t go into orientation of parents in this study. That is a deeper well, and in the cohort that I’m studying, I don’t presume that either they or their parents would confidently call their parent gay or lesbian (or something else). Ergo, we made it about behavior–and not discreet behavior but something their child would be aware of.

Moreover, plenty of scholars, like Lisa Diamond, assert that women’s sexuality is more fluid than men’s. (I make no claim or assertion either way.) If she’s right, your claim about mixed-orientation marriages seems more fixed, especially for women, than it need be in social and marital reality. But I elected NOT to make this about orientation or self-identity. You suggest more ominous motivation, but I assure you that was not true.

Your accusations are getting more heated, and I’m afraid unless we can correspond civilly, I may have to call a conclusion to this.

Again, please post.

Mark

How many times are they going to do this?

Rob Tisinai

June 11th, 2012

Two days after leaving the AIDS/LifeCycle bubble of love, I force myself to click on NOM’s blog page, and you know what I find?

Same sh*t, different day.

NOM (and the rest of the anti-gay world) is crowing about a study on the awfulness of gay parenting. You can read more about that here and here and here. Let me focus on one distinct and familiar flaw: The study compares the children of married biological parents with those from broken homes — and the study’s “lesbian mothers” that our opponents are vilifying generally weren’t married to each other; nor were the gay fathers. No, they were often in opposite-sex relationships that broke down.

Our opponents’ reporting hasn’t focused on that. But I can easily imagine how how an unstable, dishonest mom/dad relationship would (a) be harmful to the kids, and (b) have nothing to do with same-sex parenting!

Now, you can combat this sort of thing with careful analysis. But the error is so common, so recurring, that I’ve put together a cartoon I now can just whip out when the need arises. Who knows, maybe this is the best way to make such an obvious and elementary point:

Feel free to post it where needed.

Overview: Three Responses to Mark Regnerus’s Study of Children of Parents In Same-Sex Relationships

Jim Burroway

June 11th, 2012

For those of you returning from the weekend, you may have missed the release of a new study published in the July issue of the journal Social Science Research. That study claims to show “numerous, consistent differences, especially between children of women who have had a lesbian relationship and those with still-married (heterosexual) biological parents.” If true, these results would up-end some thirty years of established scientific research which had previously shown that gay and lesbian parents are, on the whole, just as good parents as their straight counterparts. The study received one-sided coverage in the Deseret News and the Washington Times.

If you haven’t already done so, I would recommend you read my analysis of Mark Regnerus’s study, “How Different are the Adult Children of Parents Who Have Same-Sex Relationships? Findings from the New Family Structures Study” (Social Science Review 41, no. 4 (July 2012): 752-770.)

Later yesterday morning, I learned that the July 2012 issue of Social Science Review also includes three commentaries on Regnerus’s paper and a rejoinder by Regnerus. That same issue also published a related paper by Loren Marks reviewing and identifying several weaknesses of the past thirty years of social science research about gay parents. I probably won’t be able to review Marks’s paper until later in the week. The three commentaries also remarked on Marks’s paper, but I will concentrate this overview on their observations about the Regnerus paper.

Commentary #1: Paul R. Amato, of Penn State’s Department of Sociology. Amato, like the other two commenters who we will review shortly, commended the Regnerus paper for its strongest feature: the use of a large, national probability sample. As I said yesterday, this is an extraordinarily rare achievement in social science research, and it is why Regnerus’s paper is so important. Amato reviewed Regnerus’s data and for the most part verified Regnerus’s finding that Regnerus’s sample of children of Lesbian Mothers (with all of the issues surrounding the construction of that sample I noted yesterday), did indeed depart from the Intact Biological Family sample.

Amato used a different statistical method to come to that conclusion, a method known as “effect size.” A very brief description is in order. Effect size is, according to this paper, “a simple way of quantifying the difference between two groups that has many advantages over the use of tests of statistical significance alone.” Traditional statistical tests, like those Rengnerus used, identify the statistical significance of two measures, meaning that they measure whether the similarity or difference between two measures can be explained by random chance — sort of like two numbers that fall within the same margin of error. If they can’t, then they are said to be statistically significant. Effect size, on the other hand, estimates the strength of an apparent relationship between two populations based on the standard deviation of results of the control population. This is important because if the control population has a high degree of variability, then even a large differences in the averages between the two groups might not mean anything since there would still be a large overlap.

I know that’s not enough of an explanation to make you (or me) an expert on statistical significance and effect size. But the important thing to keep in mind is that in social science and medical research, it is increasingly recognized that both calculations should be performed. Traditionally, only statistical significance is calculated (as Regnerus did in his paper) and many authors today still only rely on statistical significance tests to evaluate their data. But some journals are beginning to require effect size calculations alongside statistical significance measures, and statistical software packages are beginning to include effect size in their libraries. But calculating effect size has not yet become a standard standard practice.

So, getting back to Amato’s paper, he ran some effect size calculations and, as I said, he confirmed Regnerus’s finding that children growing up in lesbian households (as aggregated in Regnerus’s sample with all of its problems — and I want to keep reiterating that) differed from children growing up in intact biological families with “a moderately large effect size.” However:

The choice of comparison group makes a difference, however. Comparisons of offspring with lesbian mothers and offspring from heterosexual stepfamilies revealed a mean effect size of only .15. When children with divorced or continuously single mothers served as the comparison group, the mean effect size was only .19. I would describe these effect sizes as weak.

What is the most appropriate comparison group? This is a difficult question, given the heterogeneity of gay and lesbian families with children. Consider lesbian couples who have children through sperm donation, or gay couples who have children through surrogacy. Is it reasonable to compare these children with the children of continuously married heterosexual parents? Or should children in the heterosexual comparison group be limited to those born via sperm donation or surrogacy? What about lesbian mothers or gay fathers with children from former marriages or unions? Should these children be compared with those of heterosexual parents who are married, cohabiting, remarried, divorced, or never married? The fact that same-sex marriage is now allowed in several states adds another level of complexity to the problem. Perhaps in future studies, married same-sex parents should be matched with married heterosexual parents.

Which pretty much echoed my concerns yesterday.

Commentary #2: David J. Eggebeen of Penn State’s Department of Human Development and Family Studies. Eggebeen echoed many of Amato’s sentiments. First, he praised the sophistication of Regnerus’s raw data set, which represents a significant advance over previous studies. However:

Nevertheless these data are far from ideal. A larger sample does not translate into a sufficiently large sample. Given some of the complexity of the family lives detailed above, a sample of 163 young adults who report a lesbian mother and 73 who report a gay father are frustratingly inadequate for doing anything but broad comparisons across family characteristics.

Eggebeen also cautions against jumping to quick conclusions about what the data means:

Finding a significant number of negative correlates of well-being for children with gay or lesbian parents, even if they are derived from simple models, invites thinking about some possible mechanisms. It is hard to imagine explanations that point to the quality of parenting per se. Parents, regardless of sexual orientation, are equally motivated to provide the best care possible for their children. It is reasonable, however, to posit that gay and lesbian parents and their children face challenges that may make parenting more difficult.

He concludes that Regnerus’s study has the potential to address the shortcomings of previous studies, but with an important caveat:

The analyses in the Regnerus paper are provocative but far from conclusive. These very preliminary findings should not detract from the real importance of this paper, the description of a new data set that offers significant advantages. Whether the New Family Structures Study has the possibility of unsettling previously settled questions depends in equal parts on richness of the information collected, as well as the willingness of scholars to make use these data.

Regnerus’s larger data set and variable list will become publicly available in the fall so that other researchers to perform their own sets of calculations and comparisons.

Commentary #3: Cynthia Osborne, of the University of Texas LBJ School of Public Affairs. Osborne, like the others, also noted the heterogeneity (i.e. the large in-group differences) of the Lesbian Mother and Gay Fathers groups:

To increase the sample size of children who experienced a same-sex parent, Regnerus included respondents in either the LM or GF comparison groups if they reported that their parent ever had a same-sex relationship. Although this decision has a lot of merit, it makes comparisons across groups somewhat of a challenge. Because the LM group is comprised of young adults who experienced multiple family forms and transitions, it is impossible to isolate the effects of living with a lesbian mother from experiencing divorce, remarriage, or living with a single parent.

She also questioned the decision of what to use as an outcome variable verses a control variable. For the straight populations, the control variables included divorce parents, step-parents, adopted parents, single parents, etc. Among the outcome variables were questions about sexual molestation, forced sex, and whether the family received welfare. She wondered what the data might look like of those were used as control variables rather than outcome variables, since each of them can have a strong effect on childhood outcomes. But while there are all sorts of comparisons that might be made, assigning a cause for the outcome cannot be done based on the data at hand:

Importantly, one cannot clearly link having a lesbian mother (or gay father) with any of these outcomes. As stated earlier, the group is comprised of young adults who experienced multiple family structures, not only a same-sex parent household (indeed, some of the respondents never lived with the mother’s same-sex partner). It is quite possible, for example, that many or most of the negative outcomes result from the divorce of the young adult’s biological parents that preceded the mother’s same-sex relationship. …

…The concern for Regnerus is not Type II errors (saying something is NOT significant when it is), but the possible attribution of differences to living in a same-sex household rather than to experiencing multiple family structures in childhood, one of which happened to be a same-sex parenting relationship.

Osborne emphasized that researchers in this particular field — those who focus on children of same-sex parents — bear a particular responsibility for how their research is presented to the public:

The focus on children of same-sex parents seems, then, to be driven more by the sensitive political and social issues surrounding same-sex relationships than by evidence that this family structure is increasing rapidly or, for that matter, harmful to children. Because the topic is so politicized, scholars must pay even more careful attention to the presentation and interpretation of their findings. Although scholars are trained to use great care to disentangle the causal versus selection effects of family structure and child well-being, we understand that true causation can never be determined because we cannot randomly assign children to various family structures. Consumers of research on children of same-sex relationships, by contrast, may not always have the same training or be so careful in their interpretations. The results of scholarly studies are often scrutinized by pundits and legislators to support their pre-existing ideas of differences or ‘‘no differences’’ across groups.

…Regnerus (2012) finds substantial differences across groups and uses great care to note that his descriptive analysis does not imply causation and that the LM respondents may have lived in many different family structures. Still, the rigor of the study may lead some advocates to claim that growing up with a same-sex parent causes harm and should, therefore, be illegal.

I think we can bank on Osborne’s concern coming true. I’m willing to lay odds that we will see it coming true today.

Mark Regnerus’s Rejoinder. Regnerus’s response was brief. His first comment was to reiterate Amato’s and Osborne’s concerns about the political rammifications of the study:

I recognize, with Paul and Cynthia, that organizations may utilize these findings to press a political program. And I concur with them that that is not what data come prepared to do. Paul offers wise words of caution against it, as did I in the body of the text. Implying causation here—to parental sexual orientation or anything else, for that matter—is a bridge too far.

Regnerus acknowledged that “the sample size of respondents whose parents report a same-sex relationship is substantial but not large enough to explore some of the more fine-grained distinctions that may well be present.” He also said that he is already planning to use the detailed dataset in future studies, and invited other researchers to mine the data when it becomes publicly available in the fall. Finally, he ends with this paragraph defending his emphasis on biologically intact heterosexual families:

As each of the three explicitly or indirectly notes, family instability—whatever the sources—is often a top culprit in predicting dysfunction in the lives of children, and the data analyses in my article likewise point in this direction. In fact, the most significant story in this study is arguably not about the differences among young–adult children whose parents who have had same-sex relationships and those whose parents are married biological mothers and fathers, but between the latter and nearly everyone else. Contexts of instability—whether in gay or straight households—appear suboptimal for children’s healthy long-term development. While much is made in the scholarly literature about ‘‘resilient’’ youth—those who thrive despite the odds against them and in lieu of an optimal family context—resilience is, on average and perhaps by definition, not normal. Moreover, even resilient children would likely prefer to have engaging parents who are not simply in their lives but in their households. Adults of good will, and most family scholars, typically agree on this. Whether some relationship arrangements are more systematically prone to disorganization than others is an important and empirically-testable question.

Deseret News Covers “Kids of Gay Parents Study,” Finds No Flaws

Jim Burroway

June 10th, 2012

Deseret News in Salt Lake City this morning published a lengthy 2,100-word article on Mark Regnerus’s study of adult children of parents In same-sex relationships, making it their top story this morning. Not only did Deseret News find no flaws in the study (Surprise!), they even made it the subject of an editorial saying that “family structure counts” in the childhood development. “Those findings,” the editorial reads, “if true, are significant because in the legal battles over same-sex marriage it has been largely accepted that there is no discernable (sic) difference between the outcomes for children of heterosexual parents and the children of gay parents.”

But are those findings true? Anyone who has an understanding of the design of experiments would look at the study and see its obvious flaws. Deseret News, unsurprisingly, saw no flaws, nor did any of the experts they contacted to comment on it. The one person in a position to be critical of the study could not comment on it because Deseret News refused to show a copy of it to him, saying they were honoring an embargo of that study. Unfortunately, all the other commenters Deseret News interviewed who applauded the study were privy to what the study said. They weren’t restrained by the embargo.

I think you can see what’s happening. Robert George is a senior fellow at the Whitherspoon Institute, which provided $695,000 for this study. He also sits on the board of the Bradley Foundation, which provided an additional $90,000. George also just happens to be a member of the Deseret News Editorial Advisory Board. The man gets around. That’s not to say that Robert George is the man responsible for all of this, but I do think it’s safe to say that there will be a massive media campaign orchestrated around this study.

Update: The Washington Times also has a laudatory article, although it’s considerably shorter. Again, no voices are available to intelligently discuss the study. “Jennifer Chrisler, executive director of the Family Equality Council, declined to comment on the studies, which she had not seen.” [Emphasis added.] Come on! What’s with the secrecy?

Older Posts