Archive for August, 2008

Sequelae of Inadequate Mentoring

Also in this month’s issue of Science & Engineering Ethics is a report entitled Mentoring and Research Misconduct: An Analysis of Research Mentoring in Closed ORI Cases by David Wright, Sandra Titus (who in June published data on the underreporting of misconduct), and Jered Cornelison.

In this study, they focus on trainee misconduct investigated by ORI from 1990 to 2004 (45 of the 158 closed cases). All but 3 of the cases involved fabrication and/or falsification. In reviewing the records, the authors discovered that 73% of the mentors had not looked at the raw data generated by their trainees, and 62% did not set standards for collecting and maintaining data; of greatest concern is the finding of

a troublingly high incidence of missing data or of no lab books at all (even in the laboratories of renowned scientists).

Further, 24 of the trainees reported stress as a contributing factor to their misconduct, with 15 of these indicating that “they fabricated or falsified data because they felt internal pressure to perform well.”

The authors conclude with a thoughtful observation and suggestion:

Surprisingly, in doing our literature review we found that there appear to be no agreed upon standards or best practices in the research community recommending that mentors or lab directors review trainee raw data at regular intervals, whereas there should be.

Institutions, perhaps through peer review of mentoring practices, should assure that research standards are implemented and enforced.

Indeed, with the Hellinga case again serving as a poster child for this and other reform to provide better institutional oversight of mentor practices. The Chronicle offers some additional food for thought as well.

Comments (3)

Journal Peer Reviewers: Incompetent & Biased

So reports an article by intramural researchers at NIEHS in this month’s issue of Science & Engineering Ethics entitled, “Perceptions of Ethical Problems with Scientific Journal Peer Review: An Exploratory Study.” The authors – David Resnik, Christina Gutierrez-Ford, and Shyamal Peddada – conducted an anonymous survey of participants at mandatory RCR training sessions at NIEHS (51% response rate). The average age of respondents was 42, with an average of 35 papers published.

Here were the questions and percentage of “yes” responses:

Have any of the following ever happened to you during the peer review process?

    A reviewer was incompetent – 61.8%
    A reviewer was biased – 50.5%
    A reviewer required you to include unnecessary references to his/her publication(s) – 22.7%
    Comments from reviewers included personal attacks – 17.7%
    A reviewer delayed the review so that he/she could publish an article on the same topic – 9.6%
    A reviewer breeched confidentiality – 6.8%
    A reviewer used your ideas, data, or methods without your permission – 4.5%

Read the rest of this entry »

Comments (12)

Author Contributions Revisited

Five senior editors at the Croatian Medical Journal published a tidy randomized study of two methods for assessing authorship contribution in the Journal of General Internal Medicine. The study involved 865 authors of 181 manuscripts submitted to the journal (CMJ, that is) between January and July 2005 who were randomized to provide either binary (yes/no) or ordinal (0-4 scale) rating of their contributions. Each author on each paper had to complete and sign the form; the first or corresponding author could not serve as a proxy for the others. The qualitative values for the ordinal rating were “none” (0), “small” (1), “moderate” (2), “large” (3), and “full” (4).
Read the rest of this entry »

Comments (1)

Demise of the Lone Author

In reading a recent article on author contributions, I remembered an essay I had been meaning to set out for reflection in case it had been missed due to the timing of its publication (Dec 20, 2007). This would be Mott Greene’s essay in Nature entitled The Demise of the Lone Author.

Greene notes that “From the late 1600s until about 1920, the rule was one author per paper,” which ensured clarity regarding who received credit for which scientific advance … which in turn is important to research sponsors, promotion & tenure committees, search committees, potential trainees, and so forth. Greene’s concern with the proliferation of authors (reaching the 100s when sequences are published) is that few journals include notes about how each author contributed to the research and the article itself. With today’s cattle call authorships, it is hard to give serious weight to the contributions of those listed after the first author (or the first two when an asterisk emphasizes their equal contributions).

Greene turns to Lotka’s Law (Alfred Lotka, 1926) for mathematical relief, describing it as:

a rough ‘inverse-square law of scientific productivity’. For every 100 authors who each produce a scientific paper in a given period, there will be 25 authors who produce two, 11 who produce three, and one author who produces ten or more.

Thus, the more citations you have, the more prominent and reputable a scientist you are – and more worthy of support.

Then Greene, acknowledging modern trends, muddies the purity of mathematics with a law from the dismal science:

Goodhart’s law, from the economist Charles Goodhart: “Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.” Once citation counting became established as a means to determine prominence, players began to ‘game the system’ based on their knowledge of that standard, and the metric ceased to have a close relation to the outcome it was designed to measure. Such attempts led to the somewhat occult business of impact factors, impact journals, author rank within a paper, and other such countermeasures to re-establish the utility of citation counting.

An occult business indeed. However, Greene is concerned that even Lotka’s law combined with black magic to prevent “author gaming” cannot withstand the proliferation of papers with 100 or more authors. He envisions a sort of cinematic rolling of the credits to accommodate the casts of thousands and perhaps even institutionally imposed restrictions on the number of authors.

However, way back at the start of his essay, Greene suggested that those intrepid scientists who could legitimately conduct experiments independently and pull off a sole-author paper would be discouraged (or prevented) from doing so by funding agencies and home institutions in their push for collaborative multidisciplinary teams. This thought was picked up the following March when Kevin Hallock penned a letter in response to suggest that:

funding agencies and institutions should also encourage single-author papers. The effort and initiative required to publish alone suggests an independent and tenacious scientist — both highly desirable qualities in any researcher.

If the ICMJE authorship rules were strictly enforced, many members of this species might well enter the literature as sole authors. Lone authors. Armies of one. But perhaps that would be interpreted as not being collegial or collaborative rather than as being independent and tenacious.

Comments (4)

By JoVE – They’re Indexed!

The National Library of Medicine will index in PubMed videos from the Journal of Visualized Experiments (JoVE), an online open-access research journal that “publishes” videos of experiments and protocols “to increase reproducibility and transparency in biological sciences.”

Check out the official JoVE blog to learn more about the journal and how you can contribute to their blogging and visualization efforts. The editors also invite you to bring your own blog posts to life with their videos (just ask).

Comments (1)

Olja Finn: Science Goddess

Nothing put a bigger smile on my face last week than Science’s profile of Olivera Finn, the founding chair of Immunology at Pitt and recent president of AAI. She is a remarkable scientist (cancer immunology), superb mentor, and delightful woman. Her colleagues and trainees are quick and eager to recognize her professional accomplishments in the course of maintaining a rich family life. I like the way Mitch Leslie starts the article:

Take a look at Olivera “Olja” Finn’s life, and you can tick off the actions women are supposed to avoid if they want to advance in science. Get married fresh out of high school. Check. Interrupt your education for your husband’s sake. Check. Allow his career to take precedence over yours. Check. Have children before you have a job and give birth at what seem like inopportune times, such as shortly before you start graduate school. Check.

Yet Finn has, with great success, pursued career and family goals simultaneously. She celebrated her 40th wedding anniversary last month, has raised a daughter and a son, and, at the age of 59, already has grandchildren. Professionally, Finn has prospered. Nearly 20 years ago, she discovered the first cancer antigen, a tumor molecule that elicits a reaction from immune cells. And despite spending her youth in Communist-run Yugoslavia, Finn has climbed the academic ladder in the United States–she is chair of immunology at the University of Pittsburgh in Pennsylvania and has served as president of the American Association of Immunologists. She argues that interweaving career and family is essential. “I don’t think we live long enough to do things sequentially.”

Indeed, programs promoting women in science at the NIH, the AAMC, and FASEB need look no further than Olja for their role model, both in terms of her incredible career and how she manages her own productive yet family-friendly labs.

Of note is the current NIH RFA for “Research on Causal Factors and Interventions that Promote and Support the Careers of Women in Biomedical and Behavioral Science and Engineering.” I know of several applications going in and am not sure “research” will uncover anything more novel than the need for institutions to pony up resources and reward supportive department practices – but we’ll see. Perhaps just having hard rather than anecdotal data will make the difference in justifying policy change and budgeting priorities, especially in terms of enhancing recruitment and retention.

(Those not familiar with allowable grant costs in this regard can check this FAQ on NIH policy on child care and parental leave and should also check with their usual IC for special policies, such as the Primary Caregiver Technical Assistance Supplements for postdocs available through, who else, NIAID … Olja, did you have a hand in this?)

Now if only FASEB would recognize her with an Excellence in Science award….

Comments (7)

No Need for Research of Nicotine in Pregnancy?

This post has been modified in recognition of reports that this center proposal is no longer under consideration for funding by Philip Morris; discussion of the questionable request has been removed, though issues related to research on the safety of nicotine use during pregnancy have been left for reference purposes. In August 2008, a Richmond paper reported on a proposal by the dean of the VCU School of Medicine (Jerome F. Strauss, III, MD, PhD) for a Center for Healthy Pregnancy and Neonatal Outcomes submitted to Philip Morris for up to $30M in funding. Although the proposal was turned down, of lingering concern is Strauss’s statement that

“Research shows that nicotine entering the bloodstream of pregnant women enrolled in smoking-cessation programs improves the health of their unborn children.”

This remarkable claim aside, there remains the dilemma of what to do with moms-to-be who can’t or won’t go cold turkey on smoking cessation. The most recent published data available are from an open-label randomized clinical trial showing that while nicotine replacement products help maintain smoking cessation during pregnancy, they do not promote permanent cessation, and the long-term effects of nicotine exposure on the fetus remain unknown. Unfortunately, this trial was stopped early by its DSMB when too many negative birth outcomes occurred among the group of women using nicotine replacement therapy. Three prior clinical trials conducted in Denmark (two studies) and Canada were inconclusive at best (Canadian study was stopped early as well), and a randomized, double-blind, controlled clinical trial is underway in the UK. [oddly, Kranzler, cited in the Richmond story, has not yet published the claims he makes to Dovi and only has one review article on the topic from 2003]

The NICHD is funding a cooperative clinical research program (U10HD036104) in minority women specifically addressing “the risk of nicotine exposure to the fetus and during infancy, … [along] a continuum impacting both health and development in later life.” Perfect. The U10 award is in its tenth year, so stay tuned for results from the George Washington University Medical Center.

Although he adamently told the media that the center at the heart of the Philip Morris request would not involve any research nor publish any findings, Strauss appears to be too overcommitted to rework his proposal for a research-oriented sponsor given that he serves as as Dean of the VCU School of Medicine; as Executive Vice President for Medical Affairs for the VCU Health System; and as PI for:

Comments (2)

Findings of Scientific Misconduct … the Rest of the Story

Update: Philip Ball discusses the Redman & Merz study and what punishment of misconduct is intended to achieve in an extended commentary in Nature, Crime and Punishment in the Lab. The comments are just coming in and will no doubt be lively. Don’t forget to add your own.

Science has a policy forum article by Barbara Redman and Jon Merz entitled “Scientific Misconduct: Do the Punishments Fit the Crime?” In 2003, they examined data from an 8-year period (1994-2001) during which ORI cited 106 individuals for engaging in misconduct, 43 of whom had doctoral degrees and established research careers. Redman and Merz looked at PubMed records before and after the ORI ruling for all 43 and were ultimately able to interview 7 of these individuals.

Briefly, publications for the 37 individuals who had citations in PubMed dropped from 2.1 before the misconduct ruling to 1.0 after; 12 did not publish at all after being charged with misconduct.

Using publication records, the authors were able to trace 28 of the 43 individuals; 23 of these had been at Universities at the time of the misconduct finding, yet at follow-up, less than half (n=10) remained in academia. The authors successfully contacted 22 of the 28 traceable researchers and:

Interviews were held with seven individuals, who all reported financial and personal hardship. Six hired lawyers to defend themselves; surprisingly, three reported receiving some assistance from their institutions, one with legal help and two with nonfinancial support. Several reported that they could not appeal their cases because they lacked the resources to do so. Several became physically ill and experienced major disruptions in their personal lives.

Nonetheless, most reported that they had recovered or sustained useful scientific lives after initial shocks to their reputations. Indeed, six of the seven continued to publish in the years after the ORI determination (the exception had moved to industry). Our interviewees were more productive than the other scientists, publishing on average 1.3 more papers per year after their cases were decided (t = 2.77, P = 0.0045), and they were less likely to have been excluded from federal grants and contracts (Fisher’s exact test, P = 0.019). Thus, the picture of the consequences painted by our interviews, which shows both the hardship of punishment and the chance for redemption, is perhaps more positive than it should be.

With regard to the punishments themselves, Redman and Merz note:

There were few differences in number or duration of sanctions between those who committed fabrication and/or falsification, plagiarism, or misrepresentation. The only systematic differences observed were (i) retraction was never required after plagiarism and (ii) those who had falsified and/or fabricated data were 8.8 times (z = 2.34, P = 0.019) more likely than others to receive grant debarments and received on average 0.6 more sanctions.

They conclude that “Overall, the punishments we observed were related to the crimes: Acts of falsification and fabrication were punished more harshly than were acts of plagiarism.” (The Chronicle includes some additional quotes from the authors on their study.) I suspect a large body of interested individuals are watching to see if this eventually holds true for the recent unpleasantness in North Carolina.

Comments (3)

Killer Radio Waves

In honor of my mom’s 86th b-day (today), I bring you a story she has been telling me – and I’ve resisted hearing – for a few years now. It started about how this local guy, local being Erie, Pa, undergoing chemo for his own leukemia had used a ham radio and his wife’s pie pans to burn salt water and in the process figured out how to cure cancer. In hot dogs, anyway.

Yeah, sure, mom. No, really, she would persist, harmless radio waves kill the cancer cells but don’t cause any pain to the patient.

Okaaay. Some major woo for Respectful Insolence certainly. I’d feed the cats, let the dogs out, sort through the mail, uh-humming away. She kept updating me about this radio wave cancer cure even as I left a job, city, and spouse behind to start anew in a job and city closer to her. I wasn’t paying attention.

Mom, it takes years and years for this sort of research to progress to human trials – and lots of grant money. He’s not even a faculty member anywhere (shoot, he doesn’t have a college degree of any sort). Believe me, mom, I *know* how long this sort of work takes to progress from cells to animals to people and how hard it is to get funding for this sort of high-risk speculative research.

Except, of course mom, being mom, is right, and I’m the smartypants brat very much in the wrong. Happy Birthday, Mom! Read the rest of this entry »

Comments (2)

Scientific Integrity Editorial Cartoon Contest

And the winner is: Justin Bilicki! Congratulations! (NB: the URLs keep changing – I’ve updated them as of Nov 2008, and hopefully these will be maintained as live links)

Looking at the finalists, only one scientist and no women. I guess deductive reasoning would tell us women scientists can’t draw.

Comments (2)

Older Posts »