Archive for June, 2011

NSF Seeks Input on Proposed Revisions to Review Criteria

Rather than “enhancing” peer review like big brother NIH, the NSF has been working to clarify the principles and criteria by which the intellectual merit and (especially) broader impacts of proposed research are assessed. The problem is mainly with the broader impacts, which seem to keep growing broader and broader.

As currently laid out in the Grant Proposal Guide, reviewers are asked to consider:

What is the intellectual merit of the proposed activity?
How important is the proposed activity to advancing knowledge and understanding within its own field or across different fields? How well qualified is the proposer (individual or team) to conduct the project? (If appropriate, the reviewer will comment on the quality of prior work.) To what extent does the proposed activity suggest and explore creative, original, or potentially transformative concepts? How well conceived and organized is the proposed activity? Is there sufficient access to resources?

What are the broader impacts of the proposed activity?How well does the activity advance discovery and understanding while promoting teaching, training, and learning? How well does the proposed activity broaden the participation of underrepresented groups (e.g., gender, ethnicity, disability, geographic, etc.)? To what extent will it enhance the infrastructure for research and education, such as facilities, instrumentation, networks, and partnerships? Will the results be disseminated broadly to enhance scientific and technological understanding? What may be the benefits of the proposed activity to society?

Now the NSF seeks input on the revised Merit Review principles and criteria:

Merit Review Principles and Criteria
The identification and description of the merit review criteria are firmly grounded in the following principles:

    1. All NSF projects should be of the highest intellectual merit with the potential to advance the frontiers of knowledge.
    2. Collectively, NSF projects should help to advance a broad set of important national goals, including:
    ◦ Increased economic competitiveness of the United States.
    ◦ Development of a globally competitive STEM workforce.
    ◦ Increased participation of women, persons with disabilities, and underrepresented minorities in STEM.
    ◦ Increased partnerships between academia and industry.
    ◦ Improved pre-K–12 STEM education and teacher development.
    ◦ Improved undergraduate STEM education.
    ◦ Increased public scientific literacy and public engagement with science and technology.
    ◦ Increased national security.
    ◦ Enhanced infrastructure for research and education, including facilities, instrumentation, networks and partnerships.
    3. Broader impacts may be achieved through the research itself, through activities that are directly related to specific research projects, or through activities that are supported by the project but ancillary to the research. All are valuable approaches for advancing important national goals.
    4. Ongoing application of these criteria should be subject to appropriate assessment developed using reasonable metrics over a period of time.

Intellectual merit of the proposed activity
The goal of this review criterion is to assess the degree to which the proposed activities will advance the frontiers of knowledge. Elements to consider in the review are:

    1. What role does the proposed activity play in advancing knowledge and understanding within its own field or across different fields?
    2. To what extent does the proposed activity suggest and explore creative, original, or potentially transformative concepts?
    3. How well conceived and organized is the proposed activity?
    4. How well qualified is the individual or team to conduct the proposed research?
    5. Is there sufficient access to resources?

Broader impacts of the proposed activity
The purpose of this review criterion is to ensure the consideration of how the proposed project advances a national goal(s). Elements to consider in the review are:

    1. Which national goal (or goals) is (or are) addressed in this proposal? Has the PI presented a compelling description of how the project or the PI will advance that goal(s)?
    2. Is there a well-reasoned plan for the proposed activities, including, if appropriate, department-level or institutional engagement?
    3. Is the rationale for choosing the approach well-justified? Have any innovations been incorporated?
    4. How well qualified is the individual, team, or institution to carry out the proposed broader impacts activities?
    5. Are there adequate resources available to the PI or institution to carry out the proposed activities?

You have until July 14th to e-mail your comments to meritreview@nsf.gov. You can also review the history of modifications in merit review over the years.

Comments (2)

NCATS in Limbo

Back in May, Richard Shelby’s opening statement to a Senate subcommittee hearing on the NIH FY12 budget hinted that getting Congressional approval for NCATS might not be as easy as Collins had thought … certainly not as easy as fluffing it past the SMRB last December:

The question remains, however, as to whether NCATS is the right approach to solving this issue. Will NCATS be the right mechanism for taking valuable discoveries that the taxpayer has funded and giving it a greater opportunity to make it into the marketplace? As we review this proposal, we need to consider the fact that NIH is not a drug developer or an expert in the therapeutics world.

Indeed, Shelby urged more deliberative consideration of what actions should be taken, akin to the advice given by Jeremy Berg and countless others:

Dr. Collins, I believe that NCATS is a matter we should contemplate, but we must ensure that the steps forward are measured and in the best interest of all stakeholders, especially those who are in need of treatment and care.

All the while, the NIH has been actively moving ahead with the redistribution of NCRR programs and personnel … though sans detail with regard to space, staffing, or budgets.

Then a month later, Sebelius wrote to Tom Harkin with the NIH FY12 budget request ($31.7B), including a line item (several, actually) for NCATS and listings on how the NCRR dollars would be reallocated. These are all based on the President’s requested FY12 budget, which of course will likely bear little resemblence to what is finally appropriated (especially since the House passed an appropriation bill that reduced the President’s request for Labor, HHS, and Education by $41.6B). Sebelius describes the process of establishing NCATS as one in which an NIH taskforce:

carefully identified and evaluated program placements that would improve organizational efficiencies and provide scientific synergies. To aid in the decision-making, the taskforce implemented a transparent process to collect and consider input from a wide range of internal and external experts, as well as stakeholders ranging from members of the public to members of the extramural research community.

Efficiencies, synergies, adjacencies. I guess the process to collect input could be described as transparent, though I worry a bit about the metrics that will be used to benchmark progress in achieving her stated mission for NCATS to “advance translational sciences by accelerating the development and delivery of new and more effective diagnostics and therapeutics.”

However, Sebelius and Collins have a more immediate concern facing them, such as the June 15th letter by Rep. Denny Rehberg (R-MT):

If the President decides to submit a formal budget amendment and provides answers to my questions to allow us to review the proposal fully, we will be happy to consider the request. However, until such information is provided we cannot responsibly take any action on this matter.

Therefore, I am very troubled by reports that the NIH has already taken steps to start the search for a new director of NCATS in advance of congressional action. I understand that during public discussion of NCATS to the Advisory Council to the Director of NIH on June 9, 2011, NIH announced it has begun the search process for a director and the process to notify current employees of reassignments to be effective on October 1, 2011 in anticipation of NCATS standing up on October 1, 2011.

It seems premature to take these steps in advance of an official presidential request, let alone required congressional action. I suggest NIH cease all action related to establishing NCATS until the President submits a formal request and congressional action is completed.

… It is unclear based on the scant level of information provided to the Appropriations Committee thus far how NCATS is the answer to advance translational research.

What sort of information is Rep. Rehberg looking for? The sort requested last January by John Bartrum.

Science notes that other Representatives also have concerns about NCATS and the NIH reorganization:

Several other House members, including Representative Michael Capuano (D-MA), who represents the Boston area, also wrote NIH recently with concerns about how the reorganization would affect CTSAs. Last week Capuano sent NIH another letter. “Several of Congressman Capuano’s constituents have expressed concerns that the NIH’s priorities may be shifting away from basic research,” explained Capuano spokesperson Alison Mills, who declined to release the letter until NIH responds.

I like the concern over the shift in NIH priorities away from basic research.

Indeed, Congressional members are not the only ones wondering if NCATS is the solution to the myriad problems in bringing promising diagnostic and therapeutic agents to market:

But others are unconvinced that the public sector’s contributions stretch much beyond basic science. Benjamin Zycher, a senior fellow at the Pacific Research Institute, a conservative economic think-tank in San Francisco, says industry contributions dominate throughout applied phases of drug development (that is, beyond target discovery identified in basic research).

… Zycher, for instance, predicts the center will flop because the NIH isn’t set up for applied research. Moreover, he worries that by enhancing public sector contributions, the center could invite congressional meddling in pricing, fast-track approval decisions and other business-related concerns.

For the biotech industry in particular, USDA’s Toole [research economist] pictures two outcomes arising from the establishment of NCATS. On the one hand, companies could benefit from being relieved of some of the upfront R&D groundwork. On the other hand, it’s also possible that publicly funded scientists could seek more patent protection for their work, continue to overestimate the commercial value of their intellectual property and slow down tech transfer from academia to industry, turning them into competitors as much as collaborators, he says.

Back to the one hand, industry has long been relieved of the “upfront R&D groundwork” through the NIH’s longstanding support of basic discovery research, which is too risky for profit-maximizing companies to pursue. The shift of NIH dollars to help academic researchers take their discoveries to market would come at the price of fewer fundamental mechanisms and potential targets identified.

In the meantime, the clock is ticking:

Rehberg chairs the House appropriations labor/HHS subcommittee, which oversees NIH’s budget. On 26 July, it will introduce a spending bill that would need to fund NCATS if it is to launch by 1 October, the start of the 2012 fiscal year.

At the aforementioned June 9th ACD meeting during which the search for an NCATS Director was “prematurely” announced, Larry Tabak (Deputy Director, NIH) rather than Barbara Alving (Director, NCRR) presented the NCRR Update. In fact, the entire afternoon session was devoted to NCATS. Perhaps any champagne uncorked at the end of the day may have been premature.

Comments (17)

Findings of Misconduct in Science/Research Misconduct

I kept most of the text from the original announcement …

Notice is hereby given that on May 16, 2011, the Department of Health and Human Services (HHS) Debarring Official, on behalf of the Secretary of HHS, issued a final notice of debarment based on the misconduct in science and research misconduct findings of the ORI in the following case:

Based on the findings of an investigation report by St. Jude Children’s Research Hospital and additional analysis conducted by ORI during its oversight review, ORI found that Philippe Bois, Ph.D., former postdoctoral fellow, Department of Biochemistry, St. Jude, engaged in misconduct in science and research misconduct in research funded by R01GM071596, P30CA021765, P01CA071907, R01CA072996, and R01CA100603. ORI found that the Respondent knowingly and intentionally falsified data reported in 2 papers:

  1. Bois, P.R., Izeradjene, K., Houghton, P.J., Cleveland, J.L., Houghton, J.A., & Grosveld, C.G. “FOXO1a acts as a selective tumor suppressor in alveolar rhabdomyosarcoma.’ J. Cell. Biol. 170:903-912, September 2005 (hereafter referred to as “JCB 2005′); and
  2. Bois, P.R., Borgon, R.A., Vornhein, C., & Izard, T. “Structural dynamics of a-actinin-vinculin interactions.’ Mol. Cell. Biol. 25:6112-6122, July 2005 (hereafter referred to as “MCB 2005′).

Specifically, ORI found:

Respondent committed misconduct in science and research misconduct by knowingly and intentionally falsely reporting in Figure 1A of JCB 2005 that FOXO1a was not expressed in cell lysates from alveolar rhabdomyosarcoma tumor biopsies, by selecting a specific FOXO1a immunoblot to show the desired result.

Respondent engaged in misconduct in science and research misconduct by falsifying data presented in Figure 4B of MCB 2005 showing SDS-PAGE for papain digestion of VBS3 and aVBS, by falsely labeling lane 1 to represent papain only digestion, by falsely labeling lane 5 to represent papain digestion of the aVBS peptide, and by falsely inserting a band in lane 3 to represent the aVBS peptide.

ORI issued a charge letter enumerating the above findings of misconduct in science and proposing HHS administrative actions. Dr. Bois subsequently requested a hearing before an Administrative Law Judge of the Departmental Appeals Board to dispute these findings. ORI moved to dismiss Dr. Bois’ hearing request. On May 16, 2011, the Judge ruled in ORI’s favor and dismissed Dr. Bois’ hearing request. The Judge found that Dr. Bois had not raised a genuine dispute over facts or law material to the findings of research misconduct and dismissed the hearing request pursuant to 42 CFR 93.504(a)(2),(3).

Thus, the misconduct in science and research misconduct findings set forth above became effective, and the following administrative actions have been implemented for a period of 3 years, beginning on May 26, 2011:

  1. Dr. Bois is debarred from eligibility for any contracting or subcontracting with any agency of the United States Government and from eligibility for, or involvement in, nonprocurement programs of the United States Government, referred to as “covered transactions,’ pursuant to HHS’ Implementation of OMB Guidelines to Agencies on Governmentwide Debarment and Suspension (2 CFR 376 et seq.); and
  2. Dr. Bois is prohibited from serving in any advisory capacity to the U.S. Public Health Service (PHS), including but not limited to service on any PHS advisory committee, board, and/or peer review committee, or as a consultant.

Leave a Comment

Follow

Get every new post delivered to your Inbox.

Join 114 other followers