Archive for the 'Grant Review' category

A NIH Grant Applicant's Calming Mantra

Mar 10 2014 Published by under Grant Review, Grantsmanship, NIH Careerism

"No matter how ridiculous the summary statement comment, it helps you to write better proposals in the future."

11 responses so far

Potnia Theron on Stock Criticism of NIH Grants

Dec 13 2013 Published by under Grant Review, Grantsmanship

Apparently Potnia is going to do a series over at Mistress of the Animals blog. This statement is one of those mnemonic gems you should paste on your monitor edge.

Aims should be general enough to require a project (1-2 papers per aim), but specific enough that they are a project.

One response so far

STAY TUNED: CSR / NIH is reconsidering their options for study sections

Elevating a comment from Chris:

IMPORTANT UPDATE: My study section (originally scheduled for Oct 1-2, then cancelled until Feb) is now back on! I just heard from our chair that we will be holding an online meeting in the next few days (thanks for the advance notice). According to our chair, the "significant pressure" put on the NIH from the extramural community has led them to reconsider their decision to cancel everything and bring things back online. I have no authority on this, but would assume that this will happen across the board. So take heart, all may not be lost for this round...

I am likewise hearing rumor that the CSR is reconsidering what they are going to do.

Stay tuned folks, this ride ain't over yet.

Updated: ps, your comments at Rock Talk can't help but be viewed as part of the "significant pressure". Go to it.

Update 2:

16 responses so far

Government shutdown NIH Grant strategery

Oct 17 2013 Published by under Grant Review, Grantsmanship, NIH

There's at least one early indicator of what is going to happen with the study section rounds that were cancelled because of the government shutdown.

This has all sorts of implications, one of which was brought up by Professor Jentsch in a subsequent tweet. It is related to the NOTice just issued which says that all October deadlines will be pushed forward into the "November timeframe".

Let's say your submitted a new proposal in June or perhaps a revised or competing renewal proposal in July. And like a busy little beaver you've continued to work on the project. Perhaps you have some excellent new data that further supports your awesome ideas and the killer experiments that you've proposed.

There is only one thing to do. Pull the grant from consideration and resubmit it, with the new data, once the NIH picks some November deadlines.

44 responses so far

You know how you like to complain about your NIH grant reviewers?

Oct 02 2013 Published by under Grant Review, NIH

Remember, o ye NIH grant seeking Readers, that your peers are supposed to be reviewing the grants you submitted in the June/July interval right about now. And thanks to the House of GOP shuttering the Federal government, the study sections are being cancelled.

Maybe.

You see, maybe a Continuing Resolution will be passed....tonight? or tomorrow morning? or Friday at 2?

And then the study section meetings for next week will be back on.

So the reviewers have to struggle along and finish up their jobs as best they can, not knowing if it will be for the meeting that is scheduled....or if it will be some sort of replacement meeting later in the month or year.

From what I am hearing, your friendly peers are stepping up to the damn plate and getting their grants reviewed.

Even without access to eRA Commons (where all the grants are stored, hardly anyone bothers to get a CD anymore). So the "read phase" that is supposed to take place the week before a study section meeting is going to be difficult. Hard to read the other reviewers' comments on the grants you are assigned because you don't know who they are! All that is supposed to be automatic on Commons you see. Well, from what I hear around the campfire, the sections are doing what they can, no doubt with heroic work from the Chairs and a little illegal subterranean rogue work from the government employee SROs.

I thank you all.

72 responses so far

Dodging Vaporware: In Preparation, In Submission, Under Review, Accepted Pending

As we all know, much of the evaluation of scientists for various important career purposes involves the record of published work.

More is better.

We also know that, at any given point in time, one might have work that will eventually be published that is not, quiiiiiite, actually published. And one would like to gain credit for such work.

This is most important when you have relatively few papers of "X" quality and this next bit of work will satisfy the "X" demand.

This can mean first-author papers, papers from a given training stint (like a 3-5 yr postdoc) or the first paper(s) from a new Asst Professor's lab. It may mean papers associated with a particular grant award or papers conducted in collaboration with a specific set of co-authors. It could mean the first paper(s) associated with a new research direction for the author.

Consequently, we wish to list items that are not-yet-papers in a way that implies they are inevitably going to be real papers. Published papers.

The problem is that of vaporware. Listing paper titles and authors with an indication that it is "in preparation" is the easiest thing in the world. I must have a half-dozen (10?) projects at various stages of completion that are in preparation for publication. Not all of these are going to be published papers and so it would be wrong for me to pretend that they were.

Hardliners, and the NIH biosketch rules, insist that published is published and all other manuscripts do not exist.

In this case, "published" is generally the threshold of receiving the decision letter from the journal Editor that the paper is accepted for publication. In this case the manuscript may be listed as "in press". Yes, this is a holdover term from the old days. Some people, and institutions requiring you to submit a CV, insist that this is the minimum threshold.

But there are other situations in which there are no rules and you can get away with whatever you like.

I'd suggest two rules of thumb. Try to follow the community standards for whatever the purpose and avoid looking like a big steaming hosepipe of vapor.

"In preparation" is the slipperiest of terms and is to be generally avoided. I'd say if you are anything beyond the very newest of authors with very few publications then skip this term as much as possible.

I'd suggest that "in submission" and "under review" are fine and it looks really good if that is backed up with the journal's ID number that it assigned to your submission.

Obviously, I suggest this for manuscripts that actually have been submitted somewhere and/or are out for review.

It is a really bad idea to lie. A bad idea to make up endless manuscripts in preparation, unless you have a draft of a manuscript, with figures, that you can show on demand.

Where it gets tricky is what you do after a manuscript comes back from the journal with a decision.

What if it has been rejected? Then it is right back to the in preparation category, right? But on the other hand, whatever perception of it being a real manuscript is conferred by "in submission" is still true. A manuscript good enough that you would submit it for consideration. Right? So personally I wouldn't get to fussed if it is still described as in submission, particularly if you know you are going to send it right back out essentially as-is. If it's been hammered so hard in review that you need to do a lot more work then perhaps you'd better stick it back in the in preparation stack.

What if it comes back from a journal with an invitation to revise and resubmit it? Well, I think it is totally kosher to describe it as under review, even if it is currently on your desk. This is part of the review process, right?

Next we come to a slightly less kosher thing which I see pretty frequently in the context of grant and fellowship review. Occasionally from postdoctoral applicants. It is when the manuscript is listed as "accepted, pending (minor) revision".

Oh, I do not like this Sam I Am.

The paper is not accepted for publication until it is accepted. Period. I am not familiar with any journals which have accepted pending revision as a formal decision category and even if such exist that little word pending makes my eyebrow raise. I'd rather just see "Interim decision: minor revisions" but for some reason I never see this phrasing. Weird. It would be even better to just list it as under review.

Final note is that the acceptability of listing less-than-published stuff on your CV or biosketch or Progress Report varies with your career tenure, in my view. In a fellowship application where the poor postdoc has only one middle author pub from grad school and the two first author works are just being submitted...well I have some sympathy. A senior type with several pages of PubMed results? Hmmmm, what are you trying to pull here. As I said above, maybe if there is a clear reason to have to fluff the record. Maybe it is only the third paper from a 5 yr grant and you really need to know about this to review their continuation proposal. I can see that. I have sympathies. But a list of 8 manuscripts from disparate projects in the lab that are all in preparation? Boooo-gus.

32 responses so far

Bias in Selection for NIH Study Sections

Jul 09 2013 Published by under Fixing the NIH, Grant Review, NIH, NIH Careerism, NIH funding

Interesting exchange on the twitts today with someone who is intimating that the process of selecting peers to serve as grant reviewers on NIH study sections requires some transparency and fixing.

As my longer term Readers are aware, my main objection along these lines is that I think Assistant Professors should not be excluded and that the purge urged on by Toni Scarpa back some years ago was misguided. I will also venture that I think it is ridiculous that the peer review pool is limited to those Professorial rank people who have already won funding from the NIH (for the most part). If really pressed, I've been know to suggest that it is even unfair that the more senior postdoc types who have not yet won a faculty-level appointment cannot review grants.

Other than that, I am generally down with the official mandates to seek ethnic/racial, gender and geographic representation on panels. My personal experience has been that the SROs do a pretty good job at this. Also, because of these factors, I have found that the types of institutions represented spans the range pretty well..small mostly teaching profs, big Research Uni profs, research insitutes of various sizes, public Unis, private Unis, Med Schools and academic departments.

So it is with some confusion that I read someone asserting that there is a problem with who is selected.

My query of the day, therefore, is to ask you if you know of people who seek to serve on study section but cannot seem to land an invite. Alternately, do you know of categories of investigators that are routinely overlooked?

32 responses so far

Some days, this is just about all you have to cling to

Jul 05 2013 Published by under Careerism, Grant Review

"The proposal is extremely well-written and clear."

13 responses so far

Your Grant in Review: How do you know when a study section is a good or bad "fit"?

Jun 27 2013 Published by under Grant Review, Grantsmanship, NIH, NIH Careerism, NIH funding

This is my query of the day to you, Dear Reader.

We've discussed the basics in the past but a quick overview.

1) Since the priority score and percentile rank of your grant application is all important (not exclusively so but HEAVILY so) it is critical that it be reviewed by the right panel of reviewers

2) You are allowed request in your cover letter that the CSR route your NIH grant application to a particular study section for review.

3) Standing study section descriptions are available at the CSR website as are the standing rosters and the rosters for the prior three rounds of review (i.e., including any ad hoc reviewers).

4) RePORTER allows you to search for grants by study section which gives you a pretty good idea of what they really, really like.

5) You can, therefore, use this information to slant your grant application towards the study section in which you hope it will be reviewed.

A couple of Twitts from @drIgg today raised the question of study section "fit". Presumably this is related to an applicant concluding that despite all the above, he or she has not managed to get many of his or her applications reviewed by the properly "fitting" panel of reviewers.

This was related to the observation that despite ones' request and despite hitting what seem to be the right keywords it is still possible that CSR will assign your grant to some other study section. It has happened to me a few times and it is very annoying. But does this mean these applications didn't get the right fit?

I don't know how one would tell.

As I've related on occasion, I've obtained the largest number of triages from a study section that has also handed me some fundable scores over the past *cough*cough*cough* years. This is usually by way of addressing people's conclusion after the first 1, 2 or maybe 3 submissions that "this study section HATES me!!!". In my case I really think this section is a good fit for a lot of my work, and therefore proposals, so the logic is inescapable. Send a given section a lot of apps and they are going to triage a lot of them. Even if the "fit" is top notch.

It is also the case that there can be a process of getting to know a study section. Of getting to know the subtleties of how they tend to feel about different aspects of the grant structure. Is it a section that is really swayed by Innovation and could give a fig about detailed Interpretations, Alternatives and Potential Pitfalls? Or is it an orthodox StockCritiqueSpewing type of section that prioritizes structure over the content? Do they like to see it chock full of ideas or do they wring their hands over feasibility? On the other side, I assert there is a certain sympathy vote that emerges after a section has reviewed a half dozen of your proposals and never found themselves able to give you a top score. Yeah, it happens. Deal. Less perniciously, I would say that you may actually convince the section of the importance of something that you are proposing through an arc of many proposal rounds*.

This leaves me rather confused as to how one would be able to draw strong conclusions about "fit" without a substantial number of summary statements in hand.

It also speaks to something that every applicant should keep in the back of his or her head. If you can never find what you think is a good fit with a section there are only a few options that I can think of.
1) You do this amazing cross-disciplinary shit that nobody really understands.
2) Your applications actually suck and nobody is going to review it well.
3) You are imagining some Rainbow Fairy Care-a-lot Study section that doesn't actually exist.

What do you think are the signs of a good or bad "fit" with a study section, Dear Reader? I'm curious.
__
*I have seen situations where a proposal was explicitly mentioned to have been on the fourth or fifth round (this was in the A2 days) in a section.

Additional Reading:
Study Section: Act I
Study Section: Act II

39 responses so far

Advice on your Response to Prior Review of your NIH grant application in one easy sentence

May 10 2013 Published by under Grant Review, Grantsmanship, NIH, NIH Careerism

from jipkin over at PhysioProf's pad:

The attitude “I’m happy to debate” should be replaced with “I’m happy to explain”.

and there it is.

20 responses so far

« Newer posts Older posts »