Archive for the 'NIH Careerism' category

Grant Review Site Visits

...need to be ended.

They represent a huge risk for bias dependent on the personal characteristics of the investigators to rule the day.

Are you an older, white-haired, heteronormative appearanced, able-bodied picture of "Scientist and Professor"? Great!

Are you overweight? Do you stutter? Express unexpected gender presentation? Nonwhite? Female? Are your language skills less than native to the reviewer's ears? Too young? Too hot? Not hawt enough? .... Not so great.

Should your grant proposal be affected strongly by the direct face to face impression of these characteristics?

No.

__
H/t: @jwoodgett

Update: See PDF for site visit procedures

9 responses so far

Thought of the Day: The NIH Can't Win

Apr 18 2014 Published by under Careerism, NIH, NIH Careerism, NIH funding

A comment over at Rock Talk made a fairly traditional complaint about the NIH funding system. Dan C stated that: "NIH is to be criticized that it funds “usual suspects.

Today, I find this funny. Because after all, most of the people complaining about the NIH system want to become one of the usual suspects!

Right? They want to get a grant, one. They want to have some reasonable stability of that grant funding in a program-like sustained career. Most of them don't want to have to struggle too hard to get that funding either....I doubt anyone would refuse the occasional Program pickup of their just-missed grant.

Once you cobble together a bit of success under the NIH extramural grant system, those who feel themselves to be on the outs call you a "usual suspect". For any number of reasons it is just obvious to them that you are a total Insider (and couldn't actually deserve what you've managed to accomplish, of course). This may be based on the mere fact that you've acquired a grant, because you work in a Department or University where a whole lot of other people are similarly successful. This may be because it appears that POs actually talk to the person in question. It may be because a FOA has appeared in a research domain that you work within.

Anyone sees the duck floating serenely on the water at a given point in time and it looks like this is one most usual suspect waterfowl indeed.

I used to be annoyed at my approximate lateral peers in science who appeared to be having an easier time of it than I did. I had my Insider attributes as a younger faculty member, make no mistake, but I also had considerable Outsider traits, considering where I was seeking funding and for what topics of research. Some of those folks, over there, well boy didn't they get an easy ride because of being such Insiders to the subpart of the NIH system!

I still have those thoughts. Even though I've seen many of the people I thought had it made in the shade go through their dry spells and funding down-cycles. Despite the fact that as each year goes by and my lab remains funded, I become more and more one of the "usual suspects".

I believe that if I ever feel like I am one of the usual suspects, if I feel like I deserve special treatment and stop fighting so hard to keep my lab going that this will be the end.

I advise you to try to retain the same feeling of "outsider" that you feel as a noob PI for as long as you can into your career.

Getting back to the point, however, the NIH simply cannot win with these criticisms. Those who are feeling unsuccessful will always carp about how the NIH just funds "their" people. And if the NIH does happen to fund one of these outsiders, this very act makes them a usual suspect to the next complainer.

The NIH can't win.

14 responses so far

NIH backs down on resubmitting unfunded A1 grant applications

Apr 17 2014 Published by under Grant Review, Grantsmanship, NIH, NIH Careerism, NIH funding

The rumors were true. NOT-OD-14-074says:

Effective immediately, for application due dates after April 16, 2014, following an unsuccessful resubmission (A1) application, applicants may submit the same idea as a new (A0) application for the next appropriate due date. The NIH and AHRQ will not assess the similarity of the science in the new (A0) application to any previously reviewed submission when accepting an application for review. Although a new (A0) application does not allow an introduction or responses to the previous reviews, the NIH and AHRQ encourage applicants to refine and strengthen all application submissions.

So, for all intents and purposes you can revise and resubmit your failed application endlessly. Maybe they will pick you up on the A6 or A7 attempt!

Sally Rockey has a blog entry up which gives a bit more background and rationale.

While the change in policy had the intended result of a greater number of applications being funded earlier,

I really wonder if she believes this or has to continue to parrot the company line for face saving reasons. There is no evidence this is true. Not until and unless she can show definitively that the supposed A0s being funded were not in fact re-workings of proposals that had been previously submitted. I continue to assert that a significant number of PIs were submitting "A0" applications that were directly and substantially benefited by having been previously reviewed in different guise.


As a result, we heard increasing concerns from the community about the impact of the policy on new investigators because finding new research directions can be quite difficult during this phase of their career.

If the true concern here was the ESI or NI, then they could have simply allowed them to pass the filter as a category.

The resubmission of an idea as new means the application will be considered without an association to a previous submission; the applicant will not provide an introduction to spell out how the application has changed or respond to previous reviews; and reviewers will be instructed to review it as a new idea even if they have seen it in prior cycles.

The only way this is remotely possible is to put it in a different study section and make sure there are no overlapping ad hocs. If they don't do this, then this idea is nonsense. Surely Dr. Rockey is aware you cannot expect "instruction" to stick and force reviewers to behave themselves. Not with perfect fidelity.

However, we will monitor this new policy closely.

HA! If they'd decided to allow endless amendments (and required related apps to be submitted as such) then they would have been able to monitor the policy. The way they did this, there is no way to assess the impact. They will never know how many supposed "A0" apps are really A2, A4, A6, nor how many "A1" apps are really A3, A5, A7...etc. So what on earth could they possibly monitor? The number of established PIs who call up complaining about the unfundable score they just received on their A1?

69 responses so far

Side thought on the NIH issuing project grants versus program grants

Apr 16 2014 Published by under NIH, NIH Careerism, NIH funding

I asked a poorly worded question on the Twitts

in which what I was trying to ask was this. From the perspective of awarding NIH grants, does it matter that a given proposal fits into a larger whole? If a brand new investigator, do we assume that he or she is applying for the first grant among many? For the greybeard for whom this might be a last-award, do we recognize that it is the capstone to a lengthy program? For the mid-career investigator do we assume this is only one of the many parts that will eventually form a large body of work?

Or is it all good if this is a singleton? One grant, awarded for 5 years and that is all.

The interesting thing is that nobody on the Twitts thought that I meant this. The answers went to various places- funding from non-NIH sources, relatively inexpensive research that didn't actually require an R01 to be vibrant, the idea of a single R01 that was continued beyond a mere 5 year interval. Many people assumed that what I was really talking about was assessing the merits and qualities of the PI.

After I got done kicking myself for not asking the question properly, a simple thought struck me.

Perhaps the very fact that people assumed I meant just about anything other than a single 5 year award, period, for a given PI was my answer. We do tend to expect that a R01 award fits into a larger research program. It does not stand alone as a single project.

19 responses so far

Guest Post: Manage your career, folks!

Mar 27 2014 Published by under Academics, Careerism, NIH Careerism

This is another guest post from @iGrrrl, a grant writing consultant.


A few comments I've seen around, on top of my experience working with applicants for K-flavored and other career development grants, make it clear that they think the required career development parts are just window dressing. I hear complaints that they have to write a mentoring plan, and then they never do anything that is on it.

Is it the mentor's fault? The people who signed letters to be on the mentoring committee? No. (I'm going to switch voice now and talk at you K99/R00 or other K and F applicants/awardees.) And whose fault is it?

The fault is YOURS. No one cares about your career as much as you do, and even if it went in as fiction on paper, it is YOUR responsibility to make it reality. Otherwise you'll never know if it would have made a difference to tap into the brains on your mentoring committee, to impress them with your initiative and willingness to learn. Making someone feel smart and important to you (while also getting good advice) is a good way to increase their sponsorship of you--inviting you present at meetings, to small subdisciplinary meetings, talking positively about you.

I think it's easy for young people to underestimate the impact of the positive regard of more senior faculty, or for you young folks to know how that plays out in reality. No, they're not gossiping about you; they have better things to do. But that 'dream team' remembers that they signed letters for you and then never heard from you again.

11 responses so far

Should K99 awardees continue the R00 phase at the current Institution?

Mar 26 2014 Published by under NIH, NIH Careerism

The FOA for the K99/R00 says that a different institution is "encouraged (but not required)".

I will confess I thought this was somewhat stronger in tone but the original announcement was similar.

Applicants are encouraged to consider independent positions at departments and institutions different from where they conducted their mentored research. Should an awardee wish to activate the independent phase of the grant award at the same department or institution at which they conducted their mentored research, the individual must provide justification addressing the decision to remain at the same institution.

Still, I guess we can bench race what this would mean in our personal interpretation or recommendation. I would think this an exception for extreme circumstances... so more like 10%?

Well, a comment on a prior thread asserted that something around 25% of R00 awardees had remained at the same Institution in which they had been "training" under the K99 phase.

Naturally, I was interested in what my ICs of greatest interest have been up to. Of currently active R00 grants, one IC came in at 21% at the same institution as the K99 phase and another came in at either 29% or 35%. This latter one had a single award for which the K99 phase moved in the second year and then the R00 was continued in that new location.

Huh.

Huh.

Color me surprised.

I am no big fan of enforced academic nomadism. Were I the Boss of Science I may have omitted that little "encouraged but not required" clause, frankly. Maybe. But the clause is most assuredly in there and it gives an indication about intent. Nice to have exceptions for unusual circumstances, yes, but I would tend to interpret that statement as meaning rare.

At 25% of the awardees, clearly the NIH does not agree with me on this meaning.

Either that, or the reality of the (lack of) academic nomadism under the current system has essentially overcome the NIH's intent.

Here we have a fancy grant award that gives postdocs some negotiating room in where they would like to be. As we've been discussing, these are presumably some top-quality candidates, going by the usual academic seals of approval. And a quarter are disregarding the expectation of nomadic dispersal at the transition to faculty level independence.

To me this underlines the opinion I have on nomadism.

There is something seriously wrong with the expectation that academic scientists travel all over creation for their jobs, in the current era of dual-career families and "training" phases that extend well into the third decade of life.

Quite some time ago I started scrutinizing CVs of visiting speakers, grant applicants, etc to see their trajectories. I didn't formalize it but I came to the conclusion that a substantial (20-25% would probably have been my estimate prior to today's exercise) number had violated the "expectation". Yet it persists. Here we have fairly accomplished scientists (grant winners and invited speakers) violating the truthy truism of academic careers. Substantial numbers of them too. Yet the culture is to sneer at this as an intentional trajectory when it comes to advising junior scientists.

Shaking my head.

24 responses so far

Something you'd learn in business school?

erickttr observed:

I notice that you go to RePORTER for information to help solve mysteries and gather data and strategic thinking respecting grant strategies and for a feel for national trends. Do you ever bring this up in conversation with POs? For example, "I noticed in RePORTER that only 5 R01s have been funded from this PAR, none from my IC of interest (which had a part in creating the FOA) .... what's up with that?" Or is that too .... something ... seems like something you'd learn in business school .... not grad school (where we learn to pipette and run gels).

The things that I talk about on this blog are things that I learned, sometimes the hard way, as a faculty level scientist who was expected to land major research grants to fund his laboratory. A few things I picked up as a postdoc, but my education really accelerated after my career world said "Okay, show us what you can do, junior.".

Much of what I relate to you I learned in bits and pieces over a very long period of time. Just this very month, btw, I learned yet a new wrinkle on NIH behavior when it comes to grants. I am always learning new stuff.

Obviously, I think it is imperative for my continued career existence that I keep my head up about where the lab's funding comes from. I blog because I think you Readers should do so as well. Most of this stuff isn't rocket science, just information. Information that you will over time come to value, information that you will find to be incorrect for your situation and information that may never be of use.

It is my belief that the more academic folks who plan NIH extramurally funded careers know about the NIH system, the better for them. And even grad school isn't too early to start to pick up the basics.

When it comes to Program Officers and, yes, Scientific Review Officers, my answer to erickttr is a simple "Heck yes!". Even people who are part of the system don't necessarily know everything about the system. Not even "their" piece of the system!

You may recall my various frustrations over the years with aspects of the NIH system that participants in the system seem to ignore. Rockey's assertion about PhD job prospects. The amazing discovery that NI awards, prior to the invention of the ESI category, were going to highly established PIs who simply hadn't been NIH funded yet. Program Officers who told people in soft-money jobs that "well, that's not a very good job, you shouldn't be taking those". POs who tell investigators they just need to "write better grants". SROs who were entirely unaware of the A2 traffic-pattern effect as it was developing ("What do you mean this study section rarely funds A0 applications?")

The list goes on and on.

Areas of scientific study that are woefully underfunded by your favorite IC are no different. YOU, scientists, serve an educational purpose. You do this by virtue of the grant applications you submit. You do this by virtue of the reviews that you supply when asked to serve on study section. You do this in your annual Progress Reports.

And you do this by chatting up your friendly POs on the phone or at scientific meetings.

Part of your argument can be derived from RePORTER. Of course. Particularly when you want them to fund you to do X and there are hardly any grants funded on X at the moment. Maybe you can point to a study section which should be handling X but never seems to let any proposals out with a fundable score. Who knows, maybe you will eventually get a Program Announcement or Request for Applications funded.

Go RePORTing folks.

Addendum based on this (wisecrack?) comment from SidVic.

You are poorly served by these idiots, and it is shameful that the NIAAA portfolio doesn't contain at least 4-5 projects addressing x and z. Hey you should really do your duty to humankind and pick up my grant...

Obviously you want to be polite. But the real point here is that you are playing the long game. When you front people with the deficits in their system, they are not going to immediately agree you are right and hand you a new grant award. Not the way the world works. You are trying to shape their own beliefs. This can take time. And you are also trying to give them (your advocates) the ammunition that they need to make their case with higher-ups. (When text that is suspiciously similar to your rantings shows up in the RFA, just quietly pat yourself on the back and consider it a job well done!)

6 responses so far

Enforcing collaboration via grant review

Mar 16 2014 Published by under Grantsmanship, NIH, NIH Careerism, NIH funding

I am wondering whether anyone else is noticing any trends for prioritizing multiple-lab NIH grant proposals.

I recently got busted on, somewhat randomly given the proposal, for not including enough other faculty level investigators. At the time I shrugged it off as an annoying hobby-horse issue of one reviewer.

But Multi-PI proposals have been going over well for some time now, from appearances. So perhaps it is a trend and study sections will start punishing single-lab grants?

I am not sure what to make of this, should it become a trend.

The comment I received smelled to me like "why are you not bringing your junior faculty along for the ride?"...bu perhaps I am over interpreting.

17 responses so far

Your Grant in Review: I Can't Work With This

Mar 14 2014 Published by under Grant Review, Grantsmanship, NIH, NIH Careerism

Reminder. You are going to have advocates and detractor reviewing your grant proposals. Your goal is to give the advocate what she needs to promote your proposal.

No matter how much the advocate might love the essential ideas in your application, nothing good is going to happen if you violate every rule of basic grantsmithing.

At the least you should be able to put together a proposal that gets it mostly right. Credible. Serious. Without huge gaping holes or obvious piles of StockCritique bait lying around everywhere.

It should not be hard to give the advocating reviewer something they can work with.

17 responses so far

Guest Post: BUILDing Diversity with Dollars: Can Grants Change Culture

This guest post is from @iGrrrl, a grant writing consultant. I think I first ran across her in the comments over at writedit's place, you may have as well. She brings a slightly different, and highly valuable, perspective to the table.


iGrrlCartoonThere was an old New Yorker cartoon of two people at a party, and one tells the other, "I'm a fiction writer in the grant-proposal genre." I hate putting fiction in grant applications, especially the type that will be due shortly in response to the Ginther report.

For those who have been worrying about their own grant applications, the Ginther report detailed the relationship of race and ethnicity to NIH grant funding at the R01 level, and NIH has created a few initiatives to try to change the pattern of lower success rates for African American applicants. In early April, the applications are due for the Building Infrastructure Leading to Diversity (BUILD) Initiative, which would fund large-scale projects within individual institutions, and the NIH National Research Mentoring Network (NRMN), which is designed to build a network of mentors. In other words, diversity interventions writ large, with millions of dollars behind them.

The NSF ADVANCE program started in a similar way, and some of the early ADVANCE projects included programs with a limited evidence base. The successes of components of these programs were variable, and the recent RFA included a social science research component to complement the required evaluation of ADVANCE-funded activity. It started with good intentions, and eventually became clear that more than good intentions were needed. Part of the NRMN announcement calls for pilot programs, but I would argue that in the first year, the network should do the social science work to consolidate the anecdotes African Americans tell about their mentoring experiences into hard data, so that the pilot programs can be based upon addressing the needs identified by African Americans who have been through, or training right now in, the current system.

At the recent AAAS meeting in Chicago there were sessions on building diversity in science. At one I learned that explicit bias has reduced in the last 30 years, but implicit bias hasn't. We think we have made progress, and that our conscious intentions are enough. But they clearly are not. Expecting trainees to overcome biased behaviors (to which the actors are blind) places an undue burden on those who are discriminated against. There are studies showing that education about implicit bias helps to reduce such biased behavior, but education attempts can also be done badly and backfire. As pointed out in a recent piece in Science by Moss-Racusin, et al., there is an evidence base now for doing intervention well. If NIH is putting money into large-scale intervention, I hope the existing science will be part of the applications, and expected by the reviewers.

I've spent a lot of my professional life working on exactly the kind of large, infrastructure-based grant application represented by the BUILD and NRMN programs. It is easy for PIs to make assumptions that interventions that sound good on paper will actually have any impact. My concern is that what will be proposed by the applicants to BUILD and NRMN may miss the strong social science work that exists, and that still needs to be done. In fact, some of the best research on effective mentoring is the business literature, a place where few biomedical scientists would think to look.

Grant applications shouldn't be pure fiction, but based on solid evidence. Every grant application represents a possibility, a reality, that could come to pass if the funds are awarded. In the mentoring literature, practices that improve the success for African Americans are often shown to improve the climate for everyone. There is an opportunity here for those in biomedicine to learn from other fields, to consider an evidence base that is outside their usual ken, and to improve the entire biomedical enterprise by improving the overall environment. I hope that those applying for BUILD and the NRMN include the social sciences, and even more importantly, include the voices and ideas of the very people these programs are meant to serve.

NIH has a long history of using dollars to encourage cultural change, with mixed results, because applicants can have varying levels of commitment to the NIH vision while being happy to take NIH dollars. The ADVANCE program at NSF had some hiccups as they worked out what worked to improve the climate for women in STEM. The leadership teams for BUILD and NRMN should include people with a deep knowledge of the research and scholarship on bias and on mentoring, and who can do the rigorous analysis of the current state of affairs for African Americans in biomedical science. I hope I'm wrong here in worrying that such people won't be included, but I've seen fiction in grant applications a few too many times.

No responses yet

Older posts »