Archive for the '[Education&Careers]' category

Why I'm giving up on clickers

Feb 28 2014 Published by under [Education&Careers]

I mentioned this on twitter yesterday and several people were curious about my reasoning, so, FWIW, this is why I'm giving up on clickers:

First, some background. I am teaching a 30 student upper level class. I had slightly better use with clickers when I was teaching a class around 70 students, but in the smaller class it doesn't work as well. I also use several forms of classroom engagement, including think/pair/share and small group paper discussion followed by group presentations, etc.

- The primary reason is that they are too damn expensive. I was led to believe that every student would essentially have one because they supposedly use them in the early classes. In reality, only a small fraction of the students have the right model that works with the new software, so probably 60-70% of the class ends up buying them for my class. Considering that 85% of them are in their senior spring, this $60 seems like a poor investment.

- But wait, there's cheaper options! Yes, there are aps available that work with our system, but I honestly spend more time trouble shooting the connection than it is worth. Between getting it to work on my side and having them make sure they have it set on theirs, I get about half of the responses from those devices. And even when it's working, about two times during class the system will log me out and disrupt my slides.

- The information I get isn't as helpful as I had hoped. And this one might be on me, but I find that pretty much every question has about a 75% correct response rate. Perhaps I need to alter my questions to make them more challenging, but the idea of sinking a bunch more time into this technology I don't think is a huge benefit is not exactly enticing.

- Finally, the students aren't engaged by this method. They'll dutifully do it, but they either get the right or wrong answer and move on. On the rare occasion I find the class response to be closer to 50% correct, I already knew they were having trouble with a concept. Using the clickers to merely confirm what I can see on their faces is probably not the best use of technology.

So given my particular circumstance, I don't find the use of clickers in my class to be a major advantage, nor is it worth the monetary investment for my students. Therefore, I won't be using them next year.

12 responses so far

Pre-tenure applicants should use the CAREER mech for uninvited preproposals

Feb 26 2014 Published by under [Education&Careers]

One of the Stock Complaints about NSF review is how people feel as though the goal posts are always moving because the panel composition changes every round. While that's a topic for a different day, the preproposal system provides junior people with a bit of an exception here.

Preproposal results should be filtering in in late April or so. The CAREER deadline is in late July. It might not be the four months that PIs are given to turn an accepted preproposal into a full proposal, but that still leaves about three months between hearing back about your uninvited preproposal and the CAREER deadline. Why should you consider packaging your proposal for the CAREER award?

For one, the CAREER grants get mixed in with the full proposals submitted to a panel, so it is essentially a backdoor access for junior people to get their full proposal looked at. Yes, the CAREER has certain stipulations that are going to require your attention, but it's a good idea to be in the pool of proposals that are being considered for funding.

Second, and maybe more importantly, you have feedback from many of the people who will evaluate it again! IME, there is decent panel consistency (maybe ~50%) between the preproposal and full proposal round. In cases where someone can't make the second panel, they are often asked to be an ad hoc on a few proposals they saw as panelists. It is to your significant advantage to robustly demonstrate that you have dealt with the critiques of the reviewers rereading your proposal and that it is better now than ever!

Now, you're obviously going to want to be choosy here on which proposals to try this with. You only get three shots with the CAREER proposals, so you will need one that you feel confident just missed the cut and can be turned around effectively. Sometimes that can be a little hard to judge, but a careful reading of the reviews and maybe a discussion with the PO might help you make a call.

But don't ignore the opportunity.

2 responses so far

Get on a panel!

Feb 26 2014 Published by under [Education&Careers]

I've said this before, but it bears restating: if you are applying for NSF funds and have never been on a panel, you are shooting yourself in the foot. There's always questions about how panels work, but there's no substitute for doing it yourself. It is a TON of work, but worth every second.

So, how does one get on a panel? Well, it's a good idea to actively seek the opportunity out. You have a huge advantage if you have a semi-rare knowledge base or work in a state that isn't flooded with NSF PIs, but no matter what you should put your name out there. If you have submitted to a panel you obviously can't ask to be on it, BUT, the preproposal panels are already pretty much filling up, so if you don't get on one of those you could always ask to be on the full proposal panel, should your proposal get cut in the first round.

Regardless, you should contact several POs from different programs to put your name on their radar. It may take a bit to get called if your work, institution type and state are well represented, but you just have to keep trying. Ask, Ask and ask again.

5 responses so far


Feb 24 2014 Published by under [Education&Careers]

I have to admit, anytime someone says that we need to start funding people not projects, my suspicion meter just about craps itself. As with all "solutions to the status quo" it always turns out that the person espousing this view sees themselves as a major beneficiary of this system. The will cite HHMI is a shining example of success, of course, and conveniently forget that those HHMI peeps had to become independent before they were picked up. I may be mistaken, but I don't see a lot of Assistant Profs at the HHMI table.

I am all in favor of figuring out ways to fund good science and change the fact that I spent most of my time chasing money. ALL for it. But it's a damn waste of time to just toss out quarter-baked ideas without stopping for half a second to flex the mental muscle and see what the logical conclusion is. Why does HHMI work? Well, it identifies promising scientists and gives them the resources to get shit done. Cool! Why doesn't HHMI fund the scientific enterprise in the US? Well, for one, that's not their mission and for another, they don't have the money. And oddly, neither does NIH if it wanted to go to this model.

It's simple math. If the goal is to provide long-term stable funding so that certain people can be as creative as they like, the cost is going to be large in terms of the science that doesn't get done. Let's just take the NHLBI data that DrugMonkey is all wrought up about as an illustration of a point. These data show pretty convincingly that the science happening at the 1%ile is just as impactful as the science that gets scored at the 35%ile. Unfortunately we don't have data beyond that point, but one could hazard a guess that a tailing off doesn't happen right after the 35%ile. Let's just suppose for a second that the drop off is somewhere in the neighborhood of the 50%ile.

Current funding ranges at NIH are pretty much at the 15%ile and below at the moment. The expanse between 15 and 50 is, well, massive. So let's say we had enough NIH funds to keep the top 20% (however one would measure that) of labs comfortable. What happens to all that science that would have had the same impact but isn't happening in the right labs?

Now I realize there's no perfect correlation between the Proposal %ile and number of labs, but you get the idea. We would be forced to either give a much larger number of labs much less money or effectively cut off an enormous amount of productive impactful work. Indeed, if you're at a top institution and all you care about is your own situation, it's NBD, right? And if you're too dumb to figure out how to make it work, well then you're probably not the type of scientist that should be funded anyhow.

12 responses so far

Where NSF preproposals are a Good Thing

Feb 24 2014 Published by under [Education&Careers]

I'm on record as not particularly liking the preproposal system that NSF Bio has been essentially forced to moved to. However, I will admit that some of the advantages of the system do indeed accomplish what they were set in place to do. Namely, the short format means there is a low activation energy for getting in the game.

Why is that important? For reasons outlined in Michael Tomasson's latest post about dealing with triaged proposals. Essentially, every PI needs to have a few ideas in the mix and getting feedback on them quickly is key. If your proposal gets trashed in review, then it's time to rethink it and move on with something else. The preproposal system allows you to do this, but providing feedback on a general idea (and in 4 pages, that's about all you can do) for relatively little effort.

The downside, of course, is that you have 8 months before you can resubmit. This is why it's important to be cycling several preproposals at the same time. With the 4 page format you can afford to do it, even if you're juggling it with teaching.

If you're tenure is largely dependent on bringing in NSF funding, you need to avoid being stuck with a single proposal you keep trying in slightly different ways and be willing to walk away from an idea that gets poor feedback at panel. By at least year three you should be maxing out the 2 preproposal limit for your favorite division and probably looking at ways to hit other calls as well. There are plenty of "cross-cutting" mechanisms to explore, as well as the CAREER awards (which can also be a landing spot for re-thought non-invited preproposals).

The most successful PIs I know have also been the most flexible in their funding search. Preliminary data can be used for multiple different proposals with different foci, as long as you can be creative in the questions you want to explore.

12 responses so far

Why is my PI usually non-committal on budgetary questions?

Feb 20 2014 Published by under [Education&Careers]

I often have people in my lab come to me with requests for non-day-to-day things they would like to purchase for our research. They come to me with travel requests or questions about committing funds to something next summer. They are planning ahead and that's a good thing. But I can't always answer them right away.

Why? Because budgeting for a lab is a balancing act with many unknowns.

For instance:

A lab budget is a bit of a puzzle. At the moment the lab runs off of five different pots of money that vary significantly in the amount and duration. Some are scheduled to end this year, some a few years from now. Some have more or less restrictions with what you can do with the money. Each one of those pots has sub-categories with different strings attached. Whereas you can rebudget between most of the categories, they don't all work the same way (e.g. Equipment).

The single biggest charge to any grant is personnel. In a lab environment, the goal is personnel turn-over. Of course, when people leave and when new ones arrive is a moving target. A PhD student might leave after three years or take over 5 and there is little way to know a couple years in advance which will happen. Spending heavy now could mean leaving someone out in the cold in two years.

All of the different pots of money can interact. People often work in overlapping budgetary areas. Reagents exist within the intersections of the lab budget Venn circles. Services? Software? Consumables? There's no way to charge everything in a project-specific way*.

Given the constantly moving parts, in particular the people, a lot of budgeting just can't be done on the fly. If we spend $20k from Pot A, how is that going to affect the activities supported by Pot B? If everyone goes to Big Fancy International Conference, will we have the $$$ to pay everyone the following summer and still fulfill our research goals? Will Sue still be here and in need of support? Can we pick up Bob on an RA for another semester so he can finish after has last experiment imploded?

Ideally, I'll have made the right decisions to ensure that we keep people paid and keep doing good science, but to make that happen each significant expenditure needs to be thought out.

*We do the best we can. Please don't audit me.

13 responses so far

Repost: Like it or not, you're in sales

Feb 10 2014 Published by under [Education&Careers]

In light of the most recent "I'm leaving science because I don't like what this job is", I thought I would pull this back out. The reality of the situation is that you can't be a PI interested in getting federal funding without appreciating The Sell. Whether you like it or not and whether you're willing to embrace it or not, this is the deal: You are selling your ideas.

It always fascinates me to get different opinion of how this career works. It's part of my interest in blogging and why I find the NIH crowd worth watching. But one thing that unites scientists is the need to sell their ideas. Without being able to pitch your research plan to an audience (whoever has the money) and convince them that you have a worthy investment, you aren't going to be able to continue to do science. Whether you are going for crowd-sourced money, an institutional grant for $10,000 or an R01, your job depends on getting other people excited about what you are proposing to do.

That is part of why it has been so painful to watch the public journeyman science exploits of Ethan Perlstein. In a twitter exchange yesterday, it became clear that not everyone agrees with this. But whether your audience knows the same literature as you should not be the deciding factor as to whether or not your proposal is understandable. And no, this is not ancillary to the science, it's critical if you want to DO the science. These are fundamental aspects of grantsmithing and finding ways to keep a lab funded.

I hear people say, all the time, that so-and-so only got the money because they can sell their work. It is usually said with at least a subtle air of "my science is better, but they're smoother". The reality is that selling the ideas is critical to doing the science. Whether you are trying to get money from the federal government, industry or private donation, you still need to get people interested! Part of that is establishing feasibility based on what you have done, demonstrating you're on to something and making a case that the result is going to be AWESOME. If your response to any question of the work is either "well if YOU knew the literature like I do, you wouldn't ask such a stupid question!" or "Clearly you can't see the brilliance of my work because you're too vested in the current dogma." then you are biting the hand that feeds. Maybe BSD graybeards can pull that off, but it's no way to get established.

I'm not trying to pile on while there is an on-going discussion about the research involved, but if you can't sell an idea in plain language to your target audience you are not going to make a go of this. The sooner one recognizes the simplicity of this point, the better off they're going to be.

Oh, and it also doesn't help if you keep publicly bashing whole fields that review your work.

10 responses so far

Same job / new job

Jan 30 2014 Published by under LifeTrajectories, [Education&Careers]

The longer I have this job, the more it changes. Outside of the general adaptation to new science and evolution of that arena of my job, there seems to be a convoy of Things That Must Be Learned at each stage. When you first start a lab you need t figure what it is to actually do that job (No, not just what your postdoc-self thought was the job. The one you could totally handle if someone would just give you the keys.). Then you're thrust in to learning how to teach. Oh right, then how the university actually works. Suddenly you're not "new" anymore and people are looking to you for things.

If you couldn't guess from yesterday's short post, it's only now becoming clear to me that I've been taking on an increasingly "political" role in my college. In hindsight, I can see that I haven't found myself here by mistake, rather I've been maneuvered into this position fairly deliberately. Suddenly I find myself navigating yet new waters, once again. But somehow this seems different.

First off, this isn't something I need to do for my job. Yes, we all have a service expectation, but it is surprisingly easy too look busy on that front without really contributing anything. No, this falls under the things you do because you want to make your environment better (as you see it) at the expense of your time doing career stuff. It's also the best way to make academic enemies - the kind that will hold a grudge for decades over a minor slight. And you are BOUND to piss someone off, because resources are limited. If they are used to support something you champion, it means they were cut from somewhere else.

Thus, I'm left in the unexpected situation of being seen as linked to a particular administrator because of... circumstances. It's becoming clear to me that many senior folks are feeling under-appreciated and under-resourced and they are getting antsy. Things are tight everywhere and, man, those new start-ups are looking pretty fat. Do new people really need all that to get rolling? etc. etc.

I imagine that part of being "politically savvy" is being able to contribute to a shared agenda without drawing attention of those opposed to it. I don't know if I've got that ability. I'm bad at keeping my mouth shut (Surprise, I know) and worse at not pointing out staunch defense of the status quo. I have no idea how this is going to go or if I'm pissing people off right now. I'm not even sure if I should care.

So, onward. I guess.

3 responses so far

Question of the day: Political savvy.

Jan 29 2014 Published by under [Education&Careers]

When someone in your department is referred to as "politically savvy" what does that mean to you?

15 responses so far

Reader Poll: After hours emails

Jan 27 2014 Published by under [Education&Careers]

I find I can have wild swings in the number of undegraduate emails I receive from one semester to the next. Often the vast majority that clamor into my inbox are from a fairly restricted pool of students in my class and the difference between two Emailers and six is pronounced. There is almost always at least one student who will email whenever they happen to have a question and as someone who likes to keep the reigns on their unread messages, my temptation is to just fire back a quick response. However, that can lead students to the false impression that I am available to them at all times and I have had a few (not many) complain that they didn't hear back from me as fast as they expected. Increasingly I find myself moving to a only-during-typical-working-hours approach. I'm curious if that is typical or not.

12 responses so far

« Newer posts Older posts »