Archive for the 'Science Publication' category

A "Registered Report" with a guarantee of publication?

Mar 20 2014 Published by under Science Publication, Scientific Publication

Craziness.

From Drug and Alcohol Dependence:

Drug and Alcohol Dependence will now be offering a new submission format, Registered Reports, which offers authors the opportunity to have their research protocol reviewed before data collection begins, with acceptance of the protocol providing acceptance in principle of the eventual results, irrespective of the nature of the results.

 

and more specifically....

Manuscripts which comprise the introduction, hypotheses, methods, analysis plan (including a sample size justification, for example based on a power calculation) and pilot data if applicable can be submitted via this format, and will first be considered by Drug and Alcohol Dependence's Editor in Chief or one of its Associate Editors. Those Registered Report manuscripts considered of appropriate interest and value will be sent for peer review, and then either rejected or accepted in principle. Following acceptance in principle, the study can begin and the authors are expected to adhere to the procedures described in their initial submission. When data collection and analysis is complete, the authors are to submit their finalised full manuscript for final peer review. As long as the procedures originally described have been followed, and the results interpreted sensibly, the manuscript will be published, irrespective of the nature of the findings.

 

Yeah.... let me get right on that.

 

 

No responses yet

Thought of the day

Mar 20 2014 Published by under #FWDAOTI, Academics, Science Publication

If you don't ever publish papers that are only of interest to yourself....that's sad.

12 responses so far

Why are US Government produced "works" on the Mars Curiosity Rover locked up behind a GlamourMag paywall?

or so asketh Mike Eisen:

There’s really no excuse for this. The people in charge of the rover project clearly know that the public are intensely interested in everything they do and find. So I find it completely unfathomable that they would forgo this opportunity to connect the public directly to their science. Shame on NASA.

This whole situation is even more absurd, because US copyright law explicitly says that all works of the federal government – of which these surely must be included – are not subject to copyright. So, in the interests of helping NASA and Science Magazine comply with US law, I am making copies of these papers freely available here:

FORWARD THE REVOLUTION, COMRADE!!!!!!!

Go Read, and download the papers.

h/t: bill

3 responses so far

Rules for writing review articles

There should be a rule that you can't write a review unless you've published at least three original research papers in that topic/area of focus.

Also a rule that your total number of review articles cannot surpass your original research articles.

57 responses so far

Thought of the Day

There seems to be a sub population of people who like to do research on the practice of research. Bjoern Brembs had a recent post on a paper showing that the slowdown in publication associated with having to resubmit to another journal after rejection cost a paper citations.

Citations of a specific paper are generally thought of as a decent measure of impact, particularly if you can relate it to a subfield size.

Citations to a paper come in various qualities, however, ranging from totally incorrect (the paper has no conceivable connection to the point for which it is cited) to the motivational (paper has a highly significant role in the entire purpose of the citing work).

I speculate that a large bulk of citations are to one, or perhaps two, sub experiments. Essentially a per-Figure citation.

If this is the case, then citations roughly scale with how big and diverse the offerings in a given paper are.

On the other side, fans of "complete story" arguments for high impact journal acceptances are suggesting that the bulk of citations are to this "story" rather than for the individual experiments.

I'd like to see some analysis of the type of citations won by papers. All the way across the foodchain, from dump journals to CNS.

21 responses so far

Dodging Vaporware: In Preparation, In Submission, Under Review, Accepted Pending

As we all know, much of the evaluation of scientists for various important career purposes involves the record of published work.

More is better.

We also know that, at any given point in time, one might have work that will eventually be published that is not, quiiiiiite, actually published. And one would like to gain credit for such work.

This is most important when you have relatively few papers of "X" quality and this next bit of work will satisfy the "X" demand.

This can mean first-author papers, papers from a given training stint (like a 3-5 yr postdoc) or the first paper(s) from a new Asst Professor's lab. It may mean papers associated with a particular grant award or papers conducted in collaboration with a specific set of co-authors. It could mean the first paper(s) associated with a new research direction for the author.

Consequently, we wish to list items that are not-yet-papers in a way that implies they are inevitably going to be real papers. Published papers.

The problem is that of vaporware. Listing paper titles and authors with an indication that it is "in preparation" is the easiest thing in the world. I must have a half-dozen (10?) projects at various stages of completion that are in preparation for publication. Not all of these are going to be published papers and so it would be wrong for me to pretend that they were.

Hardliners, and the NIH biosketch rules, insist that published is published and all other manuscripts do not exist.

In this case, "published" is generally the threshold of receiving the decision letter from the journal Editor that the paper is accepted for publication. In this case the manuscript may be listed as "in press". Yes, this is a holdover term from the old days. Some people, and institutions requiring you to submit a CV, insist that this is the minimum threshold.

But there are other situations in which there are no rules and you can get away with whatever you like.

I'd suggest two rules of thumb. Try to follow the community standards for whatever the purpose and avoid looking like a big steaming hosepipe of vapor.

"In preparation" is the slipperiest of terms and is to be generally avoided. I'd say if you are anything beyond the very newest of authors with very few publications then skip this term as much as possible.

I'd suggest that "in submission" and "under review" are fine and it looks really good if that is backed up with the journal's ID number that it assigned to your submission.

Obviously, I suggest this for manuscripts that actually have been submitted somewhere and/or are out for review.

It is a really bad idea to lie. A bad idea to make up endless manuscripts in preparation, unless you have a draft of a manuscript, with figures, that you can show on demand.

Where it gets tricky is what you do after a manuscript comes back from the journal with a decision.

What if it has been rejected? Then it is right back to the in preparation category, right? But on the other hand, whatever perception of it being a real manuscript is conferred by "in submission" is still true. A manuscript good enough that you would submit it for consideration. Right? So personally I wouldn't get to fussed if it is still described as in submission, particularly if you know you are going to send it right back out essentially as-is. If it's been hammered so hard in review that you need to do a lot more work then perhaps you'd better stick it back in the in preparation stack.

What if it comes back from a journal with an invitation to revise and resubmit it? Well, I think it is totally kosher to describe it as under review, even if it is currently on your desk. This is part of the review process, right?

Next we come to a slightly less kosher thing which I see pretty frequently in the context of grant and fellowship review. Occasionally from postdoctoral applicants. It is when the manuscript is listed as "accepted, pending (minor) revision".

Oh, I do not like this Sam I Am.

The paper is not accepted for publication until it is accepted. Period. I am not familiar with any journals which have accepted pending revision as a formal decision category and even if such exist that little word pending makes my eyebrow raise. I'd rather just see "Interim decision: minor revisions" but for some reason I never see this phrasing. Weird. It would be even better to just list it as under review.

Final note is that the acceptability of listing less-than-published stuff on your CV or biosketch or Progress Report varies with your career tenure, in my view. In a fellowship application where the poor postdoc has only one middle author pub from grad school and the two first author works are just being submitted...well I have some sympathy. A senior type with several pages of PubMed results? Hmmmm, what are you trying to pull here. As I said above, maybe if there is a clear reason to have to fluff the record. Maybe it is only the third paper from a 5 yr grant and you really need to know about this to review their continuation proposal. I can see that. I have sympathies. But a list of 8 manuscripts from disparate projects in the lab that are all in preparation? Boooo-gus.

31 responses so far

Challenging grant attribution on manuscripts

One of the little career games I hope you know about is to cite as many of your funding sources as possible for any given manuscript. This, btw, is one way that the haves and the rich of the science world keep their "fabulously productive" game rolling.

Grant reviewers may try to parse this multiple-attribution fog if they are disposed to criticize the productivity of a project up for competing renewal. This is rarely successful in dismantling the general impression of the awesome productivity of the lab, however.

Other than this, nobody ever seems to question, assess or limit this practice of misrepresentation.

Here we are in an era in which statements of contribution from each author is demanded by many journals. Perhaps we should likewise demand a brief accounting as to the contribution of each grant or funding source.

68 responses so far

Query for manuscript reviewers

Aug 19 2013 Published by under Science Publication, Scientific Publication

Sometimes you get a manuscript to review that fails to meet whatever happens to be your minimal standard for submitting your own work. Also something that is clearly way below the mean for your field and certainly below this journal's typical threshold.

Nothing erroneous, of course.

More along the lines of too limited in scope rather than anything egregiously wrong with the data or experiments.

Does this make you sad for science? Angry? Or does it motivate you to knock out another LPU of your own?

13 responses so far

Manuscript Review Musing

My initial mindset on reviewing a manuscript is driven by two things.

First, do I want to see it in print?. Mostly, this means is there even one Figure that is so cool and interesting that it needs to be published.

If there is a no on this issue, that manuscript will have an uphill battle. If it is a yes, I'm going to grapple with the paper more deeply. And if their ARE big problems, I'm going to try to point these out as clearly as I can in a way that preserves the importance of the good data.

Second, does this paper actively harm knowledge?. I'm not as amped up as some people about trivial advance, findings that are boring to me, purely descriptive studies, etc. So long as the experiments seem reasonable, properly conducted, analyzed appropriately and interpreted compactly, well I am not going to get too futzed. Especially if I think there are at least one or two key points that need to be published (see First criterion). If, OTOH, I think the studies have been done in such a way that the interpretation is wrong or clearly not supported...well, that paper is going to get a recommendation for rejection from me. I have to work up to Major Revision from there.

This means that my toughest review jobs are where these two criteria are in conflict. It takes more work when I have a good reason to want to see some subset of the data in print but I think the authors have really screwed up the design, analysis or interpretation of some major aspect of the study. I have to identify the major problems and also comment specifically in a way that reflects my thinking about all of the data.

There is a problem caused by walking the thin line required for a Major-Revision recommendation. That is, I suppose I may pull my punches in expressing just how bad the bad part of the study really is. Then, should the manuscript be rejected from that journal, the authors potentially have a poor understanding of just how big the problem with their data really is. Especially if the rejection has been based on differing comments between the three sets of reviewers. Sometimes the other reviewers will have latched on hard to a single structural flaw...which I am willing to accept if I think it is in the realm of 'oh, you want another whole Specific Aim's worth of experiments for this one paper, eh?'.

The trouble is that the authors may similarly decide that Reviewer 3 and Reviewer 1 are just being jerks and that the only strategy is to send it off, barely revised, to another journal and hope for three well-disposed reviewers next time.

The trouble is when the next journal sends the manuscript to at least one reviewer that has seen it before....such as YHN. And now I have another, even harder, job of sorting priorities. Are the minimal fixes an improvement? Enough of one? Should I be pissed that they just didn't seem to grasp the fundamental problem? Am I just irritated that IMO if they were going to do this they should have jumped right down to a dump journal instead of trying to battle at a lateral-move journal?

17 responses so far

Grumpy reviewer is....

grumpy.

Honestly people. What in the hell happened to old fashioned scholarship when constructing a paper? Pub Med has removed all damn excuse you might possibly have had. Especially when the relevant literature comprises only about a dozen or two score papers.

It is not too much to expect some member of this healthy author list to have 1) read the papers and 2) understood them sufficiently to cite them PROPERLY! i.e., with some modest understanding of what is and is not demonstrated by the paper you are citing.

Who the hell is training these kids these days?

__
Yes, I am literally shaking my cane.

24 responses so far

Older posts »