Pages

Tampilkan postingan dengan label process. Tampilkan semua postingan
Tampilkan postingan dengan label process. Tampilkan semua postingan

Minggu, 01 Mei 2016

More evidence that the manuscript peer review process is broken


To the surprise of almost no one, asking authors of research papers to submit names of potential peer reviewers for their manuscripts turns out to be a bad idea.

According to a recent New England Journal of Medicine article by Dr. Charlotte J. Haug, a number of research papers have been retracted because reviews were fabricated. Email addresses of suggested peer reviewers were not legitimate. The bogus email addresses were almost all created by authors of papers who then reviewed their own work favorably using fake identities. 

More about the problem can be found on the blog Retraction Watch.

This type of fraud is simple to do because anyone can set up an email address on Gmail or Yahoo mail using any name. Unless a reviewer has an academic email address, proving legitimacy is impossible.

However even if a reviewer has an “edu” address, how would an editor know that a suggested reviewer is not the author’s sister-in-law or a former mentor?

Every medical student who applies for residency knows that you don’t ask someone for a letter of recommendation unless you are sure that it will be favorable. Why would an author take a chance on recommending someone to review a paper without knowing that the review would be a good one?

I agree with the Dr. Haug that soliciting the names of possible reviewers from authors can save editors time and bother. Having spent three years as an associate journal editor, I have experienced the frustration of trying to find high quality reviewers or even a warm body of any quality to do the job.

I also agree with her that a root cause of this problem is the pressure on faculty to publish.

Another problem is that there are too many journals. In 2014, well over 5000 journals and 760,000 papers were included in Medline. The combination of “publish or perish” and superfluous journals leads to the proliferation of marginal papers.

The problem is not simply fake reviews. Since journal reviewers are not paid and have many other responsibilities, they may not thoroughly read papers or provide useful comments about manuscripts.

Some have suggested paying peer reviewers, but who would pay them? Certainly not publishers, even though they make tons of money. And paying might attract unqualified people looking to make a little extra cash.

What about post-publication peer review? It is already happening on blogs, on sites like PubPeer, and even on PubMed. However, the volume of papers published in medicine alone certainly precludes post-publication review of all of them.

Maybe it doesn’t matter. New journals are appearing every day. Most are “open access” and the charge authors “processing fees.” For many of these publications, processing fees do not include even a cursory manuscripts peer review.

With so many journals publishing just about anything for the right price, readers will have to do their own peer reviewing. Be skeptical my friends. 


Read More..

Jumat, 29 April 2016

Follow up Meaningful Use Stage 3 is coming

Yesterday, I posted "Meaningful Use Stage 3 Is Coming: Should Be Fun" which discussed some onerous new rules that Stage 3 will impose including this one:

More than 25% of patients seen by an eligible professional (EP) or discharged from a hospital or emergency department (ED) must "actively engage" with their electronic health records (EHRs).

I said that in my experience most of the patients I took care of would have been unlikely to engage their EHRs and expressed concern that physicians would be penalized for their patients not reaching the 25% threshold.

A reader commented that the VA has had a patient portal called the Blue Button since 2010. He pointed out that in May of 2012, more than 500,000 unique patients had accessed their EMR. He meant this as a rebuttal to my opinion about the potential level of engagement.

However, it turns out that in 2012 over 6.3 million patients were treated by the VA system.  [See page 4 of this link.] If you divide 1 million by 6.3 million, you get 15.9%.

It seems like they have quite a way to go to get to 25%

I rest my case.

Read More..

Selasa, 29 Maret 2016

Cautionary tales about the matching process

Within the next two weeks, anxious fourth-year medical students will submit their residency choices to the National Residency Matching Program. I have written many posts about how to investigate residency programs and the workings of the match.

Here are a couple of stories about deception and disappointment. The first appeared as an anonymous comment on a post I wrote about how to rank surgical residency programs.

I am the spouse of a surgical resident halfway through their residency. When I hear of the idea of "vetting" the residency program as med school graduate, it makes me laugh and cringe. Its not really possible.

We were extremely concerned about not getting stuck in a malignant or toxic program. But these people must have been aware of how bad the program was, we thought the place had the happiest, friendliest people. What a facade.


So now what? We struggle. If it gets too bad I suppose we will try to switch to a new surgical program. Maybe the switch is to a different discipline altogether. Time will tell.

The take-away is perhaps make sure you are lucky, because if you are not, life is hard, and options to fix it are even harder.
[I wish I could tell you how to make sure you are lucky.]

In the mean time we will show up at each and every required recruitment dinner. We will smile, we will follow the script and lie our asses off. Why? Because if we dont we will be labeled a "problem" resident and never get a recommendation from the PD to another program. So the cycle continues. Does the program kick out good surgeons, perhaps, but how many do they lose or worse ruin?

Vetting...no. Luck of the draw.


The second, also by an anonymous writer, appeared on the KevinMD website. At over 1700 words, it is too long to reproduce here. But it echoes the theme. Here are a few excerpts.

Within only a few days of starting my residency, I was called “retarded” and referred to with homophobic slurs. Women were commonly referred to with misogynistic labels.

After one semester of training, I was told that I had not been studying enough because I didn’t do well on the national in-service examination, a test given nationally used to measure your performance versus residents at other programs. I was threatened with academic probation and warned that I needed to read more.
[Do you think the writer might be a surgical resident?]

He describes his increasing despair at the lack of teaching and respect. He failed to obtain a fellowship and speculates about possible reasons.

Today I remain discouraged, jobless, and deeply regretful of the decision I made as a medical student to choose the residency program that I did. I try to remain hopeful that someone will give me a chance and renew my interest in practicing medicine the right way, but it is hard to remain optimistic.

My goal in writing is that as this year’s match day approaches, I plead with the newly graduating doctors out there to please do your homework. Do ask about board passage trends, do try to find out why questionable programs don’t always fill with applicants in the NRMP, and do not assume that an appropriate educational plan is being offered at a program simply because it is accredited. The ACGME and the NRMP publish listings of programs that are on notice, so avail yourself of these listings. Your residency program is a place where you will work very closely with what may amount to be only a small number of supervising doctors, and you only really get one chance to make the right decision.

In my case, there were red flags that I did not pay close enough attention to. During my interview, the residents gave very short and incomplete answers to my questions, and several of them seemed downright unhappy. I had just assumed that the faculty were part of a medical school which was never the case, and I failed to do any research with respect to the effect that program size might have on education. Don’t make the same mistakes that I did, and best of luck to all of the new docs out there. 


I don’t think the match depends on luck, nor do I think that the size of a program makes a difference.

There are two sides to every story, and we will never hear the other sides of these.

However, do not completely discount these anecdotes just because the writers are anonymous. You can understand why the writers did not reveal their names.

I hope all of you did your due diligence, but as these stories show, sometimes it is not enough.
Read More..