Scientific publication 'sting'

Discussion in 'Environmental Discussion' started by tochatihu, Oct 3, 2013.

  1. tochatihu

    tochatihu Senior Member

    Joined:
    Apr 10, 2004
    9,392
    3,637
    0
    Location:
    Kunming Yunnan China
    Vehicle:
    2001 Prius
    Start with the link

    Who's Afraid of Peer Review?

    A long read. No apologies because this is serious stuff.

    As the sting here involved a faked medical study, it really does not belong in 'environmental'. But there is nothing stopping a faked environmental study from being sent around in the same way. Different journals would be chosen.

    If it is not clear from the link, it is entirely normal and ethical and all that for an open-access journal to charge money for publication. In this business model, there is no 'paper' publication and no revenue stream from individual or institutional subscribers, or article downloading fees. You probably know that a very few journals print advertisements, such as Nature and Science. So that stream is usually absent. There are always some costs associated with running a journal, and the open access model is to get it directly from the authors.

    One thing that struck me as odd in the linked piece was that some journals ask for payment before technical review. None of the OA journals I am familiar with do that. No journal that I know, OA or fee access, pays the technical reviewers. So that should not be the stage where OA needs its money.

    The results of this sting are going to bother a lot of people. They bother me. As a (pro bono) technical editor for several journals, I freely admit that my first concern is the quality and significance of the study design,and data. Second, the exposition must be clear and useful. Unless it is obvious that data are faked (personally I never have seen this), I doubt that many technical reviewers spend time on that. Perhaps we should do so more.

    I also want to mention that at least one website

    LIST OF PUBLISHERS | Scholarly Open Access

    lists one person's ideas about questionable publishers. If interested, read about how he reaches his conclusions. I mention it here, specifically, because Beall mentions InTechOpen. I linked to that publisher in the climate science book thread. So I feel that y'all should be informed. Personally, the things I have read from InTechOpen are all fine. Anyway, I will pass that link along to people I know who have published there, because they should be informed as well.

    Last thing; plagarism. I claim that for reviewers familiar with a given field, this is very easy to detect. There are also web-crawling tools that find every publication including a given phrase, etc. So don't even bother trying that :eek:

    Yes I know what mojo is going to say, and I don't care. This is serious. Science means something.
     
  2. mojo

    mojo Senior Member

    Joined:
    Sep 28, 2006
    4,519
    390
    0
    Location:
    San Francisco
    Vehicle:
    2012 Prius v wagon
    Model:
    Three
    Science used to mean something before it became a political vehicle.
    Science was probably a search for truth.LOL
    Reminds me of how the tobacco industry used MDs in their commercials to push cigarettes.
    Using respectability to sell a questionable product.
    Thats similar to how the government is using million dollar climate scientists( ie Mann) to sell the biggest tax /power scheme in history.
    You dont know it yet, but climate science has already taken your vocation out of the realm of respectability.
    In a few years when temps drop as predicted ,"climate scientist" will widely be synonymous with fool and liar.
    BTW how can you say you havent witnessed "faked data" when you are familiar with Mann and Marcott?
     
  3. mojo

    mojo Senior Member

    Joined:
    Sep 28, 2006
    4,519
    390
    0
    Location:
    San Francisco
    Vehicle:
    2012 Prius v wagon
    Model:
    Three
    For that matter youve never been critical of the climate science "Pal" review system.
    Where the Hockey Team controlled publication in journals by threatening to cut off submissions(boycott) and forcing resignations of editors .The hockey team controlled publishing faked studies and rejected those which went against their cabal.
    BTW back to the article,Mullers BEST study is a good example of junk getting published.
    Couldnt pass peer review for over a year and was never going to pass peer review.
    So they submit to a brand new journal started from scratch, and voila ,BEST is now published peer reviewed climate science.
    Was the journal created just to publish BEST?
     
  4. tochatihu

    tochatihu Senior Member

    Joined:
    Apr 10, 2004
    9,392
    3,637
    0
    Location:
    Kunming Yunnan China
    Vehicle:
    2001 Prius
    Starting from the bottom, mojo might have noticed subsequent BEST publications in well-established journals. The notion that the first BEST paper could never pass peer review is strong praise of the peer-review system. I wasn't expecting that gift.

    Paleo proxy T studies are very numerous as we have both found, their results are varied, and it takes a lot of selective mental effort to conclude that some evil hand controls all that. Mojo's porting of C3 that some publications oppose 'Mannology' actually disputes that, but I reckon that would be seen more clearly by other eyes.

    I did expect that this tread would call upon your greatest eloquence, but it concerns a more fundamental matter. Science means something. If we are doing it wrong (as the sting narrowly suggests) then we need to do it better.

    Mojo can praise (BEST couldn't get published) and deride (Hockey-team control) scientific peer review at the same time, and I guess it doesn't make his head hurt. However, I think the process deserves a closer look, specifically as a result of this sting. The value of scientific communication critically relies upon accuracy. It's pretty much all we've got. This sting affects me, in assessing the manuscripts that I receive for review. I don't get 'climate-change' manuscripts, because I have not published in that field.

    I hope that this thread can elicit comments from others as well. Mojo and I already pretty much know each others' minds ;)
     
  5. mojo

    mojo Senior Member

    Joined:
    Sep 28, 2006
    4,519
    390
    0
    Location:
    San Francisco
    Vehicle:
    2012 Prius v wagon
    Model:
    Three
    The climategate emails detail how Manns hockeystick team controlled Pal review.
    Its a public record,Prove me wrong .
    I dont care if BEST is now in prestigious journals ,prove me wrong that BEST FAILED PEER REVIEW.
    But why arent you outraged that BEST cheated the peer review system, if you love science so much?And which speaks to the point of this thread.

    I really dont believe you give a rats nice person about science.
    You care about your noble cause.
    But you want to use your respectability as a scientist to persuade others.
    You lost me there in the respect department.








     
  6. tochatihu

    tochatihu Senior Member

    Joined:
    Apr 10, 2004
    9,392
    3,637
    0
    Location:
    Kunming Yunnan China
    Vehicle:
    2001 Prius
    I startred this thread because I care much more than a rat's nice person about science. It is my noble cause, although I would not call it noble; it's just what I do.

    If BEST air-T differed greatly for other records, we'd do well to wonder why, but they don't.

    I'm not looking for repect here; mojo's or anyone else's. I believe that science is a powerful tool for figuring things out - things that are important for us, all of us. I started this thread with the idea that science is sometimes not done well, and we should do it better.

    In a perfect PC world, no one would care about either mojo or me. They would only start with textbook basics, read the literature, and reach their own conclusions. But neither mojo or I have succeeded; PC readers are not inclined to do all that work, instead (perhaps) they look to leaders to show the way. Frankly I believe that neither mojo nor I are up to that task. I present links to literature, my understanding of processes, and a strong notion that observations are reasonable if they fit together. Mojo provides lit links interpreted by affinity websites, and (I believe wrongly) redrawn figures with an apparent purpose to deceive. No surprise then that I believe that I am edging a bit closer to truth. Almost certainly, mojo will again tell us why his way is better for PC readers. It may include more cudgels ( I borrow the word from our Trebuchet), but regardless, I hope readers will consider both.

    After all that, this thread is about whether science is broken, how broken, and what is needed to fix that. If it is only we two people talking, then this thread fails.
     
  7. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    28,001
    15,843
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    Just a couple of thoughts:
    I read engineering magazines and many are nothing more than collections of advertisements. But the better ones have technical articles needed to evaluate the relative merits of one or another technology. Sad to say, the better ones are often owned by publishers pushing more vacuous magazines. I might sample one but never renew the worst.

    There is a spectrum of publications that vary in quality and content. As readers and subscribers we have to choose where we spend our time and subscription monies. So I am dropping Consumer Reports because we no longer trust their automotive reviews. But this isn't the first nor the last time we'll change what we read. In some cases, reviewing at the magazine rack and others . . . not even bending over to pick one up . . . Flying, Kitplanes, and Private Pilot being examples.
    Science does mean something but even SAE papers can have . . . 'problems.' I've bought papers based upon abstracts only to discover some pretty serious and obvious problems. Two examples being one on 'Pulse and Glide' and another claiming to 'model Prius transmission efficiency.' Part of the problem is burdening reviewers to be the quality control when some act more like English graduate students 'grading the paper' without 'reading the content.' Finding content reviewers is harder than finding papers.

    The best papers I remember are those published in a journal before a conference and presented by the author(s) with an open mike for questions and comments. The audience self-selects because they have the energy to attend the conference, an interest, and technical knowledge about the subject. So when the mike open up, you get the type of pointed, technical questions and discussions that really dig into the subject. But then you occasionally get someone who speaks from an alternate reality.

    Historically, pre-Internet, information aged:
    • books - lucky to be within two years of the date of the new discovery
    • magazines - about a year from the discovery
    • conference papers - about three to six months from a discovery
    • birds of a feather and bars - what happened just last week
    The Internet lets us self-publish new information much quicker BUT sad to say, it also attracts those living in alternate realities. I'm thinking of one character in "Prius Technical Stuff" a self-described, libertarian who at the drop of a hat will convert a technical discussion into a useless political screed.

    Disconnected from reality people used to piss me off until I realized they are kabuki-like(*) in their responses. Many times their predictability provides opportunity for humor. So to quote a rascally, disagreeable, former co-worker, Greg Katz, 'My doctor told me to be blunt instead of keeping it bottled up. He said it is better to give an ulcer than receive.'

    Bob Wilson

    * - It is perfectly OK to 'take a break' from the alternate reality people. Sometimes, it is necessary to drag them back to reality. Sometimes you just have to 'ignore user' to turn off their noise . . . and take a vacation. After a month or so, turn off 'ignore' and see if they've gotten a clue. If not, silently turn them off again. The PriusChat ignore user is especially effective. Free speech does not mean forced listening.
     
    Corwyn likes this.
  8. tochatihu

    tochatihu Senior Member

    Joined:
    Apr 10, 2004
    9,392
    3,637
    0
    Location:
    Kunming Yunnan China
    Vehicle:
    2001 Prius
    Gawd I think that Bob mentioned Flying, Kitplanes, and Private Pilot here just to cheer me up. I read those rags buddy, whenever circumstances allow. I love being a gravity denier.

    I want PC to be a place where people can present and discuss their own environmental ideas because youse guys have taken the personal $$$ buy Prius step (so did I but who cares). I post my ideas not because they are wonderful, but to get youse guys involved in the discussion. If my ideas don't resonate here, I shall survive because I have another sciency life.

    I don't want you to think a certain way. If any other PC poster wants you to think a certain way, it ain't my problem.

    I want to say again that mojo here has done the most here to cause me to closely examine climate-change literature. I appreciate that very much. Most of you other slackers have done diddly.

    I approach science in a very adversarial way- what is right; what can be demonstrated? Prove it. This works well when the parties listen politely to each other and consider what has been said. It has worked half-well here, with mojo providing spurs, but never ever considering what might be correct in the responses.

    The larger issue is whether PC can serve a purpose in causing readers to examine envt science closely, themselves. Our threads here (haven't you noticed?) have like a 100:1 view:response ratio. It is as if readers are more interested in the thrill of reading discussion than actually getting involved. I think that is our problem (my problem) here, much more so than that mojo and I disagree.
     
  9. mojo

    mojo Senior Member

    Joined:
    Sep 28, 2006
    4,519
    390
    0
    Location:
    San Francisco
    Vehicle:
    2012 Prius v wagon
    Model:
    Three
    Your noble cause is environmentalism.
    Which has clouded any scientific objectivity when it comes to climate.


     
  10. mojo

    mojo Senior Member

    Joined:
    Sep 28, 2006
    4,519
    390
    0
    Location:
    San Francisco
    Vehicle:
    2012 Prius v wagon
    Model:
    Three
    Youre spewing bullshit.
    Read the linked studies directly ,anyone with intelligence would do that.
    Then make a judgement of the studies.
    But you want to disregard the studies for the lamest reason .A reason for which you have no evidence at all.
    You just want to ignore science that disproves your theory.
    Which makes you ignorant by choice.
    So much for respect of science.

     
  11. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    28,001
    15,843
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    In my case, I'm only getting Sport Aviation, the EAA magazine which strangely is printed in larger font . . . for us older clients. <grins>
    Indeed but it is also true that those committed to empiricism bleed that behavior in all aspects of life. So I have a memories of:
    • Roberts Rules of Order and burnt Kraft - my brothers and I ran the experiment and confirmed that RR of Order do not work when making a box of Kraft macaroni and cheese.
    • Holding a knife like a scalpel - it wasn't until living in a dorm that I learned most people had never seen anyone who without even thinking about it, held a knife with three fingers, thumb and the index finger on the backside to precisely guide the cutting edge.
    Even now, I prefer to conduct an experiment rather than just copy-and-paste someone else's claim. Having duplicated the work, I cite my work as well as giving credit to those who taught me. And this is where we'll have to take different paths.

    An adversarial point of view or critical eye certainly is appreciated by those who are willing and able to 'do the heavy lifting.' What I don't care for are copy-cats who simply parrot what they want others to hear without the bringing original content to the discussion:
    • right-wing nuts
    • PnG advocates
    • climate deniers
    They don't realize that their Kabuki-like postings are the perfect target for the didactic 'banana peel.'

    I came to this forum incidental to my Prius studies with only a casual interest in environmental and climate change:
    • Mariner 2 - showed CO{2} as a run-away, greenhouse gas cooked our twin planet Venus.
    • Global warming will melt ice, polar ice, and raise the sea level.
    But along the way, some of our meteorology experienced members helped me understand more aspects of tornadoes and some climate models. Then there is this undergraduate level book next to my keyboard that tied climate science to 40 year old, engineering undergraduate studies. Now I can translate climate science into engineering terms even after a beer or two. But these happy, learning experiences are nothing like the dreck that comes from 'copy-cat' advocates who exhibit signature characteristics as distinct as any natural phenomena.

    So I'll hang here for a little while without getting terribly bent out of shape. But like everyone, we have other commitments which reminds me it is time to work on other chores.

    Bob Wilson
     
  12. mojo

    mojo Senior Member

    Joined:
    Sep 28, 2006
    4,519
    390
    0
    Location:
    San Francisco
    Vehicle:
    2012 Prius v wagon
    Model:
    Three
    Im a skeptic because Im an original thinker.
    You are a sheep who follows consensus.

     
  13. FL_Prius_Driver

    FL_Prius_Driver Senior Member

    Joined:
    Jun 17, 2007
    4,319
    1,527
    0
    Location:
    Tampa Bay
    Vehicle:
    2010 Prius
    Model:
    I
    Certainly an interesting read, but I think the problem is far less serious than it sounds. Simple stated, while a number of fly-by-night journals have found it profitable to take advantage of the "publish or perish" culture of academia, there is no evidence that any first rate scientists read these fly-by-night publication for serious science.

    At the end of the day, there is only enough time in any reviewer's and readers life to examine the best science investigations. Finding out that the science at the bottom of the barrel is sometimes rotten, does not change the reality that even 100% ethically pure science at the bottom of the barrel is not worth reading.
     
  14. FL_Prius_Driver

    FL_Prius_Driver Senior Member

    Joined:
    Jun 17, 2007
    4,319
    1,527
    0
    Location:
    Tampa Bay
    Vehicle:
    2010 Prius
    Model:
    I
    Rule 1: People can only operate at their level of understanding.

    You have the whole range here at PC. Some fully understand the subject material. Some understand the implications of the subject material, but not the terms and jargon routinely used. Some may want to understand and participate, but the first non-daily used word turns all the text into gibberish. For example, anytime something like the "Younger Dryas" is mentioned, you have just filtered your readership to two people or less. Even simple words like "Temperature Proxy" do great readership damage if the desire is to connect to the PC crowd. It may be hard to believe, but probably over 90% of the posters first checking into the Environmental Forum wonder why all the sports based arguments over a hockey stick are occurring.

    All you have to do to make a dramatic change in readership interaction is present the issue in everyday language. Replace "Younger Dryas" with the "1000 Year Big Freeze". Now you have increased you readership by at least a factor of 10. Replace "Hockey Stick" with "Explosive Warming Graphic" and then you might be caught offguard with requests for explanations.
     
  15. SageBrush

    SageBrush Senior Member

    Joined:
    Jun 4, 2008
    11,627
    2,531
    8
    Location:
    Southwest Colorado
    Vehicle:
    2012 Prius v wagon
    Model:
    Two
    Another outlet for propaganda
     
  16. tochatihu

    tochatihu Senior Member

    Joined:
    Apr 10, 2004
    9,392
    3,637
    0
    Location:
    Kunming Yunnan China
    Vehicle:
    2001 Prius
    Waaaw! But it was the Younger Dryas! It was the most amazing climatic excursion since ... probably 3 million years. Way more dramatic climatic excursion than anything we are even getting close to now.

    The best part is that the causative factors (GLOF and Earth impactor) are still slugging it out. Still don't know = still learning.

    For all of its wonderfulness I am not compelled to rename it. Especially .. something way downmarket goofy. I don't think I make too much of a burden with jargon here. This one merits the small effort involved.

    +++

    F_P_D thinks the top article is crying wolf. I certainly hope that is the case. But once something like this gets into Science, you can be sure that it will lead to further close examinations of the proccesses and products.

    I am slightly surprised that no one yet here has turned the idea on its head (as we have here some sharp thinkers). One could speculate that Science (one of the polar opposites to OA publishing) has something to gain from making OA look bad. In a nuanced and scholarly way of course:D

    The Public Library of Science is several OA journals. Quite the opposite of 'fly by night', they more or less invented the field. Went from the 'written-on-a-napkin' stage to the world's largest scientific publisher in about 10 years. This is what 'subscription publishers' are looking at. They usta own the market, now it is being disrupted.
     
  17. FL_Prius_Driver

    FL_Prius_Driver Senior Member

    Joined:
    Jun 17, 2007
    4,319
    1,527
    0
    Location:
    Tampa Bay
    Vehicle:
    2010 Prius
    Model:
    I
    My core point is essentially nobody actually reads these third rate journals for insight and education.....nobody. That is the real story. Why the explosion of open access journals that nobody reads? ScienceMag would do well to investigate that question. Answering that makes the issue of missing or faulty peer review a non-issue.

    Kerry Mullis (Nobel Prize winner for inventing the DNA PCR process) had two notable publication events. Event one was a meandering meaningless article about cosmic time reversal he wrote for Nature and got published. I actually read this and could not for the life of me figure out the point of the article. He later revealed he was in a self-induced drug stupor at the time and the physics made perfect sense. Apparently some Nature peer reviewers were in their own stupor. Somehow, Physics survived this bad theory. (You can pay money to read this in the Nature web site if so motivated.....) Decades later, after Mullis finalized the PCR process, his paper describing that Nobel worthy discovery was rejected by Nature. Go figure. Which is worse? Publishing garbage or not publishing gold? (Warning--Mullis's ratio of crazy publications to worthwhile publications is unbelievable! Scientific discipline and a Nobel worthy idea need not be present in the same person.)

    At the end of the day, it's the substance of what comes out of disciplined investigation, research, and repeatability. Peer review has failed in the past, often fails today, and will fail in the future. The real problem is rejection of key new stuff, not the failure to properly vet 3rd rate stuff. Real knowledge will always survive human publishing shortcomings.
     
  18. jamesh8251

    jamesh8251 New Member

    Joined:
    Aug 27, 2013
    1
    0
    0
    Vehicle:
    2010 Prius
    Model:
    N/A
    We need to have a healthy suspicion of any Koch Brothers funded think tank. They remind me of the old Tobacco Institute guys.
     
  19. tochatihu

    tochatihu Senior Member

    Joined:
    Apr 10, 2004
    9,392
    3,637
    0
    Location:
    Kunming Yunnan China
    Vehicle:
    2001 Prius
    Thanks for the Mullis link - I think. The paper revealed absolutely nothing to me. Google scholar, however, did. They say the paper has been cited twice in subsequent literature. This is not correct; it has been cited once, by the editor of Liver International, who used is as as an example of utter toss.

    I do not think we could find many examples of Nature papers with such a citation record, so that may be an example of the self-correction process in science. I have no doubt that real cosmologists read it, thought Wth? and moved on.

    I have an example from the other extreme. A very highly cited paper on global methane production by termites (actually by their gut microbes) has been cited 1000s of times. Almost always by subsequent authors saying "this is completely wrong". Self correction with a twist of the knife.

    More often an idea gains favor briefly, leads to additional research, and gets overturned. Comfortably or otherwise. Several such seem currently to be at the mid-point (more or less) in ecology. Some may also be in climate science, although I speak with less authority on the latter field (PC readers are frequently reminded of that).

    Anyway, this seems the main path of self-correction. Sooner or later it always works, because accurate findings inevitably hang together with others from related fields. So I guess we can feel OK about science, even if that middle part resembles a sausage factory. The difficulty comes if 'over-enthusiastic' publishing leaves us overloaded in the self-correcting work. That's the downside of journal-review failures, and that it may happen more in some OA journals was the thesis on top.
     
  20. bubbatech

    bubbatech Member

    Joined:
    Mar 4, 2012
    153
    60
    0
    Location:
    Alabama
    Vehicle:
    2011 Prius
    Model:
    Two
    As a professional scientist, I have a healthy appreciation of the advantages and limitations of peer review. I have been an editor of a biomedical journal for many years. I have found that those who assert that an entire literature of a given subject can be fabricated or part of some conspiracy (climate change is the best example) invariably have no idea how science is done or how it is funded in most western countries, especially the US. Often this is for political reasons. Since the facts don't conform with their political (sometimes religious) beliefs, they either 1) attempt to discredit those who produce the facts, 2) cite their own "experts" who claim to understand the scientific issues, but on further examination turn out to be, at best, only peripherally involved in any form of scientific work, and 3) try to block legitimate scientific investigation. Right wingnuts especially favor these tactics applying them to all kinds of issues. What is amazing is that such people, even those who are otherwise intelligent, are absolutely impervious to factual information and, if it suited them, would deny the existence of fire even as their clothes burned off their bodies.
     
    icarus, ftl and bwilson4web like this.