My autistic fixes for academic research - Diana Moon Glampers Handicaps Journals

Diana Moon Glampers

Your Handicapabillty Facilitator-General
True & Honest Fan
kiwifarms.net
Joined
Mar 24, 2016
Academia and academic research is suffering due to misaligned incentives. Align the incentives, create a world where research can flourish once more.

This doesn't even touch the "what do we do about the teaching and the tenure and the adjuncts and the administrators." Lots of things, surely, but this part is just about the research component.

1) Replication crisis needs fixed. Today, you need to create brand new research to be a newly minted Ph.D.. You should have to attempt to replicate an existing piece of research in order to obtain a master's degree or some specialized bachelor's degres. Additionally, each journal should have an adjunct journal that is exclusively for replications of research previously published by the journal.

2) End peer review. Peer review is only a few decades old and it hasn't helped research, it's stagnated it and made it hidebound more than what came before. The main reason is that there is zero consequence for bad peer review. The best science and engineering ever done, was done in a context where journals published based on topic, institutional/individual reputation, and so on. The "reviewers" before peer review tended to be the other people in your own department, who would be dishonored by any fraud, as well as people closest to you in your field. This worked better. It's obvious from looking at scientific development that it worked better. So get rid of the way it's done now.

3) Journals should have research "bug bounties" the way software companies do. A journal's entire currency is its reputation. If you got $5,000 for being the person to notify editors of a retraction-worthy issue with an article, the incentives to check research go way up and fraudsters are heavily disincentivized from publication (since there'd be a bunch of people looking for those sweet bounties, you'd better dot every i and cross every t). Soon, journals with bug bounties become inherently more trustworthy, and more and more have to offer it. They could also probably recoup the bounty expense from any researcher whose retraction-worthy errors were due to fraud or negligence.
 
i believe that the only way to actually tackle the things you describe would be a harsh top-down purge of political corruption throughout the institutions that make up (western) academia
and i don't see that happening

my personal opinion is that the whole journal system is completely obsolete in the modern era. every university department, every chair, every lab, every working group, hell in some places every individual researcher has their own website.
upload results there for public access, maybe print a couple dozen copies for your local university library/archive, and consider them published.
journals acting as entrenched gatekeepers and middle men do not serve any productive purpose in my opinion.
 
At that point, the bug bounties would belong to the programs themselves, which would make sense.

Essentially it's putting your money where your mouth is. You stand behind your researchers and their work with real money. Larger institutions could put up bigger bounties, you get more for getting a paper retracted at MIT than from Joe Schmo's Technical College.

A very modest portion of an endowment could fund a program like that. Publishing the work and offering the bounties shouldn't cost all that much, even if there are several retractions in the early phase while researchers are still realizing they need to have real results, not fake ones.
 
My thoughts on how to fix this shit heap. As a condition of receiving federal funding for your research you must:

First, use a journal or conference where research is pre-registered. This is where you submit your methods, proposed analysis, and criteria for your conclusion before collecting data and it is accepted or rejected based on those instead of the results of the data.

Yes, this will go a long way in mitigating bias in what is published. But importantly it will also increase the amount of papers with non-significant or negative results. Knowing some medicine or other intervention had insignificant or negative results 9 times out of 10 and then 1 paper with significant results is very different than knowing it has only been studied once and it had significant results then.

Second, all papers must have their data maximally available and minimally redacted. It isn't enough to say at the bottom of your paper that the data may be requested by email if you contact one of the authors.

Small data sets should be hosted directly by the journal and available for download with the paper. Large data sets should have coordination with the journal and the university or research group for how the data can be made available.

It is trivial to set up torrents for these data sets and host them if they are truly too large to host on the journal website. This is not a technical problem we are dealing with, but a cultural one.

Additionally, these data sets must be minimally redacted and minimally modified from how they were collected. It is not acceptable for you to collect 50 different variables and publish the one that just happened to correlate with what you care about. It is not acceptable to modify or interpolate or predict what data should be in your data set and have the reader have no way of knowing or replicating what you've done.

I'm not demanding researchers publish names and phone numbers of participants. But if your research uses some variable that you've normalized, readers must be able to see the unmodified original data and confirm your methods from the original data source.

Publishing unaggregated data also allows for much stronger meta analysis techniques to be used. Being able to go into the data across dozens of papers allows for much stronger analysis than relying on the results from authors grouping their data in dozens of different ways none of which are standardized.

Third, researchers must publish all scripts used to transform, modify, or analyze their data. Optimally, it should take little more than a press of the button to run the script and have the results used in the paper printed out.

You want to do some weird transformation of the data, fine. Put it in the script. You want to use the arithmetic average in one place if the paper and the geometric average in the other, fine. Put it in the fucking script. This isn't some overwhelming task to ask of researchers. Note what results you use and put it in one script for how you got to them.


Fourth, publish in open access journals because fuck you it's my tax money you're getting.

Nearly none of these things are currently required. However, a massive amount of research receives federal funding. If these were made to be a requirement, overnight all journals and conferences would require them.
 
Last edited:
Before peer-reviewed journals, The Science was simply scientists communicating with the world and each other, by book, letter, gatherings, etc.

You should just publish your research on a blog or arXiv, and let others attack it if they can. But there are wacky incentive structures. Also I think there are less replication studies than we want. I believe there was a journal solely for replication studies that was shut down out of lack of interest. Can't find the name of it.

If peer-reviewed journals must be used, it should be an open journal like PLOS One.

Requiring govt funded research to be open access is an easy fix, and may be coming:

In 2022, the White House released a memorandum that announced that all US-funded research must be made Open Access by the end of 2025. Basically, this encompasses three instructions:
  • Update public access policies as soon as possible, no later than the end of 2025, “to make publications and their supporting data resulting from federally funded research publicly accessible without an embargo on their free and public release”.
  • “Establish transparent procedures that ensure scientific and research integrity is maintained in public access policies”.
  • “Coordinate with [the Office of Science and Technology Policy] to ensure equitable delivery of federally funded research results and data”.
 
Before peer-reviewed journals, The Science was simply scientists communicating with the world and each other, by book, letter, gatherings, etc.
In the days before peer-reviewed journals there also weren't hordes of chinks and pajeets spamming the system with nonsense because one of their KPIs is "degrees earned and papers published". No offense meant to the handful of honest Chinese and Indian scientists working today, naturally.

Like it or not, the Rubicon has been crossed and we do need some sort of gatekeeping just because of all the perverse incentives around being published and having a high impact factor.

If you really want to fix academia, my magical genie wishlist would probably be:
- End publish-or-perish at universities: stop using number of publications as a metric for hiring and tenure
- End corporations and governments incentivizing spam by rewarding their employees for being "academics"
- Make journalists less ignorant and credulous so you can't get famous off the back of shoddy "research"
- Cut down the number of academics until they fit the research budget available. The insane level of competition for funding incentivizes fraud.
 
I guess we're doing this then. Fuck it, time for the essay on why modern science is grounded in fraud and failure. For those in chinkland or countries with even more ridiculous systems, this is going to be very US centric.

Money: The source of most problems in science.

Scientific funding is in and of itself a labyrinthine mess with countless possible sources of funding each clinging to different ideals on how it should be distributed.

Let's start with how university professors handle money. A professor's salary is typically drawn from undergraduate attendance revenue, excepting if they spend grant money to excuse themselves from teaching courses. Given that most professors suck at getting grant money, this creates the need for the department to constantly bring in undergraduates to cover professor and general department staff wages. Professors however are promoted and granted tenure based on research, so any undergraduate activities are inherently wasteful to them, and hence undergraduate course rigor and quality diminishes with time. The exception to this is teaching professors, who don't do research. Still, the overwhelming undergraduate student : professor ratio necessitates that adjuncts and graduate students will end up teaching a lot of courses at most universities. It's even worse with grading, which further cuts into professor time unless doled out to grad students. Graduate students writ large, excepting fake degrees and master's degrees (2nd undergrad degree), are billed to the professor as research assistants unless they're registered as teaching assistants. Teaching assistants are those grad students wasting endless hours teaching and grading undergrads and are paid for by the department through undergraduate revenue. Research assistants are paid for out of the professor's grant money or start up funds. Start up funds are department funds handed over to new professors when they join the department to cover their expenses until they get grant money rolling in. It costs at least 80k a year to cover a graduate student's expenses, which will include living stipend, insurance, tuition, and overhead for the university to pay off an ever expanding cast of administrative assistants. As a rule of thumb, about 40% of any grant money brought in by the professor is snatched away by the department as overhead to cover various expenses not otherwise covered by undergraduate tuition. University professors are somewhat limited in their ability to get the big grant money, and will usually depend on government organizations like the NSF for funding. At Ivy Leagues, you might also have private money coming in and some professors have learned the dark arts of industry money to round things out. These are exceptions, not the rule.

National laboratories are similar to university professors except there are no undergraduates. Instead, they get to play with an even bigger and even faster expanding cast of useless administrative staff who soak up near infinite money, which leads their grants and wages to come with overhead fees exceeding 50% of the grants they receive oftentimes. It's about 200k in grant money to cover a postdoc, 300k+ to hire a staff member. So where does this money come from? Well, it's rarely as simple as federal tax money paying federal employees. No, most national labs are contractor based and waste most of their time writing grants. The national labs receive a certain amount of federal money each year to use as they choose, but it is never remotely enough to cover staff, building, and equipment costs. So instead, the employees at federal laboratories write grants to agencies like the NSF, DOD, DOE, and anyone else that will listen. Further, because national laboratories are in fact made up of many divisions, they will fight over access to equipment, postdocs, and parking spaces depending on whose division received grant money to pay for what things. This leads to laughably inefficient usage of all said things, overlapping projects covering the same research fields, and general feelings of mistrust, competition, and backstabbing amongst peers at the same lab. National laboratories are known for paying post docs very well, albeit below industry pay. They are not known for paying staff well, and thus constantly lose their best scientists to universities and industry, who both pay far better and have less drama. If you want something at a university and you have grant money to pay for it, it's yours. If you want something at a national laboratory and you have grant money to pay for it, you need to stand trial to justify your expenses, research vision, and broader impacts. There is also a neverending push toward diversity by the DC bureaucrats, who seem to think that the national labs are responsible for educating blacks and hispanics. East asians might as well be white men at this point for diversity considerations.

Industry has seemingly endless money. It's just almost completely wasted because most people go to industry to retire in a 9-5 job. Intel is a joke. IBM is a joke. Google is full of pajeets. Don't get me started on Tesla. Apple won't be satisfied until the fruit cult consumes all religiosity. Pharma and big ag are usually innovating though, but their funding is pegged toward the maximization of evil and the comfort of death fats. In other words, I highly recommend shooting for an industry job if you find yourself in the unfortunate position of having a PhD. Just be sure to get a good hobby, 'cause you're going to need it.

TLDR: University bad because undergraduates fund most of the operation for professors who hate them. National laboratory bad because government makes its employees dance like circus elephants for funding. Industry bad because it attracts useless, stupid people it won't fire.

Publishing Research: The trouble with impact factor.
So, you got through all that nasty business of teaching undergraduates, writing grants, or sucking the genitals of whatever beltway bureaucrat controls the money teat. You have money now! How do you keep getting more money, promotions, and the validation that your crippling social anxiety demands? H index, of course.

You need to constantly be publishing lots of papers that get lots of citations. This creates a bit of a problem. You can't endlessly break new ground that warrants 400+ citations on multiple papers a year. Now, if you're a "good" scientist, this is where you tell your wife that she's free to sleep with other men because the children could use a father figure in their lives. You'll slave away endlessly writing more grants to pay for more grad students/post docs so that you can have a never ending paper mill of papers that you conceived of and might have read the abstract of before being sent off for publication. You don't actually review the contents of these papers, but you've got a solid few postdocs that you trust to make sure your grad students aren't making perpetual motion machines. You haven't had to retract a paper yet, so you're right on track for tenure. "Bad" scientists forgo this time honored and true method to becoming a full professor. They go home at 5pm and are present in their kids' lives. How to make up the difference and still reach professor status? Have you tried lying yet? Start embellishing the impact of your papers when you send them in. Exaggerate what you'll do when asking for grants. Make sure to only send your papers into your friends' journals. They're your buddies, so they'll make sure only softball reviewers get to peer review your work. Get a nice circle of friends and you can even take turns citing each other to drive up that citation count at the low cost of your dignity and that last shred of faith that you're benefiting mankind.

Ok, but maybe you're a retarded fuckmonkey. How do you get published in a good journal to collect endless validation citations and that eventual promotion? Well, you need to start playing the game. You don't need to be smart and come up with good ideas. You just need to constantly be shifting gears in your research to hop on the bandwagon of every fad that hits the sciences. Did someone invent a new technique? Bill yourself as an expert in it and publish some superficial papers before the low-hanging fruit is harvested. Don't bother wasting your time in well developed fields. It takes a lot of work to get a high impact paper in one of those. You're better off writing a paper like "AI integration of predictive gaussian functions in molecular hydrodynamics." Don't worry if it's not actually useful. As long as you're early to the game, some journal will pick you up.

The worst thing you can do is focus on quality. Stop trying to be perfectly concise and accurate. Make friends, get funding, get tons and tons of assistants in your paper mill, and you'll be a real scientist in no time! Losers who try to innovate can take decades before their research bears fruit. You can't wait that long. You can't start your harem* of nubile graduate students and underling professors if you don't have the H factor to back it up.

* - professors are notorious for having sex with their graduate students. This is a serious problem in universities. Think about this every time you see an old professor getting too handsy with an attractive graduate student. Professors will also get sexual favors from would-be professors on the grounds of career advancement. The more famous professors do this openly and blatantly without shame.

And, I haven't even started my rant about "broader impacts" yet. So, there's another way to get lots of citations. You just need to get into a Nature-type journal. These are the best ones to be published in because they're not really about anything in particular, their readership is basically everyone, and thus you can rake up the most citations the most easily by getting published in one of these well-respected infotainment press releases. Back in the day, these journals were supposed to publish the best and greatest of the scientific world. Now? They're gradually being accepted as a giant fucking waste of time if you want to get important information out quickly without going through a year long review process. They take pride in rejecting papers that don't fit the editor's perceived concept of novelty and the reviewers rarely actually understand what it is they're reviewing, an added downside of a journal with a broad reader/reviewer base. Reviewers are notorious for impossible demands born of pure ignorance of the topics they review.

I haven't even said what "broader impacts" are yet. Good question, who even fucking knows. Supposedly, they're about the wider benefit of your research to society, but you could just as easily start bullshitting like a snake oil salesman. "Green" technology research is filled with stupid papers on impractical shit that nonetheless qualifies as having a broader impact. It seems to mostly be a way to promote whatever the cathedral wants. Might I suggest writing a paper on transgender rights in the field of renewable energy and its intersectionality in racial discrimination in early childhood education? I'm sure there's a buzzfeed article you can steal most of the text from.

TLDR: Modern science rewards publishing lots of papers that you fluff up to pretend are way more important than they really are. Spending lots of time on a few important works will kill your career if you don't break the FTL barrier or invent a cure for heterosexuality.

Scientific Labor: How the sciences got addicted to poorly paid interns.
By now, you've probably noticed a theme here. A good scientist is constantly publishing lots and lots of papers to earn citations to justify getting more money and promotions. You cannot do this alone. What you need are graduate students and post-docs.

How does one get lots of research assistants? Well, it certainly isn't by paying them an industry competitive wage. At time of publishing, a university postdoc can expect to get about $60k per year after getting their PhD, a national lab postdoc will get about $80k. Industry for comparable positions is >$100k. The postdoc industry is maintained on the hope of a full time position of a professorship or staff position at a national laboratory, also childhood neglect, daddy issues, and a host of other psychological problems (but that's also related to why anyone would want to be a scientist in the first place instead of going into big law). It's even worse for PhD students, who regularly get <$30k per year. Berkeley students are so badly paid for the bay area that they're known to go into debt while in the phd program. Right off the bat, you can see why scientists want to be professors. You save a fortune by getting PhD students to work in your paper mill instead of postdocs, a price you pay in wasted hours teaching undergraduate students.

Attracting good talent is an eternal problem in the sciences. Ideally, you'd just post a help-wanted sign and some naive white males (or ideally talented diversity candidates) would show up at your doorstep. This is rarely the case. You'll forever suffer a lack of good recruits from promising ethnic backgrounds schools with the right academic history, assuming you can attract students at all. Students want to be part of a field that either promises a big salary on the other side or innovative research. Even if you've got one of these, chances are you'll still run into issues staffing all of your open spots that you've got funding for. This is where international students come in. Sure, you'll have to wade through an endless sea of pajeets (do not hire these, they are lazy and useless) but there's always the Chinese and Koreans, who you'll be hiring en masse. Aside, I recommend learning Mandarin to help your fresh off the boat students learn the ropes. You can also try getting students from impoverished European countries like Italy or Spain (lmao @ european academic wages).

Really though, the public sciences just aren't well funded enough to run on anything but students and postdocs. You've seen the funding structure of the scientific infrastructure. Professors are paid by undergrads and grants. Staff scientists are paid by grants and a smattering of rare, direct federal money. Hiring full time staff is simply far more expensive and cuts into the efficiency of your paper mill.

Jests aside, US and European scientific funding keeps taking a nosedive year-on-year. The Chinese are ramping up funding exponentially. We've reached the point where good Chinese professors are going back to the mainland. The grant writing scene to cover a scant few postdocs and students is increasingly competitive and only serves to waste more scientist time trying to keep the lights on.

Note: Visiting students and undergraduate research is just something scientists do to satisfy the educational outreach section of NSF grants. If you're lucky, you can find a diversity candidate this way that you'll put on all of your marketing material for the next 10 years. Otherwise, scientists literally can't be arsed to give a shit about someone who won't first author them more papers to please the citation god.

TLDR: Students cheap. Funding rare. Good students rare, and usually foreign. Full time staff expensive. Funding still rare. Your career depends on a reliable source of useful students writing you papers.

Ownership: Who actually owns the research?
Alright, so you've discovered a way to turn liberal fart huffing into a source of renewable energy, who gets the patent and can you start a business turning San Francisco into the next Aramco? This is a more complex problem than you'd think. If you're in the national labs, the answer is the labs own whatever it is you make, pending their decision to give up the patent to you because they don't want it. It's more complicated at the university level. There are a lot of startups and consultancy gigs that get started at universities, research funded by grant money, and the gains enjoyed by the professor. The students get nothing, as is only proper and right for having failed to sacrifice their humanity securing funding and a sufficiently high H index. However, generally, the department/university will try to lay claim to your inventions at the university level. This is something that influential professors negotiate away, but you're fucked as a new professor. In industry, it's generally the case that the company owns anything you make but many companies will reward you financially for creating successful products. Bad companies get a reputation for bad compensation and get bad employees (i.e. pajeets). Good companies look like an East Asian and European ethnostate (lmao @ TSMC trying to integrate diversity hires in the US).

TLDR: Get fucked. You're a scientist. If you wanted to be rich, you'd make a cell phone app that harvests user data for sale to the CCP and advertisers. Now go divorce your wife to take her life savings. She's been cheating on you for years while you've been getting tenure anyhow.


Solutions: Let's fix this mess.
  • Money is tight. Reduce the total number of research institutions and departments nationwide. There are far too many to justify this madness. Most of them aren't putting out good work and the funding is spread too thinly. Universities need to be streamlined by discipline to ensure that a strong core can be established at each one. Scientists depend on peer interactions to avoid navel gazing into some irrelevant field and breed better ideas. Raising funding writ large wouldn't hurt, but it won't do a thing if it's wasted on more $200 million buildings.
  • Direct federal funding. Do away with most grants. Research institutions need direct federal budgets to be internally distributed without endless paperwork to waste researchers' time. A certain amount of institutional trust is required that they can determine their researchers' postdoc and graduate student needs without excessive favoritism. The sheer mass of research hours wasted on grant writing is astronomical and only spiraling upward. As a certain man with an oversized clock once said, "It's time to stop!"
  • Separate undergraduate and graduate education. Undergraduates are retarded. They keep getting more retarded by the year. This is because professors give fewer shits every year about undergraduates and too many (read, dumber) students are admitted every year. Reduce enrollment, only take the best, and have a dedicated staff of teaching professors to educate the undergraduates. Graduate education should be directly federally funded without the expectation of substantial coursework.
  • Public scientist pay is shit. Increase pay for researchers to industry rates respective to their field of study. NVidia, Microsoft, and Google shouldn't be the world's leading academic institutions for AI research.
  • Shut down administrative spending. This will get easier once undergrad education is ousted from graduate departments. National labs look like a federal jobs program when you look at their staffing, so many useless admins.
  • Stop pitting national laboratory staff against each other. Get a dictator in there to shut people up and back to work. Office politics should be an instant sacking.
  • Raise expectations of graduate students. Any student that mentions work-life balance should be immediately exiled to industry. Good scientists are forged in fire and Adderall. Break the weak, discard them, and keep the strong. It's the only way to ensure you're not inundated with 9-5 wankers and emotionally fragile wankers.
  • Fire old fucks. Fire old professors/scientists that stop doing their job. Fuck tenure. Fire useless, overpaid geriatrics.
  • Bully progressives and grifters. Half of your funding nonsense is just faggots in D.C. and the Ivy League promoting globohomo. They must be bullied relentlessly until they 41% themselves. No exceptions. The only union you need is a strong man chancellor with senate connections who will raise hell if funding is insufficient.
No, I don't have a pointpoint deck for this rant, and there will be no tiktok video. Fuck you 3 minute attention span undergraduates who whine that I expected you to read the textbook.
 
I subscribe to the Leninist POV: kill the current intelligentsia and see what fills its place. The Russians were the first people in space, after all.
 
Replication crisis needs fixed. Today, you need to create brand new research to be a newly minted Ph.D.. You should have to attempt to replicate an existing piece of research in order to obtain a master's degree or some specialized bachelor's degres.
I agree with this. Your first six months as a PhD student should be replicating or trying to replicate a piece of work in the field.

Peer review is a broken system. But the main problem is too many scientists of too low quality, competing for too little money per capita which is given out to further ideologies rather than knowledge.

Also admin. Cull 98% of it. Keep one efficient Austrian autist per department who deals with the paperwork.

The whole system is broken. The gentleman scientist era was amazing because people were obsessed, talented and had their own money.
 
I can't speak intelligently to the scientific side of the house, but, at risk of powerlevelling here, my BA and MA (and should I ever finish my MA and get my PhD) is in history, so I can say a few things on that end.

1) Publish or Perish is absolutely essential to keeping historians doing history, especially so long as we're talking about tenure track positions. Simply put, a minimum of an article or conference paper a year and a book every seven years is the least someone going after tenure can be expected to do. There are simply too many people with PhDs in the field going after too few job openings. Professors, assistant professors, and adjuncts looking to get hired on as faculty must do more than just show up and teach four or five classes a semester. Journal book reviews and articles are the yardstick used to see just how much worthwhile work is being done outside of the classroom. This is compounded by the fact that almost all papers are single person efforts with no funding and are essentially done on spec; meaning, the historian researches and writes the paper and then tries to get it published in an academic journal somewhere. Books, especially those from university presses start with a very detailed proposal and a first chapter shipped around until someone takes an interest in it, and only then does that project move forward. There are exceptions I will touch on in a bit.

2) Peer Review is the only way to keep people honest in history and even then it isn't flawless, but it is the best system we have. Basically, having someone check sources and make sure the material isn't be misrepresented or taken out of context or outright fabricated is the only way to make sure the job is being done properly, especially when it intersects with modern politics. Let me give you an example of where it didn't work until it was forced to.

There was a historian named Michael Bellesiles who wrote a book called Arming America: The Origins of a National Gun Culture which was first published in 2000. Basically, Bellesiles said he researched a bunch of probate records and wills and such and found guns were not as big of a deal in early America as we had been told. It was a bombshell in the whole gun control debate. Judges used it in their rulings, editorials were written on how the NRA had gotten it wrong for decades and the laws could be rewritten after all, and the whole issue was framed as the final nail in the gun control coffin. Bellesiles got the Bancraft Award, which is THE award for historians of American History. Like winning the Best Actor Oscar big. Supposedly, it had been peer reviewed after the fact and articles were written about how well researched it was and it left no room for debate because of how well researched it was.

But, as time went on flaws were noted, normal people started saying the sources couldn't be found, and in time historians were forced to go looking for themselves. In the end it turned out he had essentially made the whole thing up. Sources couldn't be found, libraries and archives said some sources didn't exist, his notes were conveniently destroyed in flooding, and places he said he went to said he never visited there (you generally need to sign into special collections at libraries and archives). His reputation was ruined, his awards were revoked, and even the anti-gun people said the whole affair hurt their side in the long run.

The takeaway is had peer review been done in the first place, ne never would have gotten as far as he did, but once the historical community had to look into it, they did. Historians as a whole may lean left, but they value accuracy and honesty far more than they value their political stances. It's why plagiarism and academic fraud are immediate and irreversible reputation killers and career enders.

3) Unlike science which requires vast amounts of money to do these days, there is an entire section of history called popular history that does not require academia, but still holds itself to the same standards and is of use to the historical community. Books and papers are published every year that are researched and written by amateurs and retirees and people working at museums and local sites and still end up in major historical journals. I don't know how it works in the scientific end of the spectrum, but there is no real shame in being a popular historian except among the most snobbish of academic historians. In point of fact, many academic historians dream about writing something that excites the public's imagination and let's them keep their cushy academic job AND write the millionth book on a subject like D-Day or the battle of Gettysburg or a popular biography of Abe Lincoln and be the next Stephen Ambrose.
 
3) Unlike science which requires vast amounts of money to do these days, there is an entire section of history called popular history that does not require academia, but still holds itself to the same standards and is of use to the historical community. Books and papers are published every year that are researched and written by amateurs and retirees and people working at museums and local sites and still end up in major historical journals. I don't know how it works in the scientific end of the spectrum, but there is no real shame in being a popular historian except among the most snobbish of academic historians. In point of fact, many academic historians dream about writing something that excites the public's imagination and let's them keep their cushy academic job AND write the millionth book on a subject like D-Day or the battle of Gettysburg or a popular biography of Abe Lincoln and be the next Stephen Ambrose.
>I don't know how it works in the scientific end of the spectrum
not at all
the prerequisite knowledge is too deep and complicated. amateurs and outsiders basically don't have the tools to be able to comprehend research topics, let alone work on them by themselves.
the times where you could make actual contributions to science by tinkering and experimenting in your home lab for fun are long over, all the low hanging fruit has been plucked centuries ago.

maybe computer science could see some genius kid coming up with a super smart algorithm at home, or crack encryption methods previously thought to be safe and sound, it's unlikely but not unthinkable.
but in the natural sciences (physics chemistry biology and all the engineering disciplines based on them) it's really not possible, at least i don't think it is. not only is the burden of knowledge enormous, but the barrier of entry to the experimental side of these fields is gigantic. if you don't have access to a university lab or some companys R&D department then you can't really do any research even if you do know and understand the subject fully (which is near impossible if you haven't studied it at a university for many years)
 
  • Like
Reactions: FlappyBat
And I think the flip side to that is any idiot thinks he can research and write a history book, and while I can read enough science textbooks to understand what's going on, without enrolling in a course with access to a lab I'm only getting half of the picture. And the point about the ability to do cutting edge science in a garage being long past is well taken.

It's true that other than the capstone course at the end of the senior year, all one needs to do to learn history is read it. Yes, most courses require at least some form of writing, whether it is a term paper or essays or articles or book reviews or something, but the long and the short of it is all someone needs to do to learn history is pick up some books. Even then it's possible to bullshit your way through most courses since a lot of professors will assign readings out of a textbook or something and then the next class essentially tell the class what they just read, even in 400/500 level courses, to say nothing of 100/200 level survey courses. Unlike the hard sciences, there is no real experimentation or expense to learning history; all it takes is a library card and a willingness to read a lot.

That said, there is a little more to the writing end of it than simply researching and putting pen to paper. Senior Seminar Capstone courses and Graduate Methodology courses also go into the philosophy of history and the various schools of though about how history as a discipline functions and how those schools of thought seep into writing. There is a lot of nuance to writing history, especially when one realizes that the real point isn't just to answer the who/what/when/where/how of the past happened byt the why, what it meant for the people and institutions of the time, and what it means for us today.
 
  • Informative
Reactions: DumbDude43
1) Replication crisis needs fixed. Today, you need to create brand new research to be a newly minted Ph.D.. You should have to attempt to replicate an existing piece of research in order to obtain a master's degree or some specialized bachelor's degres. Additionally, each journal should have an adjunct journal that is exclusively for replications of research previously published by the journal.

I agree this is the most pressing issue. I would not create an adjunct journal though. I would bake it right into the process. An article is not considered publishable until it is replicated by an independent group. If you want you can still upload as a clearly labeled unreplicated preprint where it can be judged and torn apart.

There needs to a a new career track created for scientists devoted to replication. This can be done part time by scientists doing original research or full time. Measures like baking replication into the terms of grants can go a long way toward preventing preprint websites from just becoming first line journals. Sure it will be more expensive but its doing science properly. Right now we are not doing science properly

2) End peer review. Peer review is only a few decades old and it hasn't helped research, it's stagnated it and made it hidebound more than what came before. The main reason is that there is zero consequence for bad peer review. The best science and engineering ever done, was done in a context where journals published based on topic, institutional/individual reputation, and so on. The "reviewers" before peer review tended to be the other people in your own department, who would be dishonored by any fraud, as well as people closest to you in your field. This worked better. It's obvious from looking at scientific development that it worked better. So get rid of the way it's done now.

Peer review is necessary because you are often working in an obscure field that has maybe a handful of other people who understand it. There may not be anyone in your department with the expertise let alone at the journal.

The problem is that its an opaque informal unpaid process. You get a request and there is absolutely no incentive for the reviewer other than being polite so they foist it off on their grad student.

Rather than ending peer review I would professionalize it and make it part of a larger more transparent review process. Posting a preprint would be required and multiple peer reviews (as is the custom now) would be required to be posted under it for public review. The reviewers would be paid for their services but they would also be open to review themselves. Oh yes and this whole process would be open only to qualified scientists under their real names, or at least qualified scientists would be labeled to prevent excessive crackpotism. If the study contains sensitive information a special review process with more restricted access can be used, but this will be opened up once the article is published. Also review and replication duties can be required by universities and grant making orgs.

3) Journals should have research "bug bounties" the way software companies do. A journal's entire currency is its reputation. If you got $5,000 for being the person to notify editors of a retraction-worthy issue with an article, the incentives to check research go way up and fraudsters are heavily disincentivized from publication (since there'd be a bunch of people looking for those sweet bounties, you'd better dot every i and cross every t). Soon, journals with bug bounties become inherently more trustworthy, and more and more have to offer it. They could also probably recoup the bounty expense from any researcher whose retraction-worthy errors were due to fraud or negligence.

This is a good idea. Money should be set aside for this specifically for this. Again the problem is we don't pay enough to do science properly. Review and replication needs to be an essential part of the process. Perhaps, they should even be credited on the paper.

Now a big objection to the increased review process is it might lead to increased dogmatism and groupthink and prevent the publication of ideas which clash with the mainstream. The nightmare scenario is you have the formation of wikipedia like cliques who decide they 'own' a particular discipline, and their way is the only way.

This is a valid concern I think but its not like we don't already have that in our current system. Plus the review process being opened up the the public could help alleviate that. More eyeballs from around the world could help defend unorthodox ideas. Formal reviewers can be rotated to prevent a guru monopoly. But its something we should keep an eye on nevertheless.
 
Last edited:
The money everyone could save by not having to pay all the publishers their pound of flesh and having institutions self-publish would pay for the bug bounties ten times over.
 
  • Agree
Reactions: DumbDude43
The money everyone could save by not having to pay all the publishers their pound of flesh and having institutions self-publish would pay for the bug bounties ten times over.
This doesn't sound like a very high impact publishing strategy. The funding agency will have no idea if your work is important if they don't see it in Nature. The lack of broader impact and interdisciplinary readership alone will make the NSF question your dedication to increasing the diversity and equity of the US scientific community and engineering workforce.
 
Before peer-reviewed journals, The Science was simply scientists communicating with the world and each other, by book, letter, gatherings, etc.

The money everyone could save by not having to pay all the publishers their pound of flesh and having institutions self-publish would pay for the bug bounties ten times over.

This doesn't sound like a very high impact publishing strategy. The funding agency will have no idea if your work is important if they don't see it in Nature. The lack of broader impact and interdisciplinary readership alone will make the NSF question your dedication to increasing the diversity and equity of the US scientific community and engineering workforce.

journals as they are currently structured are obsolete. This isn't the 1800s anymore where you have to pay 5 gold bars and a mule in order to print up 5000 copies of your article for nationwide distribution. with publishing basically free and effortless, all they have now is their reputation as gatekeepers. Which is still a needed function but they need to start assuming other functions. Like greater roles in the replication and review process instead of foisting it on others. Otherwise, one day people are going to wake up and wonder why they're still using them.

Personally if I could I would ditch the journals in favor of a superArvix collecting all articles from preprint to published form in one neat place that ranks papers on more objective criteria. That would also eliminate the problem of journal mills and good papers being ignored because they are in obscure journals.

Government/grantmaking organizations can kickstart the process by requiring that papers using taxpayer money be published in free and open databases. The medical biosciences at least sort of has the beginnings of this in PubMed and there are movements to make taxpayer funded research open but what is currently available is at best a half measure that does not have all the features to optimally move away from traditional publishing.
 
Last edited:
  • Like
Reactions: Diana Moon Glampers
The only benefit I see to journals as opposed to simply publishing articles on websites or uploading them to a public server is that someone is ostensibly acting as a gatekeeper and keeping the worthless articles out of publication. Of course that presents its own problem in that if no one is actually refereeing the articles or checking sources or seeing if lab results are duplicable (not to mention editors aren't being bribed) then it doesn't matter how bad the article is because it's ending up in print anyway. And there's the whole "this journal is far more prestigious than that journal" angle is something that should be reexamined; either an article is worth putting out to the world or it isn't and it shouldn't need to end up in Science or Nature or Cell or PNAS to be considered a worthy article.

What I don't quite understand is where the publication money is going. I may be totally off base here, but the way I understand it is a scientist gets his grant, does his work, and writes his paper. He submits it to a journal for publication. if it makes the cut, he has to pay the journal to publish it. The journals aren't free and libraries, institutions, and individuals must pay for either the print editions or online editions (or an online database like EBSCOHost). Since the journals aren't actually putting the money back in the hands of scientists in the form or grants, and after the expenses of staff like editors or layout people, and printing, where is the money going?
 
What I don't quite understand is where the publication money is going. I may be totally off base here, but the way I understand it is a scientist gets his grant, does his work, and writes his paper. He submits it to a journal for publication. if it makes the cut, he has to pay the journal to publish it. The journals aren't free and libraries, institutions, and individuals must pay for either the print editions or online editions (or an online database like EBSCOHost). Since the journals aren't actually putting the money back in the hands of scientists in the form or grants, and after the expenses of staff like editors or layout people, and printing, where is the money going?
publishers like to make money and journal staff don't work for free either
that's where the money is going.
 
Back