Declining Value of Papers in Academia

Поділитися
Вставка
  • Опубліковано 30 тра 2024
  • The value of papers in academia is a very sensitive topic that I have been thinking about for quite some time. Yes, writing a paper is a great way to study the topic and advance your knowledge. Yes, papers are generally considered the best tool for disseminating scientific results. Papers are the structure and the soul of any research.
    But the value of a single paper can be very low sometimes. To become a successful researcher, you should produce dozens of papers per year. This eventually decreases the value of publications and creates other publishing problems. In this video, I want to share my vision of this trend and discuss some recent insights that may be useful to other young researchers and academics.
    00:00 Intro
    00:33 Your career = your papers
    03:46 The value of one paper is low
    07:30 How much to publish (minimum)
    08:43 Publishing pressure
    12:37 How much to publish (optimistic)
    16:29 Publishing paradox
    18:51 What to do?
    Andrey Churkin (Андрей Чуркин) 2023
    andreychurkin.ru/
  • Наука та технологія

КОМЕНТАРІ • 980

  • @kw1ksh0t
    @kw1ksh0t 3 місяці тому +2411

    For me the contradiction is as follows: huge pressure to publish, papers are king, and yet no one reads them, because they are too busy publishing, and hence your papers are worthless. So there's just an endless stream of wasted effort, since no one is reading each others' papers. Hence the value of each paper is now almost zero, even if a huge amount of effort has gone into it. As you say, there is no feedback at all. I published what is, imo, a very important breakthrough in fundamental quantum systems with applications for all high-precision measurements. But, basically no one has read it, barely even my own PhD supervisor. Why? They don't have time, in fact they're incentivised *not to*! Now I'm a postdoc and it's very lonely, I barely did any work for 2 years because I had zero support since everyone in my research group cares only about their own work. Even within the research group there is zero feedback.

    • @chuscience
      @chuscience  3 місяці тому +285

      Good point! I did not mention it in the video: academics are very busy and do not read many papers. Some of them are just tired of reading about similar trendy ideas and minor improvements in their field. So we have millions of students publishing papers, but who actually reads them? According to my statistics, my papers are usually cited by other PhD students and sometimes postdocs.

    • @kw1ksh0t
      @kw1ksh0t 3 місяці тому +188

      @@chuscience The truth is that very few people are going to read your paper unless it is relevant to their own career. Therefore, we are effectively punished for doing pioneer work, since it requires a huge effort to advertise it and convince people they should learn it. I miss the days when it was actually excusible to just spend time simply learning without feeling bad about it

    • @the11382
      @the11382 3 місяці тому +19

      Would AI analysis of papers help? There are LLMs that gobble up papers in minutes, spitting out only what you need of them.

    • @WetPig
      @WetPig 3 місяці тому +33

      Just like any business with it's KPI's..... This is not science, it's a business, the educational business. Im most parts of the world it doesn't even pay well... I would have loved to be a researcher, but all of these things made me not want to do it.

    • @mrcrapforyou
      @mrcrapforyou 3 місяці тому +5

      @kw1ksh0t care to share a link to your paper here & stíck it to the Man ?

  • @emmanuelameyaw9735
    @emmanuelameyaw9735 7 місяців тому +1983

    That's why single authored articles should carry much weight in promotions. Some professors are gaming the system with co-authors.

    • @reginayfavors
      @reginayfavors 6 місяців тому +249

      They are gaming the system by using graduate students too.

    • @sunway1374
      @sunway1374 3 місяці тому +98

      That will become problematic too. They will find ways to have more single-authored papers.
      How? There are ways. For examples, keep recycling old ideas and old papers; and dig up those old abandoned ideas and papers (even as a mid-career researcher, I have a huge number of these, maybe as many as my published first-authored papers). Nothing will get discarded now.
      Also, you can cut up the results to create more papers. Maybe you used to write one or two papers for an idea before. Now, you cut up your research into more smallest publishable units.
      Having too many single-authored may also be a sign that the authors have difficult personality in the work environment, dislike team work, do not collaborate, etc.
      What is rare will be considered valuable. Then in the future, someone in a YT comment will write that's why we need to put more weight to coauthored papers.

    • @realGBx64
      @realGBx64 3 місяці тому +17

      Most places only count corresponding author and first author in promotions and hiring. Being a simple co-author is absolutely meaningless these days.

    • @grdfhrghrggrtwqqu
      @grdfhrghrggrtwqqu 3 місяці тому +13

      @@sunway1374 Single author papers are BAD. Everything NEEDS to be peer reviewed, which means you NEED co authors. Saying otherwise is ignororant. No you are not Einstein. If you don't like team work, get out of college, and go teach it and read the textbook yourself. If you don't like it, STOP COMPLAINING AND GROW UP. Something this generation needs to DO.

    • @sunway1374
      @sunway1374 3 місяці тому +42

      @@grdfhrghrggrtwqqu Did you reply to the wrong person? Read my comment again. I didn't say single-authored papers are good. In fact, quite the opposite could be what I have meant, although even then I didn't say papers with multiple authors are good.
      Also, you don't know me, why do you think I am in a college and of "this generation"?
      I don't know you... But from your comment, I guess you are not very experienced in the journal paper publication process.

  • @ellielikesmath
    @ellielikesmath 3 місяці тому +795

    the decline in value of academic papers means a rise in the value of youtube comments. you can read all about it in this youtube comment

    • @JimTheCurator
      @JimTheCurator 3 місяці тому +35

      According to me, I agree with this sentiment!

    • @suey1690
      @suey1690 3 місяці тому

      I like searching ArXiv to see if there are any papers that have already explored solutions to some random math problem I came up with. As long as the submitted papers have correct math, more is better for that specific use case.

    • @successmaker9258
      @successmaker9258 3 місяці тому +50

      Seconded, this comment is now peer reviewed

    • @Codysdab
      @Codysdab Місяць тому +3

      I saw this comment, but have read no scientific papers today.
      That's science! 🤣

    • @Darkjnr5
      @Darkjnr5 Місяць тому

      🤣

  • @prism223
    @prism223 3 місяці тому +1117

    I said "no" to academia after a revealing experience at the very beginning. Without giving away identifiable information, here's what happened:
    - I worked for a few years on a new method of extracting data from physics experiments.
    - The results were excellent and allowed extraction of new results from old and new data sets.
    - I got a PhD on the results and submitted a paper.
    - The paper kept getting sent back from the review committee, but with strange comments, the things you would say if you didn't understand the material. Neither me nor my advisor understood why they would say what they said if they understood the material.
    Eventually I learned something that solved the mystery: Some of the people on the review committee were actively working on a competing approach to the one I developed and presented in the paper. So, there was an obvious conflict of interest between the paper and the committee, which made the mysterious negative comments suddenly make sense.

    • @snared_
      @snared_ 3 місяці тому +71

      no, that doesn't make your negative comments suddenly make sense. If they were actively developing a competing approach, then they would have the knowledge to understand the material. It seems far more likely that the negative comments were left there to gaslight you into wasting your time while they developed a superior approach or at least a copy cat of your own approach. By the way, that isn't 100% at all. So I plainly disagree that the intent behind their comments got cleared up, UNLESS you're assuming they have bad intentions from the get-go. But that is a very specific line of thinking and you are missing several other potential motivators leading to the same outcome you experienced.. But anyway, I get you. You should paste your paper onto the net somehow though, so they can't claim they came up with your idea before you published.

    • @prism223
      @prism223 3 місяці тому +169

      @@snared_ Yes I was assuming bad faith

    • @Rust_Rust_Rust
      @Rust_Rust_Rust 3 місяці тому +31

      ​@@snared_No, that doesn't necessarily mean that they were developing a superior method or copying his techniques. At the end of the day you and OP are just speculating. Whatever their intentions were it most likely wasn't good.

    • @choppergamer
      @choppergamer 3 місяці тому +11

      @@Rust_Rust_Rust too many smart people in this comment section. for once everything i wanna say have already been said

    • @sergev6632
      @sergev6632 3 місяці тому +10

      ​@snared_ and that's why preprints exist...

  • @millamulisha
    @millamulisha 4 місяці тому +1220

    I was working on a problem for around 6 months, had read a few thousand pages of advanced physics and mathematics, searched far and wide for research literature out there to help me find a solution, spent a few sleepless nights trying to work out solutions to this problem, came up with a fairly sophisticated model (system of nonlinear PDEs, solved using perturbation theory), etc… Long story short, I actually found the answer in two papers published in the 1960s (from NASA and another from a university in Germany) together which solved my problem. These two papers together had less than 4 citations (in 60+ years!). So I will say, don’t lose motivation. The work researchers do is very important, even if only realized by one person in the very far future. Stick with it folks, the system is a bit broken probably so I agree with much from what you have said in the video. 😅

    • @MarkRuvald
      @MarkRuvald 4 місяці тому +97

      Your perseverance here should be rewarded, but sadly the audience may be so limited that it won't be. In the 60s those researchers probably felt less publishing pressure than now.
      I wouldn't know if competition and prestige has changed since then also.

    • @lucaxtshotting2378
      @lucaxtshotting2378 3 місяці тому +9

      wait, so the work is important because in the future someone will realize it is already done? what a ponzi scheme
      Edit: it is a ponzi scheme because its existance is only justified by its existance. Didnt think I had to clarify this.
      Please dont answer it is not, im reducing to absurd. Not a big reduction though, as of today

    • @gsuekbdhsidbdhd
      @gsuekbdhsidbdhd 3 місяці тому +8

      ​@lucaxtshotting2378 They probably solved an internal problem and then published the results

    • @lucaxtshotting2378
      @lucaxtshotting2378 3 місяці тому +3

      @@gsuekbdhsidbdhd even more strict of a ponzi scheme then.
      I'm sure they make some progress, it's hard to believe it is worth the money and other resources. It's not like Open AI and not university of Toronto is king of Rohan

    • @lucaxtshotting2378
      @lucaxtshotting2378 3 місяці тому +2

      the other way around*. Open AI is indeed king of Rohan

  • @Dr_ahmadian1
    @Dr_ahmadian1 6 днів тому +29

    Great video. This video has garnered 240k views, which is more than the total citations an academic could receive even if they published 200 papers, each cited 1,000 times. Tremendous impact, high value.

  • @thorebergmann1986
    @thorebergmann1986 7 місяців тому +814

    When you learnt your job at 5-star restaurant, and realize you ended up in a fast food restaurant instead

    • @chuscience
      @chuscience  7 місяців тому +62

      😂

    • @snared_
      @snared_ 3 місяці тому +3

      @@MorTobXD civilized, vegan, cheap. For restaurants, Pick two, should be doable.

    • @LethalBubbles
      @LethalBubbles 3 місяці тому

      classist statements like that are why it is so bad. the only cure is full freedom of all information. transparency is the only way.
      classism, assuming the fast food eater must be an uneducated hoard, and that the academia goer isnt some nepotism yacht club scholarship is the exact reason why this happens.
      theres good people who are privleged and theres good people who are not.
      when someone denies the "fast food eaters" an education, equal access, they've created classist slavery. when they put the privlege folk into a position theyre born into, they are also robbed of their potential expertise. we're all equal and creating a system of illusions to say otherwise creates lies about cancer.

    • @Ekornpro
      @Ekornpro 3 місяці тому +3

      Let me fix that statement
      "When you learnt your job at 5-star restaurant, and realize you ended up in a fast food restaurant instead cause your not a 5-star restaurant chef"

    • @thorebergmann1986
      @thorebergmann1986 3 місяці тому

      @@Ekornpro So, you wanna say, 5-star restaurants do exist in science?

  • @bhaskartripathi
    @bhaskartripathi 4 місяці тому +470

    Coming from industry, I learnt these rules in Academia:
    1. Publish or perish.
    2. Novelty is not enough. Novelty should be valuable.
    3. Never reveal your code, until you are done with 2-3 variant papers on the same or similar topic.
    4. No one cares on the quality of code.
    5. Keep writing. Writing is thinking.
    6. Be more resourceful than more honest.

    • @yee6365
      @yee6365 3 місяці тому +8

      It's a shame

    • @GuyMichaely
      @GuyMichaely 3 місяці тому +3

      Why #3?

    • @jeanc6306
      @jeanc6306 3 місяці тому +26

      ​@@GuyMichaelyit gives you competitive advantage when developing the new methods/new experiments. Don't want to release code and then get scooped on some idea extension. Sort of trading off impact for paper quantity

    • @vNCAwizard
      @vNCAwizard 3 місяці тому +14

      I agree with 1, 2, and 3. I am a programmer, so no on 4. 5 is good only with endless editing and revision. I do not agree with the willingness to sacrifice honesty.

    • @runnerup15
      @runnerup15 3 місяці тому

      What an abomination of a system we have made. Research is made only in the name of making enough money to barely scrape by and if you get any inkling of an idea sprouting from research you need to hide it to yourself so you can hopefully continue to have medical insurance and maybe money left over for a bag of rice

  • @kyaume21
    @kyaume21 7 місяців тому +560

    The problem stems from University admin culture: it wants facile criteria to judge something which is beyond them to understand. So they take refuge in cheap numerical data, which has no connection to the actual reality.
    Compare it to art, for the sake of making a point: suppose the value of a composer (say Bach, Mozart, Beethoven) was judged by a numerical value (eg. the number of downloads of their music clips) : it would be a good 'objective'measure to use for the tone-deaf. But would it capture the true value of the output of those composers?

    • @chuscience
      @chuscience  7 місяців тому +56

      Nice analogy with composers😅 Will remember it for future discussions!

    • @tjppercussion
      @tjppercussion 5 місяців тому +47

      Exactly. Mozart wrote 41 symphonies but for the most part the first 30 or so are ignored compared to the study of his later ones like no. 39 or no. 41. Same for Haydn, he wrote 100+ but many haven't even heard any of the first 90. Meanwhile Beethoven wrote 9, all of which are highly revered. Many music scholars don't fall into the "your papers are your career" category, anyway, considering the additional achievements of performances, clinics, and masterclasses. Though publications of course are part of it

    • @moumouzel
      @moumouzel 3 місяці тому +2

      Spot on

    • @ColdNavigator
      @ColdNavigator 3 місяці тому +7

      Research may also take centuries to result in huge pay off. Any value that can be measured have a huge lag in the signal.
      I doubt many of the ancient people who studied number theory and early differential geometry would have known that it would lead to a language to describe quantum physicis and general relativity.

    • @alioshax7797
      @alioshax7797 2 місяці тому +1

      What would be the alternative solution ? You think a university has the time, the energy or the ability to read the work of every single one of their workforce ? Going from Mayan history to particule physics through the biology of the shrimp or the sociology of birthday parties ? And even then, measuring the quality of a paper is quite subjective.
      Of course they need easy, understandable metrics to make a choice. No matter how flawed their are.

  • @BS-jw7nf
    @BS-jw7nf 4 місяці тому +415

    I don’t think many people realise what the job of an academic is these days. Your job is to get funding to your university. It’s not research, it’s not even papers, it is all about getting money to the university and to that end. You need to optimise for this. Having good friends gives you better resources to get more money to your institute. Better paper metrics give you better chances at getting funding. It is ALL about getting money to your university. If you want to be a successful researcher, you need to optimise to that goal.

    • @YourCapybaraAmigo_17yrsago
      @YourCapybaraAmigo_17yrsago 4 місяці тому

      Yeah and this is bad. Why would you justify this? Academia is supposed to have a higher goal than personal profit. I think we're in sorry times where colleges are just another greedy business.
      I think it's sad as fuk, why don't you?
      All this money that comes in, and then where does it go? Don't we see a problem with this? Tuition is rising steeply, more and more students are being priced out and unable to meet the shortfalls with other forms of assistance, all while the PhDs are being dutiful little slaves trying to bring in the money, and plenty of other sources of money are rolling in and yet.......what? Are all the universes employees then paid comfortably and fairly and his tuition kept reasonable? Not in most places.
      So the university is nothing but a profit seeking machine then? Just another business? Well isn't that just so enlightened.
      I have a lot of problems with this. Apparently you don't. Again I ask you, where the hell does all this money go???
      Are you aware that according to more and more reports that have surfaced the majority of staff and support staff at universities are poorly paid???
      Apparently postdocs have a shameful record of job security because they're given appallingly short work contracts from their superiors, from 2 mos to 3 years tops. I should think this would be unacceptable. Most people want some security in their job, it doesn't have to be set in stone, but it is completely unfair to any worker especially a professional credentialed staff worker to provide them next to no predictability and longer-term contract so they can plan their life accordingly.
      I mean this shit sounds exploitative af don't you see it???
      About the money - so basically the University president is your pimp and you're supposed to be their loyal bitch and if you're not bringing in enough money your career is going to go down the toilet- yeah? A crass but apt analogy yes???
      Also are you aware that the presence of medium and large and universities has a disastrous knock-on effect of local rent prices? now local city councils are to blame for this because they refuse to enact rent control because they're corrupt trolls, but yes, universities do this whether they intend to or not. Also, are you aware that many colleges and universities pay zero taxes and contribute very little to their surrounding economy? I wonder if you're aware of any of this.
      I know we've all been trained to view the university as this august refined altruistic institution that is nothing but beatific and a positive in every way but unfortunately, whether they intend to or not, they bring a lot of negative with them.
      Looks like there's a lot of crookedness that goes on at the top level of university management. Because right now I don't see anything that they're doing as ethical.
      Not sure if greater regulation (specific laws) would change this. Still looking into that.

    • @sunway1374
      @sunway1374 3 місяці тому +60

      Yes, that's what I observed and concluded too. People still talk about publish or perish, like having papers is sufficient. No, no, no.
      You need to have grants. The more the better, the larger the better. And that is sufficient. It's been "Grants or perish" for at least 2 decades now.

    • @YourCapybaraAmigo_17yrsago
      @YourCapybaraAmigo_17yrsago 3 місяці тому +24

      And yet you're paid shit for this. Or at least not very well apparently. Lol. Ok well I think it's awesome that universities have become nothing but small corporations today.

    • @praphael
      @praphael 3 місяці тому +7

      @@sunway1374 This is true. However without the papers you don't get the grants
      Now it may be that someone has superior journal output and doesn't get the grant vs. someone who only has average journal output who doesnt
      This can also come down to how well the grant was written and novelty, etc.

    • @sunway1374
      @sunway1374 3 місяці тому +2

      @@praphael
      OK. But papers are much easier to get than grants. And you don't need great papers to get a grant.
      I know people who have many papers but never get a tenure (inc. me), and others who have many papers and even written books but never rise above associate prof.
      All because we have never been PI of a large enough grant.

  • @SoroushRabiei
    @SoroushRabiei 3 місяці тому +163

    In my line of research, I found more than 90% of published papers to be either nonesense, repeating the known in a different way, or even outright academic fraud in some cases. You often find "paper gangs"... A group of people who cite each others papers repeatedly and even review each other in lower quality publications with no "associations" checks!
    There is very little value in most of the published papers I encounter. This makes doing research a very difficult endeavour for me. I think the main reason for this is "publish or perish" situation in academia.

    • @amir-ng6jv
      @amir-ng6jv 2 місяці тому +1

      جسارتا در چه حوزه ای؟

    • @faithlesshound5621
      @faithlesshound5621 13 днів тому

      @@amir-ng6jv If he replied truthfully, he would indeed be brave (and also stupid).

    • @dmitry5319
      @dmitry5319 5 днів тому

      in my field it is pretty much the same

    • @Bvic3
      @Bvic3 4 дні тому

      Academia is a giant scam with an insane noise to signal ratio. 80-90% of papers can't even be replicated.
      The reality is that a tiny amount of paper are great and have huge impact.
      It's a winner takes all field. Like all information fields where the best/most popular can capture the entire market.
      Academia is just another Hollywood.

    • @bluemacaroons
      @bluemacaroons 4 дні тому

      I wrote a paper for school just to get some experience and while i was researching found out the main papers i was citing were from a field with that kind of peer reviewing done mostly to make money. It was kind of sickening bc it was supposed to be research on how to improve ppls mental health and instead was just a waste of the public’s money and created a lot of misconceptions in the field that ppl still believe today

  • @plazma5343
    @plazma5343 3 місяці тому +50

    My sister is a science loving phd micro biologist. Her thesis is a wonderfull small improvement in the understanding of AIDS, something that most likely will have very positive future applications.
    The shit she goes through on a daily basis is horrifying.
    Everyone tells her to go private, but she still believes she can have an impact in public research..... she works endless hours, for a mediocre salary (a criminal one hourly) for game of thrones schemer bosses. It is so infuriating.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому +1

      What small improvements? How do you know it's an improvement?

  • @heartsofiron4ever
    @heartsofiron4ever 3 місяці тому +70

    A trick my supervisor gave me to get extra citations is to attend a lot of conferences. 6 per year, but not to publish conference papers, rather to give presentations, citing or using your own work, because when 500 scholars from your field are watching your research, and also find it interesting, they'll take a note, and likely cite it in the future.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому +4

      Not surprised. Most papers are buried. The more you discuss about your work, the more people know about it.

    • @dmitry5319
      @dmitry5319 5 днів тому +3

      Well, partially, this is true. However
      1. Travelling, preparing and giving talks takes time from research
      2. To be invited to a conference you need resources. If your supervisor has resources to give you many opportunities to speak is one thing. Otherwise, it is hard to be invited to speak anywhere.
      3. Conferences are no longer as they are supposed to be. Nobody listens, everyone is typing their own papers during talks. Or sleeping, or watching football.
      Actually, as I got permanent job in academia I almost stopped going to conferences. I don't quite see the point except tourism. I almost never get any valuable feedback. Concerning the other talks, usually, people are just recycling the old stuff. There is nothing interesting and speakers behave as sales managers. In case there is anything interesting I'd rather read a paper my self, not wasting time one useless sales interprises.

    • @blancosal
      @blancosal День тому

      @@dmitry5319 that's the catch

  • @yassengorbounov
    @yassengorbounov 3 місяці тому +83

    A very brave video containing a lot of truth. Few people dare to say this, although many true researchers feel and think it. Publishing a scientific product has become a business model.
    I visited the ATLAS Experiment at CERN and made the following observations:
    1. One of the top authors has published 1,816 papers.
    If one's professional career lasts 40 years, the calculation says:
    40 years X 365 days = 14600 days; 14600 / 1816 = 8 days to publish a paper
    That means 1 paper is published every 8 days during the entire professional life! That's about 45 papers a year... every year!
    2. The same author has an h-index of 167.
    "The h-index is defined as the maximum value of h such that the given author/journal has published at least h papers that have each been cited at least h times."
    The top author has 167 papers each one cited 167 times!
    3. A paper published by researchers had 78 authors!
    I realize that CERN is something "big" and quite complex. But... there are 78 authors anyway...
    Probably all those people are high-level scientists. But... what makes them hyperprolific? Is it real? How is it possible? Is it more for the benefit of science or is it a kind of business?

    • @MiauZi69
      @MiauZi69 2 місяці тому

      Ponzi sceme

    • @samchs222
      @samchs222 Місяць тому +1

      MLM?

    • @faithlesshound5621
      @faithlesshound5621 13 днів тому +4

      I think somebody* has a "Law" to the effect that once any particular measure is selected as an index of quality and used to give rewards, people in that field work to maximise that one measure, and it stops being a useful index.
      That's where "Number of publications to your name" falls down, because of the formation of publishing cartels. Three people in one lab chop up every experiment or study into three, and spread the data and analysis over three papers under their names in a different order, plus of course the head of department and a few people. So to make sense of it you have to read all three papers.
      The big boss has his name on all of them, and gets a bigger citation number: but that's OK, because editors see his name and accept the paper, though he may not even have read it.
      This system works to the benefit of the "big bosses" who run laboratories or research groups, so they are not going to change it. What does it measure in reality? The ability to organise a group of researchers and crack the whip to keep them both working and publishing. That's what the University Grants Committee wants, and what the university's own own hierarchy is monitoring.
      No one person can evaluate the worth of an Assyriologist, a Molecular Biologist and a Health Economist, but the committee members can all look at the numbers and compare them with those of similar academic rank elsewhere.
      * Goodhart's Law.

  • @A3racada3ra
    @A3racada3ra 9 місяців тому +293

    The whole academic system is basically rotten in its core. As a young researcher its extremely hard to actually make it because nothing works in your favor. Just to name a few: 1. You are extremely dependent on senior researchers / professors, because they are the gatekeepers. Many of them see you as their workhorse who will publish with minimum effort from their side (if you are a postdoc). To top it off, many of them even insist on being put as the lead scientist on any paper you publish (even if their contribution was miniscule). And sometimes they even delegate a lot of extra work (teaching or administration) to you. It is very difficult to argue against this because they hold so much power and potentially can end your career before it even started ... 2. With the increased pressure to publish many papers, it's not just the quality of the papers but also the metrics themselves which get scewed. Lots of papers means lots of citations of older work, which again works in favor for more senior scientists. The side effect is that their metrics will ramp up significantly whilst junior scientists bite the dust. This is especially true if you are not working with a high profile professor. 3. The whole "open science" concept as it is introduced these days makes it even worse for young group leaders or whole institutions, which don't have as many financial ressources to fund open access publications (which cost thousands of dollars). Again OA leads to more citations, and statistically established researchers with a big name have the most ressources to make their work accessible. There are of course also many good sides to an academic career and there are good professors and senior scientists who really want to make a change, however it is best to be realistic and don't have any illusions about it.

    • @dxq3647
      @dxq3647 4 місяці тому +14

      Yup, a young academic has to compete with someone with 40+ years and still produce an interesting paper. How is that fair in any normal field?

    • @davecrupel2817
      @davecrupel2817 3 місяці тому +8

      There are few things i detest more than an "old boys club" situation. Which this sounds very much like.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому

      If a "professor" is gatekeeping shit, use various sources. Be upfront about it. Tell them that they're the only experts about it. Don't give it up and whine how they're gatekeeping and stuff. Convince them to give you an answer. Sometimes professors really didn't know the answer either, they're humans who are simply labelled as "professor". You can't blame everything on them. Sure, they hold power, of course they do. But it doesn't mean that you'll give up just like that. You have to convince them you're worth listening to.
      I am not a professor but in my experience, you have to convince them whatever you're concerning about required their attention. Sometimes you worry about the most mundane stuff and brings it to them and realized you could just get the answer on Google. Also, for 3, I have mixed feelings, yes, we need as much access to information including those behind a paywall but we have to hear in mind, it's the internet, you can get good information for cheap and free, plus, you have public libraries and also archives. Obviously I advocate for free information than having to pay it but you gotta understand that it's not about you and your laziness but your willingness to find good information. You gotta show people that you're capable as a student/researcher and not just whine about how professor X is possibly Satan in a lab coat.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому

      ​@@dxq3647so you want to compete with who then? A kindergartner?

  • @sunway1374
    @sunway1374 3 місяці тому +119

    This is the result when universities are run by the business types.
    Have they asked themselves what values do they bring? Have they evaluated themselves similarly in their appointment, promotion, and salary increment?
    When the universities need to save money, who are the first persons to get laid off, their salaries becoming stagnant, and their pension contributions reduced? Yep, the academics!
    Why is it that most universities in the UK now have more administrative staff than academic staff?

    • @silphonym
      @silphonym 3 місяці тому +16

      Yes, universities should be almost entirely public institutions, with two primary goals: 1. To educate 2. To create new knowledge

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому

      But that's stupid. Why would a business wants to waste money on useless research? Why would they want to compromise the only product they're trying to sell?

    • @sunway1374
      @sunway1374 Місяць тому +4

      ​@Lifeonthefastlane007 I think you misunderstand what i am saying. Could it be that you are not aware that universities in english speaking countries are run more and more by people with a business, finance, or corporate background?
      They don't intentionally jeopardise their products. But they put money making as a priority to the detriment of all else. Eg. Boeing.

    • @jgw9990
      @jgw9990 23 дні тому

      ​@@Lifeonthefastlane007Why would they allocate so many funds to useless administrative staff

    • @colbyboucher6391
      @colbyboucher6391 5 днів тому

      ​@@Lifeonthefastlane007Why do they get do deem it useless? Why is the only useful research the research that makes a line go up?

  • @fcolecumberri
    @fcolecumberri 3 місяці тому +175

    The worst thing is when you see cases of clearly frauds, I remember a researcher's google scholar profile that had 200+ entries on the same year...
    Like the year has 365 days, was he publishing once every 3 days including weekends?
    Is not that I doubt he contributed somehow to those papers, I doubt he read half of them.
    (Also topics were extremely varied, from security based on blockchain to biotechnology using AI)

    • @mysteryman480
      @mysteryman480 3 місяці тому +24

      I once stumbled upon a paper that had claims in the abstract that were not included or even mentioned elsewhere in the paper. It made me wonder about the quality control standards at that journal (I can't remember the name of the journal).

    • @fcolecumberri
      @fcolecumberri 3 місяці тому

      @@mysteryman480 Wanna see something fun? search for a classic method and a new technology (example: Bellman-Ford and Cuda) and watch the countless papers claiming to have "novel approach of the classic method with the new technology" no one has ever done.

    • @choppergamer
      @choppergamer 3 місяці тому +21

      100% hes taking obscure journals and yanking them to publish in high impact journals

    • @Marvelous771
      @Marvelous771 3 місяці тому +1

      Fraud

    • @fergalhennessy775
      @fergalhennessy775 Місяць тому

      Rockstar professor with many grad students in a fast moving field, it is possible

  • @joelfenner
    @joelfenner 3 місяці тому +72

    My experience in academia (broadly) was that only 2 things matter to the "administrative" tier:
    1. How much research money are you bringing in?
    2. See 1.
    There is very little actual consideration of the quality of your papers, or the relevance of your research topic or field. They don't even really care that much about the quantity of papers, unless you aren't publishing much, in which case they'll give you the "side-eye" about it. If the incoming money is large enough, even this can be forgiven, at least temporarily. Controversial/moral objections are often swept aside as long as the money is coming in - they only start to care if a public scandal arises (because this hurts donations or grants). But if you are bringing in the money, they really don't care about anything else.
    You would not believe some of the stories I acquired, sometimes firsthand, during my years in academia (across many institutions).
    As a student, I never thought academia was THAT mercenary. Maybe it wasn't always. It certainly is now.
    Your own research colleagues are the only people who care about the substance of your work. In general, "the department" and upwards really only cares about the grant money. And it's soul-crushing to the researchers who are actually trying to do something worthwhile or relevant.

  • @pixeljames
    @pixeljames 3 місяці тому +49

    I feel your pain. Went through that at some point. The worst part is you work really hard on something, get somewhere and then you can't even get a conversation about it. Even if you give talks on your paper you will likely never get more than superficial comments. It has to do with how the system is set up, around rock stars, egos and popularity contests. It is fundamentally rigged for people that are narcissistic. It should be about real collaboration, joint discovery and human advancement... but it is a strange system that isn't designed by the people who are actually in it.

    • @snesjkksdnuesjjsj
      @snesjkksdnuesjjsj 3 місяці тому +1

      become anarchist. all is hopeless. the masses are hopeless. there are two species of humans.

    • @JaayyRo
      @JaayyRo 3 місяці тому +2

      What are the two species?

  • @lorteauerwan8686
    @lorteauerwan8686 3 місяці тому +51

    It is indeed a problem that has been discussed for years, but its just an extension of Goodhart's law at the end. Any other metric than publications or citations will eventually lead to the same result where researchers are incentivized to optimize the given metric rather than producing anything else

    • @michaeltorrisi7289
      @michaeltorrisi7289 3 місяці тому +2

      Bad metrics become a more significant problem as entities (because this is a problem in the corporate world, not just in academia) try to quantify performance more and more. There are, of course, incentives for them to do so - it avoids the potential for accusations of favoritism or bias. But it does lead to a lower quality of worker than simply letting managers make their own decisions. That's true even if you take into account the favoritism, bias, and blind spots of managers. The increase in efficiency is small enough that it doesn't outweigh the risk of lawsuits, so metric-based evaluation wins. Or at least, that's the case for large companies. Small companies still rely heavily on their management team to make judgment calls instead of turning them into functionaries. One of the reasons that I'm happier now managing for a smaller company where people would look at me like I was speaking a foreign language if I used terms like "KPI".

    • @SeattlePioneer
      @SeattlePioneer 3 місяці тому +1

      What about just frankly and honestly measuring how much MONEY someone is brings in?
      That would be one metric that would be hard to fudge.

  • @SiMyt848
    @SiMyt848 7 місяців тому +137

    Congratulations on the video. I stumbled on it from the YT algo. What you are saying is totally true. I just quit my postdoc for a job in the industry and you cannot imagine how the past months have been so relaxing not having to worry anymore about publishing new papers every second of my free time. I never worked on weekends nor evenings but I was always thinking in my free times about coming up with the next great paper and how to milk more the same models. This is coming from someone that had more than 2x the average paper output during the PhD in my department and have just published my last paper in Nature. I am so glad that I no longer need to worry about checking my citation count on ADS when I turn on the computer in the morning...

    • @chuscience
      @chuscience  7 місяців тому +43

      Congrats on getting a normal job! I am currently the last postdoc remaining in my team. The other 4 postdocs I knew have already left for industry, and feel happy. We'll see how long I will last🙂

    • @ryanelam4472
      @ryanelam4472 2 місяці тому

      What is your field, and does your job in industry also involve research?

  • @Aaron-lp3zt
    @Aaron-lp3zt 3 місяці тому +76

    "good luck with your papers" - I grinned as I turned back to my overleaf tab

    • @and_I_am_Life_the_fixer_of_all
      @and_I_am_Life_the_fixer_of_all 3 дні тому

      I can see this happening.. I've seen departments where some people are very serious about their work while others are there to just work on something as an excuse to just fuck around

  • @richardengelhardt582
    @richardengelhardt582 Місяць тому +15

    So true. After 50 successful years at the top of academia, I now nouce that 80% of papers submitted for publication are simply rehash of old research by yourself and others, which peer reviewers are so unfamilar with the history of the discipline (due to the avalanche of largely irrelevant papers,) they frequently don't even notice.

  • @henriknielsen1662
    @henriknielsen1662 Місяць тому +12

    The problem is aggravated by the fact that it is often difficult for editors to find qualified academics who are willing to act as peer reviewers. They aren't paid and often remain anonymous afterwards so that they get neither remuneration nor credit for their work. No wonder many academics are unwilling to take on this unpaid work when they already have so much else to do. It is not easy to see a solution to this. Paying peer reviewers would obviously create all sorts of new problems.

    • @SuperFalcoFalco
      @SuperFalcoFalco 21 день тому +2

      Not being paid is actually quite the essence of maintaining quality of peer review.

  • @mranderson0075
    @mranderson0075 3 місяці тому +10

    I am very glad that my phd advisor is more old-school and doesnt really care if I only publish a single paper before my dissertation as long as my research is sound. I also find the trend to push towards publishing more and more papers (of mediocre quality and questionable novelty) that is coming from the anglosphere quite worrying (I work in Germany). Personally, I don't really see a benefit (for science overall) of publishing every single small incremental step rather than a longer journal article with more meat on the bone (if not even a patent). This also leads to a ridiculous workload being placed on reviewers who do their work pro-bono (and there are 3-4 reviewers per paper). I also don't think that researchers being bogged down with writing papers rather than doing (actual) research is really something academia should strive towards.

  • @modallas2
    @modallas2 3 місяці тому +36

    One paper with a 1000 citations, is better than 1000 papers with 1 citation each.
    Until the system changes to reflect the decline will continue.
    PS: I belong to the first category. I would not have a chance if I were to apply for a tenure-track position in academia.

    • @moumouzel
      @moumouzel 3 місяці тому +27

      you just substituted one bullshit metric for another

    • @albaniaalban
      @albaniaalban 3 місяці тому +13

      I partially disagree with this notion. While I agree with what I assume is the core sentiment - a bigger focus on quality rather than quantity - focusing on the amount of citations carries much of the same issues. Senior researchers, who often are co-authors of papers, will still see their citations skyrocket compared to their younger peers. Niche research and negative results will be disfavored. Systematic reviews and meta-analyses will be given outsized importance.
      I don't believe we can ever fully escape the fact that judging researcher performance is always going to be flawed and subjective no matter which metrics you use.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому +1

      ​@@moumouzel Well, research is full of bullshit metrics. It's what we do, we draw the line.

  • @profdc9501
    @profdc9501 3 місяці тому +19

    Papers are no longer created to be read, they are created to be counted. The fact that citations, and not its contents, are how a paper is evaluated is the problem.

    • @M-dv1yj
      @M-dv1yj 14 днів тому

      And that’s why I’m just gonna twitter any new papers 🤷🏽‍♂️. The ideas need to spread to be talked about and tested not added to and lost in a checklist of the scientist publishing /study industrial complex 😮‍💨

    • @M-dv1yj
      @M-dv1yj 14 днів тому

      For what it’s worth I am writing to be read but also know in the current climate no one will read it 😂.
      And this is how the Fermi paradox really happens

  • @llothar68
    @llothar68 3 місяці тому +72

    I'm out of my german university (Technical University Berlin) since 1998 but what you are telling me was already normal back then.

    • @chuscience
      @chuscience  3 місяці тому +44

      Interesting. I discussed this with my professor, a very senior and respected academic. He says that he built his career 30 years ago, but he is not sure how I could succeed nowadays. He admits that academia has become much more competitive since then, with many more publications, grants, students, etc. Young researchers still have to publish a lot of papers in high-quality journals, but this is no longer a guarantee of a good career and impact.

    • @kw1ksh0t
      @kw1ksh0t 3 місяці тому +18

      @@chuscience Famously also Peter Higgs said that he would not have been able to manage in today's academic landscape

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому

      ​@@chuscienceI think things have to do with political climate too. Innovation and science wasn't as good as it now than back then, so your professor was right about him being needed because they're needed to get science to where it is today. On today's climate, I don't think it's impossible. It's up for young people like you to stop whining and just do whatever work needed. Sure, complaining is fun, it made you feel less guilty, however, I'm pretty sure we're aware that in the end, we simply just have to know many things, we need to work on our skills. What skills can you do in research? What are your ideas? If you have decent answer to this, I'm pretty sure you're alright.

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому

      ​@@kw1ksh0t honestly, I don't see the problem.

    • @thefaramith8876
      @thefaramith8876 26 днів тому

      @@Lifeonthefastlane007 How does it feel to have -110 IQ ?

  • @andrewcgs
    @andrewcgs 3 місяці тому +48

    I always wanted to be a researcher all my life. I quit just before applying for PhD positions when I realized that nothing matters in academia outside of generating revenue, with an out-of-scale competition even for short crappy academic positions, and it is mostly based on publishing papers with no real impact on the world. Every PhD student I know has quit academia as of now.
    Can academia get more depressing than this?

    • @Lifeonthefastlane007
      @Lifeonthefastlane007 Місяць тому +1

      Of course it can get more depressing. With the emergence of AI, many questions in academia will be solved. Possibly, they don't need you and me anymore.
      But, the bright side is that maybe we do need help from AI, and that's alright. It's old topic now that AI helps more than it didn't.
      Needless to say, if you're really interested in solving the world's problems you would just solve it even without recognition or payment. But that won't makes sense, because if you look closely, academia, corporations, government still needs researchers, despite AI. It's pretty interesting if you think about it. More innovation simply means more brainwork instead of the opposite.
      I myself quit research because of lack of grant, but my own hindsight is that I don't even know what to research on in the first place without it sounding stupid. So I just continue studying valuable courses instead of research itself.

    • @warpedweft9004
      @warpedweft9004 Місяць тому +2

      It depends on your motivation. Some want to do a PhD to satisfy their own quest for knowledge and don't intend to buy into academia at all. They are there for the quest, not the glory.

  • @reginayfavors
    @reginayfavors 6 місяців тому +76

    Academia really judge your ability to obtain funding and grant-based resources. Academia will promote someone who can get money over someone with skills. Great video. New subscriber.

    • @sunway1374
      @sunway1374 3 місяці тому +4

      It promotes someone who can get money over someone who has a lot of papers too.

    • @reginayfavors
      @reginayfavors 3 місяці тому

      @@sunway1374 Exactly.

    • @doghat1619
      @doghat1619 3 місяці тому +1

      Someone who can get money has been successful in convincing an organisation to fund them, that their research would be valuable.
      A very good researcher who's hyper specialised in a very niche interest that nobody sees the value in will of course struggle to get funding.
      Funding has to provide some value, simply being good at research isnt providing value.

    • @sunway1374
      @sunway1374 3 місяці тому +5

      @@doghat1619 I agree partly with you.
      One challenge is we often do not know what will become useful (or valuable) or not.
      Also, what is useful or valuable is debatable in general, and debatable under the condition of limited resources.

    • @Talleyhoooo
      @Talleyhoooo 3 місяці тому

      Increase grant money, problem solved.

  • @afanasymarinov2236
    @afanasymarinov2236 3 місяці тому +8

    At times, even when they're referenced, papers go unread. People simply require material to cite in their papers and may extract a few lines from the abstract without fully grasping the content. My most cited paper has garnered over 2000 citations, but I doubt all those authors have actually read it in its entirety.

  • @AsusMemopad-us5lk
    @AsusMemopad-us5lk 3 місяці тому +7

    "Of writing many books, there is no end; and much study wearies the mind." - Solomon. Congratulations, modern academia has re-achieved that point.

  • @khangau4844
    @khangau4844 3 місяці тому +135

    if Einstein were to live in this era, he would be the lowest-ranked professor lmaooo

    • @gauravtejpal8901
      @gauravtejpal8901 3 місяці тому +37

      I would be surprised if he finished his PhD, let alone get a tenure

    • @ColdNavigator
      @ColdNavigator 2 місяці тому +25

      We do have a modern Einstein. Yitang Zhang's career trajectory was very similar to Einstein. Failed his PhD, worked in some minimum wage jobs, but ironically, being outside of academia allowed him time to think and develop one of the most groundbreaking results in recent mathematical history. Basically he was a nobody until he produced one amazing paper after decades of private work.

    • @MiauZi69
      @MiauZi69 2 місяці тому

      @@ColdNavigatorand before that he lived as a delivery driver. Great. He also has no kids, because he never could have been able to afford them. So his bloodline is already dead and our human genome more dominated by imbeciles.

    • @gauravtejpal8901
      @gauravtejpal8901 Місяць тому +9

      @@ColdNavigator This example shows that our current academic system in not suitable for the creative people with unconventional thinking

    • @YazminM2222
      @YazminM2222 Місяць тому +2

      He wouldn't even be a professor 😔 but let's hope for things to get better than this

  • @qweewqqweewq31313131
    @qweewqqweewq31313131 3 місяці тому +8

    I left the academic path just because the pressure and the over hours I used on “writing papers” are just too huge. Nobody is going to read the paper I wrote then why I am putting so much effort with minimum PhD wages. I left and I am glad I made the choice. My salary is 5 times higher now

  • @ibozum1
    @ibozum1 Рік тому +44

    As an early career researcher I totally agree every word you said. You have summarized and explained very well. I enjoyed listening you. I hope I can see you as a one of the top scientists in the near future. Good luck bro.

  • @coach_tae_
    @coach_tae_ Місяць тому +3

    I never lost so much faith in research papers as I did when I first started interacting with people in academia during my PhD studies. Not only are papers pushed out and seemingly rushed because more is better, but the quality is demoralizing as well. The amount of times I've heard senior advisors make assumptions, I ask them why they can make that assumption, they say "it HAS to be that way" or "why wouldn't that be right" as if the burden of proof was on me when they made the claim. I would then go on to show demonstrably why these assumptions were bad and they just act like it never happened. Like what if I wasn't there to force them to prove their assumptions? We'd just be assuming our way to the next paper??
    I hate it.

  • @arlieferguson7442
    @arlieferguson7442 27 днів тому +3

    I can remember professors talking about the study decline in the value and importance of papers as the volume has increased about 20 years ago. They also discussed the decline in the quality of teaching that went along with it.

  • @ClickBeetleTV
    @ClickBeetleTV 3 місяці тому +7

    It also shows what a low premium is placed on teaching and developing students at research universities

  • @danielfigueroa371
    @danielfigueroa371 4 місяці тому +14

    Hi friend, I feel very identified with your video, it really touched me deeply, I just finished a master in High Voltage, published in IEEE top journals and I have the same feeling as you, what a relief to know that there are people who are experiencing the same as one. I really appreciate your video, it would be great to chat one day.

  • @kakabudi
    @kakabudi 3 місяці тому +10

    Thank you for making this video. You explained the dilemma beautifully. I am in my junior year of undergrad and I had 1 year of experience working in a lab. The dread that I felt over publishing some paper that barely interested me and still required tons of hours of programming, research of other papers, writing the paper, was exhausting. I respect the decision of someone to want to stay in academia, but I will run far, far away from it.

  • @georgezakusilo1584
    @georgezakusilo1584 3 місяці тому +9

    at least in biomedical sciences the problem is worse. not only certain labs pushing a lot of papers, but often times you start reading an article and realize instantly that it comes from a paper mill and it is an utter and complete BS. What you are learning to do is to go to conferences and see who is actually doing great, breakthrough science and you follow them and their work

  • @moradbali5858
    @moradbali5858 3 місяці тому +2

    Thank you for this video dear colleague!
    There is definitely a need for change.
    Worth part in all of this is that if you want to have a chance to work in academia, not only you need to publish, but also you need to publish in high ranked journals.

  • @MarkRuvald
    @MarkRuvald 4 місяці тому +14

    Stress, prestige, grants, pressure, pay-walls. No to change the world in a meaningful way, you have to have an audience. For long-form content that means blogs.

  • @bennetm9498
    @bennetm9498 Місяць тому +3

    I did my PhD 20+ years ago. I didn't like this game of publishing, so never sought a career in academia. I just curiously opened my Google scholar profile, I got total 2650 citations and still have a steady 100/per year citations. Considering I haven't published anything in last 20 years, so it is not too bad 😀

  • @0xnika
    @0xnika 3 місяці тому +18

    Thank you for sharing you opinions on this sensitive point! The only way to win in Academia is by playing the game, until the game breaks..

  • @Biondis_Okul
    @Biondis_Okul 3 місяці тому +1

    Without any interruptions he spoke for 21 minutes, such a talent 👏
    Know I start reconsidering my goals in the future. Thank you very much Andrey.

  • @noone-dv1jo
    @noone-dv1jo 4 місяці тому +15

    I’m not in academia and not sure how this got recommended - very interesting talk about the nuances of academia and how it works. My professor tried to give me a rough summary of industry vs. academia/ professor when I was thinking about my future, but honestly don’t think I’m smart enough for pure academia - but to your point it seems it can be stressful and hard to become successful in academia and not always to focus on developing the models or whatever the paper itself is about

  • @neelotpaldas5616
    @neelotpaldas5616 3 місяці тому +8

    Everyone in academia wants their research to have an impact in the real world. Unfortunately impact in real world cannot be measured by citations or impact factor, which academia does.

  • @jasonl3254
    @jasonl3254 Рік тому +4

    I enjoy listening to your insights into academia

  • @johannystrom-persson2966
    @johannystrom-persson2966 3 місяці тому +1

    I couldn't agree more with your points. Thank you so much for speaking up.

  • @MohamedTarek-vt4lb
    @MohamedTarek-vt4lb 3 місяці тому +1

    Very informative! Thank you and hope things got better for you❤

  • @timng9104
    @timng9104 11 місяців тому +37

    i am a postdoc in materials, and very similar observations. I feel like a writer more than a scientist sometimes

    • @mechatronicsfun4467
      @mechatronicsfun4467 3 місяці тому +5

      Go to industry. Nobody will ask you for journal publications there.

  • @leonardodossantosferreira3496
    @leonardodossantosferreira3496 3 місяці тому +16

    As a first year PhD student, I relate a lot with what you said in the last comments of the "Publishing pressure" section. The will to be creative and to develop my own identity as a scientist is always trimmed by the pressure to publish in order to advance and achieve "relevant" positions as a scientist.
    Once I heard a scientist say that our evalutation of academic and scientific merit should not be a process that a computer could do alone, by merely counting some numbers and parameters. I absolutely agree with that idea, but it seems that without a major change, thing will converge exactly to the point where adimissions to post docs, PhDs and even to permanent positions will be made merely through numbers.
    Great video.

  • @promer4690
    @promer4690 28 днів тому

    Thanks for sharing. I am not in academia but found the topic very interesting and started to watch. Your concerns are spot on.

  • @parkerstroh6586
    @parkerstroh6586 3 місяці тому +2

    Awesome video, this is exactly the kind of things I’ve been wondering

  • @Elkatar
    @Elkatar 5 місяців тому +24

    here is a likely solution: If you hold a position in academia while also working part-time in another field, such as industry, you'll find yourself less reliant on academic metrics. The citation system follows an exponential pattern, where older works gain popularity and significantly contribute to an individual's H-index, explaining around 80% of it.

  • @TheAmazingMooCow2
    @TheAmazingMooCow2 3 місяці тому +4

    Once I started my PhD it was quite eye-opening to see how many of my colleagues and other academics in my department had parents/grandparents/other family in academia; not to say there's anything wrong with that of course but with the academic landscape as it is it seems that its a lot harder to succeed without pre-existing connections that know how the game works

  • @mitchumsport
    @mitchumsport 3 місяці тому +1

    i loved your explanation of the impact on creativity. it has been hard for me to state in the past.

  • @feifeizhang7757
    @feifeizhang7757 4 дні тому

    Thanks for sharing your experience

  • @wojpaw5362
    @wojpaw5362 3 місяці тому +2

    Very insightful, thank you. I am considering doing a PHD but this made me a realise that perhaps working as a research assistant might be better.

  • @meamzcs
    @meamzcs 3 місяці тому +12

    Imo my main problem with citation count as a metric is mainly two things:
    1. if you look at the most cited papers in a field more often than not you will find some overview papers that just summarize prior research at the very top. I mean, yes, those papers are fine and important but without the original research before them they are nothing.
    2. Sometimes there's research that is so advanced that only a small handful of other very top notch research groups on earth can make good use of those results even though they might allow for much better results than everything else.

  • @nickh7681
    @nickh7681 3 місяці тому +18

    This is precisely why I wanted to go into industry despite my love of math. As long as you can create value for your company doing what you love, then you can be as creative and diligent as you would like

    • @danimaster6647
      @danimaster6647 3 місяці тому +8

      You face similar challenges in the industry. The issue with founding is even more accelerated there and your project can be canceled at any time. Everything is about money (your solution has to be cost effective and easy to implement). Also selling your solutions to stakeholders is even more important than in academia

    • @nickh7681
      @nickh7681 3 місяці тому +1

      @danimaster6647 I agree to some extent. It's highly position dependent. If I can fulfill everything my employer asks of me and also generate value with my math projects, then, over time, I can spend an increasing amount of time on such math projects. In fact, I can eventually create a new team within the business. If it's all about money and I generate revenue which we otherwise wouldn't generate, then I earn greater freedom to do what I want to. With regards to stakeholders, that depends on the structure of the company. I've never worked somewhere so small or been so senior such that I'm actively interacting with stakeholders to the extent that they are aware of how I spend my time each month

    • @danimaster6647
      @danimaster6647 3 місяці тому

      @@nickh7681 I also agree to some extend since it's very true that the more value you create the more freedom you have. With "stakeholder" I meant the person who has an interest in your project and is involved in the founding part. In our company there is politics involved where sometimes great ideas are lost and others (which in my opinion) are dead ends are followed because of the opinion of some board members. The ressources which are allocated is also a matter of politics in our company. This isn't to say working in the industry is a bad joice. Above all you get proper money

    • @jacksonsmith2955
      @jacksonsmith2955 3 місяці тому +4

      mannn this stuff is terrifying. i'm a high schooler with a tentative love of math, but i don't actually know enough math to know exactly where my interests lie or if I'm even good at it, and everything i hear about academia and industry sounds horrific. maybe i should just grab an electrical engineering degree or something instead.

    • @nickh7681
      @nickh7681 3 місяці тому +3

      @jacksonsmith2955 If you love math and are good at it, then you have nothing to worry about. Stay humble, work diligently, and don't neglect practical skills like programming, machine learning, data science, etc. Also, don't forget to do the normal career stuff like networking and internships. If you're bright, you'll figure it out. Again, stay humble, be patient, and work diligently

  • @Avento8
    @Avento8 9 днів тому +1

    I also left academia after being thoroughly disappointed with the system. As a Ph.D. I realized that no one actually reads papers/theses because they're so hard to understand. So I wrote my Ph.D. thesis as a textbook: starting from master-course level, building up with examples, exercises, background appendices, and so on, up to the level of my own published papers. My students loved it. My thesis committee didn't: it was rejected. I had to write my thesis as paper-style: condensed and incomprehensible to anyone but a veteran in the field.
    What followed was a year of evening-time rewriting (without getting paid) merging all my papers into a very dense thesis. This was in the end accepted and I got my Ph.D. degree. Now, six years later, I still get regular emails from random people thanking me for my free introductory textbook thesis. It helped them a ton to get familiar with the field. I never got a single email about any of my papers or my rewritten Ph.D. thesis.
    Conclusion: no one needs papers. (Sure, with a very few exceptions.) We generally need clear and high-quality educational materials. But the system only forces us to write papers and rejects anything else. The system is broken.
    The above video also shows really well how the system is broken. Sadly the solutions provided are "How to survive and thrive within this broken system" and not "How to actually fix this system, so science can start making an impact and improving the world again."

  • @trucksanddirt1506
    @trucksanddirt1506 3 місяці тому +4

    Excellent contribution. I have thousands of citations, but I know people who never did any work, they don't even understand what is in the paper. They find people who put their names on papers and them. Then they turn around and brag that they are great.

  • @olivermechling7975
    @olivermechling7975 3 місяці тому +4

    very interesting perspective I have never thought about research in this way before (don't have any experience yet just a masters student). thanks for making the video and best of luck for your future.

    • @rituparn1
      @rituparn1 3 місяці тому +1

      Better not get into this grind while you still have time. When you really have something novel, the motivation to publish will automatically come. Only then you publish. Until then, get an actual job

  • @strayorion2031
    @strayorion2031 3 місяці тому +5

    I think its time to start discussing alternatives to the metrics used today, actual material things that we can ask institutions to do, to start to walk away to the horrible state of academia today. I havent tought of alternatives but i would like to see the discussion turning into what should academia be, and how do we get there

  • @fractal_gate
    @fractal_gate 2 місяці тому

    Thank you for bringing this topic to light.

  • @modalmixture
    @modalmixture 3 місяці тому +4

    Thanks for sharing your perspective on this. I have noted the overall quality of papers going down the toilet over the last ten years. Even when the research itself is good, the writing is badly in need of an editor; captions contain typos; figures are poorly designed and sloppy. And your comments suggest why this might be - the incentives at work in academia seem to be producing increasingly sloppy science communication as researchers prioritize quantity over quality.

  • @friendlyboylulea
    @friendlyboylulea 3 місяці тому +7

    Great videa. It's so good that yoy are sharing your thoughts with the public. Having been going through similar thoughts and challenges myself, I have a few points that helped me grab my hand around this whole paper problem:
    -I saw many equations and I think you work on modelling/simulation. In such mathematical fields, much fewer citations are common because people tend less to rely on other people's models. In contrast, in psychology and human sciences, a lot more citations occur because they have to make their points by citing other qualitative arguments. So, 4 citations for a psychology paper published in 2021 is bad but maybe it is not that bad for your paper given the mathematical nature of your field.
    - At the end of the day, the number of citations, h-index, etc. do not matter that much. A serious hiring committee often hires experts in your field who read your papers and judge the scientific quality of them.

    • @chuscience
      @chuscience  3 місяці тому +2

      Thanks for the comment. Indeed, I had a few academic interviews recently and noticed that clever academics avoid suspicious researchers with tons of publications. They would rather invite an adequate person with a team mentality.

  • @alcyonecrucis
    @alcyonecrucis 3 місяці тому

    Excellent, hope you get to discuss your paper with others soon 😊

  • @mohammedyaya0
    @mohammedyaya0 3 місяці тому +2

    I wish someone told me this before I joined academia!! Well said Dr. Andrey

  • @cocs88715
    @cocs88715 3 місяці тому +11

    Got off this academia treadmill two years ago and never regretted. All my fancy high impact factor papers mean absolutely nothing outside of academia.

  • @niconeuman
    @niconeuman 4 місяці тому +5

    Very interesting video! I agree with what you say. The measurements have become the objectives

    • @carpediemcotidiem
      @carpediemcotidiem 3 місяці тому +1

      Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure."

  • @bestpakistan1478
    @bestpakistan1478 3 місяці тому +1

    Dear Sir, I totally agree from your entire discussion. The malpractices are actually common in the academia and lethally crushing the impact factor standards that could produce a change in society. Regards,

  • @a_bar8579
    @a_bar8579 3 місяці тому +2

    Specifically the academic field needs as many creative geniuses as you have in 6 years you have discovered all this and this is amazing

  • @RobinTheBot
    @RobinTheBot 3 місяці тому +6

    Wow! Who could have known trying to force fundamental research into a profit system could have downsides.

  • @freeman1379
    @freeman1379 3 місяці тому +3

    This is exactly why I quit my Ph.D. I have the utmost sympathy for you and anyone finding themselves in this situation.

    • @kanao2007
      @kanao2007 2 місяці тому +1

      Congrats!! I've been under constant publishing pressure and useless reportings since 1st yr, in the 2nd yr I started a job secretly so I safely quit . Now in the 3rd yr I am leaving this hell

  • @ax5344
    @ax5344 27 днів тому

    As a practitioner in the field, I do wish there were fewer papers and each could carry higher values. There are just tooooooo many papers for me even to glimpse from. Thanks for opening discussing this issue and sharing your insider observation!

  • @davip116
    @davip116 3 місяці тому +2

    Good points for such a young researcher. One thing I suggest is to avoid focusing too much on tools. Research is not programming nor visualization.

  • @KuopassaTv
    @KuopassaTv 4 місяці тому +12

    The answer is to do soft sciences -- easier to meet quantity over quality criteria

    • @chuscience
      @chuscience  4 місяці тому +14

      😂😂 I heard some academic discussions that “it is the computer scientists who have spoilt academia. They published a lot, so other researchers had to follow”.

    • @leohuang990
      @leohuang990 3 місяці тому +4

      @@chuscience Even in computer sciences, different subareas have drastically different life cycles for publishing a paper. It typically takes 3 months or less to finish a deep learning project while a year or more to finish an operating systems one.

    • @erroredhacker
      @erroredhacker 3 місяці тому +2

      its just the age of the science. more mature fields have longer history of established practices, higher barrier of entry in terms of novel contribution

  • @mrhelli105
    @mrhelli105 2 місяці тому +3

    I am a PhD student at the second year of course. Generally I don't write comments on social media, nor I expose myself as I'm about to do.
    Because of this "publish or perish" mechanism I already lost the opportunity to became a professor in the future. The philosophy of my tutor (and so of the research group I joined) is old style: focus on the application, on the project, on the code, make everything work as best as possible, and finally (after many months or a year sometimes) prepare the paper. In the last months I realised that such philosophy doesn't create succesfull academics nor even professors. When I realised that I felt really bad, because I knew a pretty important door was closing for my future. I'm pretty sure I will not be able to became a professor, and that still bothers me a lot.
    Your video has been shocking for me. I suddenly realised that maybe the philosophy of my professor is not that wrong. Ok I have to forget the academic career, but still the knowledge and skills that I'm building are precious and valuable. You video changed my mind and my approach.
    Thank you so much

    • @chuscience
      @chuscience  2 місяці тому +3

      Thanks for sharing your story. You still might be able to get academic positions if you show other things on your CV, for example, various projects you worked on, collaborations with industry, patents, etc. But yeah, it will be difficult. You will be competing with other researchers who have dozens of journal papers. Talk to academics who you know. Maybe they can give you better advice on whether or not to stay in academia. Good luck with your PhD!

    • @mrhelli105
      @mrhelli105 2 місяці тому

      @@chuscience Thank you so much for the advices.
      You just obtained a new subscriber!
      You seem a very professional and capable researcher. Good luck for your career

  • @roderickdewar1064
    @roderickdewar1064 3 місяці тому +1

    Bravo. This needs to be discussed more openly within and without academia. The rot set in with the marketisation of universities, meaning only $$ matters. Universities no longer prioritise scholarship. They prioritise $$.

  • @testboga5991
    @testboga5991 3 місяці тому +1

    Very wise insights!

  • @realGBx64
    @realGBx64 3 місяці тому +14

    60 citations in 3 years is amazing. What I found very dishartening when I saw that all the citations I get are just general citations in introduction like [12-24] and mine is 18 😂

    • @chuscience
      @chuscience  3 місяці тому +16

      True. I also noticed that my papers got cited in that way, which means that they were selected just because of their titles or abstract/figures, without a thoughtful intention to use/develop my work.

    • @erroredhacker
      @erroredhacker 3 місяці тому

      ​@@chuscienceis this the reason why people are so anal about """"good"""" abstracts/conclusions?

    • @dizgil6881
      @dizgil6881 Місяць тому

      Same here. Out of about 30 citations, probably 5 are from my other work and 20 from general sentences. Then i get the researchgate notification "youve been cited!" Go to read said paper, and im like sooo why did they cite me? Just because it says bayesian in the title i guess

  • @AcesAndNates
    @AcesAndNates 3 місяці тому +5

    LOVE the shirt

  • @NewWorldCricket
    @NewWorldCricket День тому

    great, insightful video

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 4 місяці тому +2

    This is really informative

  • @sirmclovin9184
    @sirmclovin9184 3 місяці тому +8

    I think there are two main problems to understand this:
    1) Everyone can count, but few can read. Too often those people make hiring decisions.
    2) Capitalist overproduction: The companies owning the journals extract wealth from the public sphere and they do that by selling papers written by publicly funded researchers. The more papers, the more they can sell. So they then lobby the government to implement policies that maximize their profit. It does not matter that the extreme output of papers does not necessarily translate to good science, as long as the money machine is alive and well.

  • @Danila1
    @Danila1 4 місяці тому +4

    Obviously an alternative to papers is needed, so that focus is removed from the paper publishing. I would suggest a new format is needed. One example is large scale collaboration such as the IPCC reports. The scientists will not be measured for their individual contributions in the form of a finished paper, but will be judged for the overall work.

  • @hosszu2010
    @hosszu2010 29 днів тому

    Your creativity point is so true. People love milking out many papers from the same idea. Find a goldmine to make tenure. Other point is p-hacking, very prevalent in social sciences, and the non-publication of null results. Make the whole exercise questionable.

  • @ade1174
    @ade1174 24 дні тому

    Thanks for this video. As someone finishing a PhD in chemistry, I was interested in academia when I started, but I'm now looking at exclusively jobs in industry because I am so tired of the publish or perish climate in academia with so many good papers that go unread because everyone is focusing on their own work. My third paper was just accepted for publication, and it's the one I'm most proud of. Even if it gets relatively ignored, I'm happy about the insights that I was able to contribute in it.

  • @L4wr3nc3810
    @L4wr3nc3810 3 місяці тому +4

    Why do i have a feeling that every single person in our society is totally exhausted

  • @0MVR_0
    @0MVR_0 3 місяці тому +3

    Academia is beholden to the dictate of fiscal capture,
    just as theory must work within natural laws.
    In this generation of scientists and statisticians,
    every knowledge worker must be smarter than a generative pretrained transformer.

  • @martin128
    @martin128 3 місяці тому +2

    My friend was also in Phd and he said also that he was quite unmotivated writing papers since nobody will read them. He also had problems with supervisor that had problems with his papers.

  • @ahmedamanibrahim192
    @ahmedamanibrahim192 3 місяці тому

    Thanks so much for this video! I'm planning to start PhD soon, and this was very eye opening

    • @chuscience
      @chuscience  3 місяці тому +2

      Hi! Don't get me wrong, there are many benefits of doing a PhD. But be prepared for the paper game and the limited impact of your publications. Good luck!

  • @xhivo97
    @xhivo97 3 місяці тому +3

    What kind of (impactful) research only takes a year? This is kinda insane to me to have a minimum

  • @semsomify
    @semsomify 3 місяці тому +9

    I regret starting my PhD, it now all feels like a scam. The university wants me to publish 3 journal papers to be able to graduate, one of them has to be in a reputable journal, and all my supervisor cares about is those papers. The university wants to increase its global rank so it can attract more students and my supervisor as well. It doesn’t matter what the topics of these papers are.
    Publication is a nasty business too.
    I regret this path and so happy that I kept my job and my other career path. I probably will never return to academia after I graduate.

  • @y.t1670
    @y.t1670 Місяць тому +2

    I work in the industry and occasionally publish conference papers with PhD students we cooperate with. Our papers are more industrial and engineering oriented. And I’m proud to say our papers do provide valuable insights for industry at least, and we got some follow up query from industrial partners. And in my daily engineering role, I also often search for prior art and read carefully the most relevant papers. Mostly conference papers, almost never journal papers. And I do ignore the only academia oriented papers, because they are too theoretical and no practical engineering implementation mentioned, and of course very often too difficult for me to even read through the formulas in the academic papers, let alone understanding them.
    For the papers I coauthored, most of the time I’m responsible for most part of the implementation and validation experiments, and also 70% of the whole draft of the papers. And yes, when I’m writing a paper with a submission deadline, I work till midnight and on weekends.
    And when we look for conferences to submit to, we prefer IEEE or ACM as the basic requirements. Then we look at the committee. We’d like to see committee members from the industry, preferably from our customer companies. If the committee consists of only professors, the conference won’t be at the top of our list. And yes, we often got the comment from our professors partners that our paper is not academic enough. But I also want to mention, the professors cooperate with our company, are smart and very knowledgeable people. The professors ask good questions and provide good insights and help us sharpen our research direction and experiment design.
    In short, I love working with academias as an engineer in Industry. I guess I won’t be happy in a die hard academic environment. I love engineering and I love to have some good academic guidance for my industrial research. I love writing papers to present my industrial research results.

    • @chuscience
      @chuscience  Місяць тому

      Thank you for sharing your story! Sounds like a great balance between publishing and implementation.
      May I ask you how many papers you write or co-author per year?
      Andrey

  • @metalslegend
    @metalslegend 2 місяці тому +2

    Thank you for this reality check. I see some researchers in Psychology cope with this by for example dissect the same dataset multiple times, for different research questions each time. I saw one Post Doc publishing about 20 papers a year, all with the same dataset. Its a weird system.

  • @AlFasGD
    @AlFasGD 3 місяці тому +4

    Growing up until now, I have started to lose my sense of value for academic literature around this era. Given the recent scandals and the system you describe, it's hard to absolutely trust the results of a paper in any field, unless it's something so easily provable that you can even experiment with it in your own house. Generally, I have lost a lot of trust seeing how society itself behaves, and academia was no exception to this epidemic. You can only keep doing what you truly desire, or quit academia entirely and find your own suit in something that values your presence and does not abide to a broken underlying system.

    • @Talleyhoooo
      @Talleyhoooo 3 місяці тому

      Criticism in academia is warranted, but completely abandoning trust in published research leans me to think that maybe you haven’t spent much time in the research field in order to justifiably have that stance. Did you watch this video at all? You’re referencing scandals as your reasoning for ‘losing value in academia’ while his issue derives from the intense amount of time and effort in order to meet the level of scrutiny for publishing, and the low gratification resulting from that. Peer review isn’t perfect, but your lack of trust only shows that you probably haven’t been involved with the research field at all.