MLBBQ: “Are Transformers Effective for Time Series Forecasting?” by Joanne Wardell

Поділитися
Вставка
  • Опубліковано 29 лют 2024
  • “Are Transformers Effective for Time Series Forecasting?”. This was one of the “most Influential AAAI Papers” of 2023 based on citations. The authors introduce a set of embarrassingly simple one-layer linear models named LTSF-Linear for comparison to Transformers.
    arxiv.org/abs/2205.13504
    www.paperdigest.org/2023/09/m...

КОМЕНТАРІ • 6

  • @DunlopJ
    @DunlopJ Місяць тому

    No mention of PatchTST Transformer from "A Time Series is Worth 64 Words: Long-term Forecasting with Transformers"?

  • @mmattb
    @mmattb Місяць тому

    Great discussion and a sharp group! Around 32:27 one of the commenters mentioned a paper analyzing noisy multivariate dynamical systems and that under the CLT they may appear linear. Are you able to link me to that result? I'd love to see it.

    • @SergeyPlis
      @SergeyPlis  Місяць тому +1

      here's an empirical look at the brain arxiv.org/abs/2012.12351
      and theoretical papers, that I guess have inspired that investigation:
      Spatial averaging: ieeexplore.ieee.org/document/9993260
      Temporal averaging: ieeexplore.ieee.org/abstract/document/10155808
      HTH

    • @mmattb
      @mmattb Місяць тому +1

      @@SergeyPlis those looks like good fun! Thanks a bunch Sergey.

  • @pranavishnoi20
    @pranavishnoi20 3 місяці тому

    So we can say this paper is Haox