Logo del repository
  1. Home
 
Opzioni

Causal Text-to-Text Transformers for Water Pollution Forecasting

Roitero K.
•
Gattazzo C.
•
Zancola A.
altro
Mizzaro S.
2022
  • conference object

Abstract
We propose a novel approach based on large language causal models to perform the task of time-series forecasting, and we use the proposed approach to effectively forecast the concentration of polluting substances in a water treatment plant; we address both short- and mid-term forecasting. As opposed to the classical state-of-the-art approaches for time-series forecasting, that handle numerical and categorical features following a standard deep learning approach, we transform the input features into a textual form and we then feed them to a standard causal model pre-trained on natural language tasks. Our empirical results provide evidence that large language models are more effective than state-of-the-art forecasting systems, and that they can be practically used in time-series forecasting tasks. We also show promising results on zero-shot learning. The results of this study open up to a wide range of works aimed at predicting future temporal values by leveraging natural language paradigms and models.
Archivio
https://hdl.handle.net/11390/1263144
info:eu-repo/semantics/altIdentifier/scopus/2-s2.0-85171267037
https://ricerca.unityfvg.it/handle/11390/1263144
Diritti
open access
Soggetti
  • Deep learning

  • Language model

  • Time-series forecast

google-scholar
Get Involved!
  • Source Code
  • Documentation
  • Slack Channel
Make it your own

DSpace-CRIS can be extensively configured to meet your needs. Decide which information need to be collected and available with fine-grained security. Start updating the theme to match your nstitution's web identity.

Need professional help?

The original creators of DSpace-CRIS at 4Science can take your project to the next level, get in touch!

Realizzato con Software DSpace-CRIS - Estensione mantenuta e ottimizzata da 4Science

  • Impostazioni dei cookie
  • Informativa sulla privacy
  • Accordo con l'utente finale
  • Invia il tuo Feedback