Logo del repository
  1. Home
 
Opzioni

Multimodal feature fusion for concreteness estimation

Incitti F.
•
Snidaro L.
2022
  • conference object

Abstract
In recent years the idea of fusing diverse type of information has often been employed to solve various Deep Learning tasks. Whether these regard an NLP problem or a Machine Vision one, the concept of using more inputs of the same type has been the basis of many studies. Considering NLP problems, attempts of different word embeddings have already been tried, managing to make improvements to the most common benchmarks. Here we want to explore the combination not only of different types of input together, but also different data modalities. This is done by fusing two popular word embeddings together, mainly ELMo and BERT, with other inputs that embed a visual description of the analysed text. Doing so, different modalities -textual and visual- are both employed to solve a textual problem, a concreteness task. Multimodal feature fusion is here explored through several techniques: input redundancy, concatenation, average, dimensionality reduction and augmentation. By combining these techniques it is possible to generate different vector representations: the goal is to understand which feature fusion techniques allow to obtain more accurate embeddings.
DOI
10.23919/FUSION49751.2022.9841390
WOS
WOS:000855689000160
Archivio
https://hdl.handle.net/11390/1232106
info:eu-repo/semantics/altIdentifier/scopus/2-s2.0-85136578013
https://ricerca.unityfvg.it/handle/11390/1232106
Diritti
closed access
Soggetti
  • Autoencoder

  • BERT

  • CLIP

  • Concreteness estimati...

  • Dimensionality reduct...

  • ELMo

  • Feature fusion

  • Multimodal feature le...

  • NLP

  • Word Embeddings

google-scholar
Get Involved!
  • Source Code
  • Documentation
  • Slack Channel
Make it your own

DSpace-CRIS can be extensively configured to meet your needs. Decide which information need to be collected and available with fine-grained security. Start updating the theme to match your nstitution's web identity.

Need professional help?

The original creators of DSpace-CRIS at 4Science can take your project to the next level, get in touch!

Realizzato con Software DSpace-CRIS - Estensione mantenuta e ottimizzata da 4Science

  • Impostazioni dei cookie
  • Informativa sulla privacy
  • Accordo con l'utente finale
  • Invia il tuo Feedback