27–31 May 2024
ECT*
Europe/Rome timezone

Learning correlations between "characters" by a nano-GPT

31 May 2024, 10:15
45m
Aula Renzo Leonardi (ECT*)

Aula Renzo Leonardi

ECT*

Strada delle Tabarelle 286, I-38123 Villazzano (Trento)

Speaker

Ouraman Hajizadeh

Description

In this exploratory study we investigate the correlation between different elements of the output sequence of a GPT. The dependence of this correlation on positions of elements as well as on hyper parameters of the model is investigated. The connection with validation metrics is explored too.

Primary author

Presentation materials