A mechanism within Transformer-based models allowing them to discern relationships among tokens in an input sequence, thereby informing the output generation process.

Authority Links

A ChatGPT Glossary