Terms-text encoding, text decoding, embedding

• text encoding

text -> integer

ex) [2,4,6,1]

 

It can be said 'input ids' after convert to integer.

 

• text decoding

integer -> text

 

• embedding

(1d)text encoding -> (2d)vector

ex) [[2,4,6,1]]

 

• data

input ids, vector

 

• trainable parameters

embedding layer, attention encoder, attention decoder