text encoding text -> integer ex) [2,4,6,1] It can be said 'input ids' after convert to integer. text decoding integer -> text embedding (1d)text encoding -> (2d)vector ex) [[2,4,6,1]] data input ids, vector trainable parameters embedding layer, attention encoder, attention decoder