- text encoding
text -> integer
ex) [2,4,6,1]
It can be said 'input ids' after convert to integer.
- text decoding
integer -> text
- embedding
(1d)text encoding -> (2d)vector
ex) [[2,4,6,1]]
- data
input ids, vector
- trainable parameters
embedding layer, attention encoder, attention decoder
'Deep Learning' 카테고리의 다른 글
| encoding vs embedding (0) | 2022.12.08 |
|---|---|
| BPE(Byte Pair Encoding) (0) | 2022.11.30 |
| Word2Vec (0) | 2022.03.29 |
| How to learning of DL (0) | 2022.03.17 |
| Activation function (0) | 2022.03.17 |