4ab46088eec4,044

http://nhiro.org.s3.amazonaws.com/c/7/c700fc28df97e3b5bebdfcf3478b95d1.jpg https://gyazo.com/c700fc28df97e3b5bebdfcf3478b95d1

(OCR text)

45

Class

Class

Label

Label

TN

TISEP

TM

C

т,

T2

TN

T,

BERT

BERT

EM

E.,

EISEP

EN

ErCLSI

EN

E,

E2

Tok

Tok

Tok

Tok

Tok 1

Tok N

CLS]

Tok 2

CLS)

SEP]

M

Sentence 1

Sentence 2

Single Sentence

(a) Sentence Pair Classification Tasks:

MNLI, QQP, QNLI, STS-B, MRPC,

RTE, SWAG

(b) Single Sentence Classification Tasks:

SST-2, COLA

Start/End Span

О

B-PER

T2

T,

TM

TT

ISEP]

BERT

BERT

EM

EISEP)

EICLS)

E,

EN

E.'

EN

EICLS)

E,

E2

Tok 1

Tok N

Tok

Tok

Tok

Tok

Tok 2

CLS]

SEP]

1

N

M

Question

Paragraph

Single Sentence

(c) Question Answering Tasks:

SQUAD v1.1

(d) Single Sentence Tagging Tasks:

CONLL-2003 NER

T-

T