Skip to content

example test code on huggingface doesnt work #204

@zhihangliuuoa

Description

@zhihangliuuoa

Use the example on huggingface and github repo, test on tfns dataset.
The model can only generate a answer to certain sentence.

Prompt example:
Instruction: What is the sentiment of this tweet? Please choose an answer from {negative/neutral/positive}
Input: $ALLY - Ally Financial pulls outlook https://t.co/G9Zdi1boy5
Answer:

Total len: 2388. Batchsize: 16. Total steps: 150
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 150/150 [00:48<00:00, 3.12it/s]
len label, len dataset 2388 2388
out_text_list [' Negative', '', ' Negative', '', '', ' negative', '', '', '', '', '', ' Negative', '', '', ' Negative', ' Negative', '', '', '', '', '', '', '', '', '', '', '', '', ' Negative', '', '', '', '', '', '', '', '', '1', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '1', ' positive', '', '', ' Positive', '', '', '', '', '', '', ' Positive', ' Positive', '', ' Positive', '', '', '', '', '', ' positive', '', '', '', '', '', '', '', '', '', '', '', '', '1', '1', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '0', ' negative', '', '2', '', '', '', '1', '', '', '', '0', '', '', '', '', '', '', ' neutral', '', '', '', '', '1', '', '', '', '', '', '', '0', '', '0', '', '', '', '', '', '1', '', '', '', '', '', '', '', '1', '', '', '', '', '', '', '0', '', '', '', '', '', '', '', '1', '', '', '1', '2', '1', '', '', '', '1', '', '', '', '', ' negative', '', '', '', '', '', '', '', '0', ' negative', ''

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions