Questions tagged [bart]
5 questions
1
vote
1 answer
dealing with HuggingFace's model's tokens
I have a few questions regarding tokenizing word/characters/emojis for different huggingface models.
From my understanding, a model would only perform best during inference if the token of the input sentence are within the tokens that the model’s…
user113789
- 11
- 1
1
vote
0 answers
Huggingface Library - Multi-document summarization
Can BART, PEGASUS ... etc. API in huggingface library be used to directly perform multi document summarization?
(e.g. here: https://huggingface.co/transformers/model_doc/bart.html)
asahi kibou
- 143
- 1
- 5
1
vote
1 answer
how to convert pandas plot to OO Matplotlib bar chart
I am trying to convert pandas dataframe bar plot to matplotlib OO concept.
(npy_dataframe["Complaint Type"].value_counts()).head().plot(kind="bar")
this live perfectly working and generating bar chat attached
now this is my OO matplotlib trying to…
Dharmeshsharma
- 121
- 3
0
votes
1 answer
Question of pretraining text-generation task, it seems that pretraining is not work for a small model?
My task is to generate keywords from sentences.
I pretrain a text-generation model. I mask the sentences' tokens and predict the whole sentences' tokens.
Pretraining batch_size = 8 and step = 1000000
I haven't observed improvement from pretraining.…
DunkOnly
- 661
- 1
- 7
- 16
0
votes
0 answers
Hugging face Model Output 'last_hidden_state'
I am using the Huggingface BERTModel, The model gives Seq2SeqModelOutput as output. The output contains the past hidden states and the last hidden state.
These are my questions
What is the use of the hidden states?
How do I pass my hidden states to…
Fhunmie
- 17
- 6