I am trying out some BERT based models for a question and answering task. I need models trained on squad v2.0. To cut down on the inference time , I'm trying out pruning. I came across the BERTology example script for pruning. However, I'm confused by some of the required parameters in the file:
- data dir: This parameter is not being used anywhere in the script, so I've set the 'required' parameter to False.
- task_name: A similar parameter was required by the Retro Reader model, and i used task='squad' there which worked, but here it shows 'task squad not found'
- model_name_or_path: 'deepset/roberta-base-squad2'
What should be the correct parameters for this file to run?
