Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [question-answering]

28 questions
6
votes
2 answers

Question answering (QA) vs Chatbots

Are Question answering (QA) the same as Chatbots? I can not understand the difference between them. For me it's the same thing: interact with a robot that answers questions.
ladybug
  • 161
  • 1
  • 3
4
votes
1 answer

Bert for QuestionAnswering input exceeds 512

I'm training Bert on question answering (in Spanish) and i have a large context, only the context exceeds 512, the total question + context is 10k, i found that longformer is bert like for long document, but there's no pretrained in spanish so, is…
Simone
  • 242
  • 2
  • 9
4
votes
1 answer

Answer to Question

Looking for a system which can generate answers to questions. Most systems and blogs posted on internet are on Question to answer but not on answer to question or paraphrasing or keyword to questions. Seq2Seq I tried and even after training for many…
Sandeep Bhutani
  • 884
  • 1
  • 7
  • 22
2
votes
2 answers

Group unstructured chat logs into conversations

I am new to ML/AI/NLP and am interested in tackling the following problem. I have a database of chat logs from a Discord server. The database contains the following labeled data: Author, Text, Text Created Timestamp, and Channel ID. I think what I…
imaginative
  • 21
  • 3
1
vote
1 answer

Pretrained models for Propositional logic

Are there any pretrained models which understand propositional logic? For example, the t5 model can do question-answering. Given a context such as "Alice is Bob's mother. Bob is Charlie's father", t5 can answer the question "Who is Charlie's father"…
androidguy
  • 113
  • 2
1
vote
0 answers

Best way to suggest answers given historical question-answer pairs

Many question-answering implementations focus on extracting information from large documents/corpora of text such as Wikipedia. I have access to a full chat log from the customer service of a large electronics company and I'm wondering if I can use…
Joep
  • 11
  • 1
1
vote
0 answers

How to process list type questions in Question Answering task

How to generate question-answer-context triplets for questions with multiple answer strings? How to measure performance for it? For a question with one single answer, we generate one question-answer-context triplet, and calculate EM/F1 score. Then…
Qian
  • 11
  • 1
1
vote
1 answer

Select best answer from several existing ones for a question

After analyzing questions on a forum, a human support team has created a set of general answers, that can be used to provide basic answers on the forum. I am trying to build a system that: Selects best answer from this set of answers for a given…
dokondr
  • 295
  • 3
  • 11
1
vote
0 answers

Options to find the most similar question in a dataset of question-answer pairs?

I am building a chatbot that will only handle FAQs, but these FAQs are very specific to an organisation, so I cannot use any existing off-the-shelf solutions, or connect to question-answering APIs. I have a dataset which consists of questions,…
KOB
  • 189
  • 6
1
vote
0 answers

Meaningful Information retrieval and question answering for unstructured data - Is it even possible?

Hello good NLP people, I am working on a task that gradually seems not solvable for me. My data-set consists of long, messy, unstructured documents (pdfs, doc, docx, scans with tables, graphs, text, etc) and the client wants to obtain a system that…
XsLiar
  • 111
  • 5
1
vote
1 answer

Measuring quality of answers from QnA systems

I am having a question answering system which is using Seq2Seq kind of architecture. Actually it is a transformer architecture. When a question is asked it gives startposition and endposition of answer along with their logits. The answer is formed…
Sandeep Bhutani
  • 884
  • 1
  • 7
  • 22
1
vote
0 answers

Is it possible to access "Data Science" on Stack Exchange using an API?

I am a programmer with C and Python knowledge. I am trying to "educate" or train my Chatbot with name "Stella" in "Science and Technology History" and related areas, helped by ChatGPT 3.5. I am already using contents provided by Wikipedia, but some…
user545577
  • 11
  • 1
1
vote
1 answer

Model to implement Question Answering System over structured data

I need to write a program(like a chatbot) that retrieves an answer from a CSV datafile based on a question user asks. So for example if the CSV stores list of products and its specifications in 5-10 columns, then if a user asks a question about…
aninfgroupoid
  • 11
  • 2
1
vote
0 answers

global contrast normalization implementation

I'm trying to understand figure 12.1 in Goodfellow available here. I'm not able to reproduce figure 12.1, and I'm wondering what is it I'm missing. The denominator of equation 12.3 is a constant, and thus equation 12.3 reduces to a subtraction and a…
NNN
  • 113
  • 5
0
votes
2 answers

Question answering bot: EM>F1, does it make sense?

I am fine-tuning a Question Answering bot starting from a pre-trained model from HuggingFace repo. The dataset I am using for the fine-tuning has a lot of empty answers. So, after the fine tuning, when I'm evaluating the dataset by using the model…
SilentCloud
  • 53
  • 4
1
2