Questions tagged [chatgpt]
5 questions
1
vote
1 answer
How to measure accuracy of GPT model
I am working on a model to build questions automatically from some text
My model will analyse provided article and ask authors questions that can help improving their articles
How can we measure the accuracy of these ML-generated questions?
There is…
asmgx
- 539
- 2
- 17
0
votes
1 answer
Why do GPT models use a transpose of the embedding matrix to convert outputs to logits?
According to section 3.1 of the original GPT paper, GPT right-multiplies the final output vectors (after applying a Transformer decoder model) by the transpose of the embedding matrix, before applying a softmax. See this comment for further…
jskattt797
- 123
- 3
0
votes
0 answers
How can GPT4 be used to create structured meta-data for unstructured data?
I often ingest unstructured datasets in Excel format, create meta-data, and transform the data in R to create a structured dataset. This includes normalization, so that there is little redundancy in the output tables. The output is tidy, whereas the…
ahorn
- 101
- 2
0
votes
0 answers
What is the input and output of GPT model for fine-tuning?
From my understanding, for the pretraining of GPT model, we need to do next token prediction task.
In this case,
Input -> The GPT models are general-purpose language models that can perform ... (2048 tokens)
Output-> GPT models are general-purpose…
Kyuwan
- 1
0
votes
0 answers
Is it a problem to store your vector database in memory?
I'm learning ChatGPT/LLM Development and am regularly coming across all different kinds of vector database implementations.
Some of them, e.g. Chroma, currently only support in-memory implementations for Python.
My initial reaction when I read that…
codeananda
- 268
- 3
- 10