Apparatus, method and storage medium for data query
A question-answering system including a large language model stores history query information in a vector database and history query results in a scalar database; an incoming query is matched against the stored history so the result can be returned without re-running LLM inference, reducing latency and cost.