Feature #353
Updated by Ritwik Sinha about 2 months ago
This unit is responsible for analysing the user-prompts and extract topics and main questions from these prompts. This can be divided into two sections 1. Embeddings (Transformer-based): Use sentence-transformers to convert existing user prompts into vector embeddings. 2. Topic Discovery: use bert Topic to analyse long texts and categorise them into topics https://github.com/MaartenGr/BERTopic.