- Joined
- Sep 5, 2023
Thought of a fun project last night and I'm curious if anyone has ideas for how I could apply this. I've got a huge archive of everything from Cobra's current channel which I'm currently waiting for compression to finish on. The plan is this:
1. Generate captions using Whisper
2. Vectorize and index all the captions that Whisper generates into a searchable FAISS index
3. Connect the FAISS index to a language model like Claude 3 Haiku or GPT-3.5, so you can ask a question like "What was Cobra's childhood like?" and get an immediate answer with citations to matching videos
I was thinking this would be good for writing wiki articles in MediaWiki format, but I don't really wanna host a wiki. I previously did this for the Tony Chase Wiki and it worked pretty well. Does anyone know if there's an existing Cobra wiki that isn't hosted on something like that multi-wiki hub site? I kinda don't want to contribute to one of the multi-wiki sites because I know it's bound to get taken down sooner or later.
Another idea I had was to just let people use the chatbot on a custom domain and not attach a wiki. Imagine a site with a format sort of like ChatGPT's website, but the only thing it's meant for is to answer questions about Cobra and provide citations.
The final idea I had, though I'm not sure I want to do this since I'd prefer this doesn't become something people harass Cobra with, is to plug it into the Twilio API and set it up as a Cobra hotline. You call in, ask a question which is then transcribed to text, then the bot answers the question and its answer is read back to you with TTS. I don't think people will probably be very comfortable calling a phone number though, given the obvious privacy implications.
Thoughts?
1. Generate captions using Whisper
2. Vectorize and index all the captions that Whisper generates into a searchable FAISS index
3. Connect the FAISS index to a language model like Claude 3 Haiku or GPT-3.5, so you can ask a question like "What was Cobra's childhood like?" and get an immediate answer with citations to matching videos
I was thinking this would be good for writing wiki articles in MediaWiki format, but I don't really wanna host a wiki. I previously did this for the Tony Chase Wiki and it worked pretty well. Does anyone know if there's an existing Cobra wiki that isn't hosted on something like that multi-wiki hub site? I kinda don't want to contribute to one of the multi-wiki sites because I know it's bound to get taken down sooner or later.
Another idea I had was to just let people use the chatbot on a custom domain and not attach a wiki. Imagine a site with a format sort of like ChatGPT's website, but the only thing it's meant for is to answer questions about Cobra and provide citations.
The final idea I had, though I'm not sure I want to do this since I'd prefer this doesn't become something people harass Cobra with, is to plug it into the Twilio API and set it up as a Cobra hotline. You call in, ask a question which is then transcribed to text, then the bot answers the question and its answer is read back to you with TTS. I don't think people will probably be very comfortable calling a phone number though, given the obvious privacy implications.
Thoughts?