jay-workai-tools@alien.topOPBtoSelf-Hosted Main@selfhosted.forum•Self-hosted alternative to ChatGPT (and more)English
2·
10 months agoHardware requirements:
- RAM: As much as the AI model requires. Most models have a variant that works well on 8 GB RAM
- GPU: GPU is recommended but not required. It also runs in CPU-only mode but will be slower on Linux, Windows, and Mac-Intel. On M1/M2/M3 Macs, the inference speed is really good.
(For some reason, my response to original comment isn’t showing up so reposting here)
Ah, this is a great use case. And it can certainly be done. The policies and procedures in the clinic can be fed into SecureAI Tools as documents and then your trainers can chat with those documents to get answers to their questions.
And as you mentioned, it all runs locally so it’s compliant with HIPAA (and almost all other compliance regulations).
I would love to work with you and help you deploy an instance for your needs. Sending you a DM invite so we can chat privately