Replies to message #656

🔎 If you see an alert for analytics.usips.org, this is a self-hosted system I am running as a test. It is GDPR compliant and collects no invasive information.

It's the several billion parameters, probably. Model Parameters VRAM Required GPU Examples RAM to Load 7B 8GB RTX 1660, 2060, AMD 5700xt, RTX...

It might be incredibly difficult to run a local coding model on a 1060. It's not that it's impossible but the token output will be around 0.25...