Tried downloading this model in runpod, faced error
#2
by
Frank2478
- opened
Hey,
I downloaded Synthia-70B-v1.2b-GGUF in runpod and tried to play around with it, but I am facing some loading issues. Refer to the screenshot for the error message and configurations. Not sure what am I missing. Thanks in advance.
I am using 10 GB Disk, 250 GB Pod Volume, 32 vCPU, 250 GB RAM, 40GB VRAM pod. The pod is called L40.