Without performance penalties? If the model is larger than the vram you have to ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

Taek on May 11, 2023 | parent | context | favorite | on: PaLM 2 Technical Report [pdf]

Without performance penalties? If the model is larger than the vram you have to constantly be pulling data from disk/ram right?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact