Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You are correct! From our tests, storing model weights in the image actually isn't a preferred approach for model weights larger than ~1GB. We run a distributed, multi-layer cache system to combat this and we can load roughly 6-7GB of files in p99 of <2.5s


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: