Anyone know if whisper.cpp is GPU accelerated yet? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Ono-Sendai on June 13, 2023 \| parent \| context \| favorite \| on: Llama.cpp: Full CUDA GPU Acceleration Anyone know if whisper.cpp is GPU accelerated yet?

aidenn0 on June 13, 2023 | [–]

AFAIK it's not fully, but you can use cuBLAS/clBlast for a pretty good speedup.

regularfry on June 13, 2023 | [–]

Partially. Keep an eye out for ggml-cuda.cu getting updated.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact