sure, I'll take a look at it. Thank you for the recommendation

awesome. The more the merrier. Feel free to get started.

I'm still working on a few things, but let me get a backlog in place and push it so people know what the roadmap looks like

hey! thank you for the feedback. appreciate it. I pushed something recently that actually prevents showing up models in the download screen that don't fit on your phone. Please give it a whirl.

Yeah it wasn't straight forward figuring out the speed + getting it to work for both Android and iOS. Fair bit if complexity. But I'm so happy I got it done.

i'm adding another feature to recommend models based on h/w. that should take care of this stuff

I don't really do TTS right now, but i allow for STT using whisper. TTS is part of the backlog and I should be adding it soon

with the metal infra its actually quite good. Agreed you can't run really large models, but inference is very fast and TTFT is very low. It's a beautiful experience

awesome

thank you, appreciate it!

i don't think they do image gen etc? You can almost think of Off Grid like an on-device assistant. It'll handle everything like vision, and attachments too. We're still early stages and lots of optimizations to do, but we'll get there.

I agree. I mean mobile devices have only been getting more and more powerful.