↩️ https://toot.cat/users/Aaron_Davis/statuses/117241825598243781 - it can’t go beyond 7B models, but for translation, small coding projects, fixing broken linux system, that kind of work, it works really nice (I have not tested with newer approach that offload bigger models to disk tho)

Ricardo Mendes