Found a working way to run pretty heavy models (up to 27–32b in quant) without owning a powerful gpu.
we use free kaggle gpu notebooks: two t4s with 16 gb each = 32 gb vram. weekly limit is about 30 hours.
quick steps:
sign up on kaggle and verify your phone (otherwise you won’t get the dual...
