I’ve been trying to make my own qlora finetunes for a little while now, but progress has been slow. For a long while I couldn’t get anything to come out right besides the examples, so here’s a blog post on the progress I made.