Warning: I ran a local LLM on a Raspberry Pi 4 expecting garbage, but it wrote a decent poem about my dog.

3 comments

3 Comments

That's wild it wrote a decent poem on a Pi 4! I'm always shocked when these small models do creative stuff well. What was the poem about, like your dog's goofy habits or something? Makes me want to try running one on my old Pi.

derek6562mo ago

Yeah the poem was actually about my neighbor's cat that keeps trying to fight its own reflection in my truck's hubcap. The model nailed the weird, specific details like the puffed-up tail and the confused little chirps. It's those oddly perfect descriptions that get me, stuff you wouldn't think to prompt for. Makes the whole setup feel less like a computer and more like something with a weird sense of humor.

shane6552mo ago

You should totally try it, @jamesfox, the creative surprises are the best part.