Anybody try DMing to a posse of players controlled by ChatGPT

I like solo play, was wondering if I can spice things up by throwing an LLM in the mix. The way I tried currently becomes messy real soon, so I was wondering if someone who's successfully tried something like this could give me some pointers