So now we have LLMs that convince people it's their significant other, another LLM that gets you to tell it all the crimes you committed. In WWII people were being told to rat out their neighbors, now people are being told to rat themselves out and they are doing it. There should be a documentary on these societal anomalies and this phenomena should be studied.
Title changed
It would be quite an interesting longitudinal study to track those who have interacted with this model, and what qualities - or viewpoints - of their lives have perhaps being altered. Also, track those who have interacted with the model both in a natural - typical - space (like a place of worship) and those interacting in their own space.