For anyone who's interacted at all with ChatGPT you will notice it always has a very wholesome message. Here someone asked it to write about rotten milk:
https://old.reddit.com/r/ChatGPT/comments/ztpqsw/didnt_expect_to_cry_at_a_poem_about_rotten_milk/
and it ends on the note "friendships, love and trust can too, be forgot / So let us be careful, in all that we do / To not let the milk of life turn rotten too."
This is the end of a poem about rotten milk.
How did OpenAI train ChatGPT to be so cloyingly wholesome in all its responses, always bringing it back to a positive message?