So chatbots aren’t intelligent at all. They are a result of what has been inputted. Currently most filter the content that goes in to protect it. For fun chat programs this is just a basic filter. Where things get fucked is the larger companies trying to make these AI programs that run off the internet.
Recently some tech writers got a chance to mess around with google’s and Microsoft’s ai chat/search programs. What they found is it really breaks down fast if you delve into one subject for more than a few minutes. Hilarious results included giving users made up ‘facts’, threatening users, misinformation, and gaslighting. Problem being is if you search for something like the 2020 election there’s so much misinformation flowing around that the program learned this and spouts it like it’s the truth, much like your drunk uncle at Thanksgiving.
There’s also the dirty secret of the big tech companies that what is inputted must be manually picked to stop it from being loaded down with the worst shot the internet has to offer. This needs a lot of people doing lots of work. It involves them manually going through things like stacks of pictures to filter out porn or hate speech. Just the most terrible things. And where does a massive tech company like Microsoft turn to find workers to filter it? Places like Kenya where they pay less 50 cents to 2 bucks an hour.
Now if someone wanted to build a chatbot to dirty talk you it would need to be fed loads of dirty talk to learn from. This means that it needs tens of thousands of pages of smut talk. And without specific filtering every part of that will be rolling around the robot brain, every niche kink or dark fantasy will be on the table as a response.
Generally people’s sexual tastes in chat are pretty specific. AI likely will not adequately scratch that itch your looking for. And what it does pump out (depending on the programing) will be boring and generic or crazy and unfocused.
So tech as it is will not be good at this, and that’s really not scratching the surface of these AI programs ethical and legal issues.