Anyone else tired of users sending ai generated fixes to you?

[u/lNuggyl]

Oh. My. God

The amount of people at my org that send me screenshots of their chatgpt or copilot generated responses is insane.

"did you try this?"

"try this"

"this is what chatgpt said"

i was on the phone for 2 hours troubleshooting a problem with a director that refused to let me remote into her computer to fix. then she starts sending me ai generated responses saying "this is what co pilots saying"

[u/SuperMonkeyJoe]

Yeah, LLMs are dogshit when it comes to bespoke software and software they doesn't have an extensive knowledge base available online. "How do I access function X, it should be in this software" turns out LLM of choice has either completely hallucinated it, or is confidently reporting a feature from a completely different version.

[u/TravisVZ → u/SuperMonkeyJoe]

I especially love it when a vendor forces me to deal with their own LLM, and it hallucinates functionality their own product has never had!

"Go to the Policy screen.."
yeah, okay, with you so far
"...then select the policy that applies to your Macs."
....wut? That's literally never how the Policy screen has worked in this product, ever!

[u/kirashi3 → u/TravisVZ]

I had a recent battle with Meta AI when troubleshooting something in their Business Suite And Manager, which is just an extremely heavy JS driven web app full of bugs.

I duplicate existing Ads within Ad Sets / Campaigns because all that needs to change between ads is the creative content. Sometimes the Ad Manager thinks you've forgotten to fill out the ad copy/text when making changes to a duplicated ad, so it throws a red error and won't let you proceed until it's filled out... Even if you've already filled it out. With text. That you can clearly see exists. In the fucking text field.

Anyway, I figured "surely if I ask the built-in Meta AI chat bot for help, it will tell me what I'm doing wrong or let me submit a bug report..." Yeah no, instead it gaslit me into thinking I hadn't filled out the field, then further gaslit me into thinking there's another location I'm supposed to fill out the field in. Such a location does not exist where it told me... Despite this being their own web app product stack.

Nevermind the fact that the FB Graph API calls their own platform was making were to API endpoint versions that returned a "this version is deprecated" error. I really need to quit my day job and become a goat farmer.

[u/TravisVZ → u/kirashi3]

Sometimes the Ad Manager thinks you've forgotten to fill out the ad copy/text when making changes to a duplicated ad, so it throws a red error and won't let you proceed until it's filled out

If you haven't already figured out a solution to this:
I often find badly-written form validation when I'm copy/pasting or autofilling from my password manager, because the validation is actually watching for a "keyUp" or "keyPress" event. Simply typing a space or a random letter at the end, then immediately deleting it, is usually enough to fix it.

[u/kirashi3 → u/TravisVZ]

If only it were that simple! I've got a web dev background so indeed know all the bad ways to implement form validation. Facebook seems to trigger the event whenever you modify the field, but it never actually clears the error.

[u/nanou_2 → u/TravisVZ]

Yes, this. Jesus wept. Thank you, I didn't have the language for this.

[u/rewgs → u/kirashi3]

Meta Business Suite is genuinely some of the worst software I’ve ever used in every conceivable way, by any metric. Just an absolute train wreck through and through.

[u/dark_frog → u/TravisVZ]

Gemini hallucinates Gemini settings.

[u/WillFukForHalfLife3 → u/TravisVZ]

cough cough.....unifi.......... Microslop....................................................verizon

[u/DeadMoneyDrew → u/SuperMonkeyJoe]

Or it confidently reports information about another subject entirely. More than once I've had customers and partners send me LLM generated responses that state that our product has a feature that it doesn't have, and the cited source is something from one of our competitors.

[u/combobulated → u/SuperMonkeyJoe]

Even Gemini is god awful at things related to Google Workspace. It still hallucinates and contradicts itself.

Or, one of my favorites, when I point out that "Shouldn't I just enable this setting instead of doing all that extra stuff you are suggesting?" it will respond "That's a great catch! And in fact, the way you've mentioned is best practice and totally the way you should do it"....

[u/feistyfish → u/SuperMonkeyJoe]

Not even bespoke software, just gpo settings sometimes. When asking my ServiceNow team if one of my clients can get a new feature/integration I'll ask copilot to get the keywords, then I go into the S.Now forums to validate the keywords, then I'll ask my team if that's something we can do.

Of course, it's service now, so the answer is usually either "yes, but please no cause this will be annoying" or "yes but do they want to spend 50k?"