# Anyone testing ChatGPT ability to rewrite JSON to create content? **URL:** \ **Category:** Ignition\ **Tags:** perspective\ **Created:** [January 19, 2023, 4:54pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801 "2023-01-19T16:54:13Z")\ **Posts on this page:** 20\ **Page:** 5
**Author:** ![justinedwards.jle](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/justinedwards.jle/32/37854_2.png) [@justinedwards.jle](https://forum.inductiveautomation.com/u/justinedwards.jle)\ **Post date:** [May 23, 2023, 2:04pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/81 "2023-05-23T14:04:22Z")
> [@bkarabinchak.psi](#): > > Feels way too dystopian The more I read about this stuff, the more I share this sentiment. We could have some fun writing a dystopian novel using the times we're living in as a basis for our source material **Example:** > In the 2020s big tech companies united in policing the narrative to protect the public from misinformation, but despite their best efforts to block the misleading content and to remove the offensive contributors, election after election revealed that around half the population remained hopelessly misinformed. Ultimately, the problem was attributable to the keyboard interface. With a keyboard inputting the data, there was no way to prescreen the information for accuracy. Sure, diligent users or bots could flag the material after the fact, and a moderator could later review the materials and take the necessary actions, but in the interim, many innocent people were exposed and perhaps even affected by what they read or watched. > > Finally, researchers developed a suitable replacement for the antiquated mechanical input devices. Using powerful AI that was trained using carefully screened MRI scans, [the semantic decoder](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/77) was able to translate brain patterns directly into content, but most importantly, it could detect and intercept misinformation while it was still forming in the user's brain... ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [May 23, 2023, 2:32pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/82 "2023-05-23T14:32:59Z")
I still haven't seen an AI that will write code for Rockwell Automation ladder logic, or read it. The formatting seems like a giant hurdle. I hope these AIs cause all plcs to switch to structured text. ---
**Author:** ![Ryan\_Allen](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/ryan_allen/32/47013_2.png) [@Ryan\_Allen](https://forum.inductiveautomation.com/u/Ryan_Allen)\ **Post date:** [May 23, 2023, 3:11pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/83 "2023-05-23T15:11:20Z")
I've thought about this too. Surely there is a way to train a model on ladder logic though ---
**Author:** ![brandon1](https://avatars.discourse-cdn.com/v4/letter/b/ea666f/32.png) [@brandon1](https://forum.inductiveautomation.com/u/brandon1)\ **Post date:** [May 23, 2023, 3:14pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/84 "2023-05-23T15:14:32Z")
Given that Rockwell PLC ladder logic is just text under the hood. I'm sure it can be done, and I think you can find people on YouTube demonstrating basic ladder generation from ChatGPT. ---
**Author:** ![lrose](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/lrose/32/62724_2.png) [@lrose](https://forum.inductiveautomation.com/u/lrose)\ **Post date:** [May 23, 2023, 3:33pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/85 "2023-05-23T15:33:35Z")
> [@brandon1](#): > > Given that Rockwell PLC ladder logic is just text under the hood. I'm sure it can be done ```auto bst xic 2B nxb xio 2B bnd OTE The_Question ``` I think it would probably take me longer to ask ChatGPT to write the logic, proof it, and copy it than to just write the logic to begin with. ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [May 23, 2023, 3:43pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/86 "2023-05-23T15:43:03Z")
I didn't know it was text under the hood. I will have to check for those tutorials, thanks. I think there are some things in ladder logic that I don't precisely understand, like when a function has a control or other semi-generic names of very specific parts. ---
**Author:** ![lrose](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/lrose/32/62724_2.png) [@lrose](https://forum.inductiveautomation.com/u/lrose)\ **Post date:** [May 23, 2023, 3:45pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/87 "2023-05-23T15:45:08Z")
> [@zacharyw.larson](#): > > I will have to check for those tutorials, thanks. Write some logic in an offline program, select the rung and press the 'Enter' key. ---
**Author:** ![Ryan\_Allen](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/ryan_allen/32/47013_2.png) [@Ryan\_Allen](https://forum.inductiveautomation.com/u/Ryan_Allen)\ **Post date:** [May 23, 2023, 5:26pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/88 "2023-05-23T17:26:56Z")
I think the idea is to have it write whole programs, not just a one liner ---
**Author:** ![lrose](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/lrose/32/62724_2.png) [@lrose](https://forum.inductiveautomation.com/u/lrose)\ **Post date:** [May 23, 2023, 5:31pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/89 "2023-05-23T17:31:47Z")
I actually think that the better approach would be to have it produce boiler plate. There is just too much variation in a typical process for it to really be effective. In order for the program to be functional you would have to provide I/O configurations and other system variables that are infinitely variable from process to process. My statement still stands, I think I could write a program manually faster. ---
**Author:** ![IgnitionNewbie](https://avatars.discourse-cdn.com/v4/letter/i/94ad74/32.png) [@IgnitionNewbie](https://forum.inductiveautomation.com/u/IgnitionNewbie)\ **Post date:** [May 23, 2023, 5:35pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/90 "2023-05-23T17:35:09Z")
idk about JSON but its been pretty useful for making/ combining SQL queries ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [June 7, 2023, 2:58pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/91 "2023-06-07T14:58:07Z")
Now that ChatGPT has links to questions, it might be nice to have a link to a predefined subset of questions that lead to good JSON development. Or alternatively, a good prompt. ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [August 2, 2023, 1:28pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/92 "2023-08-02T13:28:04Z")
> [@justinedwards.jle](#): > > Just came across this in my weekly reading, and it seems somewhat relevant to this thread: [AI.com](http://AI.com) now links directly to ChatGPT Today, [ai.com](http://ai.com) redirected me to x.ai with Elon Musk declared as leader of the team. ~~Could someone tell me what is going on, and which bot is smarter or if they are the same?~~ * * * I think Musk just bought the domain, found at least an article that might explain it. [https://analyticsindiamag.com/musk-buys-ai-com-from-openai/](https://analyticsindiamag.com/musk-buys-ai-com-from-openai/)] ---
**Author:** ![justinedwards.jle](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/justinedwards.jle/32/37854_2.png) [@justinedwards.jle](https://forum.inductiveautomation.com/u/justinedwards.jle)\ **Post date:** [August 14, 2023, 5:24am UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/93 "2023-08-14T05:24:06Z")
> [@zacharyw.larson](#): > > it is dumb right now and getting dumber than compared with just a month ago This week, I came across this article that provides a possible explination for the common perception that chatGPT is getting dumber: > **[What is a 'AI drift' and why is it making ChatGPT dumber?](https://www.zdnet.com/article/what-is-a-ai-drift-and-why-is-it-making-chatgpt-dumber/)** > > You may want to rethink using GPT-4, especially for math problems. ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [August 14, 2023, 1:04pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/94 "2023-08-14T13:04:11Z")
I observed a steep decline from January to February. It seems odd to me that the model got smarter from December to January, and declined ever since. WSJ had a video saying that improving one ability degrades other abilities the model had. Maintaining model abilities before new releases seems critical. Particularly with self driving vehicles, loss in abilities to gain upgrades could be terrible. ---
**Author:** ![pturmel](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/pturmel/32/3295_2.png) [@pturmel](https://forum.inductiveautomation.com/u/pturmel)\ **Post date:** [August 14, 2023, 1:07pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/95 "2023-08-14T13:07:55Z")
> [@zacharyw.larson](#): > > self driving vehicles Thinking that a self-driving vehicle would be using a **large _language_ model** is not sane. ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [August 14, 2023, 1:10pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/96 "2023-08-14T13:10:00Z")
Sorry, should have specified that WSJ video was talking about AI models. I try really hard to get the specifics. I spent a bunch of time on the post trying to be specific. Seems I always miss something. Found the video I think: [https://www.wsj.com/video/series/tech-news-briefing/chatgpt-is-getting-dumber-at-math-what-does-it-mean-for-ais-future/B9DE3A5B-A55F-40B9-92BE-CABE3C19AFD0](https://www.wsj.com/video/series/tech-news-briefing/chatgpt-is-getting-dumber-at-math-what-does-it-mean-for-ais-future/B9DE3A5B-A55F-40B9-92BE-CABE3C19AFD0)] I think they meant more than language models. I would link it, but I can't seem to open the link I think it is because of the WSJ paywall. ---
**Author:** ![victordcq](https://avatars.discourse-cdn.com/v4/letter/v/f6c823/32.png) [@victordcq](https://forum.inductiveautomation.com/u/victordcq)\ **Post date:** [August 14, 2023, 1:28pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/97 "2023-08-14T13:28:56Z")
A general language model is quite different from specific tasked ai. But yes even in those this can happen, but for important ai's they would have tests in place to make sure all the senarions still work. Fo chatgpt they dont have (as much?) testing on these things, because the ai is incomplete and very general. Also right now they are doing all sorts of things to make the ai "sfw" and prevent it from answering "racist" questions and such. so maths and coding are on the background. They want more% of their sfw tests to pass and are ignoring defects in other fields, so the overall score still goes up, but they are scoring sfw higher atm... Anyways this ai is never intentend to be used for maths or coding or anything scientific or factual. It doesnt know if anything is correct or wrong. It just spits out **pretty text** ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [August 14, 2023, 1:34pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/98 "2023-08-14T13:34:46Z")
I think all AI have to be concerned with data drift. [https://www.fiddler.ai/blog/drift-in-machine-learning-how-to-identify-issues-before-you-have-a-problem](https://www.fiddler.ai/blog/drift-in-machine-learning-how-to-identify-issues-before-you-have-a-problem)] It would seem odd to me if language models didn't become a part of ai devices in the same way that processors have ALUs. I think right now the language models are elaborate lookup tables, but I also think that of the other AI we have today too. ---
**Author:** ![victordcq](https://avatars.discourse-cdn.com/v4/letter/v/f6c823/32.png) [@victordcq](https://forum.inductiveautomation.com/u/victordcq)\ **Post date:** [August 14, 2023, 1:38pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/99 "2023-08-14T13:38:52Z")
There is still a big difference between a general text ai and one that would be used for specific tasks. Making a chat bot to sell you something on your webpage is a lot easier than making one that answers anything. The one on your webpage will look for specific words like "buy, cola, fries" but a general one does not do that. ---
**Author:** ![zacharyw.larson](https://sea1.discourse-cdn.com/inductiveautomation/user_avatar/forum.inductiveautomation.com/zacharyw.larson/32/23749_2.png) [@zacharyw.larson](https://forum.inductiveautomation.com/u/zacharyw.larson)\ **Post date:** [August 14, 2023, 1:44pm UTC](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801/100 "2023-08-14T13:44:20Z")
I think I see what you are saying. I re-watched the WSJ video, and they are talking about the LLM. I was reading into it that this AI drift would apply to all AI. I think you are saying that it is particularly worse for a general LLM than it is for for AI with specific tasks. [Previous page](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801.md?page=4) [Next page](https://forum.inductiveautomation.com/t/anyone-testing-chatgpt-ability-to-rewrite-json-to-create-content/68801.md?page=6)