Subprocess & system.util.execute

[jrd]

Hi
I have Ignition Version 8.1.3 running on Raspberry Pi under latest Linux
I have developed a Python script that runs on the Ignition Gateway machine. It has been tested and runs correctly from both the IDE and command line.
I now want run it from Ignition, eg a button press or tag event.

I have tried both system.util.execute and subprocess methods, in both Gateway Message events and tag change scripts, and cannot coax either of them to work.

1. Using subprocess.Popen([ sys.executable, “home/pi/myDirectory/doIt.py” ])
   This throws a “No such file or directory” error

2. Using system.util.execute([ ‘python /home/pi/Nest/.py’ ])
   This does not throw an error, but the Python script does not execute

Can someone help with:
a. Which method is preferable?
b. For the recommended method, what is the process command format?

Thanks in advance

[pturmel]

Is the file executable for the user running the Ignition service? (Including readable folders in the hierarchy.)

[bkarabinchak.psi]

Using system.util.execute([ ‘python /home/pi/Nest/.py’ ]) - I don’t know if you just had a transcription error typing up the question. but shouldn’t this be the same diretory as before and pointing to dolt.py? So system.util.execute([ ‘python “home/pi/myDirectory/doIt.py”]) - you’re saying this sort of statement does not throw an error and it does not run the dolt.py?

Somewhat related - as I recall python3 is not automatically aliased to python on the raspberry pi. Make sure when you type python into terminal, you see the version that your file is written in. Otherwise you might mean to be using python3.

[jrd]

pturmel
I changed permissions to -rwx for all users and it has made no difference

[jrd]

bkarabinchak.psi :
The code in tag change script is:

logger.info(“starting”)
system.util.execute([“python3”, “/home/pi/Nest/doIt.py” ])
logger.info(“completed”)

Both log messages appear in the system log, there are no error messages thrown to the log and the doIt.py script is not executed

[bkarabinchak.psi]

What is the contents of dolt.py? What are you expecting to happen? I wouldn’t think you would get any errors to your log. What you’re doing is telling your raspberry pi to run dolt.py, in a separate process, outside of Ignition. So whether it works or not, Ignitiion I don’t believe would have any access to that information, unless you did it with subprocess.Popen, and had shell=True iirc - which would only feed you back the strings of the terminal as it executes, but again, you won’t be getting any errors here (except for an error in trying to run it at all, but once it goes, its it’s own process).

Now I will wait for @pturmel to correct me where I am wrong

[dkhayes117]

Here is an example of subprocess that might help out

def cpuLoad():
	import subprocess
	proc = subprocess.Popen(['powershell.exe', "wmic /node:<ipaddr> cpu get loadpercentage"], stdout=subprocess.PIPE, stderr=subprocess.STDOUT)
	output = proc.stdout.read()
	print output	
cpuLoad()

[jrd]

bkarabinchak.psi
Thank you for the feedback
The python script does some image processing and writes results to a database. It runs asynchronously and no results are required to be returned to Ignition.
It also displays some images and prints some debug info to the console.
I thought this may have been an issue so I have now added a “headless” mode with no print output or image display. This mode works fine from command line. I can run this headless script and it executes correctly and writes results to database (which can be seen in Ignition). However it still does not work when I run it from Ignition/subprocess()

So I remain confused.
I have a couple of questions:

1. Where do I find any error messages thrown by my py script? I have checked logs in “/var/log” directory with no joy files
2. The only other thing I can think of is that the sql writes are failing due to user permissions? What user does Ignition service run as? I connect from the python script using “pymysql.connect(host='localhost,user=“root”,password=“rootpassword”,database=”"mydb’)"

[Kevin.McClusky]

1. For logging, that will go to stderr (standard error output to the console) if you haven’t routed it to a logging file. execute() won’t show that, and subprocess can, but you have to get the subprocess code right to get any stderr messages back from subprocess into variables in Python that you can print.
2. If you list your processes (“ps” command with appropriate arguments) you’ll be able to see what user Ignition is running as.

However, before going any further you might try to provide the full path to the python executable. The OS doesn’t always set up environment variables for execute() that include python3 in the path.

system.util.execute([“/path/to/python3”, “/home/pi/Nest/doIt.py” ])

If you’re using subprocess, to get standard printed results (stdout, not stderr) one option is to do something more like:

import subprocess
result = subprocess.check_output(“/path/to/python3”, “/path/to/python/program.py”)

Also, you could instead wrap your Python program in a local web service using flask or bottle. Some folks go that direction for portability. (I’ve done it myself for home projects with image capture from a Pi camera.) More info can be found here: Python, Jython, CPython, Libraries, Pip, and Python 2.7 vs 3 - A quick primer

[pturmel]

What user is the Ignition process running as? Typically it is “ignition”, and that won’t be able to make file changes without write permissions.

Are you sure your handler is executing? Include logging in your handler before and after system.util.execute and check the gateway log for the output. (Use system.util.getLogger() instead of using print statements.)

[WillMT10]

@Jay_L - You really shouldn't be posting the same thing in multiple topics...

What is the right way to utilize 'system.util.execute' to execute a shell srtipt in Linux?

Hey Guys: I have a python file and a shell file which are both executable and their folders are readable in the hierarchy, all of which are created under root user. The problem is, I used a messagehandler to pass the command [image] and I am not able to create a foler through this shell ‘mkdir.sh’ [image] [image] I can run this shell using command ‘./mkdir.sh’ but when I run "system.util.sendRequest(‘project_name’, ‘pingCheck’) " in the Script Console, nothing happend. It really bothers…

[Jay_L]

Hello pturmel:

I also doubted that at the beginning,

while when I tried 'system.util.execute(["rm","rf","/home/file/os_.py"])', I actually deleted that py file from the folder, so I think the handler is executing.

@pturmel

Are you sure your handler is executing?

[WillMT10]

Don’t cross-post the same thing in multiple topics.
FAQ - Inductive Automation Forum

For those trying to help you, it leads to more work for them since Person A may see this topic and Person B sees the other topic. They then add answers independently of each other, to the separate posts, not realizing that the other person may have already posted the exact same answer in the other topic. They may also miss the other persons posts and have no chance to build upon them with additional thoughts.

Long story short, wastes time (making people less likely to offer assistance in the future) and can reduce the quality of the answers you will get in the end. If you see a relevant topic that you would like to pull into the discussion, you can post in your original topic with a link to the relevant second topic.

[pturmel]

@Jay_L

What’s wrong with pooling wisdom from the people, my friend?

But you aren't pooling it. You are fragmenting it. As @WillMT10 says, please don't waste our volunteer time with repeat posts.

[Jay_L]

Thank you for your patient explanation, ans I feel so sorry to do that. That won’t happen again.

[Jay_L]

I feel sorry about my behavior,

and I promise this is the last time such a stupid behavior happened.

[cbanzet]

This guy really knows how to apologize. Reminds me of the apology scene from “A Fish Called Wanda”.

[Samer_Samy1]

Dear pturmel ,
I Wish you save me as usual

I did a project for ML using python3 and I use flask to integrate with my py script , the py files are in my personal PC and I call it from ignition perpective window by :

import subprocess
import os.path
	
subprocess.Popen(["C:\ProgramFiles\Git\gitbash.exe","C:\Users\ssamer\PycharmProjects\ML_MENABEV\launch.sh"])
urlBase = "http://127.0.0.1:5000/"

urlEnd = 'ml'

return str(system.net.httpGet(urlBase + urlEnd))	

I want to copy the py files to gateway server and call the files from gateway server.

I tried to replace subprocess.Popen with system.util.execute as below:

subprocess.Popen(["C:\ProgramFiles\Git\gitbash.exe","C:\Users\ssamer\PycharmProjects\ML_MENABEV\launch.sh"])

system.util.execute(["C:\Program Files\Git\git-bash.exe", "C:\ML\ML_MENABEV\launch.sh"])

but still, I see the gitbash opens in my personal PC, not the gateway server

[Kevin.Herron]

This would only happen if one of these are true:

• the gateway and your PC are the same PC
• You are running the script from the Designer script console or some other client scope

[samer_samy]

Thanks Kevin for your support,
The gateway is not my PC , my PC is a client ( a web launched ignition client)

I want from a button in my application that is opened in my PC, to run py3 script that I saved in a local disk in my gateway recently.

but What I can do now is to run the py3 script that I saved in a local disk in my PC (Client)

I thought using (system.util.execute) instead of (subprocess.Popen) can access the gateway files instead of client files .