Machine Learning in Ignition using MATLAB

[pturmel]

The module is here:

Automation Professionals' Image Streamer Driver Module

Automation Professionals is pleased to announce a Release Candidate for its new driver module, supporting the live Network Image transmission format of Keyence CV-5000 machine vision controllers, plus support for common Network Video streams via OpenCV. Stream metadata is exposed as OPC items, and the output streams are Motion JPEG. The IP Camera Viewer Component in Vision can consume these streams, making it possible to integrate IP Cameras that don't have MJPEG support or have poor support f…

You would add it to your Ignition server. When it starts, it reports the OpenCV classes it manages to import from the java library. Something like this:

Direct Load org.opencv.aruco.Aruco to system.cv2.aruco
Indirect Load org.opencv.aruco.Board to system.cv2.aruco
Indirect Load org.opencv.aruco.CharucoBoard to system.cv2.aruco
Indirect Load org.opencv.aruco.DetectorParameters to system.cv2.aruco
Indirect Load org.opencv.aruco.Dictionary to system.cv2.aruco
Indirect Load org.opencv.aruco.GridBoard to system.cv2.aruco
Indirect Load org.opencv.bgsegm.BackgroundSubtractorCNT to system.cv2.bgsegm
Indirect Load org.opencv.bgsegm.BackgroundSubtractorGMG to system.cv2.bgsegm
Indirect Load org.opencv.bgsegm.BackgroundSubtractorGSOC to system.cv2.bgsegm
Indirect Load org.opencv.bgsegm.BackgroundSubtractorLSBP to system.cv2.bgsegm
Indirect Load org.opencv.bgsegm.BackgroundSubtractorLSBPDesc to system.cv2.bgsegm
Indirect Load org.opencv.bgsegm.BackgroundSubtractorMOG to system.cv2.bgsegm
Direct Load org.opencv.bgsegm.Bgsegm to system.cv2.bgsegm
Indirect Load org.opencv.bgsegm.SyntheticSequenceGenerator to system.cv2.bgsegm
Direct Load org.opencv.bioinspired.Bioinspired to system.cv2.bioinspired
Indirect Load org.opencv.bioinspired.Retina to system.cv2.bioinspired
Indirect Load org.opencv.bioinspired.RetinaFastToneMapping to system.cv2.bioinspired
Indirect Load org.opencv.bioinspired.TransientAreasSegmentationModule to system.cv2.bioinspired
Direct Load org.opencv.calib3d.Calib3d to system.cv2.calib3d
Indirect Load org.opencv.calib3d.StereoBM to system.cv2.calib3d
Indirect Load org.opencv.calib3d.StereoMatcher to system.cv2.calib3d
Indirect Load org.opencv.calib3d.StereoSGBM to system.cv2.calib3d
Indirect Load org.opencv.core.Algorithm to system.cv2
Direct Load org.opencv.core.Core to system.cv2
Indirect Load org.opencv.core.CvException to system.cv2
Direct Load org.opencv.core.CvType to system.cv2
Indirect Load org.opencv.core.DMatch to system.cv2
Indirect Load org.opencv.core.KeyPoint to system.cv2
Indirect Load org.opencv.core.Mat to system.cv2
Indirect Load org.opencv.core.MatOfByte to system.cv2
Indirect Load org.opencv.core.MatOfDMatch to system.cv2
Indirect Load org.opencv.core.MatOfDouble to system.cv2
Indirect Load org.opencv.core.MatOfFloat to system.cv2
Indirect Load org.opencv.core.MatOfFloat4 to system.cv2
Indirect Load org.opencv.core.MatOfFloat6 to system.cv2
Indirect Load org.opencv.core.MatOfInt to system.cv2
Indirect Load org.opencv.core.MatOfInt4 to system.cv2
Indirect Load org.opencv.core.MatOfKeyPoint to system.cv2
Indirect Load org.opencv.core.MatOfPoint to system.cv2
Indirect Load org.opencv.core.MatOfPoint2f to system.cv2
Indirect Load org.opencv.core.MatOfPoint3 to system.cv2
Indirect Load org.opencv.core.MatOfPoint3f to system.cv2
Indirect Load org.opencv.core.MatOfRect to system.cv2
Indirect Load org.opencv.core.MatOfRect2d to system.cv2
Indirect Load org.opencv.core.MatOfRotatedRect to system.cv2
Indirect Load org.opencv.core.Point to system.cv2
Indirect Load org.opencv.core.Point3 to system.cv2
Indirect Load org.opencv.core.Range to system.cv2
Indirect Load org.opencv.core.Rect to system.cv2
Indirect Load org.opencv.core.Rect2d to system.cv2
Indirect Load org.opencv.core.RotatedRect to system.cv2
Indirect Load org.opencv.core.Scalar to system.cv2
Indirect Load org.opencv.core.Size to system.cv2
Indirect Load org.opencv.core.TermCriteria to system.cv2
Indirect Load org.opencv.core.TickMeter to system.cv2
Indirect Load org.opencv.dnn.ClassificationModel to system.cv2.dnn
Indirect Load org.opencv.dnn.DetectionModel to system.cv2.dnn
Indirect Load org.opencv.dnn.DictValue to system.cv2.dnn
Direct Load org.opencv.dnn.Dnn to system.cv2.dnn
Indirect Load org.opencv.dnn.KeypointsModel to system.cv2.dnn
Indirect Load org.opencv.dnn.Layer to system.cv2.dnn
Indirect Load org.opencv.dnn.Model to system.cv2.dnn
Indirect Load org.opencv.dnn.Net to system.cv2.dnn
Indirect Load org.opencv.dnn.SegmentationModel to system.cv2.dnn
Indirect Load org.opencv.face.BIF to system.cv2.face
Indirect Load org.opencv.face.BasicFaceRecognizer to system.cv2.face
Indirect Load org.opencv.face.EigenFaceRecognizer to system.cv2.face
Direct Load org.opencv.face.Face to system.cv2.face
Indirect Load org.opencv.face.FaceRecognizer to system.cv2.face
Indirect Load org.opencv.face.Facemark to system.cv2.face
Indirect Load org.opencv.face.FacemarkAAM to system.cv2.face
Indirect Load org.opencv.face.FacemarkKazemi to system.cv2.face
Indirect Load org.opencv.face.FacemarkLBF to system.cv2.face
Indirect Load org.opencv.face.FacemarkTrain to system.cv2.face
Indirect Load org.opencv.face.FisherFaceRecognizer to system.cv2.face
Indirect Load org.opencv.face.LBPHFaceRecognizer to system.cv2.face
Indirect Load org.opencv.face.MACE to system.cv2.face
Indirect Load org.opencv.face.PredictCollector to system.cv2.face
Indirect Load org.opencv.face.StandardCollector to system.cv2.face
Indirect Load org.opencv.features2d.AKAZE to system.cv2.features2d
Indirect Load org.opencv.features2d.AgastFeatureDetector to system.cv2.features2d
Indirect Load org.opencv.features2d.BFMatcher to system.cv2.features2d
Indirect Load org.opencv.features2d.BOWImgDescriptorExtractor to system.cv2.features2d
Indirect Load org.opencv.features2d.BOWKMeansTrainer to system.cv2.features2d
Indirect Load org.opencv.features2d.BOWTrainer to system.cv2.features2d
Indirect Load org.opencv.features2d.BRISK to system.cv2.features2d
Indirect Load org.opencv.features2d.DescriptorMatcher to system.cv2.features2d
Indirect Load org.opencv.features2d.FastFeatureDetector to system.cv2.features2d
Indirect Load org.opencv.features2d.Feature2D to system.cv2.features2d
Direct Load org.opencv.features2d.Features2d to system.cv2.features2d
Indirect Load org.opencv.features2d.FlannBasedMatcher to system.cv2.features2d
Indirect Load org.opencv.features2d.GFTTDetector to system.cv2.features2d
Indirect Load org.opencv.features2d.KAZE to system.cv2.features2d
Indirect Load org.opencv.features2d.MSER to system.cv2.features2d
Indirect Load org.opencv.features2d.ORB to system.cv2.features2d
Indirect Load org.opencv.features2d.Params to system.cv2.features2d
Indirect Load org.opencv.features2d.SimpleBlobDetector to system.cv2.features2d
Direct Load org.opencv.highgui.HighGui to system.cv2
Indirect Load org.opencv.highgui.ImageWindow to system.cv2
Indirect Load org.opencv.img_hash.AverageHash to system.cv2.img_hash
Indirect Load org.opencv.img_hash.BlockMeanHash to system.cv2.img_hash
Indirect Load org.opencv.img_hash.ColorMomentHash to system.cv2.img_hash
Indirect Load org.opencv.img_hash.ImgHashBase to system.cv2.img_hash
Direct Load org.opencv.img_hash.Img_hash to system.cv2.img_hash
Indirect Load org.opencv.img_hash.MarrHildrethHash to system.cv2.img_hash
Indirect Load org.opencv.img_hash.PHash to system.cv2.img_hash
Indirect Load org.opencv.img_hash.RadialVarianceHash to system.cv2.img_hash
Direct Load org.opencv.imgcodecs.Imgcodecs to system.cv2.imgcodecs
Indirect Load org.opencv.imgproc.CLAHE to system.cv2.imgproc
Indirect Load org.opencv.imgproc.GeneralizedHough to system.cv2.imgproc
Indirect Load org.opencv.imgproc.GeneralizedHoughBallard to system.cv2.imgproc
Indirect Load org.opencv.imgproc.GeneralizedHoughGuil to system.cv2.imgproc
Direct Load org.opencv.imgproc.Imgproc to system.cv2.imgproc
Override Load org.opencv.imgproc.LineSegmentDetector to system.cv2.line_descriptor as LSDetector
Indirect Load org.opencv.imgproc.Moments to system.cv2.imgproc
Indirect Load org.opencv.imgproc.Subdiv2D to system.cv2.imgproc
Indirect Load org.opencv.ml.ANN_MLP to system.cv2.ml
Indirect Load org.opencv.ml.Boost to system.cv2.ml
Indirect Load org.opencv.ml.DTrees to system.cv2.ml
Indirect Load org.opencv.ml.EM to system.cv2.ml
Indirect Load org.opencv.ml.KNearest to system.cv2.ml
Indirect Load org.opencv.ml.LogisticRegression to system.cv2.ml
Direct Load org.opencv.ml.Ml to system.cv2.ml
Indirect Load org.opencv.ml.NormalBayesClassifier to system.cv2.ml
Indirect Load org.opencv.ml.ParamGrid to system.cv2.ml
Indirect Load org.opencv.ml.RTrees to system.cv2.ml
Indirect Load org.opencv.ml.SVM to system.cv2.ml
Indirect Load org.opencv.ml.SVMSGD to system.cv2.ml
Indirect Load org.opencv.ml.StatModel to system.cv2.ml
Indirect Load org.opencv.ml.TrainData to system.cv2.ml
Indirect Load org.opencv.objdetect.BaseCascadeClassifier to system.cv2.objdetect
Indirect Load org.opencv.objdetect.CascadeClassifier to system.cv2.objdetect
Indirect Load org.opencv.objdetect.HOGDescriptor to system.cv2.objdetect
Direct Load org.opencv.objdetect.Objdetect to system.cv2.objdetect
Indirect Load org.opencv.objdetect.QRCodeDetector to system.cv2.objdetect
Discarding unknown org.opencv.osgi.OpenCVInterface
Discarding unknown org.opencv.osgi.OpenCVNativeLoader
Indirect Load org.opencv.phase_unwrapping.HistogramPhaseUnwrapping to system.cv2.phase_unwrapping
Indirect Load org.opencv.phase_unwrapping.PhaseUnwrapping to system.cv2.phase_unwrapping
Direct Load org.opencv.phase_unwrapping.Phase_unwrapping to system.cv2.phase_unwrapping
Indirect Load org.opencv.photo.AlignExposures to system.cv2.photo
Indirect Load org.opencv.photo.AlignMTB to system.cv2.photo
Indirect Load org.opencv.photo.CalibrateCRF to system.cv2.photo
Indirect Load org.opencv.photo.CalibrateDebevec to system.cv2.photo
Indirect Load org.opencv.photo.CalibrateRobertson to system.cv2.photo
Indirect Load org.opencv.photo.MergeDebevec to system.cv2.photo
Indirect Load org.opencv.photo.MergeExposures to system.cv2.photo
Indirect Load org.opencv.photo.MergeMertens to system.cv2.photo
Indirect Load org.opencv.photo.MergeRobertson to system.cv2.photo
Direct Load org.opencv.photo.Photo to system.cv2.photo
Indirect Load org.opencv.photo.Tonemap to system.cv2.photo
Indirect Load org.opencv.photo.TonemapDrago to system.cv2.photo
Indirect Load org.opencv.photo.TonemapMantiuk to system.cv2.photo
Indirect Load org.opencv.photo.TonemapReinhard to system.cv2.photo
Direct Load org.opencv.plot.Plot to system.cv2.plot
Indirect Load org.opencv.plot.Plot2d to system.cv2.plot
Indirect Load org.opencv.structured_light.GrayCodePattern to system.cv2.structured_light
Indirect Load org.opencv.structured_light.Params to system.cv2.structured_light
Indirect Load org.opencv.structured_light.SinusoidalPattern to system.cv2.structured_light
Indirect Load org.opencv.structured_light.StructuredLightPattern to system.cv2.structured_light
Direct Load org.opencv.structured_light.Structured_light to system.cv2.structured_light
Indirect Load org.opencv.text.BaseOCR to system.cv2.text
Indirect Load org.opencv.text.Callback to system.cv2.text
Indirect Load org.opencv.text.ClassifierCallback to system.cv2.text
Indirect Load org.opencv.text.ERFilter to system.cv2.text
Indirect Load org.opencv.text.OCRBeamSearchDecoder to system.cv2.text
Indirect Load org.opencv.text.OCRHMMDecoder to system.cv2.text
Indirect Load org.opencv.text.OCRTesseract to system.cv2.text
Direct Load org.opencv.text.Text to system.cv2.text
Indirect Load org.opencv.text.TextDetector to system.cv2.text
Indirect Load org.opencv.text.TextDetectorCNN to system.cv2.text
Indirect Load org.opencv.tracking.MultiTracker to system.cv2.tracking
Indirect Load org.opencv.tracking.Tracker to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerBoosting to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerCSRT to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerGOTURN to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerKCF to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerMIL to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerMOSSE to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerMedianFlow to system.cv2.tracking
Indirect Load org.opencv.tracking.TrackerTLD to system.cv2.tracking
Direct Load org.opencv.tracking.Tracking to system.cv2.tracking
Direct Load org.opencv.utils.Converters to system.cv2
Indirect Load org.opencv.video.BackgroundSubtractor to system.cv2
Indirect Load org.opencv.video.BackgroundSubtractorKNN to system.cv2
Indirect Load org.opencv.video.BackgroundSubtractorMOG2 to system.cv2
Indirect Load org.opencv.video.DISOpticalFlow to system.cv2
Indirect Load org.opencv.video.DenseOpticalFlow to system.cv2
Indirect Load org.opencv.video.FarnebackOpticalFlow to system.cv2
Indirect Load org.opencv.video.KalmanFilter to system.cv2
Indirect Load org.opencv.video.SparseOpticalFlow to system.cv2
Indirect Load org.opencv.video.SparsePyrLKOpticalFlow to system.cv2
Indirect Load org.opencv.video.VariationalRefinement to system.cv2
Direct Load org.opencv.video.Video to system.cv2
VideoCapture is org.opencv.videoio.VideoCapture
Indirect Load org.opencv.videoio.VideoCapture to system.cv2
Indirect Load org.opencv.videoio.VideoWriter to system.cv2
Direct Load org.opencv.videoio.Videoio to system.cv2
Indirect Load org.opencv.ximgproc.AdaptiveManifoldFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.ContourFitting to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.DTFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.DisparityFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.DisparityWLSFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.EdgeAwareInterpolator to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.EdgeBoxes to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.FastBilateralSolverFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.FastGlobalSmootherFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.FastLineDetector to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.GraphSegmentation to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.GuidedFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.RFFeatureGetter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.RICInterpolator to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.RidgeDetectionFilter to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SelectiveSearchSegmentation to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SelectiveSearchSegmentationStrategy to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SelectiveSearchSegmentationStrategyColor to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SelectiveSearchSegmentationStrategyFill to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SelectiveSearchSegmentationStrategyMultiple to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SelectiveSearchSegmentationStrategySize to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SelectiveSearchSegmentationStrategyTexture to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SparseMatchInterpolator to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.StructuredEdgeDetection to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SuperpixelLSC to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SuperpixelSEEDS to system.cv2.ximgproc
Indirect Load org.opencv.ximgproc.SuperpixelSLIC to system.cv2.ximgproc
Direct Load org.opencv.ximgproc.Ximgproc to system.cv2.ximgproc
Indirect Load org.opencv.xphoto.GrayworldWB to system.cv2.xphoto
Indirect Load org.opencv.xphoto.LearningBasedWB to system.cv2.xphoto
Indirect Load org.opencv.xphoto.SimpleWB to system.cv2.xphoto
Indirect Load org.opencv.xphoto.TonemapDurand to system.cv2.xphoto
Indirect Load org.opencv.xphoto.WhiteBalancer to system.cv2.xphoto
Direct Load org.opencv.xphoto.Xphoto to system.cv2.xphoto
Generated field class for system.cv2
Generated field class for system.cv2.line_descriptor
Generated field class for system.cv2.plot
Generated field class for system.cv2.xphoto
Generated field class for system.cv2.face
Generated field class for system.cv2.features2d
Generated field class for system.cv2.ximgproc
Generated field class for system.cv2.imgproc
Generated field class for system.cv2.calib3d
Generated field class for system.cv2.aruco
Generated field class for system.cv2.bioinspired
Generated field class for system.cv2.bgsegm
Generated field class for system.cv2.tracking
Generated field class for system.cv2.phase_unwrapping
Generated field class for system.cv2.structured_light
Generated field class for system.cv2.objdetect
Generated field class for system.cv2.text
Generated field class for system.cv2.ml
Generated field class for system.cv2.dnn
Generated field class for system.cv2.img_hash
Generated field class for system.cv2.photo

Actual content will vary with the version of OpenCV you are using.

You would need to verify that the classes you are using through the python lib have corresponding elements in this java lib. (Exposed as system.cv2 in Ignition's jython, but really the java interface.)

Use dir(system.cv2) to see all the field constants, too.