plugins regularly disabled

[mehranzand]

Summary:
the plugin start and working fine but after while it suddenly stop.

Server LOG:
{"timestamp":"2023-01-09 10:48:38.234 Z","level":"error","msg":"plugin process exited","caller":"plugin/hclog_adapter.go:79","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"pathplugins/com.github.matterpoll.matterpoll/server/dist/plugin-linux-amd64pid223864errorexit status 2"}
{"timestamp":"2023-01-09 10:49:07.853 Z","level":"warn","msg":"Health check failed for plugin","caller":"plugin/health_check.go:59","id":"com.github.matterpoll.matterpoll","error":"plugin RPC connection is not responding"}
{"timestamp":"2023-01-09 10:49:07.854 Z","level":"error","msg":"RPC call OnDeactivate to plugin failed.","caller":"plugin/client_rpc_generated.go:33","plugin_id":"com.github.matterpoll.matterpoll","error":"connection is shut down"}
{"timestamp":"2023-01-09 10:49:07.854 Z","level":"warn","msg":"error closing client during Kill","caller":"plugin/hclog_adapter.go:70","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"errconnection is shut down"}
{"timestamp":"2023-01-09 10:49:07.854 Z","level":"warn","msg":"plugin failed to exit gracefully","caller":"plugin/hclog_adapter.go:72","plugin_id":"com.github.matterpoll.matterpoll"}

Mattermost version:
Enterprise 7.5.1
Matterpoll version:
1.4.0

[kaakaa]

Thank you for your reporting. This isn't reproduced in my local, so could you please give me more information on this?

• Does Matterpoll output any debug logs before shutting down?
• Do plugins except for Matterpoll continue running?
• How long does Matterpoll run? (a few seconds/minutes/hours?)
• Does Matterpoll shutdown even if you don't do anything?

[mehranzand]

• Does Matterpoll output any debug logs before shutting down?
  {"timestamp":"2023-01-14 06:16:45.815 Z","level":"info","msg":"Metrics and profiling server is stopped","caller":"platform/metrics.go:83"} {"timestamp":"2023-01-14 06:16:46.808 Z","level":"info","msg":"Metrics and profiling server is stopped","caller":"platform/metrics.go:83"} {"timestamp":"2023-01-14 06:27:16.924 Z","level":"error","msg":"plugin process exited","caller":"plugin/hclog_adapter.go:79","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"pathplugins/com.github.matterpoll.matterpoll/server/dist/plugin-linux-amd64pid337055errorexit status 2"} {"timestamp":"2023-01-14 06:27:37.856 Z","level":"warn","msg":"Health check failed for plugin","caller":"plugin/health_check.go:59","id":"com.github.matterpoll.matterpoll","error":"plugin RPC connection is not responding"} {"timestamp":"2023-01-14 06:27:37.856 Z","level":"error","msg":"RPC call OnDeactivate to plugin failed.","caller":"plugin/client_rpc_generated.go:33","plugin_id":"com.github.matterpoll.matterpoll","error":"connection is shut down"} {"timestamp":"2023-01-14 06:27:37.856 Z","level":"warn","msg":"error closing client during Kill","caller":"plugin/hclog_adapter.go:70","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"errconnection is shut down"} {"timestamp":"2023-01-14 06:27:37.856 Z","level":"warn","msg":"plugin failed to exit gracefully","caller":"plugin/hclog_adapter.go:72","plugin_id":"com.github.matterpoll.matterpoll"} {"timestamp":"2023-01-14 06:29:48.147 Z","level":"error","msg":"plugin process exited","caller":"plugin/hclog_adapter.go:79","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"pathplugins/com.github.matterpoll.matterpoll/server/dist/plugin-linux-amd64pid337540errorexit status 2"} {"timestamp":"2023-01-14 06:30:07.853 Z","level":"warn","msg":"Health check failed for plugin","caller":"plugin/health_check.go:59","id":"com.github.matterpoll.matterpoll","error":"plugin RPC connection is not responding"} {"timestamp":"2023-01-14 06:30:07.853 Z","level":"error","msg":"RPC call OnDeactivate to plugin failed.","caller":"plugin/client_rpc_generated.go:33","plugin_id":"com.github.matterpoll.matterpoll","error":"connection is shut down"} {"timestamp":"2023-01-14 06:30:07.853 Z","level":"warn","msg":"error closing client during Kill","caller":"plugin/hclog_adapter.go:70","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"errconnection is shut down"} {"timestamp":"2023-01-14 06:30:07.853 Z","level":"warn","msg":"plugin failed to exit gracefully","caller":"plugin/hclog_adapter.go:72","plugin_id":"com.github.matterpoll.matterpoll"} {"timestamp":"2023-01-14 06:42:18.154 Z","level":"error","msg":"plugin process exited","caller":"plugin/hclog_adapter.go:79","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"pathplugins/com.github.matterpoll.matterpoll/server/dist/plugin-linux-amd64pid337668errorexit status 2"} {"timestamp":"2023-01-14 06:42:19.461 Z","level":"error","msg":"Plugin failed to ServeHTTP, RPC call failed","caller":"plugin/client_rpc.go:423","plugin_id":"com.github.matterpoll.matterpoll","error":"connection is shut down"} {"timestamp":"2023-01-14 06:42:24.462 Z","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't Accept request body connection","caller":"plugin/client_rpc.go:397","plugin_id":"com.github.matterpoll.matterpoll","error":"timeout waiting for accept"} {"timestamp":"2023-01-14 06:42:24.463 Z","level":"error","msg":"Plugin failed to ServeHTTP, muxBroker couldn't accept connection","caller":"plugin/client_rpc.go:378","plugin_id":"com.github.matterpoll.matterpoll","serve_http_stream_id":5,"error":"timeout waiting for accept"} {"timestamp":"2023-01-14 06:42:37.856 Z","level":"warn","msg":"Health check failed for plugin","caller":"plugin/health_check.go:59","id":"com.github.matterpoll.matterpoll","error":"plugin RPC connection is not responding"} {"timestamp":"2023-01-14 06:42:37.856 Z","level":"error","msg":"RPC call OnDeactivate to plugin failed.","caller":"plugin/client_rpc_generated.go:33","plugin_id":"com.github.matterpoll.matterpoll","error":"connection is shut down"} {"timestamp":"2023-01-14 06:42:37.856 Z","level":"warn","msg":"error closing client during Kill","caller":"plugin/hclog_adapter.go:70","plugin_id":"com.github.matterpoll.matterpoll","wrapped_extras":"errconnection is shut down"} {"timestamp":"2023-01-14 06:42:37.856 Z","level":"warn","msg":"plugin failed to exit gracefully","caller":"plugin/hclog_adapter.go:72","plugin_id":"com.github.matterpoll.matterpoll"} {"timestamp":"2023-01-14 06:42:49.003 Z","level":"error","msg":"Plugin for /poll is not working. Please contact your system administrator","caller":"web/context.go:117","path":"/api/v4/commands/execute","request_id":"d3f7s5byjtgwdbqkbp3pn5jrby","ip_addr":"172.22.0.1","user_id":"cytjtozmbpnu7gbkckqq8b5fdw","method":"POST","err_where":"ExecutePluginCommand","http_code":500,"error":"ExecutePluginCommand: Plugin for /poll is not working. Please contact your system administrator, err= Plugin has recently crashed: com.github.matterpoll.matterpoll"}

• Do plugins except for Matterpoll continue running? Yes

• How long does Matterpoll run? (a few seconds/minutes/hours?) In my last test, Matterpoll stopped after working with. not automatically.

• Does Matterpoll shutdown even if you don't do anything? I am not ensure to correct answer this question. I guess Yes

[kaakaa]

Thank you. I'm afraid that I would like to confirm one more thing, but are log levels of your Mattermost server set to DEBUG?
If not, could you please set levels to DEBUG and give me logs again? If Matterpoll exits after you work with the plugin, the cause of the crash may be output in the DEBUG level logs.

[mehranzand]

Thank you. I'm afraid that I would like to confirm one more thing, but are log levels of your Mattermost server set to DEBUG? If not, could you please set levels to DEBUG and give me logs again? If Matterpoll exits after you work with the plugin, the cause of the crash may be output in the DEBUG level logs.

Yes, the console log and file log levels were set to these values already.
I guess this bug is more to do with network issues.

[kaakaa]

Thanks again. It's odd that the log doesn't output when the plugin process is shutting down. Does your Mattermost server run as single process? or k8s cluster?

[mehranzand]

Mattermost server run as pure docker container.

[kaakaa]

Thanks. Hm, there would be something causing the plugin to fail, but without logs from Matterpoll, It is difficult for me to determine the cause. I think we should first find the cause of the lack of logs, so I asked for help on Community chat.
https://community.mattermost.com/core/pl/ogtqf7sakjfwfftobx76f3hoio

[mehranzand]

Thanks. Hm, there would be something causing the plugin to fail, but without logs from Matterpoll, It is difficult for me to determine the cause. I think we should first find the cause of the lack of logs, so I asked for help on Community chat. https://community.mattermost.com/core/pl/ogtqf7sakjfwfftobx76f3hoio

Thank you, I'll following through the Developer Channel.