60 devices - TDM extremely slow - not usable #185

Montreal666 · 2022-02-07T18:57:09Z

I have about 60 active Tasmota devices;

TDM works but seems to be in a perpetual scanning/discovery state, making the app unusable;
App starts populating fields, then hangs, doesn't respond for several minutes, then back for a second or two.
Can't click menus or takes forever to respond, etc.
I've tried playing around with all parameters, disabled telemetry, etc.

I also installed TasmoAdmin, and it works smoothly so really seems to be app related;
I'd prefer the TDM interface if I manage to get it working.

Let me know what you think and how I should troubleshoot this,

Thanks!

jziolkowski · 2022-02-07T20:09:11Z

Finally, someone with a lot of hardware :)

First of all, TasmoAdmin works in a completely different manner connection-wise. Also TDM pulls (and internally updates) much more stuff from Tasmota.

Are you able to prepare the venv for TDM and run some debug/tests for me from console?

Montreal666 · 2022-02-07T20:13:50Z

Sure can. Just guide me through the process as I'm not familiar with the console (unless you are talking about the Tasmota console) . Fyi I am running Windows 10. Thx

Montreal666 · 2022-02-07T20:24:24Z

Had to create a few custom bins so I have a number of tools already installed (IOplatform, VB, etc.) But not an expert so will need some guidance.

barbudor · 2022-02-07T20:50:18Z

@homeseer666 Do you already have a Python interpreter on your computer ?
If not, the easiest could be that we provide you a ZIP file which include the VENV + TDM sources code

@jziolkowski If you don't have a Windows computer handy, I can do it : VENV Python 3.8 + latest TDM source tree ?

Montreal666 · 2022-02-07T21:04:24Z

Python 3.10.2 installed, had to use it for esptool.py/ PYFlasher.
Let me know what is the simplest course of action.
Thx,

jziolkowski · 2022-02-07T21:17:31Z

@barbudor please provide the zip, that would make it easier. TIA

barbudor · 2022-02-07T21:41:48Z

@homeseer666 As per @jziolkowski suggestion, please find here a lkink to download a ZIP with latest TDM source + minimum Python env
https://transfert.free.fr/mMgxcV
Unzip the file
To activate the VENV (Virtual ENVironement), open a CMD console, go to the folder where you have unzipped the content and type
venv\Scripts\activate.bat
This will add a (venv) at the beginning of the prompt which confirm that from now on you are running a local Python environment wuth all hte dependencies
To check that it is working, just type python tdm.py and that should launch TDM
From there, @jziolkowski will tell you how to enable the debug features he needs

Thanks

Montreal666 · 2022-02-08T00:25:05Z

Sounds good, should have time later this evening or tomorrow, will report back. Thx

Montreal666 · 2022-02-08T19:52:21Z

All set.
Except fot the last command (python tdm.py) where I get:

(venv) C:\xxxxxxxxxxxxxxxx\tdm_venv>python tdm.py
python: can't open file 'C:\xxxxxxxxxxxxxxxxxx\tdm_venv\tdm.py': [Errno 2] No such file or directory

barbudor · 2022-02-08T20:28:56Z

my bad, it's python tdmgr.py

Montreal666 · 2022-02-08T20:50:34Z

Originally thought this was the problem but it was also returning an error....

(venv) C:\xxxxxxxxxxxxxx\tdm_venv>python tdmgr.py
Traceback (most recent call last):
File "C:\xxxxxxxxxxxxxxxxxxxx\tdm_venv\tdmgr.py", line 10, in
from PyQt5.QtCore import QTimer, pyqtSlot, QSettings, QDir, QSize, Qt, QDateTime, QUrl
ModuleNotFoundError: No module named 'PyQt5'

barbudor · 2022-02-08T20:57:47Z

Strange. I just deleted my original tdm_env folder, restored from the zip and it works
PyQt5 should be there in tdm_venv\venv\Lib\site-packages\PyQt5

jziolkowski · 2022-02-08T21:36:28Z

@homeseer666 did you activate the venv?

barbudor · 2022-02-08T21:54:02Z

the (venv) marker at the beginning of the prompt suggests he did

Montreal666 · 2022-02-08T22:40:53Z

yes I did , (venv) marker is there.

BartGijsbers · 2022-02-18T18:31:19Z

I have/had the same problem. I needed to change the code a little because I am not using %prefix% at all in any of my 42 tasmota devices. Due to the changes TDM subscibed to '#' 42 times. This seems to start 42 times a request with each receiving mqtt entry. First I try-ed to fix it by removing duplicate entry's in the mqtt queue and the lwts list. I was hitting over 100.000 entry's in the mqtt queue. Now I hard coded subscribe to just '#' only ones. That seems to work for me but sometimes it still get's very slow.

btw, I love your program!!

jziolkowski · 2022-02-18T19:19:21Z

Can you show me a line from debug that can back the claim that it subbed to "#" 40 times?

BartGijsbers · 2022-02-19T06:36:49Z

2022-02-17 17:05:57 [INFO] ### TDM START ###
2022-02-17 17:06:03 [INFO] MQTT: Subscribed to +//#, +//#, +/cmnd/#, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #, #

My devices look like (only showing 2):

[5C-CF-7F-2C-19-AC]
topic=relayserverwaskamer
full_topic=%topic%/
device_name=RelayServerWaskamer

[A0-20-A6-26-74-DD]
topic=DS18B20-02
full_topic=%topic%/
device_name=DS18B20-02

So they only have %topic% and no %prefix%

barbudor · 2022-02-19T12:14:38Z

Which is totally wrong
Without prefix you can't manage tasmota

jziolkowski · 2022-02-19T13:25:30Z

also pls paste your discovery topics

BartGijsbers · 2022-02-20T09:58:21Z

Remember I changed some code in order to make the program work without the %prefix%.

Discovery topics: %topic%/%prefix%

Changes:
prefix_tele = ""
prefix_stat = ""
prefix_cmd = "cmnd"

    self.prefix_cmd = prefix_cmd
    self.prefix_stat = prefix_stat
    self.prefix_tele = prefix_tele

def build_topic(self, prefix):
    return self.p['Topic'] + "/" + prefix

def cmnd_topic(self, command=""):
    if command:
        return "{}/{}".format(self.build_topic(self.prefix_cmd), command)
    return self.build_topic(self.prefix_cmd)

def stat_topic(self):
    return self.build_topic(self.prefix_stat)

def tele_topic(self, endpoint=""):
    if endpoint:
        return "{}/{}".format(self.build_topic(self.prefix_tele), endpoint)
    return self.build_topic(self.prefix_tele)

def mqtt_subscribe(self):
    self.topics.append("#")
    self.mqtt.subscribe([(topic, 0) for topic in self.topics])

jziolkowski · 2022-02-20T13:40:51Z

You removed the whole logic behind finding duplicate topics. That's why there are duplicated subscriptions.

BartGijsbers · 2022-02-20T14:10:52Z

I did that after I found out that there were duplicate topics. I just wanted to say that if you have duplicated topics the program gets very slow.

jziolkowski · 2022-02-20T14:15:47Z

Well, duh :)

jziolkowski · 2022-02-20T14:41:22Z

Couldn't help myself, sorry :D

BartGijsbers · 2022-02-20T14:58:23Z

:-) No problem, you are more then welcome.
The sequence was however. TDM was slow, removed duplicate topics. TDM is ok.

Montreal666 · 2022-03-01T18:44:03Z

Back to my original request; still interested to troubleshoot ?
I'd like to find a way to make the tool usable. Thank you!

barbudor · 2022-03-01T19:55:43Z

HI @homeseer666
I didn't even noticed that there was a switch between 2 people :)
So where are you
If you can't run the tdmgr.py script from what I provided, are you able to run it from your own Python install ?

Montreal666 · 2022-03-01T21:55:00Z

still at the same place, getting this error when runnning tdmgr.py:

(venv) C:\Users\xxx\Downloads\tdm_venv>python tdmgr.py
Traceback (most recent call last):
File "C:\Users\xxx\Downloads\tdm_venv\tdmgr.py", line 10, in
from PyQt5.QtCore import QTimer, pyqtSlot, QSettings, QDir, QSize, Qt, QDateTime, QUrl
ModuleNotFoundError: No module named 'PyQt5'

barbudor · 2022-03-02T13:44:40Z

While in the venv, can you please try to re-install dependencies:
pip install -U -r requirements.txt

jziolkowski · 2022-03-04T20:16:32Z

Good job. Now please paste your autodiscovery paths and TDM debug log (the part with "subscribed to topics blah blah")

Montreal666 · 2022-03-04T21:46:56Z

Sorry but where can I get the autodiscovery paths and TDM debug log ?
I've checked briefly the app menus and file structure for logs or some config file to enable logging but couldn't find it.
Thx

jziolkowski · 2022-03-04T21:48:43Z

It's in the project wiki

Montreal666 · 2022-03-04T21:49:42Z

ok let me check

Montreal666 · 2022-03-04T21:56:55Z

Ok got it. Do you have a personal account I can send this to? lots of details in there.
Just noticed that past logs are also included, could be useful but lots of data.

jziolkowski · 2022-03-04T23:13:59Z

let's start with the basics now. autodiscovery patterns and log entries related to subscription topics

Montreal666 · 2022-03-05T01:35:54Z

Here's the output from the last startup:

2022-03-04 16:52:29 [INFO] ### TDM START ###
2022-03-04 16:52:34 [INFO] MQTT: Subscribed to tele/#, stat/#, cmnd/#, +/tele/#, +/stat/#, +/cmnd/#
2022-03-04 16:53:20 [ERROR] MQTT MESSAGE DECODE ERROR: 'utf-8' codec can't decode byte 0x97 in position 1121: invalid start byte (stat/SONOFFBASIC6/RESULT=b'{"GPIOs1":{"0":"None","32":"Button","64":"Button_n","96":"Button_i","128":"Button_in","160":"Switch","192":"Switch_n","224":"Relay","256":"Relay_i","288":"Led","320":"Led_i","352":"Counter","384":"Counter_n","416":"PWM","448":"PWM_i","480":"Buzzer","512":"Buzzer_i","544":"LedLink","576":"LedLink_i","608":"I2C SCL","640":"I2C SDA","672":"SPI MISO","704":"SPI MOSI","736":"SPI CLK","768":"SPI CS","800":"SPI DC","832":"SSPI MISO","864":"SSPI MOSI","896":"SSPI SCLK","928":"SSPI CS","960":"SSPI DC","992":"Backlight","1024":"Display Rst","1056":"IRsend","1088":"IRrecv","1120":"RFSend","1152":"RFrecv","1184":"DHT11","1216":"AM2301","1248":"SI7021","1280":"DHT11_o","1312":"DS18x20","1344":"DS18x20_o","1376":"WS2812","1408":"MHZ Tx","1440":"MHZ Rx","1472":"PZEM0XX Tx","1504":"PZEM004 Rx","1536":"PZEM016 Rx","1568":"PZEM017 Rx","1600":"SAir Tx","1632":"SAir Rx","1664":"PMS5003 Tx","1696":"PMS5003 Rx","1728":"SDS0X1 Tx","1760":"SDS0X1 Rx","1792":"SerBr Tx","1824":"SerBr Rx","1856":"SR04 Tri/TX","1888":"SR04 Ech/RX","1920":"SDMx20 Tx","1952":"SDMx20 Rx","1984":"SDM630 Tx","2016":"SDM630 Rx","2048":"TM1638 CLK","20800\x97\x01\x00\x18stat/SONOFFBASIC6/RESULT{"GPIO1":{"1472":"PZEM0XX Tx"},"GPIO2":{"0":"None"},"GPIO3":{"1536":"PZEM016 Rx"},"GPIO4":{"0":"None"},"GPIO14":{"0":"None"}}0-\x00\x18stat/SONOFFBASIC6/RESULT{"Interlock":"OFF"}0@\x00\x18stat/SONOFFBASIC6/RESULT{"PulseTime1":{"Set":0,"Remaining":0}}0@\x00\x18stat/SONOFFBASIC6/RESULT{"PulseTime5":{"Set":0,"Remaining":0}}0\xc8\x02\x00\x17tele/SONOFFBASIC6/STATE{"Time":"2022-03-04T16:52:51","Uptime":"0T07:23:32","UptimeSec":26612,"Heap":20,"SleepMode":"Dynamic","Sleep":50,"LoadAvg":19,"MqttCount":4,"POWER":"OFF","Wifi":{"AP":1,"SSId":"BELLFIBE","BSSId":"30:B5:C2:44:29:B9","Channel":11,"Mode":"11n","RSSI":56,"Signal":-72,"LinkCount":2,"Downtime":"0T00:00:14"}}0\xfc\x02\x00\x18tele/SONOFFBASIC6/SENSOR{"Time":"2022-03-04T16:52:51","ENERGY":{"TotalStartTime":"2021-06-01T04:07:34","Total":[24.38993,49.62791],"Yesterday":[0.00805,6.10599],"Today":[0.00793,5.05599],"Period":[0.000,0.000],"Power":[0.000,0.000],"ApparentPower":[0.000,0.000],"ReactivePower":[0.000,0.000],"Factor":[0.00,0.00],"Frequency":[60,60],"Voltage":[120,120],"Current":[0.000,0.000]}}0\xc8\x02\x00\x17tele/SONOFFBASIC6/STATE{"Time":"2022-03-04T16:53:01","Uptime":"0T07:23:42","UptimeSec":26622,"Heap":20,"SleepMode":"Dynamic","Sleep":50,"LoadAvg":19,"MqttCount":4,"POWER":"OFF","Wifi":{"AP":1,"SSId":"BELLFIBE","BSSId":"30:B5:C2:44:29:B9","Channel":11,"Mode":"11n","RSSI":54,"Signal":-73,"LinkCount":2,"Downtime":"0T00:00:14"}}0\xfc\x02\x00\x18tele/SONOFFBASIC6/SENSOR{"Time":"2022-03-04T16:53:01","ENERGY":{"TotalStartTime":"2021-06-01T04:07:34","Total":[24.38993,49.62791],"Yesterday":[0.00805,6.10599],"Today":[0.00793,5.05599],"Period":[0.000,0.000],"Power":[0.000,0.000],"ApparentPower":[0.000,0.000],"ReactivePower":[0.000,0.000],"Factor":[0.00,0.00],"Frequency":[60,60],"Voltage":[120,120],"Current":[0.000,0.000]}}0\xc8\x02\x00\x17tele/SONOFFBASIC6/STATE{"Time":"2022-03-04T16:53:11","Uptime":"0T07:23:52","UptimeSec":26632,"Heap":20,"SleepMode":"Dynamic","Sleep":50,"LoadAvg":19,"MqttCount":4,"POWER":"OFF","Wifi":{"AP":1,"SSId":"BELLFIBE","BSSId":"30:B5:C2:44:29:B9","Channel":11,"Mode":"11n","RSSI":56,"Signal":-72,"LinkCount":2,"Downtime":"0T00:00:14"}}0\xfc\x02\x00\x18tele/SONOFFBASIC6/SENSOR{"Time":"2022-03-04T16:53:11","ENERGY":{"TotalStartTime":"2021-06-01T04:07:34","Total":[24.38993,49.62791],"Yesterday":[0.00805,6.10599],"Today":[0.00793,5.05599],"Period":[0.000,0.000],"Power":[0.000,0.000],"ApparentPower":[0.000,0.000],"ReactivePower":[0.000,0.000],"Factor":[0.00,0.00],"Frequency":[60,60],"Voltage":[120,120],"Current":[0.000,0.000]}}\xc0\x000\xc8\x02\x00\x17tele/SONOFFBASIC6/STATE{"Time":"2022-03-04T16:53:21","Uptime":"0T07:24:02","UptimeSec":26642,"Heap":20,"SleepMode":"Dynamic","Sleep":50,"LoadAvg":19,"MqttCount":4,"POWER":"OFF","Wifi":{"AP":1,"SSId":"BELLFIBE","BSSId":"30:B5:C2:44:29:B9","Channel":11,"Mode":"11n","RS')
2022-03-04 16:53:48 [CRITICAL] PARSER: Can't parse RESULT (Invalid control character at: line 1 column 386 (char 385)): {"GPIOs4":{"2976":"SM16716 PWR","3008":"MY92x1 DI","3040":"MY92x1 DCKI","3072":"CSE7766 Tx","3104":"CSE7766 Rx","3136":"ALux IrRcv","3168":"ALux IrSel","3200":"Serial Tx","3232":"Serial Rx","3264":"Rotary_a","3296":"Rotary_b","3328":"ADC Joystick","3360":"MX31865 CS","3392":"HRE Clock","3424":"HRE Data","3456":"ADE7953 IRQ","3488":"SolaxX1 Tx","3520":"SolaxX1 Rx","3552":"Zigbee Tx0(��stat/ESP8266RELAY1/RESULT{"MqttLog":0}0G��stat/ESP8266RELAY1/RESULT{"PulseTime2":{"Set":0,"Remaining":1951796}}0G��stat/ESP8266RELAY1/RESULT{"PulseTime4":{"Set":0,"Remaining
2022-03-04 16:55:49 [CRITICAL] PARSER: Can't parse RESULT (Extra data: line 1 column 282 (char 281)): {"GPIO0":{"224":"Relay1"},"GPIO1":{"1472":"PZEM0XX Tx"},"GPIO2":{"0":"None"},"GPIO3":{"1536":"PZEM016 Rx"},"GPIO4":{"0":"None"},"GPIO5":{"0":"None"},"GPIO12":{"0":"None"},"GPIO13":{"0":"None"},"GPIO14":{"0":"None"},"GPIO15":{"0":"None"},"GPIO16":{"0":"None"},"GPIO17":{"0":"None"}}}

Montreal666 · 2022-03-05T18:24:35Z

I deleted the original user/TDM folder in order to get the base config/data from scratch; here it is.
Same result however IE: after about a minute the app becomes totally unresponsive/frozen.
Let me know if this helps and if I can troubleshoot further. The app would be really useful if this could be fixed.
Thx

2022-03-05 13:14:35 [INFO] ### TDM START ###
2022-03-05 13:14:39 [INFO] MQTT: Subscribed to tele/#, stat/#, cmnd/#, +/tele/#, +/stat/#, +/cmnd/#
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGB4/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/BULBRGBWW1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH3W3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGB3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG15/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH15/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/TH16A/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH8/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH3W2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH6/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/TH16B/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG8/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/INLINEDIMMER1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH7/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH10/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGB2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG11/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGBWW2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG12/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUGMONITOR3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH5/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH14/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH12/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SONOFFBASIC1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGBWW3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG5/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGBWW1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG9/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUGMONITOR1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WEMOSMINI1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGB6/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG6/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/BULBRGBWW3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUGMONITOR5/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH11/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGB5/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGBWW4/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH13/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/BULBRGBWW4/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/BULBRGBWW2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG13/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG4/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH50/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUGMONITOR6/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/TH16C/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/INLINEDIMMER3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGBW1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH4/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG14/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH9/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WALLSWITCH3W1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG10/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUG7/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/ESP32-BLE-TASMOTA/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/ESP8266RELAY1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SONOFFBASIC3/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WEMOSMINI2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/ESP12FRELAYX4A/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/WEMOSMINI7/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SONOFFBASIC5/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/ESP01C/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/ESP32-BLE-TASMOTA2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/RGB1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SMARTPLUGMONITOR2/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/HW622RELAY1/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: LWT from an unknown device tele/SONOFFBASIC6/LWT
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGB1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGB4 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGBWW2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGBW1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGBWW4 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH3W3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=TH16A with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH11 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SMARTPLUG15 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SMARTPLUGMONITOR3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SMARTPLUG9 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SMARTPLUG7 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH50 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SMARTPLUG6 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WEMOSMINI1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SMARTPLUG14 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH10 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=ESP8266RELAY1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH3W1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH14 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SMARTPLUG5 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH3W2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGB2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=TH16C with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=SONOFFBASIC1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=BULBRGBWW4 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=TH16B with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=ESP01C with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH4 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=INLINEDIMMER1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WEMOSMINI2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WEMOSMINI7 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGBWW3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=WALLSWITCH15 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=RGB5 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:39 [INFO] DISCOVERY: Discovered topic=BULBRGBWW3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=WALLSWITCH6 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=WALLSWITCH7 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SMARTPLUG2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SMARTPLUGMONITOR1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SMARTPLUGMONITOR2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SMARTPLUG10 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SMARTPLUG4 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=BULBRGBWW2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=WALLSWITCH5 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=INLINEDIMMER3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SONOFFBASIC3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SONOFFBASIC5 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:40 [INFO] DISCOVERY: Discovered topic=SMARTPLUG11 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=RGB3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=SMARTPLUG13 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=RGBWW1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=SMARTPLUGMONITOR5 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=SMARTPLUG1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=SMARTPLUG8 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=SMARTPLUG12 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=BULBRGBWW1 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=ESP32-BLE-TASMOTA2 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=ESP32-BLE-TASMOTA with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=WALLSWITCH8 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=WALLSWITCH12 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=WALLSWITCH13 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=SONOFFBASIC6 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [INFO] DISCOVERY: Discovered topic=WALLSWITCH9 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:42 [CRITICAL] PARSER: Can't parse RESULT (Extra data: line 1 column 282 (char 281)): {"GPIO0":{"224":"Relay1"},"GPIO1":{"1472":"PZEM0XX Tx"},"GPIO2":{"0":"None"},"GPIO3":{"1536":"PZEM016 Rx"},"GPIO4":{"0":"None"},"GPIO5":{"0":"None"},"GPIO12":{"0":"None"},"GPIO13":{"0":"None"},"GPIO14":{"0":"None"},"GPIO15":{"0":"None"},"GPIO16":{"0":"None"},"GPIO17":{"0":"None"}}}
2022-03-05 13:14:43 [INFO] DISCOVERY: Discovered topic=SMARTPLUGMONITOR6 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:43 [INFO] DISCOVERY: Discovered topic=SMARTPLUG3 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:43 [INFO] DISCOVERY: Discovered topic=RGB6 with fulltopic=%prefix%/%topic%/
2022-03-05 13:14:44 [INFO] DISCOVERY: Discovered topic=ESP12FRELAYX4A with fulltopic=%prefix%/%topic%/

dawnstrider · 2022-03-26T14:31:56Z

Just my 2 cents: I figured out this project does not run with Python 3.10 on Windows. Also experienced some of the above errors while installing requirements but ultimately also failing to run the application.

Works fine with Python 3.9.12 on Windows 10 except for the PyQt5 version issue. Seems 5.14.2 is only binary-compatible with older Python versions, see this Stackoverflow discussion

Jason2866 · 2022-03-26T15:15:36Z

I removed the fix of using 5.14.2 The packages have been updated and latest versions do work in general with less issues now.

Montreal666 · 2022-03-29T17:07:46Z

I removed the fix of using 5.14.2 The packages have been updated and latest versions do work in general with less issues now.

Is there a new release to test these changes ? don't see anything new on Github, thx.

Jason2866 · 2022-03-29T17:23:24Z

No, this only relevant when you use the Python version. The compiled versions are working.

Montreal666 · 2022-03-29T17:26:37Z

Anything planned to fix the slowness/freezing issues described above in Windows ?

jziolkowski · 2022-03-29T17:48:39Z

@homeseer666 I recognize your username from discord. Please contact me directly, we need to set up a live session for that

jziolkowski · 2022-11-16T17:22:36Z

@homeseer666 it's been ages but I've gotten back to development. I've fixed this issue in the current development branch.

Just be aware that this version stores config in new location and I didn't make a migration mechanism. The config is saved in ~/.config/tdm/tdm.ini on Mac/Linux, and <USER_DIR>\AppData\Roaming\tdm\tdm.ini on Windows

Montreal666 · 2022-11-16T17:39:48Z

Thanks, will try to test and report back.
Cheers,

barbudor · 2022-11-16T18:32:48Z

Happy to see you back @jziolkowski 😄

About configuration, a way to switch between different configurations would be nice, like specifiying an alternate config file or config folder on the command line would be nice.
I have 3 different independant systems (1 home, 1 remote reachable through VPN, 1 remote using a cloud-based broker) I'm doing "hard-swapping" of files using scripts for now

jziolkowski · 2022-11-16T18:58:04Z

@barbudor let's move it to separate discussion

Montreal666 · 2022-11-16T22:08:21Z

Just to be clear, I see release 0.2.13 updated 6 days ago; should I test this the one ?
because it has the same behavior, IE: starts but eventually freezes.
Thanks,

jziolkowski · 2022-11-16T22:09:31Z

the change is in the develop branch. can you pull and run it? if not, I can compile an .exe from development

Montreal666 · 2022-11-16T22:29:18Z

I already have a working uncompiled version from last summer which I manually run from a venv;
if you could compile it that would be great. Will test and report back.
thx

jziolkowski · 2022-12-11T21:19:43Z

https://github.com/jziolkowski/tdm/actions/runs/3670837944

at the very bottom there is a zipped file including all builds of the latest develop. Please give it a shot.

Notice: TDM stores config file in a different place now. At windows it's
%appdata%\tdm\tdm.ini

Montreal666 · 2022-12-14T03:53:12Z

Thanks, much appreciated, will test and report back, cheers

Montreal666 · 2022-12-20T21:18:07Z

Works! Thank you
Takes a little while to populate (68 devices) but once started it doesn't seem to hang/crash.
Thanks for the great work on this one ;)
cheers!

Montreal666 · 2022-12-20T21:28:51Z

BTW just something for the wishlist :

abilty to add custom columns to the main screen/device list
ex: teleperiod or setoptionxxx ; and possibly bulk edit these same features for selected devices

ex: recently had to manually change teleperiod,wattres,ampres,voltres and energyres on a number of energy monitoring devices, this would have proven useful to target the correct devices and push the change to the right ones.

Thx again!

jziolkowski · 2022-12-20T22:45:03Z

So glad to hear!

Takes a little while to populate (68 devices) but once started it doesn't seem to hang/crash.

I started working on supporting native tasmota discovery, it's blazing fast.

abilty to add custom columns to the main screen/device list

Please give it a try while I'll think of a way to make it configurable in GUI... https://github.com/jziolkowski/tdm/wiki/View-mode-customization

ex: recently had to manually change teleperiod,wattres,ampres,voltres and energyres on a number of energy monitoring devices, this would have proven useful to target the correct devices and push the change to the right ones.

I'll add this to the roadmap

jziolkowski · 2022-12-20T22:47:16Z

However, in the latest develop version there is a change in where the config files are located

On Linux/Unix it's ~/.config/tdm, on Windows it's %appdata%\Roaming\tdm

Montreal666 · 2022-12-21T04:09:39Z

Please give it a try while I'll think of a way to make it configurable in GUI... https://github.com/jziolkowski/tdm/wiki/View-mode-customization

The columns are added but not populated, am I missing something? Thanks

[Views]
Home="Module;Power;Color;LoadAvg;LinkCount;Uptime;Teleperiod;Setoption59"

Montreal666 · 2023-01-31T18:59:11Z

just a quick follow up on the above as it would be very useful;
not sure if I am missing something in configuring new columns in the ini file ?

[Views]
Home="Module;Power;Color;LoadAvg;LinkCount;Uptime;Teleperiod;Setoption59"

jziolkowski added the awaiting feedback Feedback needed from opener of the issue label Dec 13, 2022

60 devices - TDM extremely slow - not usable #185

60 devices - TDM extremely slow - not usable #185

Comments

Montreal666 commented Feb 7, 2022

jziolkowski commented Feb 7, 2022 • edited

Montreal666 commented Feb 7, 2022 • edited

Montreal666 commented Feb 7, 2022

barbudor commented Feb 7, 2022

Montreal666 commented Feb 7, 2022 • edited

jziolkowski commented Feb 7, 2022

barbudor commented Feb 7, 2022

Montreal666 commented Feb 8, 2022

Montreal666 commented Feb 8, 2022

barbudor commented Feb 8, 2022

Montreal666 commented Feb 8, 2022

barbudor commented Feb 8, 2022

jziolkowski commented Feb 8, 2022

barbudor commented Feb 8, 2022

Montreal666 commented Feb 8, 2022

BartGijsbers commented Feb 18, 2022 • edited

jziolkowski commented Feb 18, 2022

BartGijsbers commented Feb 19, 2022

barbudor commented Feb 19, 2022

jziolkowski commented Feb 19, 2022

BartGijsbers commented Feb 20, 2022 • edited

jziolkowski commented Feb 20, 2022

BartGijsbers commented Feb 20, 2022

jziolkowski commented Feb 20, 2022

jziolkowski commented Feb 20, 2022

BartGijsbers commented Feb 20, 2022

Montreal666 commented Mar 1, 2022

barbudor commented Mar 1, 2022

Montreal666 commented Mar 1, 2022

barbudor commented Mar 2, 2022

jziolkowski commented Mar 4, 2022

Montreal666 commented Mar 4, 2022

jziolkowski commented Mar 4, 2022

Montreal666 commented Mar 4, 2022

Montreal666 commented Mar 4, 2022 • edited

jziolkowski commented Mar 4, 2022

Montreal666 commented Mar 5, 2022

Montreal666 commented Mar 5, 2022

dawnstrider commented Mar 26, 2022

Jason2866 commented Mar 26, 2022

Montreal666 commented Mar 29, 2022

Jason2866 commented Mar 29, 2022

Montreal666 commented Mar 29, 2022

jziolkowski commented Mar 29, 2022

jziolkowski commented Nov 16, 2022

Montreal666 commented Nov 16, 2022

barbudor commented Nov 16, 2022

jziolkowski commented Nov 16, 2022

Montreal666 commented Nov 16, 2022

jziolkowski commented Nov 16, 2022

Montreal666 commented Nov 16, 2022

jziolkowski commented Dec 11, 2022

Montreal666 commented Dec 14, 2022

Montreal666 commented Dec 20, 2022

Montreal666 commented Dec 20, 2022 • edited

jziolkowski commented Dec 20, 2022

jziolkowski commented Dec 20, 2022

Montreal666 commented Dec 21, 2022

Montreal666 commented Jan 31, 2023

jziolkowski commented Feb 7, 2022 •

edited

Montreal666 commented Feb 7, 2022 •

edited

Montreal666 commented Feb 7, 2022 •

edited

BartGijsbers commented Feb 18, 2022 •

edited

BartGijsbers commented Feb 20, 2022 •

edited

Montreal666 commented Mar 4, 2022 •

edited

Montreal666 commented Dec 20, 2022 •

edited