LVGL + Touch Display + USB-Mouse + USB-Keyboard

Tested with ESP32 DevKitC v4 ( or Lolin ESP32 lite ), ili9341 display and Arduino IDE 2.1.0 ( PlatformIO ).

A second test with an ESP32-S3 is in the folder S3.

The library ESP32-USB-Soft-Host 0.1.4 supports only USB1.1 and known working HID devices can be found here or below.

The display works with LVGL, TFT_eSPI by Bodmer or LovyanGFX. Details about this display and the installation of the libraries can be found here. Remember that here the CS pin has changed from GPIO15 to GPIO14, because GPIO15 is needed as second USB device.

Connections for ESP32 DevKitC V4

Share SPI - MOSI, MISO and CLK, so you need only 11 Pin's for 3 SPI devices.

GPIO	USB	TFT	Touch	SD-Card	Description
16	DP_P0				D+ ( green )
17	DM_P0				D- ( white )
13	DP_P3				D+ ( green )
15	DM_P3				D- ( white )
					5V ( red )
					GND ( black )
------	-------	-------	-------	---------	----------------
EN		RESET			RST
23		SDI	T_DIN	(SD_MOSI)	MOSI
19		(SDO)	T_DO	(SD_MISO)	MISO
18		SCK	T-CLK	(SD_SCK)	CLK
2		DC			DC
14		CS			CS (TFT)
4			T_CS		CS (Touch)
(5)				(SD_CS)	CS (SD)
			T_IRQ		IRQ (not used)
		GND			GND
		VCC			3.3V
		LED			3.3V

D+ and D- are directly connected to the GPIO's without using any resistor. SD-card and GPIO 5 are not used in this test.

Quick installation

• Arduino :
  • Install the libraries "lvgl", "TFT_eSPI" and "LovyanGFX".
  • Copy the program file(s) from the folder "Arduino/" and especially "Arduino/libraries/", which contain all configuration files and the library "ESP32-USB-Soft-Host-main" version 1.0.4 .
  • Copy the demos folder "Arduino\libraries\lvgl\demos" to "Arduino\libraries\lvgl\ src\demos"
  • Copy the examples folder "Arduino\libraries\lvgl\examples" to "Arduino\libraries\lvgl\ src\examples".
• PlatformIO :
  • Copy all files from the folder "PlatformIO/LVGL_Demo_USB_kbd/" or "PlatformIO/LVGL_Demo_USB_Lovyan_kbd/" to your project folder.
  • PlatformIO should now install the missing libraries.
  • Copy the folder ".pio/libdeps/esp32dev/lvgl/demos" to ".pio/libdeps/esp32-s3-devkitc-1/lvgl/ src/demos".
  • Copy the folder ".pio/libdeps/esp32dev/lvgl/examples" to ".pio/libdeps/esp32-s3-devkitc-1/lvgl/ src/examples".

Test programs

Details about installation and configuration of the libraries LVGL, TFT_eSPI and LovyanGFX can be found here. All modified files can be found above in the folders Arduino or PlatformIO. Version 0.1.4 of ESP32-USB-Soft-Host is used and must be copied e.g. from here.

• USB_Test_Scan.ino ( PlatformIO version )

  • Used for testing, whether there are mice and keyboards, that work with "ESP32-USB-Soft-Host". Only this library must be installed or copied. The line "#define DEBUG_ALL" is not commented, so a lot of informations are shown. For further informations every 10 seconds or so ( USB0: Ack = 0 Nack = 0 ... ) set the "Core Debug Level" to "Debug" or "Verbose" in the Arduino IDE.

• USB_Test_Input.ino ( PlatformIO version ).

  • More/other information are shown in the serial monitor.
    • Which Mouse Button is pressed
    • Direction of mouse movement and scrolling.
    • Keyboard input is shown directy for english ( //#define lang_DE ) or german keyboard ( #define lang_DE ), also special characters ( @€µöäü etc. )

• LVGL_Arduino_USB.ino ( PlatformIO version )

  • Libraries needed : LVGL , TFT_eSPI and ESP32-USB-Soft-Host 0.1.4.
  • Mouse and all mouse buttons are working fine in LVGL.
  • Custom mouse cursor is shown (see comments in "Cursor_XXxXX.c" files.
  • Keyboard works except special keys ( äöü߀... ).
  • Mouse position x/y , buttons and Keyboard keys are shown in the serial monitor.

• LVGL_Arduino_USB_Lovyan.ino ( PlatformIO version mouse does not work properly)

  • Version for the library LovyanGFX

The target of these programs is to find out how HID mice and keyboards can be used with an ESP32.

Problems with the PlatformIO versions :

Compiling errors and warnings are related to the special characters ( öäü߀ etc.) in the library "usbkbd_de.h".

To avoid the [-Wnarrowing] errors the "platformio.ini" should contain the build flag "-Wno-narrowing" :

; ...
lib_deps = 
  ESP32-USB-Soft-Host
build_flags =
  -Wno-narrowing      ; disable [-Wnarrowing] errors
  ;-Wno-multichar     ; disable [-Wmultichar] warnings
; ...

The mouse does not work properly in PlatformIO/LVGL_Demo_USB_Lovyan_kbd.

Library files ESP32-USB-Soft-Host

Some files of ESP32-USB-Soft-Host are slightly modified for minimal output of messages in the serial monitor, if "DEBUG_ALL" is commented in the line "//#define DEBUG_ALL".

The library files i downloaded and used for testing are recognized by VSCode/PlatformIO as "ESP32-USB-Soft-Host @ 0.1.4".

My working HID devices

Type	bcdUSB	idVendor	idProduct	3.3V	Description
Mouse	0x0200	0x04f2	0x0923	Yes	HP MSU0923
Mouse	0x0110	0x062a	0x0000	Yes	Speedlink Snappy BL-6141
Keyboard	0x0110	0x04ca	0x0050	No	Acer SK-9621
Keyboard	0x0200	0x04f2	0x1516	Yes	HP KU-1516
Keyboard	0x0110	0x03f0	0x1441	No	HP SK-2029

None of my wireless HID devices work. Neither the keyboard HP KBAR211.

Some usb devices work with 3.3V .

No device was found when i use the logic level shifter TXS0108E (YF08E).