Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ESP32 : spiffs image creation #3571

Open
fikin opened this issue Mar 23, 2023 · 1 comment
Open

ESP32 : spiffs image creation #3571

fikin opened this issue Mar 23, 2023 · 1 comment

Comments

@fikin
Copy link
Contributor

fikin commented Mar 23, 2023 •
edited

generating spiffs image for ESP32 in following way:

sdk/esp32-esp-idf/components/spiffs/spiffsgen.py 0x100000 local/fs build/spiffs.img

using default partition table with changed sizes for lfs and spiffs only:

...
lfs,0xC2, 0x01, ,0x40000
storage, data, spiffs, ,0x100000

and flashing it together with bootloader and nodemcu.bin:

.../esptool.py ... write_flash ... 0x10000 build/nodemcu.bin 0x1d0000 build/spiffs.img

the device boots but spiffs stats are not working:

> =file.list()
Failed to stat init.lc err=-1
Failed to stat _lfs-reload.lc err=-1
Failed to stat LFS.img err=-1
...
table: 0x3ffc2dc4

boot banner for partition table seems to fit with used addresses :

I (59) boot: Partition Table:
I (63) boot: ## Label            Usage          Type ST Offset   Length
I (70) boot:  0 nvs              WiFi data        01 02 00009000 00006000
I (78) boot:  1 phy_init         RF data          01 01 0000f000 00001000
I (85) boot:  2 factory          factory app      00 00 00010000 00180000
I (93) boot:  3 lfs              unknown          c2 01 00190000 00040000
I (100) boot:  4 storage          Unknown data     01 82 001d0000 00100000

if i do file.format(), its starts to work.

is that the technique to prepare and flash spiffs for esp32?
@fikin
Copy link
Contributor Author

fikin commented Mar 23, 2023

after reading 6429 and 9984 i thought of playing with the options a bit.

and there is partial progress using image produced by mkspiffs but not by spiffsgen.py.

how much are we deviating in dev-esp32 branch from master in esp-idf?

default sdkconfig is containing:

CONFIG_SPIFFS_PAGE_SIZE=256
CONFIG_SPIFFS_OBJ_NAME_LEN=32
CONFIG_SPIFFS_USE_MAGIC=y
CONFIG_SPIFFS_USE_MAGIC_LENGTH=y
CONFIG_SPIFFS_META_LENGTH=4

if i compile image using ../mkspiffs/mkspiffs -c local/fs -s 0x100000 build/spiffs.img (mkspiffs is compiled with above settings),

i'm able to open a file using /<file name> path but file.list still fails to stat it.

rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:2
load:0x3fff0030,len:6676
load:0x40078000,len:14848
ho 0 tail 12 room 4
load:0x40080400,len:3792
entry 0x40080694
I (29) boot: ESP-IDF v4.4-dev-5344-g6407ecb3f8 2nd stage bootloader
I (29) boot: compile time 17:04:56
I (29) boot: chip revision: 1
I (33) boot_comm: chip revision: 1, min. bootloader chip revision: 0
I (40) boot.esp32: SPI Speed      : 40MHz
I (45) boot.esp32: SPI Mode       : DIO
I (49) boot.esp32: SPI Flash Size : 4MB
I (54) boot: Enabling RNG early entropy source...
I (59) boot: Partition Table:
I (63) boot: ## Label            Usage          Type ST Offset   Length
I (70) boot:  0 nvs              WiFi data        01 02 00009000 00006000
I (78) boot:  1 phy_init         RF data          01 01 0000f000 00001000
I (85) boot:  2 factory          factory app      00 00 00010000 00180000
I (93) boot:  3 lfs              unknown          c2 01 00190000 00040000
I (100) boot:  4 storage          Unknown data     01 82 001d0000 00100000
I (108) boot: End of partition table
I (112) boot_comm: chip revision: 1, min. application chip revision: 0
I (119) esp_image: segment 0: paddr=00010020 vaddr=3f400020 size=29d18h (171288) map
I (190) esp_image: segment 1: paddr=00039d40 vaddr=3ff80063 size=00008h (     8) load
I (190) esp_image: segment 2: paddr=00039d50 vaddr=3ffb0000 size=03884h ( 14468) load
I (201) esp_image: segment 3: paddr=0003d5dc vaddr=40080000 size=02a3ch ( 10812) load
I (209) esp_image: segment 4: paddr=00040020 vaddr=400d0020 size=baf50h (765776) map
I (490) esp_image: segment 5: paddr=000faf78 vaddr=40082a3c size=147a0h ( 83872) load
I (524) esp_image: segment 6: paddr=0010f720 vaddr=400c0000 size=00064h (   100) load
I (525) esp_image: segment 7: paddr=0010f78c vaddr=50000000 size=00010h (    16) load
I (541) boot: Loaded app from partition at offset 0x10000
I (541) boot: Disabling RNG early entropy source...
I (555) cpu_start: Pro cpu up.
D (555) efuse: In EFUSE_BLK0__DATA3_REG is used 1 bits starting with 15 bit
D (556) efuse: In EFUSE_BLK0__DATA5_REG is used 1 bits starting with 20 bit
D (564) efuse: In EFUSE_BLK0__DATA3_REG is used 3 bits starting with 9 bit
D (571) efuse: In EFUSE_BLK0__DATA3_REG is used 1 bits starting with 2 bit
I (578) cpu_start: Starting app cpu, entry point is 0x40081534
I (0) cpu_start: App cpu up.
D (592) clk: RTC_SLOW_CLK calibration value: 3251328
I (605) cpu_start: Pro cpu start user code
I (605) cpu_start: cpu freq: 160000000
I (605) cpu_start: Application information:
I (609) cpu_start: Project name:     nodemcu
I (614) cpu_start: App version:      32d03a2-dirty
I (620) cpu_start: Compile time:     Mar 23 2023 13:31:16
I (626) cpu_start: ELF file SHA256:  0962067f2af1b9cf...
I (632) cpu_start: ESP-IDF:          v4.4-dev-5344-g6407ecb3f8
D (638) memory_layout: Checking 7 reserved memory ranges:
D (644) memory_layout: Reserved memory range 0x3ffae000 - 0x3ffae6e0
D (650) memory_layout: Reserved memory range 0x3ffb0000 - 0x3ffb7b00
D (656) memory_layout: Reserved memory range 0x3ffe0000 - 0x3ffe0440
D (663) memory_layout: Reserved memory range 0x3ffe3f20 - 0x3ffe4350
D (669) memory_layout: Reserved memory range 0x40070000 - 0x40078000
D (676) memory_layout: Reserved memory range 0x40078000 - 0x40080000
D (682) memory_layout: Reserved memory range 0x40080000 - 0x400971dc
D (689) memory_layout: Building list of available memory regions:
D (695) memory_layout: Available memory region 0x3ffae6e0 - 0x3ffb0000
D (701) memory_layout: Available memory region 0x3ffb7b00 - 0x3ffb8000
D (708) memory_layout: Available memory region 0x3ffb8000 - 0x3ffc0000
D (715) memory_layout: Available memory region 0x3ffc0000 - 0x3ffc2000
D (721) memory_layout: Available memory region 0x3ffc2000 - 0x3ffc4000
D (728) memory_layout: Available memory region 0x3ffc4000 - 0x3ffc6000
D (734) memory_layout: Available memory region 0x3ffc6000 - 0x3ffc8000
D (741) memory_layout: Available memory region 0x3ffc8000 - 0x3ffca000
D (748) memory_layout: Available memory region 0x3ffca000 - 0x3ffcc000
D (754) memory_layout: Available memory region 0x3ffcc000 - 0x3ffce000
D (761) memory_layout: Available memory region 0x3ffce000 - 0x3ffd0000
D (767) memory_layout: Available memory region 0x3ffd0000 - 0x3ffd2000
D (774) memory_layout: Available memory region 0x3ffd2000 - 0x3ffd4000
D (781) memory_layout: Available memory region 0x3ffd4000 - 0x3ffd6000
D (787) memory_layout: Available memory region 0x3ffd6000 - 0x3ffd8000
D (794) memory_layout: Available memory region 0x3ffd8000 - 0x3ffda000
D (800) memory_layout: Available memory region 0x3ffda000 - 0x3ffdc000
D (807) memory_layout: Available memory region 0x3ffdc000 - 0x3ffde000
D (813) memory_layout: Available memory region 0x3ffde000 - 0x3ffe0000
D (820) memory_layout: Available memory region 0x3ffe0440 - 0x3ffe3f20
D (827) memory_layout: Available memory region 0x3ffe4350 - 0x3ffe8000
D (833) memory_layout: Available memory region 0x3ffe8000 - 0x3fff0000
D (840) memory_layout: Available memory region 0x3fff0000 - 0x3fff8000
D (846) memory_layout: Available memory region 0x3fff8000 - 0x3fffc000
D (853) memory_layout: Available memory region 0x3fffc000 - 0x40000000
D (860) memory_layout: Available memory region 0x400971dc - 0x40098000
D (866) memory_layout: Available memory region 0x40098000 - 0x4009a000
D (873) memory_layout: Available memory region 0x4009a000 - 0x4009c000
D (879) memory_layout: Available memory region 0x4009c000 - 0x4009e000
D (886) memory_layout: Available memory region 0x4009e000 - 0x400a0000
I (893) heap_init: Initializing. RAM available for dynamic allocation:
D (900) heap_init: New heap initialised at 0x3ffae6e0
I (905) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM
D (911) heap_init: New heap initialised at 0x3ffb7b00
I (916) heap_init: At 3FFB7B00 len 00028500 (161 KiB): DRAM
I (922) heap_init: At 3FFE0440 len 00003AE0 (14 KiB): D/IRAM
I (929) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM
D (935) heap_init: New heap initialised at 0x400971dc
I (940) heap_init: At 400971DC len 00008E24 (35 KiB): IRAM
D (947) intr_alloc: Connected src 46 to int 2 (cpu 0)
D (952) FLASH_HAL: extra_dummy: 1
D (955) spi_flash: trying chip: issi
D (959) spi_flash: trying chip: gd
I (962) spi_flash: detected chip: gd
I (966) spi_flash: flash io: dio
D (970) cpu_start: calling init function: 0x4016da1c
D (975) cpu_start: calling init function: 0x401090b4
D (980) cpu_start: calling init function: 0x400f99ac
D (986) cpu_start: calling init function: 0x400d3dac
D (990) cpu_start: calling init function: 0x400d3378
D (996) intr_alloc: Connected src 17 to int 3 (cpu 0)
D (1001) intr_alloc: Connected src 24 to int 9 (cpu 0)
I (1006) cpu_start: Starting scheduler on PRO CPU.
D (0) intr_alloc: Connected src 25 to int 2 (cpu 1)
I (0) cpu_start: Starting scheduler on APP CPU.
D (1032) heap_init: New heap initialised at 0x3ffe0440
D (1032) heap_init: New heap initialised at 0x3ffe4350
D (1042) intr_alloc: Connected src 16 to int 12 (cpu 0)
D (1042) event: running task for loop 0x3ffbde30
D (1052) event: created task for loop 0x3ffbde30
D (1052) event: created event loop 0x3ffbde30
I (1052) uart: queue free spaces: 3
D (1062) intr_alloc: Connected src 34 to int 13 (cpu 0)

D (1062) partition: Loading the partition table
D (1072) partition: Partition table MD5 verified
D (1202) esp_netif_lwip: LwIP stack has been initialized
D (1202) esp_netif_lwip: esp-netif has been successfully initialized
D (1212) nvs: nvs_open_from_partition lfsload 0
D (1212) intr_alloc: Connected src 22 to int 17 (cpu 0)
D (1222) esp_netif_objects: esp_netif_add_to_list 0x3ffc26b0
D (1222) esp_netif_objects: esp_netif_add_to_list netif added successfully (total netifs: 1)
D (1232) esp_netif_objects: esp_netif_add_to_list 0x3ffc5b98
D (1232) esp_netif_objects: esp_netif_add_to_list netif added successfully (total netifs: 2)
D (1242) nvs: nvs_open_from_partition misc 1
I (1262) wifi:wifi driver task: 3ffc8034, prio:23, stack:6656, core=0
I (1262) system_api: Base MAC address is not set
I (1262) system_api: read default base MAC address from EFUSE
D (1272) efuse: In EFUSE_BLK0__DATA2_REG is used 8 bits starting with 8 bit
D (1272) efuse: In EFUSE_BLK0__DATA2_REG is used 8 bits starting with 0 bit
D (1282) efuse: In EFUSE_BLK0__DATA1_REG is used 8 bits starting with 24 bit
D (1292) efuse: In EFUSE_BLK0__DATA1_REG is used 8 bits starting with 16 bit
D (1292) efuse: In EFUSE_BLK0__DATA1_REG is used 8 bits starting with 8 bit
D (1302) efuse: In EFUSE_BLK0__DATA1_REG is used 8 bits starting with 0 bit
D (1312) efuse: In EFUSE_BLK0__DATA2_REG is used 8 bits starting with 16 bit
D (1322) nvs: nvs_open_from_partition nvs.net80211 1
D (1322) nvs: nvs_get opmode 1
D (1322) nvs: nvs_get_str_or_blob sta.ssid
D (1332) nvs: nvs_get sta.authmode 1
D (1332) nvs: nvs_get_str_or_blob sta.pswd
D (1342) nvs: nvs_get_str_or_blob sta.pmk
D (1342) nvs: nvs_get sta.chan 1
D (1342) nvs: nvs_get auto.conn 1
D (1352) nvs: nvs_get bssid.set 1
D (1352) nvs: nvs_get_str_or_blob sta.bssid
D (1352) nvs: nvs_get sta.lis_intval 2
D (1362) nvs: nvs_get sta.phym 1
D (1362) nvs: nvs_get sta.phybw 1
D (1362) nvs: nvs_get_str_or_blob sta.apsw
D (1372) nvs: nvs_get_str_or_blob sta.apinfo
D (1372) nvs: nvs_get sta.scan_method 1
D (1382) nvs: nvs_get sta.sort_method 1
D (1382) nvs: nvs_get sta.minrssi 1
D (1382) nvs: nvs_get sta.minauth 1
D (1392) nvs: nvs_get sta.pmf_e 1
D (1392) nvs: nvs_get sta.pmf_r 1
D (1392) nvs: nvs_get sta.btm_e 1
D (1402) nvs: nvs_get sta.rrm_e 1
D (1402) nvs: nvs_get sta.mbo_e 1
D (1402) nvs: nvs_get_str_or_blob ap.ssid
D (1412) nvs: nvs_get_str_or_blob ap.passwd
D (1412) nvs: nvs_get_str_or_blob ap.pmk
D (1422) nvs: nvs_get ap.chan 1
D (1422) nvs: nvs_get ap.authmode 1
D (1422) nvs: nvs_get ap.hidden 1
D (1432) nvs: nvs_get ap.max.conn 1
D (1432) nvs: nvs_get bcn.interval 2
D (1432) nvs: nvs_get ap.phym 1
D (1442) nvs: nvs_get ap.phybw 1
D (1442) nvs: nvs_get ap.sndchan 1
D (1442) nvs: nvs_get ap.pmf_e 1
D (1452) nvs: nvs_get ap.pmf_r 1
D (1452) nvs: nvs_get ap.p_cipher 1
D (1452) nvs: nvs_get lorate 1
D (1462) nvs: nvs_get_str_or_blob country
D (1462) nvs: nvs_get ap.ftm_r 1
D (1472) nvs: nvs_set ap.sndchan 1 1
I (1472) wifi:wifi firmware version: 8cb87ff
I (1472) wifi:wifi certification version: v7.0
I (1482) wifi:config NVS flash: enabled
I (1482) wifi:config nano formating: disabled
I (1482) wifi:Init data frame dynamic rx buffer num: 32
I (1492) wifi:Init management frame dynamic rx buffer num: 32
I (1492) wifi:Init management short buffer num: 32
I (1502) wifi:Init dynamic tx buffer num: 32
I (1502) wifi:Init static rx buffer size: 1600
I (1512) wifi:Init static rx buffer num: 10
I (1512) wifi:Init dynamic rx buffer num: 32
I (1522) wifi_init: rx ba win: 6
I (1522) wifi_init: tcpip mbox: 32
I (1522) wifi_init: udp mbox: 6
I (1532) wifi_init: tcp mbox: 6
I (1532) wifi_init: tcp tx win: 5744
I (1542) wifi_init: tcp rx win: 5744
I (1542) wifi_init: tcp mss: 1440
I (1542) wifi_init: WiFi IRAM OP enabled
I (1552) wifi_init: WiFi RX IRAM OP enabled
D (1562) nvs: nvs_open_from_partition lfsload 0

NodeMCU ESP32 build unspecified powered by Lua 5.3.5 [5.3-int32-singlefp] on IDF v4.4-dev-5344-g6407ecb3f8
cannot open init.lua: No such file or directory

> =file.list()
Failed to stat init.lc err=-1
Failed to stat _lfs-reload.lc err=-1
Failed to stat LFS.img err=-1
Failed to stat release err=-1
Failed to stat _lfs-init.lc err=-1
table: 0x3ffc2de0
> 
> =file.fsinfo()
865197	91364	956561
>
> f1=assert(io.open("release"))
Lua error: 	stdin:1: release: No such file or directory
stack traceback:
	[C]: in function 'ROM.assert'
	stdin:1: in main chunk
	[C]: in ?
	[C]: in ?
>
> f1=assert(io.open("/release"))
> =f1:read("*a")
4deb89786b7b8082802a1aa5e9d33a17  init.lc
9d48163659b6e1950a6583c734451495  _lfs-reload.lc
26d501e492db018c282a3aff2e1b7664  LFS.img
09fbf439ee4458a2dacdf0d51a9476c7  _lfs-init.lc

> f1:close()

if i use comprehensive spiffsgen.py options:

./sdk/esp32-esp-idf/components/spiffs/spiffsgen.py --aligned-obj-ix-table --page-size=256 --obj-name-len=32 --meta-len=4 --use-magic --use-magic-len 0x100000 local/fs build/spiffs.img

and verifying it by using mkspiffs, built with same settings, renders readable result:

./mkspiffs -l  ../nodemcu-firmware-esp32/build/spiffs.img
428	/init.lc
1133	/_lfs-reload.lc
55543	/LFS.img
1147	/release
1481	/_lfs-init.lc

is failing as in first comment.

@fikin fikin changed the title ESP32 : spiffs image flashing ESP32 : spiffs image creation Mar 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@fikin