enter some directory will stuck a long time then the prompt show

[rmGFW]

Prerequisites

• I've checked the existing issues and I'm not duplicating a report.
• I've checked the zimfw Changelog and I'm not being affected by documented changes.
• I've checked the zimfw 📢 Announcements and I'm not being affected by announced changes.

Bug description

when i cd some directory ,prompt will stuck , i have tried remove all plugin and upgrade to latest zim ,but still not fixed.

Steps to reproduce

1. cd ${$(mktemp -d):A} && \
       ZDOTDIR=${PWD} HOME=${PWD} ZIM_HOME=${PWD}/.zim && \
       curl -fsSL https://raw.githubusercontent.com/zimfw/install/master/install.zsh | zsh && \
       exec zsh
   

2. cd my/folder and it will reproduce now

Current behavior

slow prompt

Expected behavior

faster prompt

zimfw info

zimfw version:        1.12.1 (built at 2023-09-16 18:25:16 UTC, previous commit is 26151d2)
LANG:                 en_US.UTF-8
LC_TERMINAL:          iTerm2
LC_ALL:               en_US.UTF-8
LC_TERMINAL_VERSION:  3.4.20
OSTYPE:               darwin22.0
TERM:                 xterm-256color
TERM_PROGRAM:         iTerm.app
TERM_PROGRAM_VERSION: 3.4.20
ZIM_HOME:             /Users/xxx/.zim
ZSH_VERSION:          5.8.1

Additional context

No response