模型的回答是空输出，偶尔能输出一次正常的；后面我将语言切换到中文后，最初对话顺序错乱后面就都正常；

[WenJieLife]

1.启动命令和操作系统信息：
./ai00_server --model ~/GPT/RWKV-model/RWKV-4-World-CHNtuned-7B-v1-20230709-ctx4096.st --quant 32
系统：Ubuntu22
显卡：AMD RX6700XT 12GB

2.以下是终端记录：
`terryjay@TJUbuntu:/GPT/ai00$ ./ai00_server --model ./RWKV-4-World-CHNtuned-7B-v1-20230709-ctx4096.st --quant 32
✔ Please select an adapter · AMD Radeon RX 6700 XT (RADV NAVI22) (Vulkan)
2023-09-16T03:12:15.772Z INFO [ai00_server] server started at http://0.0.0.0:65530
2023-09-16T03:14:59.251Z INFO [ai00_server] AdapterInfo {
name: "AMD Radeon RX 6700 XT (RADV NAVI22)",
vendor: 4098,
device: 29663,
device_type: DiscreteGpu,
driver: "radv",
driver_info: "Mesa 22.2.5-0ubuntu0.122.04.3",
backend: Vulkan,
}
2023-09-16T03:14:59.251Z INFO [ai00_server] ModelInfo {
num_layers: 32,
num_emb: 4096,
num_vocab: 65536,
}
2023-09-16T03:14:59.251Z INFO [ai00_server] chosen head chunk size: large (8192)
2023-09-16T03:17:08.866Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:08.866Z TRACE [ai00_server] state cache miss
2023-09-16T03:17:08.866Z TRACE [ai00_server] User: 现在的时间是2023 9月 16日 星期六 上午

Assistant: 好的我知道了！

User: 你是谁？

Assistant: Hello, I am your AI assistant. If you have any questions or instructions, please let me know!

User: 你好

Assistant:

User: hello

Assistant:

User: 你好

Assistant:

[DONE]
2023-09-16T03:17:09.823Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:29.249Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:29.249Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:29.249Z TRACE [ai00_server] User: hello!

Assistant:
User:[DONE]
2023-09-16T03:17:29.405Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:33.687Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:33.688Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:33.688Z TRACE [ai00_server]

User: 111

Assistant:
User

[DONE]
2023-09-16T03:17:33.853Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:37.943Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:37.943Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:37.943Z TRACE [ai00_server] User: ???

Assistant:
I'm sorry, but I'm not sure what you mean by "111". Can you please provide more context or information?

[DONE]
2023-09-16T03:17:39.044Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:52.410Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:52.410Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:52.410Z TRACE [ai00_server] User: 今天是什么日子

Assistant:
User:[DONE]
2023-09-16T03:17:52.618Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:27:47.835Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:27:47.835Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:27:47.836Z TRACE [ai00_server]

User: 你叫什么

Assistant:
User

[DONE]
2023-09-16T03:27:48.017Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:27:54.082Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:27:54.082Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:27:54.082Z TRACE [ai00_server] User: ？

Assistant:
我是一个AI助手，你可以称呼我为“你”或者“小助手”。

[DONE]
2023-09-16T03:27:55.263Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:27:59.982Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:27:59.982Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:27:59.982Z TRACE [ai00_server] User: 111

Assistant:
好的，有什么问题或任务需要我帮忙吗？

[DONE]
2023-09-16T03:28:00.806Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:28:06.045Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:28:06.045Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:28:06.045Z TRACE [ai00_server] User: OK

Assistant:
如果您有任何问题或需要帮助，请随时告诉我。

[DONE]
2023-09-16T03:28:07.027Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:28:13.035Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:28:13.036Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:28:13.036Z TRACE [ai00_server] User: 小助手

Assistant:
是的，有什么我可以帮您的吗？User:[DONE]
2023-09-16T03:28:13.867Z TRACE [ai00_server] state cache evicted: 0
`

3.以下是网页chat截图：

[tastypear]

我也有这个问题，在rwkv-runner中运行的时候字多一点就输出空