Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chinese error #23

Open
gitlihua opened this issue Oct 17, 2023 · 0 comments
Open

chinese error #23

gitlihua opened this issue Oct 17, 2023 · 0 comments

Comments

@gitlihua
Copy link

(vid2vid) root@ecs-5dea:~/Text2Video# sh text2video_tts_chinese.sh "正在为您查询合肥的天气情况。今天是2020年2月24日,合肥市今天多云,最低温度9摄氏度,最高温度15摄氏度,微风。" henan f
正在为您查询合肥的天气情况。今天是2020年2月24日,合肥市今天多云,最低温度9摄氏度,最高温度15摄氏度,微风。
henan
f
input 正在为您查询合肥的天气情况。今天是2020年2月24日,合肥市今天多云,最低温度9摄氏度,最高温度15摄氏度,微风。
stripped_input 正在为您查询合肥的天气情况今天是2020年2月24日合肥市今天多云最低温度9摄氏度最高温度15摄氏度微风
person henan
Traceback (most recent call last):
File "tts_request.py", line 54, in
sound = AudioSegment.from_mp3('./input_audio/{person}/{file_name}.mp3'.format(person=person, file_name=file_name))
File "/root/venv/vid2vid/lib/python3.8/site-packages/pydub/audio_segment.py", line 796, in from_mp3
return cls.from_file(file, 'mp3', parameters=parameters)
File "/root/venv/vid2vid/lib/python3.8/site-packages/pydub/audio_segment.py", line 773, in from_file
raise CouldntDecodeError(
pydub.exceptions.CouldntDecodeError: Decoding failed. ffmpeg returned error code: 1

Output from ffmpeg/avlib:

ffmpeg version 4.2.7-0ubuntu0.1 Copyright (c) 2000-2022 the FFmpeg developers
built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.1)
configuration: --prefix=/usr --extra-version=0ubuntu0.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-nvenc --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
libavutil 56. 31.100 / 56. 31.100
libavcodec 58. 54.100 / 58. 54.100
libavformat 58. 29.100 / 58. 29.100
libavdevice 58. 8.100 / 58. 8.100
libavfilter 7. 57.100 / 7. 57.100
libavresample 4. 0. 0 / 4. 0. 0
libswscale 5. 5.100 / 5. 5.100
libswresample 3. 5.100 / 3. 5.100
libpostproc 55. 5.100 / 55. 5.100
[mp3 @ 0x55e641b4f700] Failed to read frame size: Could not seek to 1160.
./input_audio/henan/正在为您查询合肥的天.mp3: Invalid argument

stripped_chn_punct 正在为您查询合肥的天气情况今天是2020年2月24日合肥市今天多云最低温度9摄氏度最高温度15摄氏度微风
stripped_eng_punct 正在为您查询合肥的天气情况今天是2020年2月24日合肥市今天多云最低温度9摄氏度最高温度15摄氏度微风
len_stripped 52
Please download the model from https://github.com/alphacep/vosk-api/blob/master/doc/models.md and unpack as 'model' in the current folder.
Traceback (most recent call last):
File "interp_landmarks_motion.py", line 48, in
first_didx = int(pinyin_ts[0][0])
IndexError: index 0 is out of bounds for axis 0 with size 0
------------ Options -------------
add_face_disc: False
aspect_ratio: 1.0
basic_point_only: False
batchSize: 1
checkpoints_dir: ./checkpoints
dataroot: datasets/henan
dataset_mode: pose
debug: False
densepose_only: False
display_id: 0
display_winsize: 512
feat_num: 3
fg: False
fg_labels: [26]
fineSize: 512
fp16: False
gpu_ids: [0]
how_many: 1200
input_nc: 3
isTrain: False
label_feat: False
label_nc: 0
loadSize: 512
load_features: False
load_pretrain:
local_rank: 0
max_dataset_size: inf
model: vid2vid
nThreads: 2
n_blocks: 9
n_blocks_local: 3
n_downsample_E: 3
n_downsample_G: 3
n_frames_G: 3
n_gpus_gen: 1
n_local_enhancers: 1
n_scales_spatial: 1
name: henan
ndf: 64
nef: 32
netE: simple
netG: composite
ngf: 128
no_canny_edge: False
no_dist_map: False
no_first_img: True
no_flip: False
no_flow: False
norm: batch
ntest: inf
openpose_only: True
output_nc: 3
phase: test
random_drop_prob: 0.0
random_scale_points: False
remove_face_labels: False
resize_or_crop: scaleHeight
results_dir: ./results/
serial_batches: False
start_frame: 0
tf_log: False
use_instance: False
use_real_img: False
use_single_G: False
which_epoch: latest
-------------- End ----------------
CustomDatasetDataLoader
dataset [PoseDataset] was created
Traceback (most recent call last):
File "test.py", line 23, in
data_loader = CreateDataLoader(opt)
File "/root/vid2vid/data/data_loader.py", line 6, in CreateDataLoader
data_loader.initialize(opt)
File "/root/vid2vid/data/custom_dataset_data_loader.py", line 33, in initialize
self.dataset = CreateDataset(opt)
File "/root/vid2vid/data/custom_dataset_data_loader.py", line 23, in CreateDataset
dataset.initialize(opt)
File "/root/vid2vid/data/pose_dataset.py", line 19, in initialize
self.img_paths = sorted(make_grouped_dataset(self.dir_img))
File "/root/vid2vid/data/image_folder.py", line 38, in make_grouped_dataset
assert os.path.isdir(dir), '%s is not a valid directory' % dir
AssertionError: datasets/henan/test_img is not a valid directory
Moviepy - Building video ./results/henan/shared_video_output/henan_smooth_正在为您查询合肥的天.mp4.
Moviepy - Writing video ./results/henan/shared_video_output/henan_smooth_正在为您查询合肥的天.mp4

t: 0%| | 0/85 [00:00<?, ?it/s, now=None]Traceback (most recent call last):
File "/root/venv/vid2vid/lib/python3.8/site-packages/moviepy/video/io/ffmpeg_writer.py", line 136, in write_frame
self.proc.stdin.write(img_array.tobytes())
BrokenPipeError: [Errno 32] Broken pipe

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "image2video.py", line 70, in
my_clip.write_videofile('./results/{person}/shared_video_output/{person}smooth{audio}.mp4'.format(person=person, audio=file_name),
File "", line 2, in write_videofile
File "/root/venv/vid2vid/lib/python3.8/site-packages/moviepy/decorators.py", line 54, in requires_duration
return f(clip, *a, **k)
File "", line 2, in write_videofile
File "/root/venv/vid2vid/lib/python3.8/site-packages/moviepy/decorators.py", line 135, in use_clip_fps_by_default
return f(clip, *new_a, **new_kw)
File "", line 2, in write_videofile
File "/root/venv/vid2vid/lib/python3.8/site-packages/moviepy/decorators.py", line 22, in convert_masks_to_RGB
return f(clip, *a, **k)
File "/root/venv/vid2vid/lib/python3.8/site-packages/moviepy/video/VideoClip.py", line 300, in write_videofile
ffmpeg_write_video(self, filename, fps, codec,
File "/root/venv/vid2vid/lib/python3.8/site-packages/moviepy/video/io/ffmpeg_writer.py", line 228, in ffmpeg_write_video
writer.write_frame(frame)
File "/root/venv/vid2vid/lib/python3.8/site-packages/moviepy/video/io/ffmpeg_writer.py", line 180, in write_frame
raise IOError(error)
OSError: [Errno 32] Broken pipe

MoviePy error: FFMPEG encountered the following error while writing file ./results/henan/shared_video_output/henan_smooth_正在为您查询合肥的天.mp4:

b'[mp3 @ 0x6836840] Failed to read frame size: Could not seek to 1160.\n../Text2Video/input_audio/henan/\xe6\xad\xa3\xe5\x9c\xa8\xe4\xb8\xba\xe6\x82\xa8\xe6\x9f\xa5\xe8\xaf\xa2\xe5\x90\x88\xe8\x82\xa5\xe7\x9a\x84\xe5\xa4\xa9.mp3: Invalid argument\n'

请问这个问题,怎么解决 ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant