ESPnet version 202207

New Features

• [New Features][ESPnet1][ASR] Add DDP support for v1 ASR training. #4430 by @lazykyama
• [New Features][ESPnet2] Support tensorboard graph #4418 by @kamo-naoyuki
• [New Features][ESPnet2][ASR] Branchformer Encoder in ESPnet2 #4400 by @pyf98
• [New Features][ESPnet2][Diarization][SE] enh_diar joint model #4339 by @YushiUeda
• [New Features][ESPnet2][ESPnet1] Calculate RTF and latency in espnet2 #4382 by @espnetUser
• [New Features][ESPnet2][ESPnet1][SE] Add EnhPreprocessor for Speech Enhancement #4321 by @Emrys365
• [New Features][ESPnet2][SE] Add DPTNet and WarmupStepLR scheduler #4449 by @Emrys365
• [New Features][ESPnet2][SE] Add support for calculating losses on noise and dereverberated signals #4476 by @Emrys365

Recipe

• [Recipe][ESPnet2] Aishell-2 GPU info #4501 by @jctian98
• [Recipe][ESPnet2] Fix librispeech default path to signify auto download #4517 by @karthik19967829
• [Recipe][ESPnet2] Recipe fix for PueblaNahuatl Recipe #4522 by @ftshijt
• [Recipe][ESPnet2][ASR][README] Add Aishell-2 ASR Recipe for Espnet2 #4451 by @jctian98
• [Recipe][ESPnet2][ASR][README] Add AmericasNLP 2022 baselines #4428 by @akreal
• [Recipe][ESPnet2][ESPnet1][ASR][Installation] FLEURS ASR Recipe for ESPnet2 #4455 by @wanchichen
• [Recipe][ESPnet2][ESPnet1][ASR][README] tedx_spanish_corpus egs2 recipe #4523 by @jessicah25
• [Recipe][ESPnet2][ESPnet1][ASR][SE] Adding L3DAS22 Task1 model to ESPNet-SE #3994 by @popcornell
• [Recipe][ESPnet2][ESPnet1][ST] Must_C v1 and v2 in egs2 #4306 by @brianyan918
• [Recipe][ESPnet2][README] Dcase task1 Baseline #4317 by @siddhu001
• [Recipe][ESPnet2][README] Report Aishell-2 Transducer results #4489 by @jctian98
• [Recipe][ESPnet2][README] Update language codes in AmericasNLP 2022 baseline #4441 by @akreal
• [Recipe][ESPnet2][README] Vox populi baseline #4478 by @siddhu001
• [Recipe][ESPnet2][SE] L3DAS22 enhancement recipe #4269 by @neillu23
• [Recipe][ESPnet2][SE] Update notes in the recipes for DNS challenges #4433 by @YoshikiMas
• [Recipe][ESPnet2][SE][SLU][ST] LT-Spatialized and SLURP-Spatialized combined enhancement recipe #4268 by @neillu23
• [Recipe][ESPnet2][ST] Add moses check for ST recipes #4417 by @ftshijt
• [Recipe][ESPnet2][TTS] Add talromur recipe #4379 by @G-Thor
• [Recipe][ESPnet2][TTS] Fix for issue #4401 #4402 by @G-Thor
• [Recipe][ESPnet2][TTS] add pre-trained model jets in the recipe of ljspeech, kss #4406 by @imdanboy

Bugfix

• [Bugfix][ESPnet1] fix the corrupted pretrained model #4490 by @wentaoxandry
• [Bugfix][ESPnet1][ESPnet2] Fix an4 URL #4427 by @pyf98
• [Bugfix][ESPnet1][ESPnet2][RNNT] Fix mAES with big vocab size #4312 by @b-flo
• [Bugfix][ESPnet2] Adding init.py to espnet2/diar/layers and espnet2/diar/separator #4470 by @cycentum
• [Bugfix][ESPnet2] Fix tensorboard-graph creation for multi gpu mode #4431 by @kamo-naoyuki
• [Bugfix][ESPnet2] Update char_tokenizer.py #4499 by @xiabingquan
• [Bugfix][ESPnet2][ESPnet1][ASR][LM][MT][TTS] Fix Transducer LM fusion and add Logging for Transducer inference #4327 by @chintu619
• [Bugfix][ESPnet2][SE] Fix a bug in enh unit test #4435 by @Emrys365

Enhancement

• [Enhancement][ESPnet2] Optionize graph creation #4551 by @kan-bayashi
• [Enhancement][ESPnet2][Installation][TTS] Add icelandic g2p #4384 by @G-Thor
• [Enhancement][ESPnet2][SE] Add support of test-only criterions after each epoch #4381 by @Emrys365
• [Enhancement][ESPnet2][SSL] raise more useful error in espnet2/asr/frontend/s3prl.py if s3prl is not installed #4480 by @popcornell
• [Enhancement][ESPnet2][TTS] Add JETS AlignmentModule in calculate_all_attentions.py #4446 by @seastar105

Refactoring

• [Refactoring][ESPnet1] Refactoring 'is_prefix' function #4530 by @jhlee9010
• [Refactoring][ESPnet2][ASR] Zero_infinity option for ctc loss #4415 by @kamo-naoyuki

Others

• [CI][ESPnet1][ESPnet2][Installation] Remove the version restriction for numpy #4419 by @kamo-naoyuki
• [CI][ESPnet2] Canged to install espnet from wheel in the test_import CI test #4471 by @kamo-naoyuki
• [CI][Installation] Temporary fixed numpy version #4464 by @kamo-naoyuki
• [Documentation] Add notes on batch size and num of GPUs in ESPnet2 documentation #4436 by @pyf98
• [Documentation][ESPnet1] Update decoder.py #4322 by @sw005320
• [Documentation][ESPnet2] Add a note to follow the installation instructions #4477 by @akreal

Acknowledgements

Special thanks to @Emrys365, @G-Thor, @YoshikiMas, @YushiUeda, @akreal, @b-flo, @brianyan918, @chintu619, @cycentum, @espnetUser, @ftshijt, @imdanboy, @jctian98, @jessicah25, @jhlee9010, @kamo-naoyuki, @kan-bayashi, @karthik19967829, @lazykyama, @neillu23, @popcornell, @pyf98, @seastar105, @siddhu001, @sw005320, @wanchichen, @wentaoxandry, @xiabingquan.