DeepSeech2 pytorch implementation
L 『PyTorch』とは、Facebookが開発を主導したPython向けの機械学習ライブラリ
Github:
What is Deep Speech2?
end-to-end deep learning approach
Key to approach is our application of HPC techniques, resulting in a 7x speedup over our previous system
入力音声をMelspectrogram変換した後、CNNおよびRNNを適用し、最後にCTCでテキスト出力
CTCの言語モデルを補正する事で、より自然な文章にすることができる
python3 deepspeech2.py -i input.wav で使用
### install(安装)
$ git clone http://www.github.com/SeanNaren/deepspeech.pytorch
> 此外，需要安装几个库以便进行训练。我假设所有的东西都安装在Ubuntu上的Anaconda中。 如果你还没有安装pytorch，请安装。 为Warp-CTC绑定安装这个fork ：
ubuntuにpytorchをインストールします。
$ pip3 install torchvision
beam search decoding for PyTorch
$ git clone –recursive https://github.com/parlance/ctcdecode.git
$ cd ctcdecode && pip3 install .
finally install deepspeech.pytorch
$ pip3 install -r requirements.txt
$ pip3 install -e .
### Training
– Datasets
$ cd data
$ python3 an4.py
Manifest CSV file
train.py take csv file called manifest file, which is a csv file containing the paths to wav files and label texts files.
$ cd ..
$ python3 train.py +configs=an4
train.py:19: UserWarning:
config_path is not specified in @hydra.main().
See https://hydra.cc/docs/next/upgrades/1.0_to_1.1/changes_to_hydra_main_config_path for more information.
@hydra.main(config_name=”config”)
/home/vagrant/.local/lib/python3.8/site-packages/hydra/_internal/defaults_list.py:251: UserWarning: In ‘config’: Defaults list is missing `_self_`. See https://hydra.cc/docs/upgrades/1.0_to_1.1/default_composition_order for more information
warnings.warn(msg, UserWarning)
Global seed set to 123456
Error executing job with overrides: [‘+configs=an4’]
Traceback (most recent call last):
File “train.py”, line 21, in hydra_main
train(cfg=cfg)
File “/home/vagrant/deepspeech2/deepspeech.pytorch/deepspeech_pytorch/training.py”, line 25, in train
checkpoint_callback = FileCheckpointHandler(
File “/home/vagrant/deepspeech2/deepspeech.pytorch/deepspeech_pytorch/checkpoint.py”, line 16, in __init__
super().__init__(
TypeError: __init__() got an unexpected keyword argument ‘prefix’
Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.
う〜ん、コンパイルまでは上手く行ってるような気がするけど、何か難しいな。。。
