@j/ 4ddlZddlmZddlmZmZmZddlmZddl m Z ddl m Z ddl mZmZdZd gd gd d d ddddZdZdZdefdZdedededeefdZdedefdZdedefdZGdde ZGd d!eZGd"d#eZdS)$N)Path)ListTupleUnion)Tensor)Dataset)download_url_to_file) _extract_zip_load_waveformi>zvox1_dev_wav.zip)zIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partaazIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partabzIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partaczIhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partad)@21ec6ca843659ebc2fdbe04b530baa4f191ad4b0971912672d92c158f32226a0@311d21e0c8cbf33573a4fce6c80e5a279d80736274b381c394319fc557159a04@92b64465f2b2a3dc0e4196ae8dd6828cbe9ddd1f089419a11e4cbfe2e1750df0@00e6190c770b27f27d2a3dd26ee15596b17066b715ac111906861a7d09a211a5) archive_nameurls checksumszvox1_test_wav.zipzGhttps://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_test_wav.zip@8de57f347fe22b2c24526e9f444f689ecf5096fc2a92018cf420ff6b5b15eaea)rurlchecksumdevtestzBhttps://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/iden_split.txtzAhttps://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/veri_test.txtrootc dD]}t|d}tj||}|dkrt|d}t|d}t |d5}t ||D]\}}tj|tj|} t|| |t | d5} || dddn #1swxYwY dddn #1swxYwYn8t|d }t|d }t|||t|dS) Nrrrrrwb) hash_prefixrbrr) _ARCHIVE_CONFIGSospathjoinopenzipbasenamer writereadr ) rarchiver archive_pathrrfrr file_pathf_splits NC:\Projects\Historical\venv\Lib\site-packages\torchaudio/datasets/voxceleb1.py_download_extract_wavsr-&s"##'0@ w||D,77  e  #G,V4D(1+>IlD)) 0Q%(y%9%900MC " T273C3CC3H3H I II(iXNNNNi..0' ///0000000000000000 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0#7+E2C'0<s F  5 i  $ $ $Dzz||HB2ww% d### $$$$$$$$$$$$$$$$ &>>sAA99A=A=veri_test_pathcg}t|d5}|D]2}|\}}}||||f3 dddn #1swxYwY|S)Nr5)r"r6r8)rr?r:r)r<labelpath1path2s r,_get_paired_flistrDLs F nc " "1a 1 1D"&**,, E5% MM5%/ 0 0 0 0 1111111111111111 Ms6AAA _ext_audioc|ddd\}}}||d}d|||g}|S)N/-)r6replacer!)r*rE speaker_id youtube_id utterance_idfile_ids r, _get_file_idrPUsU+4??3+?+?+D(J L'' B77Lhh J =>>G Nc`eZdZdZdZd deeefdeddfdZ d e fd Z d e fd Z de fd Z dS) VoxCeleb1a"*VoxCeleb1* :cite:`nagrani2017voxceleb` dataset. Args: root (str or Path): Path to the directory where the dataset is found or downloaded. download (bool, optional): Whether to download the dataset if it is not found at root path. (Default: ``False``). z.wavFrdownloadr/Nctj|}tj|d|_tj|js+|st d|jdt|dSdS)NwavzDataset not found at z5. Please set `download=True` to download the dataset.)rfspathr r!_pathisdir RuntimeErrorr-)selfrrTs r,__init__zVoxCeleb1.__init__gsyW\\$.. w}}TZ(( ) "mDJmmm #4 ( ( ( ( (  ) )rQnctNNotImplementedErrorr[r]s r, get_metadatazVoxCeleb1.get_metadatar!!rQctr_r`rbs r, __getitem__zVoxCeleb1.__getitem__urdrQctr_r`r[s r,__len__zVoxCeleb1.__len__xrdrQ)F)__name__ __module__ __qualname____doc__rErstrrboolr\r7rcrfrirQr,rSrS\sJ ) )U39- ) )$ ) ) ) )"c"""""S"""""""""""rQrSc eZdZdZdedfdeeefdedededd f fd Z d e de ee e effd Z d e de e e e effd Zde fdZxZS)VoxCeleb1Identificationu*VoxCeleb1* :cite:`nagrani2017voxceleb` dataset for speaker identification task. Each data sample contains the waveform, sample rate, speaker id, and the file id. Args: root (str or Path): Path to the directory where the dataset is found or downloaded. subset (str, optional): Subset of the dataset to use. Options: ["train", "dev", "test"]. (Default: ``"train"``) meta_url (str, optional): The url of meta file that contains the list of subset labels and file paths. The format of each row is ``subset file_path". For example: ``1 id10006/nLEBBc9oIFs/00003.wav``. ``1``, ``2``, ``3`` mean ``train``, ``dev``, and ``test`` subest, respectively. (Default: ``"https://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/iden_split.txt"``) download (bool, optional): Whether to download the dataset if it is not found at root path. (Default: ``False``). Note: The file structure of `VoxCeleb1Identification` dataset is as follows: └─ root/ └─ wav/ └─ speaker_id folders Users who pre-downloaded the ``"vox1_dev_wav.zip"`` and ``"vox1_test_wav.zip"`` files need to move the extracted files into the same ``root`` directory. r1Frr.meta_urlrTr/Nct|||dvrtdtj|tj|}tj|st||t|j |||_ dS)N)r1rrz0`subset` must be one of ['train', 'dev', 'test']) superr\ ValueErrorrr r!r$existsr r>rX_flist)r[rr.rsrTmeta_list_path __class__s r,r\z VoxCeleb1Identification.__init__s x((( 1 1 1OPP PdBG,<, : : : ^VDD rQr]c|j|}t||j}|dd}t |dd}|t ||fS)aGet metadata for the n-th sample from the dataset. Returns filepath instead of waveform, but otherwise returns the same fields as :py:func:`__getitem__`. Args: n (int): The index of the sample Returns: Tuple of the following items; str: Path to audio int: Sample rate int: Speaker ID str: File ID rJrr4N)rxrPrEr6r7 SAMPLE_RATE)r[r]r*rOrLs r,rcz$VoxCeleb1Identification.get_metadatasZ&KN y$/::]]3''* ABB(( +z7::rQc||}t|j|d|d}|f|ddzS)adLoad the n-th sample from the dataset. Args: n (int): The index of the sample to be loaded Returns: Tuple of the following items; Tensor: Waveform int: Sample rate int: Speaker ID str: File ID rr2Nrcr rX)r[r]metadatawaveforms r,rfz#VoxCeleb1Identification.__getitem__sG$$$Q''!$*hqk8A;GG{Xabb\))rQc*t|jSr_lenrxrhs r,rizVoxCeleb1Identification.__len__4;rQ)rjrkrlrm_IDEN_SPLIT_URLrrnrror\r7rrcrrfri __classcell__rzs@r,rrrr|s85<_ot E E#t)$ E.1 EGJ Ehl E  E E E E E E;c;eCc3,>&?;;;;2*S*U63S+@%A****,         rQrrc eZdZdZedfdeeefdededdffd Z d e de eee e eeffd Z d e de e e e e eeffd Zde fd ZxZS) VoxCeleb1Verificationu*VoxCeleb1* :cite:`nagrani2017voxceleb` dataset for speaker verification task. Each data sample contains a pair of waveforms, sample rate, the label indicating if they are from the same speaker, and the file ids. Args: root (str or Path): Path to the directory where the dataset is found or downloaded. meta_url (str, optional): The url of meta file that contains a list of utterance pairs and the corresponding labels. The format of each row is ``label file_path1 file_path2". For example: ``1 id10270/x6uYqmx31kE/00001.wav id10270/8jEAjG6SegY/00008.wav``. ``1`` means the two utterances are from the same speaker, ``0`` means not. (Default: ``"https://www.robots.ox.ac.uk/~vgg/data/voxceleb/meta/veri_test.txt"``) download (bool, optional): Whether to download the dataset if it is not found at root path. (Default: ``False``). Note: The file structure of `VoxCeleb1Verification` dataset is as follows: └─ root/ └─ wav/ └─ speaker_id folders Users who pre-downloaded the ``"vox1_dev_wav.zip"`` and ``"vox1_test_wav.zip"`` files need to move the extracted files into the same ``root`` directory. FrrsrTr/NcXt||tj|tj|}tj|st||t|j ||_ dSr_) rur\rr r!r$rwr rDrXrx)r[rrsrTryrzs r,r\zVoxCeleb1Verification.__init__s x(((dBG,<, : : :' NCC rQr]c|j|\}}}t|}t||j}t||j}||t|||fS)agGet metadata for the n-th sample from the dataset. Returns filepaths instead of waveforms, but otherwise returns the same fields as :py:func:`__getitem__`. Args: n (int): The index of the sample Returns: Tuple of the following items; str: Path to audio file of speaker 1 str: Path to audio file of speaker 2 int: Sample rate int: Label str: File ID of speaker 1 str: File ID of speaker 2 )rxr7rPrEr|)r[r]rAfile_path_spk1file_path_spk2 file_id_spk1 file_id_spk2s r,rcz"VoxCeleb1Verification.get_metadatasW.15 A-~~E #NDODD #NDODD ~{ErDrPrSrrrrprQr,rs %%%%%%%%%%$$$$$$555555BBBBBBBB +         ,XV  !,WT#####, S S # $s)     CCS""""""""@X X X X X iX X X v^ ^ ^ ^ ^ I^ ^ ^ ^ ^ rQ