#jo#dZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z gdZ gdZejd Zgd Zgejd ejejd ejejd ejdejdejdejdejdejdejdejejdejejdejejdejejdejejdejdejdejejdejdejdejdejd ejd!ejd"ejejd#ejd$ejd%ejd&ejd'ejd(ejd)Zd*Zd+Zd,Zd-Zd.Zd/Zd0Zd1Zd2ZdS)3z Unit test suite for FreeExile 9-Language Novel Localization Integrity. Validates 100% adherence to canonical nomenclature, 216 chapter files, 0 residual Vietnamese characters in non-VI editions, and 0 vulgarity/anomalies. N)Path)CHAPTER_TITLES)CANONICAL_SECTION_HEADINGS)ENTITY_DICTIONARY) vienzhjakothderues)rr r r r r rru[ăâđêôơưĂÂĐÊÔƠƯằầềồờừẳẩẻểỉỏổởủửỷẵẫẽễĩõỗỡũữỹạặậẹệịọộợụựỵ])zCon CotzNuoc DuczHac Thiz Hoang Cot Thoz Hung Sa CotzBang LoizLai Bo Thi Langz Dai DoanhzCo Thiz Kim Van Nhucz Vu Hoa Shinhzfloorable sandwich bowlzMenstrual HatezSEXUALITY RISEu 按摩黑人zKIM LOAN ELECTRICITYzTWO BINH CHANGEz Chan Thuyz Chan Thienz Thanh LaczHai Monz Trong Daou Qing LạczJiang KyzNIVELA EL JIANG KY 고위 감귤高位のみかんmenstru monatsblutuประจำเดือนu经血u经期u経血u経期u생리u 생리혈z \bperiods?\bu\bper[ií]odos?\bz\bperiode[n]?\bu\bпериод\w*zjiang kyrrzcapital of deathu 死刑期u 死刑時代u 사형시대u사형수\s*감옥\s*기간u<ช่วงจำคุกประหารชีวิตu-ช่วงแห่งความตายzZeit des Todesu剑派史诗级u壮大な時代u검파의 서사시u!ยุคมหากาพย์u ゼント\d*u七年前七年前z$vor sieben Jahren.*vor sieben JahrenctD]V}tddD]C}d|d|dd}tj|}t|dksJd|d|DWd S) zKVerify that all 24 chapters across 9 canonical languages exist (216 files).novels/locales//act_*/chuong_03d_*.mdMissing chapter z for language N) LANGUAGESrangegloblen)langchpatternmatchess EC:\Projects\FreeExile\tests\unit\test_novel_localization_integrity.py)test_exactly_216_localized_chapters_existr%BsRR2,, R RBIIIBIIIIGi((Gw<<1$$$&Q&Q&Q4&Q&Q$$$$ RRRc Tddddd}tddD]}tD]}tjd|d |d d }|sJd |d |t|dd}|d}t||}|dkr d|d||vsJ|dvrd|d||ksJ|dkrd|d||ksJ|dkrd|d||ksJ||}d|d|d||ksJdS)zNVerify that every chapter title level-1 heading matches the canonical catalog.CHAPTERKAPITELu ГЛАВАu CAPÍTULO)rr rrrrrrrrrz for rutf-8encodingru CHƯƠNG z: )r r u# 第u章：r u# 제u장: r u# บทที่ z#  N)rrrr read_text splitlinesstripr) prefix_mapr!r filescontent first_linetitleprefixs r$#test_chapter_titles_match_canonicalr7Js J ArllAA A ADIQQQBQQQQRRE < <>>>>%%0r0000J>>>>>/r////:=====9B99%99ZGGGGG#D)2F22R22522j@@@@@# AAAr&c tddD]m}tjd|dd}t|dd}d |D}t D]}tjd |d |dd}t|dd}d |D}t |t |ks0Jd |d|dt |dt |t|D];\}} t|||} | | ksJd |d|d| d| d <odS)zRVerify that every section heading in all 216 files matches the canonical headings.rrznovels/locales/vi/act_*/chuong_rrrr*r+cg|]=}|d)|>Sz### r0 startswith.0ls r$ zAtest_all_113_section_headings_match_canonical..ks<bbbQQWWYYEYEYZ`EaEabqwwyybbbr&rrcg|]=}|d)|>Sr:r;r=s r$r@zAtest_all_113_section_headings_match_canonical..ps<jjj1QWWYYMaMabhMiMijQWWYYjjjr&zChapter z (z) has z headings, expected z) heading mismatch: 'z' != ''N) rrrr.r/NON_VI_LANGUAGESr enumerater) r!vi_files vi_content vi_headingsr lang_files lang_content lang_headingsidxhexpecteds r$-test_all_113_section_headings_match_canonicalrNfsArll9LrLLLLMM(1+&&00'0BB bb**?*?*A*Abbb $  D#VT#V#V#V#V#V#VWWJ 1 ..88'8JJLjj 0G0G0I0IjjjM}%%[)9)9999g2ggggS-?-?ggUXYdUeUegg:99$M22  Q5k#6FGMH}}}TrTTTTTTTTTT%}}}   r&c8g}tD]}tjd|dD]e}t|d}t|}|r$||t|ff|r Jd|dS)zIVerify that zero pure Vietnamese characters remain in any non-VI edition.r /act_*/*.mdr*r+z&Found residual Vietnamese diacritics: N)rCrrr.PURE_VI_DIACRITICSfindallappendset) violationsr fpathr3r#s r$.test_zero_pure_vietnamese_diacritics_in_non_virW|sJ 99YBBBBCC 9 9E5kk++W+==G(0099G 9!!5#g,,"7888  9 PPPJPPPP>PPr&cg}tD]e}tjd|dD]J}t|d}tD]}||vr|||fKf|r Jd|dS)zNVerify that no corrupted tokens or vulgar machine-translation artifacts exist.rrPr*r+z"Found anomalous or vulgar tokens: N)rCrrr.ANOMALOUS_STRINGSrS)foundr rVr3tokens r$%test_zero_anomalous_or_vulgar_stringsr\s E 11YBBBBCC 1 1E5kk++W+==G* 1 1G##LL%000 1 1 BBB5BBBB9BBr&c4g}tD]~}tjd|dD]c}t|d}tD]6}||}|r|||j|f7d|r Jd|dS)u\Verify that zero menstrual or inappropriate period/era mistranslations of 'kinh kỳ' exist.rrPr*r+z8Found forbidden menstrual/period mistranslation tokens: N)rCrrr.FORBIDDEN_KINH_KY_PATTERNSrRrSr")rZr rVr3patr#s r$1test_zero_menstrual_or_inappropriate_period_termsr`s E @@YBBBBCC @ @E5kk++W+==G1 @ @++g..@LL%g!>??? @ @XXXQVXXXX9XXr&cg}tD]W}tjd|dD]<}t|}d|vr||=X|r Jd|dS)z?Verify that all 216 chapter files strictly use LF line endings.rrPs zFiles with CRLF endings: N)rrr read_bytesrS) crlf_filesr rVdatas r$'test_no_crlf_line_endings_in_any_localeresJ))YBBBBCC ) )E;;))++D$!!%((( ) CCCzCCCC>CCr&cttdksJttdksJttdksJdtD}|t |dks JddS) z'Verify catalog imports and size limits.qdc8g|]}t|dS)r)r)r>es r$r@z6test_catalogs_and_entity_integrity..s"444Qs1Q4yy444r&T)reversez1ENTITY_DICTIONARY not sorted descending by lengthN)rrrrsorted)lengthss r$"test_catalogs_and_entity_integrityros ~  " $ $ $ $ ) * *c 1 1 1 1  ! !S ( ( ( (54"3444G fWd333 3 3 35h 3 3 3 3 3r&cgd}|D][\}}}tjd|d|D]:}t|d}||vsJd|d|d;\d S) zPVerify that audited first-person slips in third-person narration are eradicated.))rzchuong_001_*.mdztearing through my dry lungs)rzchuong_009_*.mdz&receded to my knees, then to my ankles)rchuong_010_*.mdz My blade was made of Crude Flint)rrqzIn just one slash, I cut)rzchuong_015_*.mdzcorners of my dry, cracked lips)r rqu[ใบมีดของฉันทำจาก หินเหล็กไฟหยาบ)r rqu3ฉันตัดโซ่เหล็กหนา)r zchuong_022_*.mdu?もし私たちがその腐った王座を破壊しなければrz/act_*/r*r+zFound POV slip in z: 'rBN)rrr.)checksr glob_pat forbidden_strrVr3s r$ test_zero_pov_slips_in_narrationrus   F*0aa%h YHHHhHHII a aE5kk++W+==G ///1`e1`1`P]1`1`1`//// aaar&)__doc__osrerpytestpathlibr'tools.localization.novel_titles_catalogr)tools.localization.novel_headings_catalogr)tools.localization.novel_entities_catalogrrrCcompilerQrY IGNORECASEr^r%r7rNrWr\r`rerorur&r$rsQ  BBBBBBPPPPPPGGGGGG B B B CCCRZ!wxx BJz2=)) BJ}bm,, BJ011 BJy  BJy  BJy BJy BJy BJ| BJ .. BJ#R]33 BJ!2=11 BJ#R]33 BJ{BM** BJ$%%  BJ  ! "BJ"BM22# $BJ|% &BJ' (BJ) *BJ-..+ ,BJNOO- .BJ?@@/ 0BJ "-001 2BJ!""3 4BJ!""5 6BJ%&&7 8BJ3449 :BJ; <BJ$%%= >BJ677? DRRRAAA8, Q Q Q C C C Y Y Y D D Diiiaaaaar&