jTV ddZddlZddlZddlZddlmZddlmZmZm Z m Z ddl m Z ddl mZmZmZmZddlmZe d'd ed ed deded de dzdededededzdeddedefdZe d(d ed eddeded de dzdededededzdeddedefdZe d)d ed edededde dzdededededzdeddedeeeeeefffdZe d'd ed ededede dzdededededzdeddedeezeeeeeeffzfdZ d'd ed ededede dzdededededzdeddedeeeeeeeffzfdZ d*d ededededededzdeddeeeeeeeffzezfdZ d+d e dedededededzdeddeeeeeeeffzfd!Z d+d"eezdedededededzdeddeeeeeeeffzfd#Zd,d$eedzdefd%Zed&krej edSdS)-a% This module will parse the JSON file following the BNF definition: ::= ::= | | ; Where: ; is a valid real number expressed in one of a number of given formats ; is a string of valid characters enclosed in quotes ; is one of the literal strings 'true', 'false', or 'null' (unquoted) ::= | ::= '[' [ *(', ' ) ] ']' ; A sequence of JSON values separated by commas ::= '{' [ *(', ' ) ] '}' ; A sequence of 'members' ::= ': ' ; A pair consisting of a name, and a JSON value If something is wrong (a missing parentheses or quotes for example) it will use a few simple heuristics to fix the JSON string: - Add the missing parentheses if the parser believes that the array or object should be closed - Quote strings or add missing single quotes - Adjust whitespaces and remove line breaks All supported use cases are in the unit tests N)Path)AnyLiteralTextIOoverload) JSONParser)SchemaRepairerload_schema_modelnormalize_schema_repair_modeschema_from_input)JSONReturnTypeFstandardjson_strreturn_objectsskip_json_loadsloggingjson_fd chunk_length stream_stablestrictschemaschema_repair_mode)rsalvagejson_dumps_argsreturnc  dSN rrrrrrrrrrrs EC:\Projects\DSCons\.venv\Lib\site-packages\json_repair\json_repair.py repair_jsonr#$s  #Tc  dSrr r!s r"r#r#4s Sr$c  dSrr r!s r"r#r#Ds 36#r$c  dSrr r!s r"r#r#Ts JMr$c vt| } || dkrtd||rtdd} g} |du} |t||||||} |r| j} |t |nd}|t ||r| nd| nd}d}d} |s|rt j|nt j|}|| | ||rd}nC | ||d}| ||r|}d}n#t$rYnwxYwn$#t$r}td |d}~wwxYwd}n"#t j ttf$rYnwxYw|s| t||||||| } |r| | _ |R|P | ||}|||n6#t$r}td |d}~wwxYw| }n"#t$r}td |d}~wwxYw|r|| fS|r|S|d krd St j|fi| S) aW Given a json formatted string, it will try to decode it and, if it fails, it will try to fix it. Args: json_str (str, optional): The JSON string to repair. Defaults to an empty string. return_objects (bool, optional): If True, return the decoded data structure. Defaults to False. skip_json_loads (bool, optional): If True, skip calling the built-in json.loads() function to verify that the json is valid before attempting to repair. Defaults to False. logging (bool, optional): If True, return a tuple with the repaired json and a log of all repair actions. Defaults to False. When no repairs were required, the repair log will be an empty list. json_fd (Optional[TextIO], optional): File descriptor for JSON input. Do not use! Use `from_file` or `load` instead. Defaults to None. ensure_ascii (bool, optional): Set to False to avoid converting non-latin characters to ascii (for example when using chinese characters). Defaults to True. Ignored if `skip_json_loads` is True. chunk_length (int, optional): Size in bytes of the file chunks to read at once. Ignored if `json_fd` is None. Do not use! Use `from_file` or `load` instead. Defaults to 1MB. stream_stable (bool, optional): When the json to be repaired is the accumulation of streaming json at a certain moment.If this parameter to True will keep the repair results stable. strict (bool, optional): If True, surface structural problems (duplicate keys, missing separators, empty keys/values, etc.) as ValueError instead of repairing them. schema (Any, optional): JSON Schema dict, boolean schema, or pydantic v2 model used to guide repairs and validation for both valid and invalid JSON inputs. schema_repair_mode (Literal["standard", "salvage"], optional): Schema repair mode. "standard" keeps default schema behavior; "salvage" enables best-effort schema salvage heuristics for arrays/objects. Returns: Union[JSONReturnType, Tuple[JSONReturnType, List[Dict[str, str]]]]: The repaired JSON or a tuple with the repaired JSON and repair log when logging is True. Nrz-schema_repair_mode='salvage' requires schema.z*schema and strict cannot be used together.)rFT$zBInput schema nesting exceeds the supported schema recursion depth.)try_valid_json_suffixz;Input nesting exceeds the supported parser recursion depth.r)r ValueErrorr loggerr r jsonloadloadsis_valid repair_valueRecursionErrorJSONDecodeError TypeErrorparse_with_schemavalidateparsedumps)rrrrrrrrrrrparser repair_logr* schema_objrepairer parsed_json is_valid_jsonrepaired_valueexcs r"r#r#dsn>66HII ~, 99HIIIfEFFF $F')J$tO           'J.4.@"6***dJ  ! z#B::dWijjjj  #'KM  %07Q$)G,,,TZ=Q=QK# (>t((jAA !(, !.6-B-B;PZ\_-`-`N'00LL5.< 04 )!!! D!%ttt$%ijjpsst!%  )Z 8     e >&;F + *  e# (>t"(":":8Z"P"PK%%k:>>>>%ttt$%ijjpsst%llnn  e e eZ[[ad d e 'J&&br :k 5 5_ 5 55s0ED!1DD! DD!DD! E! E+D;;EEE%$E% G5,F>=G5> GGGG55 H?HHc 0t|d||||||S)a This function works like `json.loads()` except that it will fix your JSON in the process. It is a wrapper around the `repair_json()` function with `return_objects=True`. Args: json_str (str): The JSON string to load and repair. skip_json_loads (bool, optional): If True, skip calling the built-in json.loads() function to verify that the json is valid before attempting to repair. Defaults to False. logging (bool, optional): If True, return a tuple with the repaired json and a log of all repair actions. Defaults to False. strict (bool, optional): If True, surface structural problems (duplicate keys, missing separators, empty keys/values, etc.) as ValueError instead of repairing them. schema (Any, optional): JSON Schema dict, boolean schema, or pydantic v2 model used to guide repairs and validation for both valid and invalid JSON inputs. schema_repair_mode (Literal["standard", "salvage"], optional): Schema repair mode. "salvage" requires schema. Returns: Union[JSONReturnType, Tuple[JSONReturnType, List[Dict[str, str]]], str]: The repaired JSON object or a tuple with the repaired JSON object and repair log. T)rrrrrrrrr#)rrrrrrrs r"r/r/s30 '#-    r$fdc 0t||d|||||S)a This function works like `json.load()` except that it will fix your JSON in the process. It is a wrapper around the `repair_json()` function with `json_fd=fd` and `return_objects=True`. Args: fd (TextIO): File descriptor for JSON input. skip_json_loads (bool, optional): If True, skip calling the built-in json.loads() function to verify that the json is valid before attempting to repair. Defaults to False. logging (bool, optional): If True, return a tuple with the repaired json and a log of all repair actions. Defaults to False. chunk_length (int, optional): Size in bytes of the file chunks to read at once. Defaults to 1MB. strict (bool, optional): If True, surface structural problems (duplicate keys, missing separators, empty keys/values, etc.) as ValueError instead of repairing them. schema (Any, optional): JSON Schema dict, boolean schema, or pydantic v2 model used to guide repairs and validation for both valid and invalid JSON inputs. schema_repair_mode (Literal["standard", "salvage"], optional): Schema repair mode. "salvage" requires schema. Returns: Union[JSONReturnType, Tuple[JSONReturnType, List[Dict[str, str]]]]: The repaired JSON object or a tuple with the repaired JSON object and repair log. T)rrrrrrrrrBrCrrrrrrs r"r.r. s32 !'-    r$filenamec t|5}t|||||||cdddS#1swxYwYdS)a This function is a wrapper around `load()` so you can pass the filename as string Args: filename (str | Path): The name of the file containing JSON data to load and repair. skip_json_loads (bool, optional): If True, skip calling the built-in json.loads() function to verify that the json is valid before attempting to repair. Defaults to False. logging (bool, optional): If True, return a tuple with the repaired json and a log of all repair actions. Defaults to False. chunk_length (int, optional): Size in bytes of the file chunks to read at once. Defaults to 1MB. strict (bool, optional): If True, surface structural problems (duplicate keys, missing separators, empty keys/values, etc.) as ValueError instead of repairing them. schema (Any, optional): JSON Schema dict, boolean schema, or pydantic v2 model used to guide repairs and validation for both valid and invalid JSON inputs. schema_repair_mode (Literal["standard", "salvage"], optional): Schema repair mode. "salvage" requires schema. Returns: Union[JSONReturnType, Tuple[JSONReturnType, List[Dict[str, str]]]]: The repaired JSON object or a tuple with the repaired JSON object and repair log. rEN)ropenr.)rFrrrrrrrCs r" from_filerI.s0 h      "+%1                      sAA  A  inline_argscvtjd}|ddd|ddd d |d d dd|dd d |dtdd|dd d |ddd|ddd|dd d |d!d"d#gd"d$%||}|jr6|js/td&tj 'tj d(|jr6|j r/td)tj 'tj d(|j r6|j r/td*tj 'tj d(|jr=|j s|j r/td+tj 'tj d(|jd#kr=|j s6|j s/td,tj 'tj d(|j} d-}|j rSt#|j 5}t'j|}d-d-d-n #1swxYwYn|j rt+|j }|jr)t-|j|j|j||j.}nAtj}t5||j|j||j.}|js|j ret#|j p|jd/05}t'j|||j|1d-d-d-n #1swxYwYn)tt'j||j|1nC#t<t>t@f$r)}td2|tj 'Yd-}~d(Sd-}~wwxYwd3S)4a[ Command-line interface for repairing and parsing JSON files. Args: inline_args (Optional[List[str]]): List of command-line arguments for testing purposes. Defaults to None. - filename (str): The JSON file to repair. If omitted, the JSON is read from stdin. - -i, --inline (bool): Replace the file inline instead of returning the output to stdout. - -o, --output TARGET (str): If specified, the output will be written to TARGET filename instead of stdout. - --ensure_ascii (bool): Pass ensure_ascii=True to json.dumps(). Will pass False otherwise. - --indent INDENT (int): Number of spaces for indentation (Default 2). - --skip-json-loads (bool): Skip initial json.loads validation. - --schema SCHEMA (str): Path to a JSON Schema file that guides repairs. - --schema-model MODEL (str): Pydantic v2 model in 'module:ClassName' form that guides repairs. - --strict (bool): Raise on duplicate keys, missing separators, empty keys/values, and other unrecoverable structures instead of repairing them. Returns: int: Exit code of the CLI operation. Raises: Exception: Any exception that occurs during file processing. Example: >>> cli(['example.json', '--indent', '4']) >>> cat json.txt | json_repair zRepair and parse JSON files.) descriptionrF?z6The JSON file to repair (if omitted, reads from stdin))nargshelpz-iz--inline store_truezAReplace the file inline instead of returning the output to stdout)actionrOz-oz--outputTARGETzMIf specified, the output will be written to TARGET filename instead of stdout)metavarrOz--ensure_asciiz&Pass ensure_ascii=True to json.dumps()z--indentz,Number of spaces for indentation (Default 2))typedefaultrOz--skip-json-loadsz"Skip initial json.loads validationz--schemaSCHEMAz.Path to a JSON Schema file that guides repairsz--schema-modelMODELz@Pydantic v2 model in 'module:ClassName' form that guides repairsz--strictz|Raise on duplicate keys, missing separators, empty keys/values, and other unrecoverable structures instead of repairing themz--schema-repair-moderrzYSchema repair mode: 'standard' (default) or 'salvage' (best-effort array/object salvage).)choicesrVrOz&Error: Inline mode requires a filename)filerz1Error: You cannot pass both --inline and --outputz7Error: You cannot pass both --schema and --schema-modelz>Error: --strict cannot be used with --schema or --schema-modelzGError: --schema-repair-mode salvage requires --schema or --schema-modelN)rrrrw)mode)indent ensure_asciizError: r)!argparseArgumentParser add_argumentint parse_argsinlinerFprintsysstderrexitoutputr schema_modelrrr^rrHr-r.r rIrstdinreadr/dumpr]r8OSErrorr4r+) rJr9argsr^rrCresultdataes r"clirsRsZ4 $1O P P PF  E    P     \    5    ;    1   =   O  L  Y' h    [ ) )D {4= 6SZHHHH   {t{ A SSSS   {t( GcjYYYY   { t'8 NUXU_````   )++T[+DDU+ W^a^hiiii  $L! ; :dk""'')) 'R2 ' ' ' ' ' ' ' ' ' ' ' ' ' ' '   :&t'899F =  $ 4{#'#: FF9>>##D $ 4{#'#: F ; U$+ Udk2T]3388c8BB Ub &"T[|TTTT U U U U U U U U U U U U U U U $*VDKlSSS T T T Y + oooCJ////qqqqq 1sa1/O6 K5 O6KO6K C O6O4 O6OO6O-O66P6 P11P6__main__) rFFFNrFFNr) rTFFNrFFNr) rFFTNrFFNr)FFFFNr)FFrFNrr)!__doc__r_r-rfpathlibrtypingrrrr json_parserr schema_repairr r r r utils.constantsrstrboolrbr#tuplelistdictr/r.rIrs__name__rhr r$r"rsS0 111111111111######mmmmmmmmmmmm++++++ %*!#!9C   EN  U^  d]       $J  56         $(!#!9C   DM  U^  d]       $J  56         !!!9C 6 6 6 6 6T] 6 d] 6  6 6  6 $J 6 56 6 6 >4S#X/ /0 6 6 6  6  !!9C M M M M M M d] M  M M  M $J M 56 M M >E.$tCH~2F"FGG M M M  M  !!9C~6~6~6~6~6 ~6 d] ~6  ~6~6 ~6 $J~6 56~6~6eNDc3h,@@AA~6~6~6~6F"9C!!!!! !  ! $J ! 56!eNDc3h,@@AACG!!!!L"9C""""" "  " $J " 56"eNDc3h,@@AA""""N"9C! ! Dj! ! !  !  ! $J !  56! eNDc3h,@@AA! ! ! ! HN N T#Y%N N N N N b z CHSSUUOOOOOr$