jdZddlmZddlmZddlmZddlmZddl Z ddl Z ddl m Z e rddl mZmZd Zdd ZddZddZGddeZddZddZdS) z6 :func:`~pandas.eval` source string parsing functions ) annotations)Enum)StringIO) iskeywordN) TYPE_CHECKING)HashableIteratordnamestrreturnc |rt|s|Sd|D}dd|D}dtjDddddd d d d d dd dfd|D}d|}|std|d|S)aj Create valid Python identifiers from any string. Check if name contains any special characters. If it contains any special characters, the special characters will be replaced by a special string and a prefix is added. Raises ------ SyntaxError If the returned name is not a Python valid identifier, raise an exception. c 3K|]9}|dd|ddDfV:dS)c34K|]}t|VdS)N)chr).0bs MC:\Projects\DSCons\.venv\Lib\site-packages\pandas\core\computation\parsing.py z;create_valid_python_identifier...+s(JJqCFFJJJJJJasciibackslashreplaceN)joinencode)rcs rrz1create_valid_python_identifier..*se    BGGJJAHHW6H$I$IJJJ J JK      rrc3XK|]%\}}|d||krdndV&dS)\ _UNICODE_ _BACKSLASH_N)replace)rr c_escapeds rrz1create_valid_python_identifier...sV Ay $qI~~ =QQrcBi|]\}}|dtj|dS)_)tokentok_name)rchartokvals r z2create_valid_python_identifier..6sA''' D& +%.(+++'''rr$_QUESTIONMARK__EXCLAMATIONMARK_ _DOLLARSIGN_ _EUROSIGN_ _DEGREESIGN_ _SINGLEQUOTE_ _DOUBLEQUOTE__HASH_ _BACKTICK_)  ?!$u€°'"#`c<g|]}||S)get)rr'special_characters_replacementss r z2create_valid_python_identifier..Is*UUU377dCCUUUrBACKTICK_QUOTED_STRING_zCould not convert 'z' to a valid Python identifier.) isidentifierrrtokenizeEXACT_TOKEN_TYPESitemsupdate SyntaxError)r genr?s @rcreate_valid_python_identifierrIsT 9T??      C 77  D''%7==??'''#$**!$        77UUUUPTUUU V VD +T + +D     WUUUUVVV Krtoktuple[int, str]c`|\}}|tkrtjt|fS||fS)a[ Clean up a column name if surrounded by backticks. Backtick quoted string are indicated by a certain tokval value. If a string is a backtick quoted token it will processed by :func:`_create_valid_python_identifier` so that the parser can find this string when the query is executed. In this case the tok will get the NAME tokval. Parameters ---------- tok : tuple of int, str ints correspond to the all caps constants in the tokenize module Returns ------- tok : Tuple[int, str] Either the input or token or the replacement values )BACKTICK_QUOTED_STRINGrCNAMErI)rJtoknumr(s rclean_backtick_quoted_toksrPRs9(NFF '''}rrc t|tr|ddn|}td|d}t |d}t |S#t $r|cYSwxYw)a Function to emulate the cleaning of a backtick quoted name. The purpose for this function is to see what happens to the name of identifier if it goes to the process of being parsed a Python code inside a backtick quoted string and than being cleaned (removed of any special characters). Parameters ---------- name : hashable Name to be cleaned. Returns ------- name : hashable Returns the name after tokenizing and cleaning. r;z``) isinstancer r!tokenize_stringnextrIrG)r tokenizedr(s rclean_column_namerWls&*4T3*?*?It||C&&&T#KKKK00 i#-f555  sA#A&& A54A5ceZdZdZdZdZdZdS) ParseStaterrRN)__name__ __module__ __qualname__DEFAULT IN_BACKTICKIN_SINGLE_QUOTEIN_DOUBLE_QUOTEr=rrrYrYs"GKOOOOrrYslist[tuple[bool, str]]cg}g}d}tj}|t|kr||}|xdkr|tjkrA|r*|dd|f|g}|dz }tj}v|tjkr|t|dz kr ||dznd}|dkr0|||||dz }|||dd|fg}|dz }tj}3nxd krJ|tjkr tj}ny|tjkr||dz d kr tj}nMd krH|tjkr tj}n+|tjkr||dz d kr tj}|||dz }|t|k|r*|dd|f|S) a Splits a str into substrings along backtick characters (`). Disregards backticks inside quotes. Parameters ---------- s : str The Python source code string. Returns ------- substrings: list[tuple[bool, str]] List of tuples, where each tuple has two elements: The first is a boolean indicating if the substring is backtick-quoted. The second is the actual substring. rr;FrrRNrZTr8rr9)rYr_lenappendrr`rarb)rc substringssubstri parse_stater' next_chars r_split_by_backtickrmsO$JF A$K c!ff**t*"444D"))5"''&//*BCCC"VFFA","8K J$:::-.#a&&1*__!a%4I C'' d+++ i000Q  d+++"))4*ABBB!#Q&0&8  #;$*"444",".s[ *  "  *9QrT? ; ; ; rN)rrmrreadlinerCgenerate_tokens)rn line_readertoken_generatorrOr(r$s rrTrTs WW .@-G-G F6""+K.{;;O#21afnr)r r r r )rJrKr rK)r rr r)rcr r rd)rnr r ro)__doc__ __future__renumriorkeywordrr%rCtypingrcollections.abcrr rMrIrPrWrYrmrTr=rrrsS#"""""   7777t4<KKKK\r