ڎj_dZddlZddlZddlZddlmZddlmZddlm Z ddl m Z m Z m Z ddlZddlmZdd lmZmZmZdd lmZdd lmZd d lmZd dlmZd dlmZd dlm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'd dl(m)Z)hdZ*dZ+GddZ,dS)z#The base class for the chat models.N)abstractmethod)deepcopy)Path)TypeAnyAsyncGenerator) BaseModel)StructuredResponse ChatResponseFinishedReason) ModelCard)_StreamAccumulator)logger)_json_loads_with_repair)CredentialBase)Msg TextBlockUserMsg ToolCallBlock ThinkingBlockToolResultBlock DataBlock HintBlock) ToolChoice>autononerequirediceZdZUdZGddeZeed< eed< e ed< e ed< e ed< e ed < d"dededede de de d e ddfdZ e deeedffdZe d#dedzdeefdZ d$deedeedzdedzdedeeedfzf dZe d$dedeedeedzdedzdedeeedfzf dZdedzdeedzddfdZdeedeedzde fdZdeedeeezdede fd Z! d#dedeedeeezdedzdede f d!Z"dS)% ChatModelBasezThe base class for chat models.ceZdZdZdS)ChatModelBase.ParameterszQEach subclass should implement this inner class to define its parameters.N)__name__ __module__ __qualname____doc__DC:\Projects\DSCons\.venv\Lib\site-packages\agentscope\model\_base.py Parametersr#'s    r)r+ credentialmodelstream max_retries retry_delay context_sizeT? parametersreturnNch||_||_||_||_||_||_||_dS)atInitialize the chat model base. Args: credential (CredentialBase): The API credential. model (`str`): The model name. parameters (`BaseModel`): The model parameters. stream (`bool`, defaults to `True`): Whether to enable streaming output for the LLM. max_retries (`int`, defaults to `3`): The maximum number of retries for API calls. Only exceptions listed in ``_get_retryable_exceptions()`` count against this budget; other exceptions are raised immediately. retry_delay (`float`, defaults to `1.0`): Seconds to sleep between retry attempts. context_size (`int`, defaults to `32768`): The model context size used for context compression. N)r,r-r5r.r/r0r1)selfr,r-r5r.r/r0r1s r*__init__zChatModelBase.__init__=s><% $ &&(r).cdS)a@Return the exception types that should trigger a retry. Defaults to an empty tuple (no retries). Subclasses can override to declare provider-specific retryable exceptions. SDK exception types should be imported lazily inside the override so the SDK stays an optional dependency. r(r()clss r*_get_retryable_exceptionsz'ChatModelBase._get_retryable_exceptionscs rr)custom_yaml_dirc |,ttj|}|jdz }nt|}t |d}g}|D]z} t jt||j }| |A#t$r-}tj d|t|Yd}~sd}~wwxYw|S)zList candidate models of the API. Args: custom_yaml_dir (`str | None`): The custom YAML directory. Returns: `list[ModelCard]`: A list of candidate models. N_modelsz*.yaml) yaml_pathparameter_classzWarning: Failed to load %s: %s)rinspectgetfileparentlistglobr from_yamlstrr+append Exceptionrwarning) r;r= subclass_fileyaml_dir yaml_files model_cards yaml_filecardes r* list_modelszChatModelBase.list_modelsns "  "!!5!566M$+i7HHO,,H(--1122  #  I  *!)nn$'N""4((((   4FF  s'=B%% C/#CCmessagestools tool_choicekwargsc  K|}d}t|jdzD]} |j|jf|||d|d{V n#t j$r!tgdtj cYcSt$r}t||s|}||jkrRtj d|dz|jt||jt j|jd{Vn#tj d|jdz|jYd}~d}~wwxYw||t#d|jd |jdzd t tr Sd t$tdff fd } | S) aCall the model with retry logic. Attempts to call the model up to ``max_retries + 1`` times. Only exceptions listed in ``_get_retryable_exceptions()`` count against this budget; other exceptions are raised immediately. Args: messages (`list[Msg]`): The messages to send to the model. tools (`list[dict] | None`, optional): The tools available to the model. tool_choice (`ToolChoice | None`, optional): The tool choice mode or function name. **kwargs: Additional keyword arguments passed to the underlying API. Nr )rTrUrVT)contentis_lastfinished_reason8Attempt %d failed for model %s: %s. Retrying in %.1fs...&All %d attempt(s) failed for model %s.zFailed to call model z after retries.r6c<Kd}t} 23d{V}|js*|||j|_|js7nd}|WV@6n(#t j$rtj|_ d}YnwxYw|r| WVdSdS)z!The wrapper around model calling.TNF) rrZappend_chat_responseidrYasyncioCancelledErrorr INTERRUPTEDr[build) yield_acc_resacc_reschunkress r*_streamz'ChatModelBase.__call__.._streams!M(**G %#&       % =.44U;;;%*X  %}%$%). KKKKK!$'3") % % %*8*D' $  % &mmoo%%%%%% & &sAA;A"A>=A>)r<ranger/ _call_apir-rbrcr r rdrJ isinstancerrKrHr0sleep RuntimeErrorr) r8rTrUrVrW retryable last_errorattemptrRrjris @r*__call__zChatModelBase.__call__s_02244 '+ T-122, , G# *DNJ% +   )   # $2$>    !!Y// T---N/!  A( "-(89999999999N@(1,  *%  3 33#a'333  c< ( ( J &~lD.@A & & & & & &<wyysA+D( D( BD##D( model_namec KdS)a3Call the underlying API. Subclasses must implement this method. Args: model_name (`str`): The model name to use for this call. messages (`list[Msg]`): The messages to send to the model. tools (`list[dict] | None`, optional): The tools available to the model. tool_choice (`ToolChoice | None`, optional): The tool choice mode or function name. **kwargs: Additional keyword arguments for the underlying API. Nr()r8rtrTrUrVrWs r*rlzChatModelBase._call_api s r)c |dS|j}d|pgD}|j}|>|D];}||vr5td|ddt |<|t vrj|r|n|}||vrbtd|d|%ddt |n$ddt |zdSdS) a\Validate tool_choice parameter. Args: tool_choice (`ToolChoice | None`): Tool choice with ``mode`` and optional ``tools`` fields. tools (`list[dict] | None`): Available tools list. Raises: `ValueError`: If mode or tool names are invalid. Nc*g|]}|ddS)functionnamer().0tools r* z7ChatModelBase._validate_tool_choice..9s/   )-D V $   r)zInvalid tool name 'z)' in tool_choice.tools. Available tools: z, z' in tool_choice.mode. z&Available tools in tool_choice.tools: zAvailable tools: )moderU ValueErrorjoinsorted_TOOL_CHOICE_LITERAL_MODES)r8rVrUr}available_functions tool_namesryvalidation_scopes r*_validate_tool_choicez#ChatModelBase._validate_tool_choice$sv"   F  27+2   !&  !"  222$DdDD99V,?%@%@AADD3 1 1 1)A .A +++ G$GGG&1;99VJ%7%788;;;D99V,?%@%@AADD     2 1 ,+r)c.Kd}g}g}|D]v}|D]]}t|tr||j3t|t r||jct|trt|jtr||j|jD]\}t|tr||j2t|tr||]t|tr||j Dt|trt|jtr||jt|jtrd|jD]\}t|tr||j2t|tr||]t|tr||;t!jdt%|_x|r)|t'j|d|t+|t,zz }d|} |t1t+| ddz dzz }|S) aA quick and unified method to estimate the token count of the model input by dividing the total input size in bytes by 4. Note a standard way to count the tokens is first formatting the input messages into the API required format, then use the tokenizer of the underlying API to count the tokens. Subclasses may override this method to provide a more accurate implementation tailored to their specific tokenizer. Args: messages (`list[Msg]`): The messages to send to the model. tools (`list[dict] | None`): The tools available to the model. Returns: `int`: The number of tokens in the model. rz2Unknown block type %s in token counting, skipping.F) ensure_asciizutf-8g?)get_content_blocksrmrrItextrthinkingrhintrHrrinputroutputrErrKtypejsondumpslen%_MULTIMODAL_DATA_BLOCK_TOKEN_ESTIMATErintencode) r8rTrUcnt acc_texts data_blocksmsgblockitemacc_texts r* count_tokenszChatModelBase.count_tokensYs 2  * * C//11) ) eY//($$UZ0000}55%$$U^4444y11" "%*c229!((4444$)J99D)$ ::9 ) 0 0 ; ; ; ;!+D)!Now you **MUST** call the tool named 'zc' to generate the structured output required by the user. DON'T do anything else.user)r)ryrYrxzFCall this function to generate structured output required by the user.)ry descriptionr5)rrx)rtrTrUrVz0Failed to get the completed response from model .z/Failed to generate structured output for model.z[The structured_model is expected to be a subclass of Pydantic.BaseModel or a dict, but got )ra created_atrYusager[r()"rmdictmodel_json_schemarrrolerrrYrIrrlr.rrZr`rarerorryrr jsonschemavalidate issubclassr model_validater~rr rrr[)r8rtrTrrVrW input_schema func_name instructioncopied_messagesricompleted_responsergrhstructured_output_s r*rz.ChatModelBase._call_api_with_structured_outputsP & - - @+LL+==??L0  $)444K E E E E  #8,, 2  #v - -*9+  ""i[&A&A&A%B+COB  ' '  " "Vi[.I.I.I-JKKK   #DN !$' )($'3 !!   $  !        &37 ; %)**G" & & & & & & &e=).&E,,U333"X #")%,]]__"!$   %-?-G %!!!!  48#+  A!]++ )0C0C$;G %%!  $A  & - -    13C D D D D () 4 4   + +,= > > > >5 011555  "!$)4%$*.>     s E)Tr2r3r4)N)NN)#r$r%r&r'r r+r__annotations__rHboolrfloatr9 classmethodrrrJr<rErrSrrrrr rrsrrlrrr rrr(r)r*r!r!$s))Y JJJ LLL6?2N !$)$)"$)$) $)  $)  $)$)$) $)$)$)$)L%Y0D*E['+--t- i---[-d$()- lls)lDzD l $& l  l |T'9: : llll\ $()-    s) DzD   $&     |T'9: :   ^ .3$&3DzD 3  3333jVs)VDzD V VVVVp? s)? y/D0?  ?  ? ? ? ? L*. T T T s)T y/D0 T  $& T  T  T T T T T T r)r!)-r'rbrBrabcrcopyrpathlibrtypingrrrrpydanticr _model_responser r r _model_cardr_utilsr_loggingr_utils._commonrr,rmessagerrrrrrrrr{rrrr!r(r)r*rs)) ,,,,,,,,,,MMMMMMMMMM""""""&&&&&&444444''''''                    999(,%b  b  b  b  b  b  b  b  b  b  r)