xj5 ddlZddlmZddlZddlmZddlmZddlmZm Z m Z m Z m Z ddl mZddlmZmZddlmZdd lmZmZdd lmZmZerdd lmZdd lmZmZmZ ddlZdd lmZm Z m!Z!n#e"$r edwxYwdZ#d'dZ$d(dZ%d(dZ&d)dZ'd*dZ(d*dZ) d+d!Z* d+d"Z+ddd#e,ddd dddf d$Z-Gd%d&eZ.dS),N) TYPE_CHECKING)consts)record_token_usage)get_start_span_functionset_data_normalizedtransform_openai_content_part&truncate_and_annotate_embedding_inputstruncate_and_annotate_messages)SPANDATA) DidNotEnable Integration)should_send_default_pii)has_span_streaming_enabledshould_truncate_gen_ai_input)event_from_exceptionhas_data_collection_enabled)datetime)AnyDictList)failure_callbackinput_callbacksuccess_callbackzLiteLLM not installed _sentry_spankwargsDict[str, Any]spanrreturnc||t<dSN) _SPAN_KEY)rrs PC:\Projects\Historical\venv\Lib\site-packages\sentry_sdk/integrations/litellm.py _store_spanr#'sF9c6|tSr )getr!rs r" _peek_spanr(+s ::i  r$c8|tdSr )popr!r's r" _pop_spanr+/s ::i & &&r$messagesList[Dict[str, Any]]ctj|}|D]}t|ts|d}t|t t fr_g}|D]U}t|tr)t|}|||n|@||V||d<|S)z Convert the message parts from OpenAI format to the `gen_ai.request.messages` format using the OpenAI-specific transformer (LiteLLM uses OpenAI's message format). Deep copies messages to avoid mutating original kwargs. content) copydeepcopy isinstancedictr&listtuplerappend)r,messager/ transformeditemresults r"_convert_message_partsr;3s}X&&H - -'4((  ++i(( ge} - - -K - -dD))-:4@@F&&1CvvNNNN&&t,,,,!,GI  Or$cHtj}|t}|dS|dd} t j|\}}}}n#t$r|}d}YnwxYw|dd}|dks|dkrd}nd }t|j rZtj |d ||d krtj jntj jtjd  } nct#|d krtj jntj j|d |tj } | t'|| t)| t*j|t)| t*j|d} t1|j r|j ddd} nt3r |jrd} | r|dkr|d} | rstj} t9| t:r| n| g} t=|j rt?| | | n| }|t)| t*j |dn|dg}|rhtj} tC|}t=|j rtE|| | n|}|t)| t*j#|dt*j$t*j%t*j&t*j't*j(t*j)t*j*d}|+D]-\}}||}|t)| ||.dS)zHandle the start of a request.Nmodelunknown call_type embedding aembedding embeddingschat )z sentry.opz sentry.origin)name attributes)oprForiginFdata_collectiongen_aiinputsTinput)unpackr,)r=stream max_tokenspresence_penaltyfrequency_penalty temperaturetop_p), sentry_sdk get_clientget_integrationLiteLLMIntegrationr&litellmget_llm_provider Exceptionroptionstraces start_spanrOP GEN_AI_CHATGEN_AI_EMBEDDINGSrIr __enter__r#rr GEN_AI_SYSTEMGEN_AI_OPERATION_NAMErrinclude_promptsget_current_scoper2r4rr GEN_AI_EMBEDDINGS_INPUTr;r GEN_AI_REQUEST_MESSAGESGEN_AI_REQUEST_MODELGEN_AI_RESPONSE_STREAMINGGEN_AI_REQUEST_MAX_TOKENSGEN_AI_REQUEST_PRESENCE_PENALTY GEN_AI_REQUEST_FREQUENCY_PENALTYGEN_AI_REQUEST_TEMPERATUREGEN_AI_REQUEST_TOP_Pitems)rclient integration full_modelr=provider_r@ operationr record_inputsembedding_inputscope input_list messages_datar,paramskey attributevalues r"_input_callbackrNs  " $ $F(();<22'89(CHM " "{'B )  $ $$jj11O "466"/488+OO)*4FNCC$::tUSSS# !,' 8%$ zz*b11H "4661(;;4FNCC"28T5III! !,' 8%$ .48$D%F:.F!,,..88Y 3   i 7 7 788s A##A43A4c$Kt|Sr )rr's r"_async_input_callbackrs 6 " ""r$completion_response start_timerend_timec t|}|dStj}|t}|dS t |dr t |tj|j d}t|j r|j ddd}ntr |j rd}|rTt |drCg}|jD]} t | d rt | jd r-|| jVt | jd r-|| ji} t | jd r| jj| d <t | jd r| jj| d <t | jdr| jj| d<|| |rt |tj|t |drG|j} t1|t3| ddt3| ddt3| dd|d} | dusd|vsd|vr,t7|}||ddddSdSdS#|d} | dusd|vsd|vr*t7|}||dddwwwxYw)zHandle successful completion.Nr=FrJrKoutputsTchoicesr7 model_dumpr3roler/ tool_callsusage prompt_tokenscompletion_tokens total_tokens) input_tokens output_tokensrrOcomplete_streaming_response!async_complete_streaming_response)r(rUrVrWrXhasattrrr GEN_AI_RESPONSE_MODELr=rr\rrerr7r6rr3rr/rGEN_AI_RESPONSE_TEXTrrgetattrr&r+__exit__) rrrrrrqrrrecord_outputsresponse_messageschoicemsgr is_streamings r"_success_callbackrs{ f  D |  " $ $F(();<xHSNN $ & & ";+F "!N  *I66 $&!19::Fvy11:"6><@@ :-44V^5N5N5P5PQQQQ$V^V<< :-44V^5H5H5J5JKKKK#%C&v~v>>B.4n.AF &v~yAAH171GI&v~|DDN4:N4ML 1-44S999$'h;=N & 0 0 '-E $UOTBB%e-@$GG$UNDAA     zz(++   $ $,662f<<V$$D dD$///// =< zz(++   $ $,662f<<V$$D dD$//// =sH%J::A Lc*Kt||||Sr )r)rrrrs r"_async_success_callbackrs&    r$ exceptioncPt|}|dS t|tjjddd\}}tj|||t||ddS#|t||dwxYw)zHandle request failure.NrYF)typehandled)client_options mechanism)hint)r+rrUrVr\ capture_eventrr)rrrrreventrs r"_failure_callbackr's V  D | 8* %022:(U;;   t  T2222 d9ooy$77777 d9ooy$7777s AA??&B%cNeZdZdZdZdeZd dddeddfd Zed d Z dS) rXa" LiteLLM integration for Sentry. This integration automatically captures LiteLLM API calls and sends them to Sentry for monitoring and error tracking. It supports all 100+ LLM providers that LiteLLM supports, including OpenAI, Anthropic, Google, Cohere, and many others. Features: - Automatic exception capture for all LiteLLM calls - Token usage tracking across all providers - Provider detection and attribution - Input/output message capture (configurable) - Streaming response support - Cost tracking integration Usage: ```python import litellm import sentry_sdk # Initialize Sentry with the LiteLLM integration sentry_sdk.init( dsn="your-dsn", send_default_pii=True integrations=[ sentry_sdk.integrations.LiteLLMIntegration( include_prompts=True # Set to False to exclude message content ) ] ) # All LiteLLM calls will now be monitored response = litellm.completion( model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello!"}] ) ``` Configuration: - include_prompts (bool): Whether to include prompts and responses in spans. Defaults to True. Set to False to exclude potentially sensitive data. rYzauto.ai.TselfrerNc||_dSr )re)rres r"__init__zLiteLLMIntegration.__init__os.r$ctpgt_ttjvr$tjtttjvr$tjtt pgt_t tjvr$tjt ttjvr$tjttpgt_ttjvr&tjtdSdS)z(Set up LiteLLM callbacks for monitoring.N) rrYrr6rrrrrrr$r" setup_oncezLiteLLMIntegration.setup_oncers"0!52 '"8 8 8  " ) )/ : : : (> > >  " ) )*? @ @ @#3#9r G$< < <  $ + +,= > > > "'*B B B  $ + +,C D D D#3#9r G$< < <  $ + +,= > > > > > = rs< 777777'&&&&&========444444ONNNNNNN'!!!!!!&&&&&&&&&&0NNNJJJJJJJJJJJ000 ,. / //0  !!!!''''6t8t8t8t8n####M0 M0M0M0 M0  M0M0M0M0`           8 888 8  88880D?D?D?D?D?D?D?D?D?D?s A//B