Axj, dZddlZddlZddlZddlZddlmZmZmZm Z m Z m Z m Z ddl Z ddlmZmZddlmZddlmZdd lmZd d lmZd d lmZmZd d lmZd dlm Z m!Z!m"Z"e#ej$%d&de Z'eZ(e"Z)de e#fdZ*dede e#fdZ+dde,fdZ- ddede,de e e e#effdZ.dede e#efde/fdZ0dede e#efde e#effdZ1dede e#efdee e#e e#effdffdZ2dS) z Job related helpers. N)AnyAsyncGeneratorCallableDictOptionalUnionList) ClientSessionTooManyRequests) RunPodLogger) __version__) rp_debugger) is_generator) send_result stream_result)check_return_size) WORKER_IDREF_COUNT_ZERO JobsProgressRUNPOD_WEBHOOK_GET_JOBz$IDreturncNdtvrdStddS)a Prepare the URL for the worker's dedicated stop channel. Derived from the job-take URL so it points at the same endpoint and worker, preserving its query string (auth and routing params). Returns None when the job-take URL is not in the expected form. /job-take/Nz /job-stop/) JOB_GET_URLreplaceQC:\Projects\Historical\venv\Lib\site-packages\runpod/serverless/modules/rp_job.py _job_stop_urlr"s*;&&t   |\ : ::r sessionc6Kt}|sgS||4d{V}|jdkrgcdddd{VS|jdkr't|j|j|j|j||jdkr6t d|jgcdddd{VS | d{V}nT#tj tf$r;}t d|gcYd}~cdddd{VSd}~wwxYwt|t sCt dt#|jgcdddd{VS|d g}t|t&sCt d t#|jgcdddd{VSd |D}t)|t)|kr;t d t)|t)|z d |cdddd{VS#1d{VswxYwYdS)a Long-poll the dedicated stop channel for request ids the worker should stop. The server is expected to hold the request open (long-poll) until a stop signal is available or the poll times out, so cancellations and timeouts reach the worker without waiting for the next heartbeat. Returns: A list of request ids to stop. Empty when the poll returned no signals. Nstatusmessageapplication/jsonz4rp_job | get_stop_signals: unexpected content type: z5rp_job | get_stop_signals: failed to parse response: z4rp_job | get_stop_signals: unexpected payload type: jobsToStopz5rp_job | get_stop_signals: jobsToStop is not a list: c<g|]}t|t|Sr) isinstancestr).0job_ids r! z$get_stop_signals..`s'KKKf:fc3J3JK6KKKr z#rp_job | get_stop_signals: dropped z non-string job ids)r"getr(r request_infohistoryreasonraise_for_status content_typelogwarnjsonaiohttpContentTypeError ValueErrorr-dicttype__name__listlen)r#stop_urlresponsepayloaderrorraw_idsjob_idss r!get_stop_signalsrI*sZH  {{8$$,,,,,,, ?c ! !,,,,,,,,,,,,,, ?c ! !!%     !!###  $6 6 6 HH^xG\^^   %,,,,,,,,,,,,,,( $MMOO++++++GG(*5    HHTUTT U U UIIIII1,,,,,,,,,,,,,,, '4((  HH_tG}}G]__   =,,,,,,,,,,,,,,@++lB//'4((  HH`W H^``   K,,,,,,,,,,,,,,NLKKKK w<<3w<< ' ' HHfc'llS\\6Qfff   Y,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,sW JA4JC32J3E D?'E(J?EAJAJ A(J JJ batch_sizec|dkr$tdd}|d|z }nt}trdnd}|d|z }td||S) a` Prepare the URL for making a 'get' request to the serverless API (sls). This function constructs the appropriate URL for sending a 'get' request to the serverless API, ensuring that the request will be correctly routed and processed by the API. Returns: str: The prepared URL for the 'get' request to the serverless API. rrz/job-take-batch/z &batch_size=10z&job_in_progress=zrp_job | get_job: )rr job_progress get_job_listr8debug)rJ job_take_urljob_in_progresss r! _job_get_urlrShsA~~"**<9KLL 3z333 " )6688AcccO9999LII1<11222 r num_jobscK|t|4d{V}tdt |jd|j|jdkr.td dddd{VdS|jdkr.td dddd{VdS|jdkr't|j|j |j|j | |j d kr6td |j  dddd{VdS|j d kr.td  dddd{VdS |d{V}tdn#tj$r7td|jYdddd{VdSt$$r9}td|Yd}~dddd{VdSd}~wwxYwt'|t(r,d|vsd|vrt+d|gcdddd{VSt'|t,r|cdddd{VS dddd{VdS#1d{VswxYwYdS)a3 Get a job from the job-take API. `num_jobs = 1` will query the legacy singular job-take API. `num_jobs > 1` will query the batch job-take API. Args: session (ClientSession): The aiohttp ClientSession to use for the request. num_jobs (int): The number of jobs to get. Nzrp_job | Response:  r%z&rp_job | Received 204 status, no jobs.izArp_job | Received 400 status, expected when FlashBoot is enabled.r&r'r*z"rp_job | Unexpected content type: rzrp_job | No content to parse.zrp_job | Received Job(s)z-rp_job | Response content is not valid JSON. z(rp_job | Failed to parse JSON response: idinputz&Job has missing field(s): id or input.)r2rSr8rPr?r@r(r r3r4r5r6r7content_lengthr:r;r<contentr=r-r> ExceptionrA)r#rTrDjobs json_errors r!get_jobr^sC{{<11222222222h SX(?SS(/SSTTT ?c ! ! II> ? ? ?  22222222222222 ?c ! ! IIY Z Z Z 22222222222222 ?c ! !!%     !!###  $6 6 6 IIR8;PRR S S S 3222222222222228  "a ' ' II5 6 6 6 =22222222222222@ !((((((D II0 1 1 1 1'    IIXhFVXX Y Y Y K22222222222222L    IIMMM N N N FFFQ22222222222222L  dD ! ! 47$#6#6 HIII6]22222222222222b dD ! ! e22222222222222b c222222222222222222222222222222saAK&KA4K&K4G  K 1I<K II 6K I1KK K Kconfigc.Kt|dr4d}t|d|}td|ddgi}|23d{V}td||dt |dt r8|ddrdt|ddi}|dr|}nP|dd r!|d|dt|||d{V6nd }t|d|d{V}|d d r&t d |dd|d <|d idd rwt |t rbtj |dd<td|d|dtz dz}||ddd<n4td|dtjt!||||d{VdS)NhandlerTz*Handler is a generator, streaming results.rWoutputzStream output: rFreturn_aggregate_streamFrefresh_workerz0refresh_worker flag set, stopping pod after job.stopPodrp_argsrz2rp_debugger | Flag set, returning debugger output.reference_counter_startiready_delay_msz5rp_debugger | Flag not set, skipping debugger output.) is_stream)rrun_job_generatorr8rPr-r2r>r.appendrrun_jobinforget_debugger_outputrclear_debugger_outputr)r#r_jobrigenerator_output job_result stream_output ready_delays r! handle_jobrusF9%&&; ,VI->DD >D JJJ^ #3 = = = = = = =- II7 77T C C C-++H55t<< U *..w77U%,c-2I'2R.S.S$TM  )) * zz3U;; E8$++M(,CDDD<< < < < < < < < <$4  "6)#4c:::::::: zz"E**% CSYOOO $ 9zz)R  $$]E:: ,z*VZ?[?[ ,.9.M.O.O 8]+ FD RRR78>ITQ @K 8]+,<== I3t9UUU)+++ gz3) D D DDDDDDDDDDsE rarpc Ktd|di} ||}tj|r|d{Vn|}td||dt |t r@|dd}|dd}||d<|r||d<|rd|d <nt |trd|i}nd|i}| dikr|dt|n#t$r}tt|t|tjt j d d t j d d t$d }td|dtt)j|ddt)j|i}Yd}~nd}~wwxYwtd||dn)#td||dwxYw|S)z Run the job using the handler. Args: handler (Callable): The handler function to use. job (Dict[str, Any]): The job to run. Returns: Dict[str, Any]: The result of running the job. zStarted.rWNzHandler output: rFrdrbTreRUNPOD_POD_HOSTNAMEunknown RUNPOD_POD_ID) error_type error_messageerror_tracebackhostname worker_idrunpod_versionzCaptured Handler Exception)indentzrun_job return: )r8rminspect isawaitablerPr-r>popboolr2rr[r.r? traceback format_excosenvironrrFr:dumps) rarp run_resulthandler_return job_output error_msgrderr error_infos r!rlrlsHHZT###J.> ">22 .   1Z113t9=== j$ ' ' 0"w55I'^^,>( # #r ) ) NN8 $ $ $*%%%%  7 7 7d3ii.. XX(355 'rurlrjrr r!rs MMMMMMMMMMMMMMMMMM========<<<<<<444444$$$$$$////////&&&&&&AAAAAAAAAAc"*..!9::;;CCE9UU lnn|~~  ;x} ; ; ; ;;M;d3i;;;;|S2-.@@ @&)@ d4S>"#@@@@F,Em,ET#s(^,ET,E,E,E,E^>8>$sCx.>T#s(^>>>>B; ; cN;DeCHo-.45;;;;;;r