AxjO|dZddlZddlZddlZddlZddlmZmZmZm Z ddl m Z e Z ej ZejdeejZdZejddduZGd d ZGd d e eZGd dZdS)z] Handles getting stuff from environment variables and updating the global state like job id. N)AnyDictOptionalSet) RunPodLogger RUNPOD_POD_IDiRUNPOD_WEBHOOK_GET_JOBc eZdZdZ d dedeeeefdeeddfdZde de fd Z de fd Z defd ZdS) Jobz Represents a job object. Args: job_id: The id of the job, a unique string. job_input: The input to the job. webhook: The webhook to send the job output to. Nidinputwebhookreturnc ||_||_||_|D]\}}t |||dSN)r rritemssetattr)selfr rrkwargskeyvalues WC:\Projects\Historical\venv\Lib\site-packages\runpod/serverless/modules/worker_state.py__init__z Job.__init__&sS   ,,.. & &JC D#u % % % % & &othercPt|tr|j|jkSdS)NF) isinstancer r )rrs r__eq__z Job.__eq__4s( eS ! ! '7eh& &urc*t|jSr)hashr rs r__hash__z Job.__hash__9sDG}}rc|jSrr r"s r__str__z Job.__str__<s wr)NN)__name__ __module__ __qualname____doc__strrrrrobjectboolrintr#r&rrr r s+/!% & &  &S#X' &# &  & & & &Ft #rr ceZdZdZdZdZdZdefdZddZ ddZ dfd Z d e ffd Z d e ffd Zd e deefd ZdeefdZdefdZxZS) JobsProgresszETrack the state of current jobs in progress (in-memory, per process).NctjYt|t_ttjdtj_tjSr)r1 _instanceset__new__r_mirror)clss rr5zJobsProgress.__new__HsJ  ! )%([[%5%5L " LL/ 0 0 0.2L " *%%rcdSrr/r"s rrzJobsProgress.__init__Qs rrcJd|jjd|S)N: ) __class__r' get_job_listr"s r__repr__zJobsProgress.__repr__Us)D4>*DDt/@/@/B/BDDDrc<||_|dS)zAttach a PingJobMirror that mirrors the in-progress job ids to the ping process. Every add/remove/clear then pushes the snapshot to it.N)r6_notify_mirror)rmirrors r set_mirrorzJobsProgress.set_mirrorXs#  rcp|j.|j|dSdS)z@Push the current job-id snapshot to the attached mirror, if any.N)r6r4r<r"s rr?zJobsProgress._notify_mirror^s: < # L  T..00 1 1 1 1 1 $ #rcpt|dSr)superclearr?)rr;s rrEzJobsProgress.clearcs,   relementcFt|trt|}t|tr tdi|}t|tst dt |}||S)z Adds a Job object to the set. If the added element is a string, then `Job(id=element)` is added. If the added element is a dict, then `Job(**element)` is added. r%z.Only Job objects can be added to JobsProgress.r/)rr+r dict TypeErrorrDaddr?rrFresultr;s rrJzJobsProgress.addgs gs # # &WoooG gt $ $ %nnGnnG'3'' NLMM MW%%  rcFt|trt|}t|tr tdi|}t|tst dt |}||S)z Removes a Job object from the set. If the element is a string, then `Job(id=element)` is removed. If the element is a dict, then `Job(**element)` is removed. r%z2Only Job objects can be removed from JobsProgress.r/)rr+r rHrIrDdiscardr?rKs rremovezJobsProgress.remove{s gs # # &WoooG gt $ $ %nnGnnG'3'' RPQQ Q))  rct|trt|}t|tstd|D] }||kr|cS dS)Nr%z4Only Job objects can be retrieved from JobsProgress.)rr+r rI)rrFjobs rgetzJobsProgress.getsn gs # # &WoooG'3'' TRSS S  Cg~~ trcbt|sdSdd|DS)z\ Returns the list of job IDs as a comma-separated string, or None if empty. N,c34K|]}t|VdSr)r+).0rQs r z,JobsProgress.get_job_list..s(11SC111111r)lenjoinr"s rr<zJobsProgress.get_job_lists84yy 4xx11D111111rc t|S)z- Returns the number of jobs. )rXr"s r get_job_countzJobsProgress.get_job_counts4yyr)rN)r'r(r)r*r3r5rr+r=rAr?rErrJrOrr rRr<r.r[ __classcell__)r;s@rr1r1CsXOOI&&&   E#EEEE 2222 3(c( 3 8C=    2hsm2222srr1cXeZdZdZedfdefdZdeeddfdZ deefdZ dS) PingJobMirrora One-way snapshot of in-progress job ids from the worker (main) process to the separate ping process. Backed by a fixed-size shared-memory buffer created in the main process and passed to the ping process via ``Process(args=...)``. It lives only in this worker's own process tree, so it cannot be shared across workers and never touches the filesystem. All operations are best-effort and never raise into the caller (a failure here must not break job processing or kill the ping). Ncapacityc\|pt}||_|d||_dS)Nc)multiprocessing _capacityArray_buffer)rr_ctxs rrzPingJobMirror.__init__s,$_!yyh// rjob_idsrc |pdd}|jdz }t||krM|d|}|d}|dkr |d|}td|d|j5||j_ddddS#1swxYwYdS#t$r(}t d |Yd}~dSd}~wwxYw) z=Write the current job-id snapshot. Best-effort; never raises.utf-8rN,z(PingJobMirror: job-id snapshot exceeded z bytes; truncatedzPingJobMirror.set failed: ) encodercrXrfindlogwarnreget_lockr Exceptionerror)rrgdatalimitcuterrs rr4zPingJobMirror.setsc :Mr))'22DNQ&E4yy5  FUF|jj&&"99:DWuWWW&&(( * *%) " * * * * * * * * * * * * * * * * * * : : : II8388 9 9 9 9 9 9 9 9 9 :s<BC B6) C6B::C=B:>C C5 C00C5c |j5|jj}dddn #1swxYwY|d}|pdS#t$r(}t d|Yd}~dSd}~wwxYw)zrsg ++++++++++++######lnn""$$ JNN?CC  ,=,= > >  7>>$F !!!!!!!!Neeeee3s8eeeV,,,,,,,,,,r