˲j)-*UdZddlZddlZddlmZmZmZmZmZm Z m Z ddl Z ddl m Z mZddlmZmZmZddlmZddlmZe e eefZe jZe jZd agaee egdfeefed <ejZ ej!Z"eZ#d Z$d Z%d e&fdZ'd*dZ(Gdde)Z*d e&fdZ+d e&fdZ,d+deed dfdZ-d efdZ.d efdZ/d+deed efdZ0d+deed efdZ1d+deed e eeffdZ2d*dZ3defdZ4ded dfdZ5GddZ Gd d!Z6ded"d e6fd#Z7d,de eee j fd efd%Z8 d,d&ede eee j fd dfd'Z9dd(l:Tgd)Z;dS)-zH This package enables an interface for accessing MTIA backend in python N)AnyCallableDictListOptionalTupleUnion)deviceTensor) _dummy_type_LazySeedTracker classproperty)Device)_get_device_indexF _queued_callsc"tdSN) _lazy_initDC:\Projects\Historical\venv\Lib\site-packages\torch/mtia/__init__.pyinitr!sLLLLLrc.tot S)z9Return whether PyTorch's MTIA state has been initialized.) _initialized_is_in_bad_forkrrris_initializedr%s  1 1 111rreturnc>tjSr)torch_C_mtia_isInBadForkrrrrr*s 8 % % ' ''rc 2tsttdrdSt5tr ddddSt rt dt stdtj dt_ t dtD tD]Z\}} |#t $r=}dt#|dd|}t'||d}~wwxYw t)tdn#t)tdwxYwdaddddS#1swxYwYdS) Nis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!Tc3K|]}||V dSrr).0callss r z_lazy_init..Ps(XXuRWXUXXXXXXrz6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )rhasattr_tls_initialization_lockr RuntimeError _is_compiledAssertionErrorr r! _mtia_initr$rextend_lazy_seed_tracker get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr) queued_callorig_tracebackemsgs rrr.s;74):;; ,,     ,,,,,,,,    I ~~  *   $XX0B0L0L0N0NXXXXXX -/< < <+ ^<KMMMM <<<]QTUVQWQW]]CE77>CZCZ]]044!; < < D+ , , , ,GD+ , , , , Y,,,,,,,,,,,,,,,,,,sTF  BF * E#7 DE# E  8EE  E# F #E::F  FFceZdZdS)r7N)__name__ __module__ __qualname__rrrr7r7asDrr7c>tjS)z*Return true if compiled with MTIA support.)r r! _mtia_isBuiltrrrr.r.es 8 ! ! # ##rcFtsdStdkS)z'Return true if MTIA device is availableFr)r. device_countrrr is_availablerEjs" >>u >>A rr ctj|5tjcdddS#1swxYwYdS)z?Waits for all jobs in all streams on a MTIA device to complete.N)r mtiar r!_mtia_deviceSynchronizer s r synchronizerJrs   6 " "22x//11222222222222222222sA  AAc>tjS)z,Return the number of MTIA devices available.)r r!_accelerator_hooks_device_countrrrrDrDxs 8 3 3 5 55rc>tjS)z0Return the index of a currently selected device.)r r!%_accelerator_hooks_get_current_devicerrrcurrent_devicerO}s 8 9 9 ; ;;rc^tjt|dS)aSReturn the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)r r!_mtia_getCurrentStreamrrIs rcurrent_streamrT( 8 * *+tjS)zEmpty the MTIA device cache.)r r!_mtia_emptyCacherrr empty_cacher^s 8 $ $ & &&rstreamcL|dStj|dS)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)r r!_mtia_setCurrentStreamr_s r set_streamrcs*~ H##F+++++rcrt|}|dkr!tj|dSdS)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)rr r!%_accelerator_hooks_set_current_devicerIs r set_devicerfs=v & &F {{ 66v>>>>>{rc8eZdZdZdefdZdZdededefdZdS) r zContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. c@t|d|_d|_dS)NTrQ)ridxprev_idx)selfr s r__init__zdevice.__init__s!$Vd;;; rcXtj|j|_dSr)r r!(_accelerator_hooks_maybe_exchange_devicerjrk)rls r __enter__zdevice.__enter__sII$(SS rtypevalue tracebackcXtj|j|_dS)NF)r r!rorkrj)rlrqrrrss r__exit__zdevice.__exit__s 8DDT]SSurN)r>r?r@__doc__rrmrprurrrr r stsTTTSrc\eZdZUdZeded<dedfdZdZdeded efd Z d S) StreamContextaContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.mtia.Stream cur_streamr_cd|_||_tdd|_tjs|jd|_tjsdntjd|_ tjsdntjd|_ dS)NTri) rzr_rrjr jit is_scriptingrGrXsrc_prev_streamdst_prev_stream)rlr_s rrmzStreamContext.__init__s $T400y%%'' x ..00 UDDej6O6OPT6U6U  ..00 UDDej6O6OPT6U6U rc|j}| |jdkrdStjd|_|jj|jkrUt |j5tj|j|_dddn #1swxYwYtj|dSNri) r_rjr rGrTr~r rrc)rlrzs rrpzStreamContext.__enter__s[  R F$z88>>   &**; ; ; )** T T',z'@'@AR'S'S$ T T T T T T T T T T T T T T T j)))))s$*BB!Brqrrrsc|j}| |jdkrdS|jj|jkr$tj|jtj|jdSr)r_rjr~r r rGrcr)rlrqrrrsrzs rruzStreamContext.__exit__sl[  R F   &**; ; ; J ! !$"6 7 7 7 d233333rN) r>r?r@rvr__annotations__rmrprrurrrrxrxs  ,----  x(;<      * * * 4S 4 4 4 4 4 4 4 4rrxryc t|S)a+Wrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. ..Note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rxrbs rr_r_s   rrGc~tjdtdtjdgtj|S)zReturns the random number generator state as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.get_rng_state is not implemented in torch.mtia stacklevelr)dtyper )warningswarn UserWarningr zerosuint8rIs r get_rng_statersC M8 ;s%+f = = ==r new_statec>tjdtddS)aSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.set_rng_state is not implemented in torch.mtiarrN)rrr)rr s r set_rng_stater,s0 M8r)*)rrErrJrDrOrTrX memory_statsmax_memory_allocatedr[r^rfrcr_r rr)rNr)rG)rsoDDDDDDDDDDDDDDDDDD ++++++++EEEEEEEEEE%%%%%% '3# $     t (2t8 d3i '(y%y~''%%''222 (((((0000f     I   $d$$$$ d22+2t2222 6c6666 <<<<< U U8I. U& U U U U U U8I. U& U U U UXX(9"5XsCxXXXX'''' ,v , , , , ?y ?T ? ? ? ?(7474747474747474t!8/0!]!!!! > >%S%, 67 >V > > > > @F$S#u|%;< "   r