j dZddlmZddlmZmZmZddlZddlm Z ddlm Z gd Z ee e edfZd efd Zd efd Zd efd Zd efdZd efdZd efdZd efdZd efdZd efdZd"ded dfdZGddZGddZeZead"ded efdZGddeZ ded efdZ!d efdZ"ded dfd Z#d e fd!Z$dS)#zj This package implements abstractions found in ``torch.cuda`` to facilitate writing device-agnostic code. )AbstractContextManager)AnyOptionalUnionNdevice)amp) is_available synchronizecurrent_devicecurrent_streamstream set_device device_countStream StreamContextEventreturncHtjjS)z/Returns a bool indicating if CPU supports AVX2.)torch_C_cpu_is_avx2_supportedCC:\Projects\Historical\venv\Lib\site-packages\torch/cpu/__init__.pyrr s 8= + + - --rcHtjjS)z1Returns a bool indicating if CPU supports AVX512.)rrr_is_avx512_supportedrrrr r %s 8= - - / //rcHtjjS)z6Returns a bool indicating if CPU supports AVX512_BF16.)rrr_is_avx512_bf16_supportedrrrr"r"*s 8= 2 2 4 44rcHtjjS)z/Returns a bool indicating if CPU supports VNNI.)rrr_is_avx512_vnni_supportedrrr_is_vnni_supportedr%/s 8= 2 2 4 44rcHtjjS)z3Returns a bool indicating if CPU supports AMX_TILE.)rrr_is_amx_tile_supportedrrrr'r'5 8= / / 1 11rcHtjjS)z3Returns a bool indicating if CPU supports AMX FP16.)rrr_is_amx_fp16_supportedrrrr*r*:r(rcHtjjS)zInitializes AMX instructions.)rrr _init_amxrrrr,r,?s 8= " " $ $$rcHtjjS)z2Returns a bool indicating if CPU supports Arm SVE.)rrr_is_arm_sve_supportedrrrr.r.Ds 8= . . 0 00rcdS)zReturns a bool indicating if CPU is currently available. N.B. This function only exists to facilitate device-agnostic code Trrrrr r Is 4rr cdS)zWaits for all kernels in all streams on the CPU device to complete. Args: device (torch.device or int, optional): ignored, there's only one CPU device. N.B. This function only exists to facilitate device-agnostic code. Nrrs rr r Rrc,eZdZdZddeddfdZd dZdS) rzH N.B. This class only exists to facilitate device-agnostic code priorityrNcdSNr)selfr4s r__init__zStream.__init__a rcdSr6rr7rs r wait_streamzStream.wait_streamdr9r)r3rN)__name__ __module__ __qualname____doc__intr8r<rrrrr\sY   d          rrc6eZdZdefdZdddZddZdddZdS) rrcdS)NTrr7s rqueryz Event.queryistrNcdSr6rr;s rrecordz Event.recordlr9rcdSr6rrEs rr zEvent.synchronizeor9rcdSr6rr;s rwaitz Event.waitrr9rr6r=)r>r?r@boolrFrHr rKrrrrrhsut                rrctS)zReturns the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): Ignored. N.B. This function only exists to facilitate device-agnostic code )_current_streamrs rrrzs  rcNeZdZUdZeeed<dZdZde de de dd fd Z d S) rzvContext-manager that selects a given stream. N.B. This class only exists to facilitate device-agnostic code cur_streamc,||_t|_dSr6)r_default_cpu_stream prev_streamr;s rr8zStreamContext.__init__s .rc8|j}|dSt|_|adSr6)rrNrS)r7rPs r __enter__zStreamContext.__enter__s'[   F+$rtypevalue tracebackrNc*|j}|dS|jadSr6)rrSrN)r7rVrWrXrPs r__exit__zStreamContext.__exit__s"[   F*r) r>r?r@rArr__annotations__r8rUrrZrrrrrs     ///%%%+S+++++++++rrrc t|S)zWrapper around the Context-manager StreamContext that selects a given stream. N.B. This function only exists to facilitate device-agnostic code )r)rs rrrs   rcdS)zReturns number of CPU devices (not cores). Always 1. N.B. This function only exists to facilitate device-agnostic code r rrrrrrs 1rcdS)zzSets the current device, in CPU we do nothing. N.B. This function only exists to facilitate device-agnostic code Nrrs rrrr1rcdS)zyReturns current device for cpu. Always 'cpu'. N.B. This function only exists to facilitate device-agnostic code cpurrrrrrs 5rr6)%rA contextlibrtypingrrrrr _devicer __all__strrB _device_trLrr r"r%r'r*r,r.r r rrrRrNrrrrrrrrrrhs .-----''''''''''     '3T) * .D.... 0d0000 545555 5D5555 22222 22222 %4%%%% 1t1111 d T                  fhh%  9     +++++*+++>!6!4!!!! c    yTr