jXUdZddlZdZiZeed<iZeed<dZd%d ZGd dZ Gd d Z Gd de Z Gdde Z Gdde Z Gdde ZGddZGdde ZGdde ZGdde ZGdde ZGdd e ZGd!d"e ZGd#d$e ZdS)&ac Backends in `einops` are organized to meet the following requirements - backends are not imported unless those are actually needed, because - backends may not be installed - importing all available backends will drive to significant memory footprint - backends may be present but installed with errors (but never used), importing may drive to crashes - backend should be either symbolic or imperative - this determines which methods (from_numpy/to_numpy or create_symbol/eval_symbol) should be defined - if backend can't provide symbols for shape dimensions, UnknownSize objects are used NzAlex Rogozhnikov_loaded_backends _type2backendFreturnAbstractBackendc4t|}t|d}||Stt}|D](\}}||r|t|<|cS)g}t}|rB| }||z }| ||Bd|D}|D]} trtd| | j |vrk| j tjvrXtrtd| j | }|t|j <||r|t|<|cSt!dt|)z Takes a correct backend (e.g. numpy backend if tensor is numpy.ndarray) for a tensor. If needed, imports package and creates backend Ncg|]\}}|Sr ).0x_s AC:\Projects\Historical\venv\Lib\site-packages\einops/_backends.py zget_backend../sCCC1!CCCzTesting for subclass of zImported backend for zTensor type unknown to einops )typergetlistritemsis_appropriate_typer__subclasses__popappend_debug_importingprintframework_namesysmodules RuntimeError) tensor_type_resultpreviously_loaded_backends_framework_namebackendbackend_subclassesbackendsprev_backend_namesBackendSubclasss r get_backendr(s LLEt,,G!%&6&<&<&>&>!?!?$>   & &v . . #*M% NNN  --//H +,,..G**,,,!!'*** + DC(BCCC- # #  ? ,o > > >  )1C C C-<<#S1?3QRRR)/++;B !78..v66#+2M%("NNN FV FF G GGrceZdZUdZeed<dZdZdZdZ dZ dZ d Z d Z d Zd Zd efdZdZdZdZdefdZdZdZdZdZdS)rzJBase backend class, major part of methods are only for debugging purposes.rct)z4helper method should recognize tensors it can handleNotImplementedErrorselfrs r rz#AbstractBackend.is_appropriate_typeF!###rc tdNz.framework doesn't support imperative executionr+r.r s r from_numpyzAbstractBackend.from_numpyJ!"RSSSrc tdr1r+r2s r to_numpyzAbstractBackend.to_numpyMr4rc tdNz/framework doesn't support symbolic computationsr+r.shapes r create_symbolzAbstractBackend.create_symbolPs!"STTTrc tdr8r+r.symbolsymbol_value_pairss r eval_symbolzAbstractBackend.eval_symbolSs!"STTTrc td)Nz"framework doesn't implement aranger+r.startstops r arangezAbstractBackend.arangeWs!"FGGGrc|jS)zashape should return a tuple with integers or "shape symbols" (which will evaluate to actual size)r:r2s r r:zAbstractBackend.shape[s wrc,||SNreshaper.r r:s r rKzAbstractBackend.reshape_yyrc,||SrI transposer.r axess r rPzAbstractBackend.transposeb{{4   rc6t|||SNaxis)getattrr.r operationrRs r reducezAbstractBackend.reducees$wq)$$$////rtensorsctrIr+r.r\s r stack_on_zeroth_dimensionz)AbstractBackend.stack_on_zeroth_dimensionh!###rctrIr+r.r new_positions r add_axiszAbstractBackend.add_axiskr`rcdg|z}|D] \}}|||}|||<!||t|S)N)rrdtiletupler.r n_axespos2lenrepeats axis_position axis_lengths r add_axeszAbstractBackend.add_axesnsc#,*1--// 1 1 &M; a//A%0GM " "yyE'NN+++rct)z!repeats - same lengths as x.shaper+r.r rls r rgzAbstractBackend.tileur/rrWct)zzconcatenates tensors along axis. Assume identical across tensors: devices, dtypes and shapes except selected axis.r+r.r\rWs r concatzAbstractBackend.concaty"###rctrIr+r2s r is_float_typezAbstractBackend.is_float_type~rurc td)Nzbackend does not provide layersr+r.s r layerszAbstractBackend.layers!"CDDDrcd|jdS)Nz)rrys r __repr__zAbstractBackend.__repr__s473C"DEEErcl|jsJ|j|SrI)r.executing_eagerlyconvert_to_tensorr2s r r3zTensorflowBackend.from_numpyjs2w((*****w((+++rc`|jsJ|SrI)r.r3rr2s r r6zTensorflowBackend.to_numpyns*w((*****wwyyrc8|j||SrI)r.rangerBs r rEzTensorflowBackend.arangersw}}UD)))rc|jrtd|jDS|j}|j|tfdt |D} t ||S#t$rt|cYSwxYw)Nc3TK|]#}|tnt|V$dSrI)rr)r ds r z*TensorflowBackend.shape..ws4QQA!)QQQQQQQrc*g|]\}}|p|Sr r )r rstf_shapes r rz+TensorflowBackend.shape..|s&TTT&#q1- TTTr) r.r3rhr:as_list enumerater BaseExceptionr)r.r static_shaper:r>s @r r:zTensorflowBackend.shapeus 7 $ $ & & ,QQQQQQQ Q7??,,Lw}}Q''HTTTTIl.s(P(P(P#q(P(P(Prcg|]\}}|Sr r )r r vals r rz.TFKerasBackend.eval_symbol..s&N&N&Nx3s&N&N&Nr)rQmodelsModelpredict_on_batch)r.r>r?models r r@zTFKerasBackend.eval_symbolsQ !''(P(P=O(P(P(PRXYY%%&N&N;M&N&N&NOOOrc8|j||SrI)rRrErBs r rEzTFKerasBackend.arangesv}}UD)))rcn|j|}tt|SrI)rRr:rrhrLs r r:zTFKerasBackend.shapes' QU5\\***rcBt|j|||SrU)rXrRrYs r r[zTFKerasBackend.reduces#)wtvy))!$7777rc8|j||SrI)rRrKrLs r rKzTFKerasBackend.reshapesv~~a'''rc8|j||SrI)rRpermute_dimensionsrQs r rPzTFKerasBackend.transposesv((D111rr\c6|j|SrI)rRrr^s r r_z(TFKerasBackend.stack_on_zeroth_dimensionsv||G$$$rc8|j||SrI)rRrgrqs r rgzTFKerasBackend.tilesv{{1g&&&rrWc:|j||SrU)rRrrss r rtzTFKerasBackend.concatsv!!'!555rc8|j||SrI)rRrrbs r rdzTFKerasBackend.add_axissv!!!\222rc:d|j|vS)Nfloat)rRrr2s r rwzTFKerasBackend.is_float_types$&,,q//))rcddlm}|S)Nrf)rQ)rzrQ)r.rQs r rzzTFKerasBackend.layersrrN)rrrrrrr;r@rEr:r[rKrPrr_rgrrtrdrwrzr rr rOrOs'N"""LLL333PPP***+++888(((222%%%%%'''6C6666333***rrOcxeZdZdZdZdZdZdZdZdZ dZ d e fd Z d Z d Zd efdZdZdZdZdZdS)OneFlowBackendoneflowcddl}||_dSr)rqflow)r.rss r rzOneFlowBackend.__init__s rc6t||jjSrI)rrsrr-s r rz"OneFlowBackend.is_appropriate_types&$)"2333rcr|j|}||rd|_|Sr)rsr3rwrrs r r3zOneFlowBackend.from_numpys:9''**   h ' ' *%)H "rcr|SrIrr2s r r6zOneFlowBackend.to_numpyrrcP|j|||jjSr)rsrErrBs r rEzOneFlowBackend.aranges#yt49?CCCrc t|dD]p}|dkr||\}}"|dkr||\}}B|dvrt|||}at d||S)NTreverserrr)rrrrrr)rrrrXr,)r.r rZrrWr s r r[zOneFlowBackend.reduces<666 K KDE!!uuu11e##uuu11CCC)GAy))d333)*> JJJrc,||SrIrrQs r rPzOneFlowBackend.transposerrr\c6|j|SrI)rsrr^s r r_z(OneFlowBackend.stack_on_zeroth_dimensionrrcdg|z}|D] \}}|||}|||<!|j|Srrris r rozOneFlowBackend.add_axessX$-*1--// 1 1 &M; a//A%0GM " "qx!!rc,||SrIrrqs r rgzOneFlowBackend.tilerrrWc:|j||Sr)rsrtrss r rtzOneFlowBackend.concatsyT222rc8|j||SrI)rsrrbs r rdzOneFlowBackend.add_axissy""1l333rcV|j|jj|jj|jjfvSrI)rrsrrrr2s r rwzOneFlowBackend.is_float_types%w49,di.?ARSSSrcddlm}|S)Nrf)rq)rzrq)r.rqs r rzzOneFlowBackend.layerss######rc(|jj|g|RSrI)rsrrs r rzOneFlowBackend.einsum rrNr r rr rprpsN 444(((DDD   ((((("""!!!3C3333444TTT -----rrpceZdZdZdZdZdZdZdZfdZ dZ d Z d e fd Z d Zd ZdefdZdZdZdZdZdZxZS) PaddleBackendpaddlecddl}||_dSrrr.rs r rzPaddleBackend.__init__'s  rc6|j|SrI)rrTr-s r rz!PaddleBackend.is_appropriate_type,s{$$V,,,rcH|j|}d|_|S)NF)r to_tensor stop_gradient)r.r rs r r3zPaddleBackend.from_numpy/s$&&q))$ rcN|SrI)rrr2s r r6zPaddleBackend.to_numpy4sxxzz!!!rcP|j|||jjSr)rrErrBs r rEzPaddleBackend.arange7s${!!%T[5F!GGGrct||jkr6t|||dSt|||Sr)r%ndimrr[squeeze)r.r rZrRrs r r[zPaddleBackend.reduce:sX t99  77>>!Y55==a@@ @77>>!Y55 5rc,||SrIrOrQs r rPzPaddleBackend.transposeArSrcdg|z}|D] \}}|||}|||<!||Srrris r rozPaddleBackend.add_axesDrrr\c6|j|SrI)rrr^s r r_z'PaddleBackend.stack_on_zeroth_dimensionKs{  )))rc,||SrIrJrLs r rKzPaddleBackend.reshapeNrMrc,||SrI)rgrqs r rgzPaddleBackend.tileQsvvgrrWc:|j||SrU)rrtrss r rtzPaddleBackend.concatTs{!!'!555rc,||SrIrrbs r rdzPaddleBackend.add_axisW{{<(((rcV|j|jj|jj|jjfvSrI)rrrrrr2s r rwzPaddleBackend.is_float_typeZs%w4;. 0CT[EXYYYrcddlm}|S)Nrfr)rzrrs r rzzPaddleBackend.layers]s"""""" rc(|jj|g|RSrI)rrrs r rzPaddleBackend.einsumbs!t{!'.A....rc*t|jSrI)rhr:r2s r r:zPaddleBackend.shapeesQW~~r)rrrrrrr3r6rEr[rProrr_rKrgrrtrdrwrzrr:rrs@r rr$sKN --- """HHH66666!!!!!!*****   6C6666)))ZZZ ///rrcxeZdZdZdZdZdZdZdZdZ dZ d Z d Z d e fd Zd ZdZdefdZdZdZdS)TinygradBackendtinygradcddl}||_dSr)r)r.rs r rzTinygradBackend.__init__ls  rc6t||jjSrI)rrrr-s r rz#TinygradBackend.is_appropriate_typeqs&$-"6777rc6|j|SrI)rrr2s r r3zTinygradBackend.from_numpyts}##A&&&rc*|SrI)rr2s r r6zTinygradBackend.to_numpywswwyyrcB|jj||SrI)rrrErBs r rEzTinygradBackend.arangezs}#**5$777rc|jSrIrGr2s r r:zTinygradBackend.shape}s wrc,||SrIrJrLs r rKzTinygradBackend.reshaperMrc,||SrIrrQs r rPzTinygradBackend.transposerrcbt|dD]}t|||}|S)NTryrV)rrX)r.r rZrRrWs r r[zTinygradBackend.reducesA4... 1 1D%9%%4000AArr\c@|jj|SrI)rrrr^s r r_z)TinygradBackend.stack_on_zeroth_dimensions}#))'222rc,||SrIrrbs r rdzTinygradBackend.add_axisrrc,||SrIrrqs r rgzTinygradBackend.tilerrrWcnt|dkr|dj|ddd|in|dS)Nrfrr)r%rrss r rtzTinygradBackend.concats?9.sC  ( L%0JJl      r)rhziprr:r2s r r:zPyTensorBackend.shapes@  ,/ ag,F,F      rr\c6|j|SrI)rrr^s r r_z)PyTensorBackend.stack_on_zeroth_dimensionrrc8|j||SrI)rrgrqs r rgzPyTensorBackend.tilerrrWc:|j||SrU)rrrss r rtzPyTensorBackend.concatrrc8|j||SrI)rrrbs r rdzPyTensorBackend.add_axisrrc(|jj|g|RSrI)rrrs r rzPyTensorBackend.einsumrrN)rrrrrrrwr3r6r;r@rEr:rr_rgrrtrdrr rr rrsN :::444$$$+++ 555+++   &&&&&(((7C7777444+++++rrc`eZdZdZdZdZdZdZdZde fdZ d Z d Z d e fd Zd ZdZdS) MLXBackendmlxc6ddlm}ddl}||_||_dSr)mlx.corecorermxr)r.rrs r rzMLXBackend.__init__s2rc6t||jjSrI)rrarrayr-s r rzMLXBackend.is_appropriate_types&$'-000rc6|j|SrI)rrr2s r r3zMLXBackend.from_numpysw}}Qrc|j|jjkr||jj}|j|SrI)rrrastyperrrr2s r r6zMLXBackend.to_numpys= 7dg& & &))Aw}}Qrc8|j||SrI)rrErBs r rEzMLXBackend.arangerrr\c6|j|SrI)rrr^s r r_z$MLXBackend.stack_on_zeroth_dimensionrrc8|j||SrI)rrrbs r rozMLXBackend.add_axesrrc8|j||SrI)rrgrqs r rgzMLXBackend.tilerrrWc:|j||SrU)rrrss r rtzMLXBackend.concatrrcV|j|j|jjSrI)r issubdtyperfloatingr2s r rwzMLXBackend.is_float_types!w!!!'47+;<<rs     $ t(H(H(H(HVIEIEIEIEIEIEIEIEX&$+$+$+$+$+?$+$+$+N########$J.J.J.J.J.?J.J.J.Z$-$-$-$-$-/$-$-$-N # # # # # # # #$C+C+C+C+C+C+C+C+L66666_666rC-C-C-C-C-_C-C-C-LBBBBBOBBBJ2828282828o282828j3+3+3+3+3+o3+3+3+l(+(+(+(+(+(+(+(+(+(+r