̲jf 6ddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z m Z ddl mZddlmZmZddgZe eefZeee edffZd Zd ed ed e ed eefdZded efdZdded eed efdZded ed e ed efdZdS)N) Collection)DictListOptionalSetTupleTypeUnion)dill_available) IterDataPipe MapDataPipetraverse traverse_dps DataPipeGraphcdS)NSTUBrGC:\Projects\Historical\venv\Lib\site-packages\torch/utils/data/graph.py_stub_unpicklerrs 6rscan_obj only_datapipecachereturnc@ tj}tj|}t rddlm}||}nd}g d} fd}t tf} | D].} | ||r| |/ | nG#tj ttf$r(t r| nYnwxYw| D].} | d|r| d/t rddlm} | dnV#| D].} | d|r| d/t rddlm} | dwwxYw S)Nr)Picklercd}t|trDi}|D],\}}t|ttt fr|||<-nt|t tfr?g}|D]9}t|ttt fr||:n$t|ttt fr|}|SN) isinstancedictitemsr r rtuplelistappend) ori_statestatekvs r getstate_hookz0_list_connected_datapipes..getstate_hook's i & & E!)) ! !1a, Z!HII! E!H ! E4= 1 1 E $ $a, Z!HII$LLOOO $ L+z#J K K E rc|kst|vrt|t|tdfS)Nr)idNotImplementedErrorr$addr)objrcaptured_connectionsrs r reduce_hookz._list_connected_datapipes..reduce_hook7sY (??bgg..% % ' ' , , , IIbgg   "B& &r)extendF)ioBytesIOpicklerr dillr r set_reduce_ex_hookset_getstate_hookdump PickleErrorAttributeError TypeErrorr1) rrrfp dill_Picklerdr)r0datapipe_classescls dill_extendr/s ` ` @r_list_connected_datapipesrCsL A   A000000 LOO  '''''''0<[.I# 5 5C  " "; / / / 5%%m444  FF8    "NI>    x    !   $ , ,C  " "4 ( ( ( ,%%d+++     2 2 2 2 2 2 K   $ , ,C  " "4 ( ( ( ,%%d+++     2 2 2 2 2 2 K      s2(1EB0/E0AC41E3C44EAFdatapipecBt}t|d|S)a Traverse the DataPipes and their attributes to extract the DataPipe graph. This only looks into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Args: datapipe: the end DataPipe of the graph Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph T)rr)set_traverse_helper)rDrs rrrZs"eeE HD F F FFrcd}|s|dz }tj|t|d}t}t |||S)a6 Traverse the DataPipes and their attributes to extract the DataPipe graph. [Deprecated] When ``only_dataPipe`` is specified as ``True``, it would only look into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Note: This function is deprecated. Please use `traverse_dps` instead. Args: datapipe: the end DataPipe of the graph only_datapipe: If ``False`` (default), all attributes of each DataPipe are traversed. This argument is deprecating and will be removed after the next release. Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph zV`traverse` function and will be removed after 1.13. Please use `traverse_dps` instead.zM And, the behavior will be changed to the equivalent of `only_datapipe=True`.NF)warningswarn FutureWarningrFrG)rDrmsgrs rrrlsZ* - _ ^^ M#}%%% eeE HmU ; ;;rc t|ttfs tdt |dt |}||vriS||t|||}||ifi}|D]D}||d t|||E|S)Nz.Expected `IterDataPipe` or `MapDataPipe`, but z is found) rr r RuntimeErrortyper+r-rCcopyupdaterG)rDrrdp_idr!r?items rrGrGs h{ ; < <  VT(^^ V V V    xLLE ~~  IIe %h uzz|| L LE"~.APP % +D-NNOOOO Hrr)r2r4rIcollections.abcrtypingrrrrrr r torch.utils._import_utilsr #torch.utils.data.datapipes.datapiper r __all__DataPipeintrrboolrCrrrGrrrr]s &&&&&&@@@@@@@@@@@@@@@@@@444444IIIIIIII ~ & {* +S%/ 9::;  @ @ '+@ 47H@  (^@ @ @ @ FG8G GGGG$<