[i ddlZddlZddlZddlmZddlmZddlmZm Z ddgZ ee zZ e e ee dffZdefd Zd e d ed ee dee fd Zde defdZdde d edzdefdZde d ed ee defdZdS)N) Collection)dill_available) IterDataPipe MapDataPipetraverse traverse_dps DataPipeGraphreturncdS)NSTUBr I/var/www/icac/venv/lib/python3.11/site-packages/torch/utils/data/graph.py_stub_unpicklerrs 6rscan_obj only_datapipecachec@ tj}tj|}t rddlm}||}nd}g d} fd}t tf} | D].} | ||r| |/ | nG#tj ttf$r(t r| nYnwxYw| D].} | d|r| d/t rddlm} | dnV#| D].} | d|r| d/t rddlm} | dwwxYw S)Nr)Picklercd}t|trDi}|D],\}}t|ttt fr|||<-nt|t tfr?g}|D]9}t|ttt fr||:n$t|ttt fr|}|SN) isinstancedictitemsrrrtuplelistappend) ori_statestatekvs r getstate_hookz0_list_connected_datapipes..getstate_hook&s i & & E!)) ! !1a, Z!HII! E!H ! E4= 1 1 E $ $a, Z!HII$LLOOO $ L+z#J K K E rc|kst|vrt|t|tdfS)Nr )idNotImplementedErrorraddr)objrcaptured_connectionsrs r reduce_hookz._list_connected_datapipes..reduce_hook6sY (??bgg..% % ' ' , , , IIbgg   "B& &r)extendF)ioBytesIOpicklerrdillrrset_reduce_ex_hookset_getstate_hookdump PickleErrorAttributeError TypeErrorr*) rrrfp dill_Picklerdr"r)datapipe_classescls dill_extendr(s ` ` @r_list_connected_datapipesr<sL A   A000000 LOO  '''''''0<[.I# 5 5C  " "; / / / 5%%m444  FF8    "NI>    x    !  $ , ,C  " "4 ( ( ( ,%%d+++     2 2 2 2 2 2 K   $ , ,C  " "4 ( ( ( ,%%d+++     2 2 2 2 2 2 K      s2(1EB0/E0AC41E3C44EAFdatapipecBt}t|d|S)a Traverse the DataPipes and their attributes to extract the DataPipe graph. This only looks into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Args: datapipe: the end DataPipe of the graph Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph T)rr)set_traverse_helper)r=rs rrrZs"eeE HD F F FFrcd}|s|dz }tj|td|d}t}t |||S)a6 Traverse the DataPipes and their attributes to extract the DataPipe graph. [Deprecated] When ``only_dataPipe`` is specified as ``True``, it would only look into the attribute from each DataPipe that is either a DataPipe and a Python collection object such as ``list``, ``tuple``, ``set`` and ``dict``. Note: This function is deprecated. Please use `traverse_dps` instead. Args: datapipe: the end DataPipe of the graph only_datapipe: If ``False`` (default), all attributes of each DataPipe are traversed. This argument is deprecating and will be removed after the next release. Returns: A graph represented as a nested dictionary, where keys are ids of DataPipe instances and values are tuples of DataPipe instance and the sub-graph zV`traverse` function and will be removed after 1.13. Please use `traverse_dps` instead.zM And, the behavior will be changed to the equivalent of `only_datapipe=True`.) stacklevelNF)warningswarn FutureWarningr?r@)r=rmsgrs rrrls_* - _ ^^ M#}3333 eeE HmU ; ;;rc t|ttfs tdt |dt |}||vriS||t|||}||ifi}|D]D}||d t|||E|S)Nz.Expected `IterDataPipe` or `MapDataPipe`, but z is found) rrr RuntimeErrortyper$r&r<copyupdater@)r=rrdp_idrr8items rr@r@s h{ ; < <  VT(^^ V V V    xLLE ~~  IIe %h uzz|| L LE"~.APP % +D-NNOOOO Hrr)r+r-rDcollections.abcrtorch.utils._import_utilsr#torch.utils.data.datapipes.datapiperr__all__DataPiperintrr strrboolr?rr<rrr@r rrrXs &&&&&&444444IIIIIIII ~ & + %S%/ 9::;  A A '+A 47HA  (^A A A A HG8G GGGG$<