<Цi SSKrSSKrSSKJrJrJrJr SSKJr SSK r SSK J r J r SSK JrJrJr /SQrS\S\\4S jrS\S \\S\\4S jrS \S\4S jr\ R.4S \S\S\S\4SjjrS \S\4SjrSS \S\\S\4Sjjr\"S\S9S \S\S\4Sj5rS \S\4SjrS \S\ R<S\4Sjrg)N)AnyListOptionalSet) deprecated)_ShardingIterDataPipeSHARDING_PRIORITIES)DataPipe DataPipeGraph traverse_dps)apply_random_seedapply_shardingapply_shuffle_seedapply_shuffle_settingsget_all_graph_pipesgraphreturnc*[U[55$N)_get_all_graph_pipes_helperset)rs ^/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/torch/utils/data/graph_settings.pyrrs &uce 44id_cachec/nUR5HKunupEX1;aMURU5 URU5 UR[ XQ55 MM U$r)itemsaddappendextendr)rrresultsdp_iddatapipe sub_graphs rrrs[!G(- $$    Ux 29GH )6 Nrr"c[U[5=(d3 [US5=(a [R"UR 5$)Nr) isinstancerhasattrinspectismethodrr"s r_is_sharding_datapiper*)s; h 5 6 *+ 6   X44 5rnum_of_instances instance_idcJ^^^^[U5nSUUUU4SjjmT"U5 U$)z Apply dynamic sharding over the ``sharding_filter`` DataPipe that has a method ``apply_sharding``. RuntimeError will be raised when multiple ``sharding_filter`` are presented in the same branch. c\>UR5Hup#Sn[U5(asUb[SUSU35e[R"UR 5n[ UR5S:aUR TT5 OUR TTT S9 UnUcUnT"X45 M g)NzoSharding twice on a single pipeline is likely unintended and will cause data loss. Sharding already applied to z while trying to apply to )sharding_group)valuesr* RuntimeErrorr' signaturerlen parameters) r prev_applieddpr#appliedsig_helperr,r+r0s rr:apply_sharding.._helper=s"\\^MBG$R((+&77CnD^_a^bd ''(9(9:s~~&*%%&6 D%%(+n&& I '',rr)r )r"r+r,r0rr:s ``` @rrr0s'  "E((, EN Orc[US5=(aZ [US5=(aG [R"UR5=(a [R"UR5$)N set_shuffleset_seed)r&r'r(r=r>r)s r_is_shuffle_datapiper?XsT-( 0 Hj ) 0   X11 2 0   X.. / rshufflec0UcU$[U5n[U5nUVs/sHn[U5(dMUPM nnU(d0U(a)[R"S5 UR 5nU/nUHnUR U5 M U$s snf)a) Traverse the graph of ``DataPipes`` to find and set shuffle attribute. Apply the method to each `DataPipe` that has APIs of ``set_shuffle`` and ``set_seed``. Args: datapipe: DataPipe that needs to set shuffle attribute shuffle: Shuffle option (default: ``None`` and no-op to the graph) z`shuffle=True` was set, but the datapipe does not contain a `Shuffler`. Adding one at the end. Be aware that the default buffer size might not be sufficient for your task.)r rr?warningswarnr@r=)r"r@r all_pipespipe shufflersshufflers rrras  "E#E*I"+J)$/CD/I)IJ   [ ##%  W% OKs BBz`apply_shuffle_seed` is deprecated since 1.12 and will be removed in the future releases. Please use `apply_random_seed` instead.)categoryrngc[X5$r)r )r"rIs rrrs X ++rch[US5=(a [R"UR5$)Nr>)r&r'r(r>r)s r_is_random_datapiperLs% 8Z ( PW-=-=h>O>O-PPrc[U5n[U5n[5n/nUHQn[U5U;aM[ U5(dM&UR U5 UR [U55 MS UH[n[[R"S[RS9RUS9R55nURU5 M] U$)a Traverse the graph of ``DataPipes`` to find random ``DataPipe`` with an API of ``set_seed``. Then set the random seed based on the provided RNG to those ``DataPipe``. Args: datapipe: DataPipe that needs to set randomness rng: Random number generator to generate random seeds )dtype) generator)r rridrLrrinttorchemptyint64random_itemr>)r"rIrrDcacherandom_datapipesrE random_seeds rr r s  "E#E*I EE d8u   t $ $  # #D ) IIbh  ! KK%++ . 6 6 6 E J J L  k" ! Orr) r'rBtypingrrrrtyping_extensionsrrS(torch.utils.data.datapipes.iter.shardingrr torch.utils.data.graphr r r __all__rrRrboolr*DEFAULTrr?r FutureWarningrrL Generatorr rNrrrdsT++( IH 5}5h5   $'H  (^ H'.. %%%%  %P837  !)$   F .  ,,,,  ,Q(QtQu8r