ΑiiSSKJr SSKrSSKJr SSKrSSKJr SSKJ r SSK J r J r J r \(aSSKJr SSKJr SSKJr SS K Jr S rS S S jjrg)) annotationsN) TYPE_CHECKING) framework)_get_global_group_get_or_throw_group_rank_warn_cur_rank_not_in_group)Sequence)Tensor)task)GroupcURnURU:XaC[U5S:Xa3U[U5Vs/sHn[R "U5PM sn- nO[U5Vs/sHopPM nn[U5U:XdS[U5SUS35eUR RXX$U5nU(aUR"5 U$s snfs snf)Nrz gather_list length z and nrankd z not equal) nranksranklenrangepaddle empty_like process_groupgatherwait) tensor gather_listdst_rank_in_groupgroupsync_opuse_calc_streamr_r s n/var/www/html/banglarbhumi/venv/lib/python3.13/site-packages/paddle/distributed/communication/stream/gather.py_gather_in_dygraphr%s\\F zz&& { q uV}M}!F--f5}M MK',V}5}!v} 5 { v % s;/0 VHJO %    % %. D KN5s C- Ccd[R"5(dS5e[U5(agU(dU(a [S5eU[R "5:waUb[ R"S5 /nO UcS5eUc [5OUn[X#5n[XXcXE5$)a Gather tensors from all participators. Args: tensor (Tensor): The input Tensor. Its data type should be float16, float32, float64, int32, int64, int8, uint8, bool or bfloat16. gather_list (list|None): A list of Tensors to hold the gathered tensors. Every element in the list must be a Tensor whose data type should be float16, float32, float64, int32, int64, int8, uint8, bool or bfloat16. Default value is None. dst (int): The dst rank id. Default value is 0. group (Group|None, optional): The group instance return by new_group or None for global default group. sync_op (bool, optional): Whether this op is a sync op. The default value is True. use_calc_stream (bool, optional): Indicate whether the communication is done on calculation stream. If none is given, use false as default. This option is designed for high performance demand, be careful to turn it on except you are clearly know its meaning. Returns: Async work handle,which can be wait on, if async_op is set to True. None, if not async_op Examples: .. code-block:: python >>> # doctest: +REQUIRES(env: DISTRIBUTED) >>> import paddle >>> import paddle.distributed as dist >>> dist.init_parallel_env() >>> gather_list = [] # type: ignore[var-annotated] >>> if dist.get_rank() == 0: ... data = paddle.to_tensor([1, 2, 3]) ... dist.stream.gather(data, gather_list, dst=0) >>> else: ... data = paddle.to_tensor([4, 5, 6]) ... dist.stream.gather(data, gather_list, dst=0) >>> print(gather_list) >>> # [[1, 2, 3], [4, 5, 6]] (2 GPUs, out for rank 0) >>> # [] (2 GPUs, out for rank 1) z-gather doesn't support static graph mode yet.Nz5use_calc_stream can only be true in sync op behavior.z@Specific `gather_list` is meaningless for rank which is not dst.z)gather_list must not be none for dst rank) rin_dynamic_moder RuntimeErrordistget_rankwarningswarnrrr)rrdstrrrrs rrr=s^  $ $ & &7 &#5))  C   dmmo  " MMR  & 7 &$)=  eE0< .w )NrNTF)rr rzSequence[Tensor] | Noner'intrz Group | Nonerboolrr*returnz task | None) __future__rr%typingrrpaddle.distributed distributedr#r&paddle.distributed.communication.grouprrrcollections.abcr r paddle.base.corer r rrr(rr4s# ! (%<4,0! M M(M M  M  M  MMr(