x-jddlmZddlmZmZddlZddlmZddlm Z m Z ddl m Z erddlm Z ddlmZdd lmZ dddZ dddZ d d!dZdS)") annotations) TYPE_CHECKINGAnyN)stream)_get_global_group_warn_cur_rank_not_in_group)convert_tensor_to_object)Tensor)task)GroupTtensorr srcintgroup Group | Nonesync_opboolreturnr c4tj||||dS)a Receive a tensor to the sender. Args: tensor (Tensor): The tensor to receive. Its data type should be float16, float32, float64, int32, int64, int8, uint8, bool or bfloat16. src (int): The source rank id. group (Group, optional): The group instance return by new_group or None for global default group. Default: None. sync_op (bool, optional): Whether this op is a sync op. The default value is True. Returns: Return a task object. Examples: .. code-block:: python >>> # doctest: +REQUIRES(env: DISTRIBUTED) >>> import paddle >>> import paddle.distributed as dist >>> dist.init_parallel_env() >>> if dist.get_rank() == 0: ... data = paddle.to_tensor([7, 8, 9]) ... dist.send(data, dst=1) >>> else: ... data = paddle.to_tensor([1, 2, 3]) ... dist.recv(data, src=0) >>> print(data) >>> # [7, 8, 9] (2 GPUs) F)rrruse_calc_stream)rrecv)r rrrs e/var/www/html/banglarbhumi/venv/lib/python3.11/site-packages/paddle/distributed/communication/recv.pyrr#s)H ;Cugu    int | Nonec(t|||dS)aG Receive a tensor to the sender. Args: tensor (Tensor): The Tensor to receive. Its data type should be float16, float32, float64, int32, int64, int8, uint8, bool or bfloat16. src (int): The source rank id. group (Group, optional): The group instance return by new_group or None for global default group. Default: None. Returns: Return a task object. Warning: This API only supports the dygraph mode. Examples: .. code-block:: python >>> # doctest: +REQUIRES(env: DISTRIBUTED) >>> import paddle >>> import paddle.distributed as dist >>> dist.init_parallel_env() >>> if dist.get_rank() == 0: ... data = paddle.to_tensor([7, 8, 9]) ... task = dist.isend(data, dst=1) >>> else: ... data = paddle.to_tensor([1, 2, 3]) ... task = dist.irecv(data, src=0) >>> task.wait() # type: ignore[union-attr] >>> print(data) >>> # [7, 8, 9] (2 GPUs) F)r)r)r rrs rirecvrLsH UE 2 2 22r object_list list[Any] src_in_groupc|t|dkrtd|tn|}t|rdS|'|td||}n|dn|}t jt|fd}t|||t j| }t j|ft j }t|||d}t|D]>\}} | } |||| z} t| | ||<|| z }?dS)a} Receive a list of Python objects from the sender. Args: object_list (list): The list to store received objects. Must be pre-allocated with correct size. src (int, optional): The source rank id. Default: 0. group (Group, optional): The group instance return by new_group or None for global default group. Default: None. src_in_group (int, optional): The source rank within the group. Cannot be specified together with src. Default: None. Returns: This function does not return any value. Examples: .. code-block:: python >>> # doctest: +REQUIRES(env: DISTRIBUTED) >>> import paddle >>> import paddle.distributed as dist >>> dist.init_parallel_env() >>> if dist.get_rank() == 0: ... data = ["hello", {"key": 100}, [1, 2, 3]] ... dist.send_object_list(data, dst=1) >>> else: ... data = [None] * 3 # type: ignore ... dist.recv_object_list(data, src=0) >>> print(data) >>> # ["hello", {"key": 100}, [1, 2, 3]] (2 GPUs) Nrz#object_list cannot be None or emptyz7Cannot specify both 'src' and 'src_in_group' arguments.int64)dtype)rr) len ValueErrorrrget_global_rankpaddleemptyrsumitemuint8 enumerater ) rrrrobject_sizes_tensor total_size object_tensoroffsetiobj_sizeobj_views rrecv_object_listr3ssFc+..!33>???#(=    eE"5)) ?I ##L11;aaC ,K(8(8':'JJJ #U3333/005577JL*flCCCMCu---- F !455 8==?? &8*;!;<1(HEE A( r)rNT) r r rrrrrrrr )NN)r r rrrrrr )NNN)rrrrrrrr) __future__rtypingrrr& paddle.distributed.communicationr&paddle.distributed.communication.grouprr4paddle.distributed.communication.serialization_utilsr r paddle.base.corer r rrr3rrr;sF#"""""%%%%%%%% 333333=%%%%%%<<<<<<  &&&&&TCG$3$3$3$3$3R# ???????r