etha.comm.comm_methods

Communication utilities for Etha.

Attributes

logger

Functions

bucket_comm(→ None)	Run the bucket pipeline: prepare -> launch -> complete -> finalize.
gather_broadcast_comm(target_mesh, target_specs, ...)	Performs data redistribution using the Gather-Broadcast method.

Module Contents

etha.comm.comm_methods.bucket_comm(buckets: list[etha.comm.ir.Bucket], max_in_flight: int = 2) → None

Run the bucket pipeline: prepare -> launch -> complete -> finalize.

Per channel key, at most max_in_flight buckets are prepared/in-flight at once, so buffer assembly overlaps with in-flight collectives.

etha.comm.comm_methods.gather_broadcast_comm(target_mesh: torch.distributed._tensor.DeviceMesh, target_specs: tuple[torch.distributed.tensor.placement_types.Placement, Ellipsis], local_tensor: torch.distributed._tensor.DTensor, origin_tensor: torch.Tensor, source_world_size: int)

Performs data redistribution using the Gather-Broadcast method.

etha.comm.comm_methods.logger