etha.comm.comm_methods

Communication utilities for Etha.

Attributes

logger

Functions

bucket_comm(→ None)	Execute bucketized communication.
chunk_comm(→ None)	Execute chunked communication.
gather_broadcast_comm(target_mesh, target_specs, ...)	Performs data redistribution using the Gather-Broadcast method.

Module Contents

etha.comm.comm_methods.bucket_comm(buckets: list[etha.comm.ir.Bucket]) → None

Execute bucketized communication.

etha.comm.comm_methods.chunk_comm(chunks: list[etha.comm.ir.Chunk]) → None

Execute chunked communication.

etha.comm.comm_methods.gather_broadcast_comm(target_mesh: torch.distributed._tensor.DeviceMesh, target_specs: tuple[torch.distributed.tensor.placement_types.Placement, Ellipsis], local_tensor: torch.distributed._tensor.DTensor, origin_tensor: torch.Tensor, source_world_size: int)

Performs data redistribution using the Gather-Broadcast method.

etha.comm.comm_methods.logger