j^ UddlmZmZddlmZgZeeed<dedefdZdeded eee e e e ffd Z d S) )ListTuple)ChunkStorageMetadata__all__shard1shard2ct|j}t|D]\}|j||j||j|zkrdS|j||j||j|zkrdS]dS)zCheck if two shards overlap.FT)lenoffsetsrangesizes)rrndimsis XC:\Projects\Historical\venv\Lib\site-packages\torch/distributed/checkpoint/resharding.py"_check_shard_metadata_pair_overlapr s   E 5\\ >! q 1FLO C C C55 >! q 1FLO C C C55 D 4 saved_shard current_shardreturnc4g}tt|j|j|j|jD]a\}\}}}}t ||z||z}|t ||z } ||krd} ||z } n||z } d} ||| | | fb|S)a[ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r) enumeratezipr r minmaxappend) rrnarrowsdimsaved_shard_offsetcurrent_shard_offsetsaved_shard_sizecurrent_shard_size min_range_endlengthoffset_for_saved_tensoroffset_for_current_tensors r+_shards_get_overlap_region_wrt_saved_tensorr&sG     !              !1 1 #5 5  %9;M!N!NN  4 4 4&' #(:=Q(Q % %&:=O&O #() % )+Df M     NrN) typingrr%torch.distributed.checkpoint.metadatarrstr__annotations__rintr&rrr-sFFFFFFc *>$,%,6J, %S#s" #$,,,,,,r