[Feature]: add cache flushing control flags to stream memory operations

[Epliz]

Suggestion Description

Hi,

As mentioned briefly at #104 , I believe that adding support for cache flushing control flags to the stream memory read/write operations could be great, similarly to how it is possible with events.

Thanks to stream memory operations I have been able to implement an all-reduce single machine implementation that has ~18us latency, which is really good already (better than rccl from what I see). I believe that being able to avoid cache flushes might help shave more on that.

Best,
Epliz

Operating System

No response

GPU

No response

ROCm Component

No response

[Epliz]

In CUDA land, I believe that what I am requesting corresponds to supporting the flags CU_STREAM_WAIT_VALUE_FLUSH and CU_STREAM_WRITE_VALUE_NO_MEMORY_BARRIER