Add support for Intel GPU Memory Information #164429
Description
🚀 The feature, motivation and pitch
It would be nice if PyTorch added support for torch.xpu.memory.mem_get_info()! When calling this in PyTorch 2.8.0+xpu, the following RuntimeError shows up:
RuntimeError: The device (Intel(R) Arc(TM) Graphics) doesn't support querying the available free memory. You can file an issue at https://github.com/pytorch/pytorch/issues to help us prioritize its implementation.
This way, code (and other libraries/frameworks) can get memory information for Intel GPUs, which can be useful.
Alternatives
No response
Additional context
I was trying to use bitsandbytes to quantize LLM for HuggingFace Transformers inference, but it required accessing memory information from the xpu.