can I connect nvidia A100 gpu with new mac pro 2023?

I expect you will find that, even IF it could be inserted in a PCIe-4 slot, powered, and made to operate correctly, there are no NVIDIA drivers for Apple-Silicon Macs, as Apple and NVIDIA had a falling out several years before Apple silicon was introduced. NVDIA driver support fell away about 10.14 Mojave.

You MIGHT be able to install an AMD card that is still covered by the Radeon drivers included in MacOS for Mac-Pro (intel) support.

Hi,

We are all Apple products users like you, I suppose nobody knows it works on Mac Pro 2023 except Apple guys.

Apple Silicon (AARM) architectures do not support external GPUs.