After moving all images from uploads to R2 I have confirmed that all images are present on the R2 bucket and are visible on the media.mysite.com subdomain.
And new images uploaded also are saved on the correct location.
However, some products did not display their image thumbs on WooCommerce...