It looks like it’s more-commonly called “coffee concentrate”.

https://www.amazon.com/s?k=coffee+concentrate

I do also see it sold as “coffee syrup”, but that gets mixed up with syrups that are added to coffee.

If you make iced coffee with it its going to be fine.

If you make iced coffee, like, mixing stuff up with ice, I suspect that you’re better off just getting coffee syrup, which is available, and lets you select how dilute you want the coffee. Doesn’t make a lot of sense to ship large bottles of water around when you already have a sink.