Question about the hardware cost

[robinren03]

Though the cost of running a tuned model is relatively small, I wonder how many high-efficiency hardwares like GPU did you use to finish such a fine-tune process and how long will it take to obtain a considerable outcome? And whether there was a temporary loss increasing observed at the beginning?
To my best knowledge, these messages are not shown in the paper.