[Feature Request] mock gpt data

[Wendong-Fan]

Required prerequisites

• I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• Consider asking first in a Discussion.

Motivation

currently we run the test by calling openai api in our CI/CD pipeline, which is high-cost

Solution

use mock instead of call real api

Alternatives

No response

Additional context

No response