Send screenshots after each update via GPT 4 Vision

[Joabutt]

Maybe you could use gpt 4 vision to check the current state of how the website looks, then send that input off together with the prompt so that the ai can understand what its looking at and what the user is referring to

[reidbarber]

I think this is a great idea. I see two areas this could fit in:

1. It could do a direct follow up after each code modification to see if it did a good job matching the design request. It could then dispatch more actions to fix anything it missed.
2. It would be good to supplement each generation so the model has a good understanding of the current state, without having to send all the code during each generation.

I think these would both rely on #9

Additionally, I think this would get much better results with when Assistants API adds support for Vision.