Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add 'piping' option where previous answers can be slotted into to question text / options in future questions #471

Open
johnjosephhorton opened this issue May 11, 2024 · 7 comments

Comments

@johnjosephhorton
Copy link
Contributor

Screenshot 2024-05-11 at 6 22 34 AM
@rbyh
Copy link
Contributor

rbyh commented May 11, 2024

Let's sketch out different piping situations:

  1. Simple: I want to (immediately) use the response to q1 as an input to q2 in the same survey.

  2. More complex: I want to extract themes/topics from each text in a set of texts (step 1), condense them (flatten list of lists) into a final non-duplicative substantively complete list (step 2), and then use that list as answer options to new questions (step 3).

--> Can this be done in a single survey?

  1. I want the model to generate a question that I then have another model answer. @benjamin-manning

@benjamin-manning
Copy link

3b. or have many other models answer

  1. I don't want the model to have a memory of entire previous questions, but I want to pipe in items that are answers from a subset of previous questions in a given survey into a new question as portions of that new questions---either in the question itself, or as answer options.

  2. Memory, but just a list of previous choices, no need for question repeats. Like in John's repeated prisoner's dilemma making it say "you responded to the following questions 6 times Question. Here are those responses: list of answers without repeating question

@rbyh
Copy link
Contributor

rbyh commented May 11, 2024

I think this is the important distinction from targeted memory methods --- you want to access only the response, not the context of the question or fact that it was asked.

@benjamin-manning
Copy link

yup! exactly. I haven't used targeted memory much, but from my understanding, my request is different, and I hope, useful for people so worth implementing :)

@rbyh
Copy link
Contributor

rbyh commented May 12, 2024

Current compose_questions() looks for the q1 question name to be present as a parameter of the q2 question text, but we should also allow the q1 answer to become the q2 answer options (multiple choice, checkbox, etc), ie modify this:
image

@rbyh
Copy link
Contributor

rbyh commented May 12, 2024

eg using free text or list question to elicit a selection is not ideal because the agent is likely to differently format unless we add detailed formatting instructions:
image

@rbyh
Copy link
Contributor

rbyh commented May 12, 2024

Note that we also do not want/need the field name duplicatively nested within the response to the composed/piped question:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants