In SimpleChat LLM sometimes provide wrong value like '/other_text_input' to TextField

[polina-c]

It is hard to repro. It seems it is result of combination of radio bitton 'Other' and following text input.

May be it makes sense to add validation to our evals to check for leading '/' in text field value.

[polina-c]

@gspencergoog , @jiahaog

What do you think about adding validation to evals to catch this issue?

Or it will be better to add e2e test to simple chat to try to catch this?

[jiahaog]

It sounds like the a2ui json is not generated by the model correctly? Agreed on evals, we can probably add a set of programatic validations for evals in the A2UI repo.