Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

[@I-0-0-I]

I really enjoyed this episode. Like you said, so much practical info. One crazy thing: Joseph mentioned that he would like non-industry folks to learn about the arena. I just tried to post comments on Reddit with links to Chatbot and WebDev arena, and they get immediately [removed by Reddit]. If you have any contacts there, it might be worth reaching out. Looking around Reddit, it appears that this is happening to everyone. I am super curious as to why Reddit is banning links to the arena sites.

[@haraldwolte3745]

How can people run their own internal benchmarks, as recommended in this conversation? Seems like it would require a lot of complicated custom systems