Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

this is not a good benchmark for models, but it's great if you're optimizing for attention on twitter because video content and 3d animations perform best on social media.

a real benchmark is instead running evals on your own traces, and building a cost/quality/speed profile for models based on real workloads. but it doesn't get you a shiny video you can post on twitter.



You can do both.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: