Cover Image for Beyond the Benchmark - Prolific Meetup #2
Cover Image for Beyond the Benchmark - Prolific Meetup #2
Avatar for Prolific
Presented by
Prolific
Building the biggest pool of quality human data in the world—for AI developers, researchers, and organizations.
45 Going

Beyond the Benchmark - Prolific Meetup #2

Register to See Address
San Francisco, California
Registration
5 Spots Remaining
Hurry up and register before the event fills up!
Approval Required
Your registration is subject to approval by the host.
Welcome! To join the event, please register below.
About Event

About the Event

​Prolific is bringing the AI community together in San Francisco to explore the evolving role of humans in post-training, alignment, evaluation, and AI at large.

​This series is designed to foster thoughtful exchange between researchers, builders, and the broader community, to ask not just how we’re building AI, but why and with whom.

​This Month's Theme: Beyond the Benchmark

As models grow more powerful, traditional benchmarks tell less of the story. So where do we go next, and what should we actually measure?

Our November edition, we'll go beyond static scores to talk about feedback loops and emotional intelligence in AI systems.

Join us for a fireside chat with Andy Wong and Albert Luo, Research Engineers at Inflection AI, moderated by Viviana Márquez, AI Community Lead at Prolific.

Andy, Albert, and team are developing a data flywheel framework: a self-reinforcing feedback system where every model interaction generates the data to make the next one better. It’s a glimpse into a future where AI systems self-correct through smarter evaluation, not just bigger training runs.

Together, we’ll unpack:

  • Why the next leap in AI isn’t scale, it’s self-correction

  • How principle-following reward models learn from written rubrics instead of massive preference sets

  • What inference-time scaling for judges means, and why it might redefine reliability

  • And how humans fit “above the loop” in this new paradigm

​​🗓️ Agenda

  • 5:30 – 6:30 PM – Arrival & networking (light snacks provided)

  • 6:30 – 6:40 PM – Intro

  • 6:40 – 7:20 PM – Fireside chat

  • 7:20 – 7:30 PM – Audience Q&A

  • 7:30 – 8:30 PM – Open networking


🥟 Join us for light bites from Little Szechuan
​👉 Reserve your spot now! Space is limited.

Location
Please register to see the exact location of this event.
San Francisco, California
Avatar for Prolific
Presented by
Prolific
Building the biggest pool of quality human data in the world—for AI developers, researchers, and organizations.
45 Going