Ramblings on the art of surrender.

Here’s an update from my previous post in May.

“Grief is a terrible thing.” - Robert Ford, Westworld

I’m sitting in the AGI House in SF at the moment, having had the priviledge of attending Holy Books: Religion Reading Night. The goal is to read through a religious textbook that interests you and share your thoughts and ideas with the rest of the group. Tonight I spent the last hour reading through Gateless Gate, a collection of short but deep stories or koans on Zen Buddhism. One story in particular gripped me:

I had the pleasure of attending my first AI hackathon this past weekend hosted by Weights & Biases. The goal was to implement this paper on implementing LLMs as judges using reference guided verdicts. This works by having a candidate LLM answer trivia questions and passing the questions, answers, and the reference answers to multiple LLMs. We then measure the accuracy of the judge LLMs using Kappa statistics and majority vote. You can find my project on github here.

Inspired by the methodology of learning in public, I figured it wouldn’t hurt to make a blog post describing past diets that have worked for me and what my current plan is. Mostly, it’s to keep me honest, but if it helps some of you out, then that’s a plus.

Overview

AICamp kindly invited me to talk about training open sources models for PII detection. My talk starts at 41:30.

Thoughts on Spartan Society