LLM agent loops with tool use

Trying to get the robots to read the logs and metrics for us...

Worked with the Performance and Architecture team (and others!). Lots of fun changes, optimizations, and features up and down the stack.