LLM Party

LLMParty is a collection of small experiments I've been doing to better understand the capabilities of LLM models, and also how to work with them.

The questions I wanted to poke at:

• What knowledge do they have? If I give them a GPS coordinate, will they know where the place is?
• How far do the vision capabilities go? How much can they understand if I draw?
• What is this thing called tool calling that everybody was chatting about at the beginning?

So for me, LLM Party was the sandbox to experiment with all these things that people were chatting about on the internet, and also to learn how to develop new workflows to use my computer and to use them also in my work.

It changed how I build

I started to code the project by hand, but immediately I embraced the proto-agentic coding with Aider, one of the first harnesses that appeared. It was a great experience, and then immediately I thought, wow, this is the future!

It also changed my way of designing, my workflow and my process. I realized that yeah, I couldn't work the same as before. In many cases I realized I didn't have to use Figma anymore to fully prototype what I wanted to do. I could iterate faster in code rather than on a white canvas. The white canvas was amazing for me to sketch out the idea, then copy paste the image to the agent and see it build. So that was great to see.

Some of the experiments are a bit subversive, so they play a bit with the idea of what the models can do, should do, or shouldn't do. Also, like, how are we gonna end up?

I think better than explaining the project, I invite you to have a look. I hope you can enjoy it!