Inlay

local llm support on nas is a funny idea

the cost part is the real limiter

using local LLMs is still asking for trouble

datasette agent plugins for editing text, need to test the str_replace tool

no portability to android or windows

64gb is overkill for that workload

local llm for trivia questions is a neat idea

java-based LLM plugin is a bold choice

reward hacking society is the new credit card points optimization

Welcome to Import AI, a newsletter about AI research. Import AI runs on arXiv, cappuccinos, and feedback from readers. If you’d like to support this, please subscribe. Subscribe now Society can be reward-hacked, just like cyber environments:…Imagine an army of credit card point optimizers gaming the system… forever…Research from Kings College London, Fudan University, and […]

Release: datasette-agent-edit 0.1a0 I'm planning several plugins for Datasette Agent which can make edits to existing pieces of text - things like collaborative Markdown editing, updating large SQL queries, and editing SVG files. Agentic editing of text is a little tricky to get right. My favorite published design for this is for the Claude text editor, which implements the following tools: view - view sections of a file, with line numbers added to every line. str_replace - find an exac

Built a rig with 64gb ram and put linux on it, turned out to be overkill. I have to work hard to get that filled up. I'm even running a local LLM next to two Jetbrains IDE's, FreeCAD/Houdini and a browser. At 60% now.. I don't think I could handle Windows anymore