It’s very likely that frontier LLMs have latent capabilities that no human fully knows about.
This technology is unlike anything else we’ve built before (which has been more or less predictable) and that should scare us.
We have no idea what we’re summoning.