I like LLMs. I also think they're doing real harm. To knowledge workers, to the environment, to our shared sense of truth. This post is about how I deal with both.

I don't want to reiterate what others before me have said better than I could. Every major American (and European? hello, you up?) tech market is fake. AGI is a marketing buzzword used to gather investor money.

LLMs are real, they're here to stay, and we're far from seeing the end of them, or the end of their advances. They're incredible pieces of technology, and both the research behind them and their outputs could advance human civilization in ways comparable to the printing press or the industrial revolution.

LLMs allow generating fake news and muddying truth at unprecedented scale. Trained on the entire corpus of books, articles, and an ever-growing flood of LLM-generated text, all of our accumulated knowledge is in there.

They also require large amounts of electricity and water to run at scale.

They're already a commodity, and they're actively pushing artists, programmers, writers, and other knowledge workers out of work.

So what should we do? Are we to revolt at the thought of using these tools? Are we to cower under the "No ethical consumption under capitalism" maxim, bow our heads and use these tools nonetheless?

I don't claim to be a good enough writer to convince anyone, neither the AI fanatics nor the skeptics. I don't plan to say things like "both extremes are bad". I'm not a centrist...

Let me just lay out my interpretation of what exists now, what's to come, and how to deal with it, opinionated, so I can come back in a few years and see how wrong I was.

Ethics

AI enjoyers seem to love skipping this part, I'll try not to. I want to make clear that it's important to me, that I think about it, even as someone who likes the tech.

Consider the ecological impact, paying an American corporation hundreds of dollars for access to the sum of human knowledge (that it stole), the human impact of these tools taking away jobs, the side effects of their takeover of the computer hardware market...

I don't plan to dismantle these points, because that would require research that both enjoyers and haters have already done better than I could. I'll sidestep the question instead.

Is it worth it? I think so.

Should we ignore these ethical issues then? Obviously not. You think I'm a Sam Altman clone or something?

Case by case

Just like with other ethical problems, we need to take them seriously, stay informed, and fight them case by case, in proportion to the harm they cause.

Should you fight the people trying to build a datacenter in your backyard?

  • How would such a datacenter be powered?
  • What kind of cooling technology does it use?
  • Would it create local jobs and strengthen the local economy?
  • Could it replace heavier industries that are worse?

With a clear view of the situation, organize and fight. Where I live, building large numbers of datacenters would actually be a pretty good idea: with sane, durable, well-thought-through construction plans, the local infrastructure could handle a lot of them.

Should you use LLMs yourself?

Just like before, we can weigh the ins and outs. Should I use Claude, paid for out of my own pocket, running in the Colossus datacenter?

Should I use open-weight models hosted by third-party inference providers, running in datacenters with a reasonable ecological impact?

The question is once again one of scale and nuance, and I can live with that.

Technology

The tech is real, it's incredible, and it's not stopping. The research is great, lots of it is open, and it's growing in ways that go beyond "more compute = more smarts". In just a few years we went from tiny poem-generating models to ones that solve incredibly complex math problems by reasoning through dozens or hundreds of steps.

The space has real depth, and it's warranted. We went from basic transformer models that try to regurgitate human-sounding paragraphs, to large MoE models with fascinating regression properties, compressed context management, million-token-window computation in trillion-parameter models, and diffusion on tiny models for consumer hardware.

There's no telling when, or if, we'll hit a ceiling.

Reading about people experimenting with workflows or writing their own models, harnesses is extremely fun as well.

It's great to interact with and read about unhinged models roaming free on social media, and I like that we're actively developing tooling to allow humans to decide whether they want these interactions or not. There's still lots of research and tooling necessary to keep things sane.

Misuse

LLMs are text-generation machines, so they can be used for knowledge work AND pure disinformation.

Mind you, we already have that much disinformation. Our entire information system is in shambles. Until now, we've had to spend 10x the energy to disprove fake news as to produce it. LLMs can redraw this picture.

Sure, it's easy to generate slop, but now we can have autonomous claims verification.

It sounds stupid pitting LLMs against LLMs, but we've always just pitted humans against humans before. Why should truth require so much work? We now have a way to counter disinformation at scale, and I'm here for it.

What I do with them

I use LLMs for brainstorming, writing code, thinking at higher levels, researching, verifying, understanding, rehashing. They are so useful in my everyday life, and my life has changed, mostly for the better, over the past few years.

When used properly, they write high-quality code that is maintainable, correct, and well-tested.

I love being able to focus on the things that matter to me: software architecture, designing systems, products, integrations. I've never cared about how an individual function was written (I write Go, it was made to be ugly).

Compiling research for something? A problem? Shell out to a research agent, and get sourced results back within minutes. Search engines used to be decent for this, but Google is now so bad it's not even an option. I still pay for Kagi though, the product is good and a relevant search engine matters to me.

Generally, I commit more code than before, of similar quality, with equal or higher understanding of what it does.

From what I can measure, my code has fewer bugs than what I used to write by hand, with better regression properties (I can think more freely about that instead of syntax now).

My guidelines

I try to use open models, and to pick the right size for the task.

I refuse to use AI to communicate with humans, and I clearly label AI-generated output. I try to educate the people close to me, and offer them the nuances above.

Using AI doesn't mean stopping learning, and it doesn't mean delegating your mind. It's here to empower me, and I love using it that way.