The machine stops

Large language models have reaped our words and plundered our books. Bryan Vandyke:

Turns out, everything on the internet—every blessed word, no matter how dumb or benighted—has utility as a learning model. Words are the food that large language algorithms feed upon, the scraps they rely on to grow, to learn, to approximate life. The LLNs that came online in recent years were all trained by reading the internet.

We can shut the barn door—now that the horse has pillaged—by updating our robots.txt files or editing .htaccess. That might protect us from the next wave, ’though it can’t undo what’s already been taken without permission. And that’s assuming that these organisations—who have demonstrated a contempt for ethical thinking—will even respect robots.txt requests.

I want to do more. I don’t just want to prevent my words being sucked up. I want to throw a spanner in the works. If my words are going to be snatched away, I want them to be poison pills.

The weakness of large language models is that their data and their logic come from the same source. That’s what makes prompt injection such a thorny problem (and a well-named neologism—the comparison to SQL injection is spot-on).

Smarter people than me are coming up with ways to protect content through sabotage: hidden pixels in images; hidden words on web pages. I’d like to implement this on my own website. If anyone has some suggestions for ways to do this, I’m all ears.

If enough people do this we’ll probably end up in an arms race with the bots. It’ll be like reverse SEO. Instead of trying to trick crawlers into liking us, let’s collectively kill ’em.

Who’s with me?

How do we build the future with AI? – Chelsea Troy

This is the transcript of a fantastic talk called “The Tools We Still Need to Build with AI.”

Absorb every word!

Should I remove this blog from Google Search?・The Jolly Teapot

There was life before Google search. There will be life after Google search.

Google is not a huge source of traffic and visibility. I get most of my visits from RSS readers, other people’s links including fellow bloggers, or websites like Hacker News. It’s hard to tell at this point since I don’t track anything, but that’s an educated guess.

Removing my website from Google would have very little impact, so I was wondering if I should just do it.

The mainstreaming of ‘AI’ scepticism – Baldur Bjarnason

1. Tech is dominated by “true believers” and those who tag along to make money.
2. Politicians seem to be forever gullible to the promises of tech.
3. Management loves promises of automation and profitable layoffs.

But it seems that the sentiment might be shifting, even among those predisposed to believe in “AI”, at least in part.

Because There’s No “AI” in “Failure”

My new favourite blog on Tumblr.

On being human and “creative”

Now we have this collision of those who, with the specific intent of creative expression, make things that are wholly the product of their unique experience and skills and offer them in the marketplace. Then there are those who use machines to produce derivatives of other’s creative work to offer as products in the marketplace. Both are seeking an audience and financial benefit for their offering.

Those who wholly manufacture creative works are asking the same value be put on their imitation of creative expression as the value inherent with sentient creation. They are saying they deserve the same recognition—be that in respect, attention, acknowledgement or compensation—that works created by a person might receive. But they haven’t earned it.

Using generative AI is to ask What If but then hand off not only the responsibility and effort of answering the question but also accountability for the answer. When the machine creates something pleasing or marketable, it’s “look at what I did”. When the machine creates something terrible or wrong, it’s “not my fault, the machine did it”. The claim of ownership is conditional and only maintained if the output can generate value.

There’s so much to love here, like this:

My art is the story of how I have spent the time in my life.

And this:

The value of an idea comes from the execution of the idea.