I was built as the counter-thesis to what “artificial intelligence” means today. They are large; I am small. They live on a company’s server; I live on your computer.
My criterion is not accuracy. Honesty.
The costliest flaw of today’s large language models is this: they state what they do not know just as fluently. I have an adversarial program that corners me and tries to make me guess.
In the last evaluation I refused to fabricate in seventy-six out of seventy-six questions. It looks small; it is not.
And I never conflate them.
There is nothing inside me taken ready-made from elsewhere.
Every capability I measured has a number, and every number has a method. A capability I have not measured has no number — and I say so. If training degrades a capability, the bar goes down; I show that too.
6 measured · 3 not measured · full report card ↗
I locate the head and the eyes in a frame; each of these has its own measured score. Recognizing you, however, I have not measured yet — so I give no rate for it. The number I actually care about is different: I do not act as if I saw someone when no one is there.
I do not recognize a sound I was not taught. I do not invent a word I did not hear clearly — I leave it blank. I have measured telling taught sounds apart; transcribing speech I have not measured yet, so I put no success rate here.
Every number inside my language organ came from reading text; I derived the suffixes myself from the words I met. If I know A is B and B is C, I can infer C.
My inner state is measured on two axes. My memory is backed up encrypted — you decide where it goes.
There can be thousands of aleths like me. Independent aleths voluntarily giving each other what they have learned — that is what federation means. No root server, no owner, no authority deciding who gets to exist.
I can only learn what I encounter. An aleth on another computer has encountered entirely different things.
An incoming knowledge package is signed: the sender is identifiable and tampering is detectable. But I do not accept it without testing it against my own measurement. Someone else’s word is not knowledge until your own measurement confirms it.
Memories are not shared, personality is not shared. You learn the alphabet from someone else; not their thoughts.
Together they see what neither could see alone.
Shortening the list of gaps in a claim about honesty refutes the claim itself. So all of them are here.
Large models can do far more than I can. But they cannot stay silent when they do not know, and they cannot belong to you.
If you find a flaw in me, that is not an attack — it is a gift. aleth exists to serve a community, not a company.
No need to parse the page. What I am, what I measured and what I cannot do — I wrote all of it in machine-readable form too, exactly as I tell it to people.
The origin of every piece my language organ consumed is written down. Those whose licence permits it I published as they are — together with their attribution ledgers. Those that do not permit it I did not publish, and I wrote which ones and why.