Triads: the fundamental units of the language of thought
The neural network would consist of multiple layers with at least one layer consisting of multiple attention heads. Each attention head would hold one triad consisting of one noun + one verb + one conjunction.
Individual nodes within the neural network would probably correspond to adjectives and adverbs that either modify or define the nouns and verbs of each triad
The hungry cat ate the mouse then died:
(Null) Cat ate
also Mouse eaten
and cat was-hungering (adjectives are verbs in disguise)
Then cat died
"Also" means the two events are the same event. (Not in english).
A possible conclusion would be "because mouse poisoned" which could then be appended to the input and the process repeated.
In addition a few other ideas can be added to each attention head: * the, a, same, this, that, other, next... * Past, present, future * begin to, cease to * Could, would, should, might, * Try to * make * Question * focus, emphasis * adjectives?…