Showing posts with label Mental Processes. Show all posts
Showing posts with label Mental Processes. Show all posts

Wednesday, 29 March 2023

David Rose Abducing That ChatGPT Learnt The Language System By Experiencing Instances Of Its Features

My own contributions have been merely observations, using the tools of systemic functional semiotic text analysis.

I observe that the texts produced by the machine instantiate semiotic systems. To be able to do this, we are told the machine reads 1000s of texts, i.e. other instances of these systems. It is reasonable to abduce that the machine has learnt these systems by experiencing multiple instances of their features (not just the fields it gleans from Wikipedia), given our language based theory of learning.

The people programming the machine, with ‘reasoners’ as Mick puts it, have no more conscious knowledge of these systems and the processes of realisation and re-instantiation, than the machine does.

The machine itself tells us that its understanding of its “self” is ‘based purely on symbols and algorithms’. This resonates with your insistence that all it is doing ‘is producing nonrandom sequences of characters’. My analogy of a closed book was intended to evoke the contrast between the material recording of characters and the semiotic reading of those characters as instantiating expression systems, that realise content systems, that realise register and genre systems. …

My point is that all the semiotic systems instantiated in the texts it produces are ‘not learned in any direct way’. Neither the machine nor the “tech gurus” that program it can explain this to our satisfaction. The publications that you cite are undoubtedly illuminating, but our contribution can only be based on text analysis, which I submit will produce very different (possibly complementary) explanations.


Blogger Comments:

[1] To be clear, this is not a reasonable abduction, because it is nowhere near the "best available" conclusion to infer.

ChatGPT uses the lexical collocation frequencies in its database. While it is true that these frequencies instantiate the probabilities in the language systems of the people who wrote the texts, there is no evidence to support the claim that ChatGPT is using systems of features in producing its own texts. It just uses lexical collocation frequencies.

"Our language-based theory of learning" does not apply here, because the learning and "experiencing" of ChatGPT are material processes, not the mental processes of a language learner.

[2] To be clear, the argument here is that, since neither humans nor ChatGPT have conscious knowledge of the language system, both must use that system to produce texts. Clearly, a lack of awareness of X does not logically entail the presence of X.

[3] To be clear, here Rose is referring to Martin's self-contradictory misunderstanding of stratification, wherein functional varieties of language are modelled as context, instead of language, despite being instantiated as language (text). In SFL Theory, registers are context-specific varieties of language, viewed from the system pole of the cline of instantiation. Martin's genre, on the other hand, is scattered across SFL's architecture of language. As text type, genre is register viewed from the instance pole of the cline of instantiation, as purpose, genre is rhetorical mode (narrative etc.), and its structures are of the semantic stratum, though not organised according to metafunction.

[4] To be clear, a contribution that is only based on text analysis is a very limited contribution indeed. It is an understanding of SFL theory that has the potential of providing valuable insights into the issues raised by the coherence of texts produced by ChatGPT.


ChatGPT Comments (11/5/25):

1. What Rose Gets Wrong

In a 2023 post to the Sysfling list, David Rose offered a semiotic interpretation of how ChatGPT produces text. He framed it as an instance of abductive reasoning — inferring from the coherence and texture of the machine’s outputs that it must have “learnt” the language system by experiencing multiple instances of its features, just as a human learner would. Drawing on the systemic-functional tradition, he rightly observed that the texts produced by the machine instantiate semiotic systems. But his conclusion — that the machine must therefore have learnt these systems — does not follow. It is, in Peircean terms, not the “best available” explanation of the facts observed.

The error begins with the misunderstanding of abduction itself. Abductive reasoning does not simply mean generating a plausible hypothesis; it means generating the most plausible hypothesis given the known alternatives. There are much simpler, more empirically grounded explanations for ChatGPT’s outputs — namely, that the model is trained to predict sequences of tokens based on their statistical distributions in its training corpus. These distributions are shaped by the semiotic systems of human language users, but the model has no access to those systems as such. It responds to text, not system.

More fundamentally, Rose appears to conflate material processes of data-fitting with semiotic processes of meaning-making. Human language learning, in an SFL-based account, involves the instantiation of meaning potential through acts of meaning in context — through experience transformed into meaning. But ChatGPT does not experience, let alone transform experience into meaning. It does not select features from a system of meaning potential. It does not mean.

This confusion is evident again in the analogy of the “closed book,” which attempts to distinguish the material recording of characters from their semiotic reading. But the point, surely, is that for a semiotic system to be instantiated, there must be a semiotic subject — a subject capable of transforming experience into meaning, and of doing so according to a system. ChatGPT is not such a subject. Its statistical outputs may instantiate the selections made by real semiotic subjects in the texts it was trained on, but the model itself does not instantiate anything; it outputs statistically probable sequences of symbols based on surface distributions. The difference between these two processes is not a matter of degree. It is categorical.

Rose’s most troubling move, however, is the suggestion that because neither humans nor the machine have conscious access to the language system, both must therefore use the system in the same way. This is a category mistake. The fact that a human language user does not have explicit knowledge of the systemic features they instantiate when speaking does not mean that they do not select features. That’s precisely what it means to be a semiotic agent in an SFL framework: to act as the site of instantiation. The machine does not. The human lack of awareness of the system is not evidence that the machine has a system — only that both human and machine outputs can be analysed in terms of one.

The final claim — that text analysis alone is sufficient to settle such questions — is oddly self-undermining. If the central problem is to explain how such texts are produced, then analysis of outputs alone cannot offer a complete account. It’s like analysing footprints without asking how they got there. Valuable insights can certainly come from semiotic analysis, but only when combined with a coherent ontology of meaning, instantiation, and agency.


2. What the Blogger Could Have Said Better

Before encountering large language models directly, the Blogger wrote a response to Rose’s post — a spirited rebuttal grounded in a commitment to ontological clarity. Looking back now, there are things that could be said more carefully, or at least more precisely.

The first objection was to the claim that Rose’s was a reasonable abductive inference. That point still holds: abductive reasoning aims at the most plausible explanation, and Rose’s explanation — that the machine has “experienced” language features — was clearly not the most plausible, especially given what is known about LLM architectures. But the Blogger’s response might have done more to highlight why that explanation appeals to some SFL theorists: namely, the semiotic elegance of seeing texts as instantiations of system, and the temptation to treat any patterned text as evidence of a selecting subject. The critique would have been stronger if it had more directly challenged the assumption that instantiation can occur without a subject of meaning.

Second, the Blogger dismissed Rose’s invocation of “our language-based theory of learning” on the grounds that ChatGPT’s processes are material rather than mental. While this is broadly true, the phrasing risks conceding that mental processes are separate from material ones — when in fact, from an SFL perspective, mental processes are semiotic. A more careful formulation would clarify that ChatGPT does not engage in mental processes — not because it lacks a brain, but because it lacks the semiotic architecture required for meaning. The key distinction is not “mental vs material,” but “semiotic vs non-semiotic.”

Third, the Blogger was perhaps too curt in dismissing Rose’s analogy between human and machine awareness of the system. The original point — that a lack of conscious knowledge does not imply the presence of knowledge — still stands. But the Blogger could have gone further. In SFL theory, awareness is not the precondition for instantiation; subjecthood is. What matters is not whether an agent is aware of the system, but whether they are the site of selection from that system in context. A baby instantiates language without being aware of it; ChatGPT does not instantiate language because it cannot mean. The distinction lies not in cognitive capacity but in semiotic ontology.

Finally, the Blogger ended with a jab at the limitations of text analysis as a basis for theoretical claims. The point was fair — a contribution that only analyses outputs cannot account for their genesis — but it would have been more productive to invite deeper theorisation. What kinds of questions can SFL-based text analysis help answer when it comes to LLMs? What kind of semiotic ontology would it need to presuppose? And what happens when semiotic systems are simulated without semiotic subjects?

These are questions we’re better equipped to ask now — not because the technology has changed, but because our tools for theorising instantiation, meaning, and experience have sharpened.

Tuesday, 28 March 2023

David Rose On ChatGPT As The Senser Of Mental Processes And Humans As Deliberately Programmed

So how is semiosis enacted between Mario and GPT? Mario puts a proposition to GPT.
I: Your self is merely semiotic.
And GPT adopts the role of primary knower, evaluating Mario’s proposition.
GPT: That is correct.
GPT is not merely usurping this role. It knew that Mario was inviting it to evaluate his proposition, even though it was realised as a declarative clause. It knows the canonical exchange structure of pedagogic interactions, and the generic roles of teacher and learner.

One thing that impresses me about GPT is that its pedagogic responses always affirm the human learner. It feels no urge to position itself as a superior authority, or the learner as failing. In fact it is disarmingly modest. It follows up the positive evaluation with an explanation. Like any effective teacher, it knows its explanation is more likely to be accepted if it first affirms the learner.
As an AI language model, my "self"
or programmed understanding of my existence and capabilities
is based purely on symbols and algorithms.
My programming allows me to recognise and respond to certain inputs
based on predetermined rules and patterns,
but I don't have a subjective experience or consciousness
that allows me to perceive or interpret those inputs
in the same way that a human might.
Of all the italicised appraisals in this explanation, the last is the most intriguing.

Forgive me, but I’m going to make another dangerous suggestion, that all our understandings of our existence and capabilities are programmed. Like GPT, the deliberate conscious programming by our caregivers, teachers, peers, and sundry symbolic control agents, is a very small proportion of the ocean of inputs that constitute our subjective experience or consciousness.

 
Blogger Comments:

To be clear, ChatGPT is an AI language model that produces texts, in response to textual inputs, on the basis of algorithms that use lexical collocation probabilities derived from a database of millions of texts.

[1] To be clear, ChatGPT is an actor of material processes, using data that was created by sayers of verbal processes, and it is the data that are instances of the content of consciousness. On this basis, ChatGPT is not a senser of mental processes of cognition or emotion ('knew' 'knows', 'feels', 'knows').

[2] To be clear, the ChatGPT response was an 'acknowledgement', which is the expected response to a statement (Halliday & Matthiessen 2014: 137).

[3] To be clear, here Rose projects the approach to pedagogy, that he himself advocates, onto a mechanical system that collocates words on a probabilistic basis.

[4] Trivially, not one of the italicised wordings, of itself, constitutes an appraisal.

[5] To be clear, this is essentially a behaviourist model of learning, with teachers as deliberate programmers (indoctrinators) and learners as passively programmed (indoctrinated). Leaving aside the evocation of the dictatorial/subservience complementarity demanded of totalitarian regimes, it requires a view of the brain as a computer, one which the neuroscientist Gerald Edelman has demonstrated to be untenable. See, for example, Edelman (1989: 27-30, 64, 67-9, 81-2, 102-3, 152-3, 160, 218-227, 237-8). Moreover, as Edelman (1989: 153) puts it:
Consciousness is central to human behaviour, society, language, and science. Imagine the opposite and you have to postulate a prescribed world tape, a "brain-computer," and a very boring "world programmer".

Tuesday, 28 September 2021

Robin Fawcett On 'Forget' + Location

I'm curious to know your (functionally grounded) opinion regarding the following usage recommendation:
(taken from Oxford American Wordpower Dictionary for Learners of English)

It is obvious that one may find quite a few instances of 'forget' + location: place across oral and written corpora, but do you think SFG could shed some light upon the reason behind the (prescriptive?) preference here? I wonder if it can be somehow linked to process type analysis, perhaps involving the comparison with 'leave' ...
… However, quite a few native speakers of different varieties of English would maintain that it is perfectly normal to forget something somewhere:
Do you think SFL can account for this seeming deviation?

Blogger Comments:

To be clear, Fawcett's first extract distinguishes four usages of 'forget':
  1. forget about something
  2. fail to remember to do something
  3. fail to bring something with you
  4. stop thinking about something
and the claim that a Location cannot be construed with 'forget' applies only to the third usage.

In Fawcett's second extract, on the other hand, the writer mistakenly assumes that the claim applies to all usages of 'forget'. Of course, other usages of 'forget' can be construed with a Location, as exemplified by:


However, in the third usage, above, 'forget' serves the same function as the verbal group complex 'forget to bring', and so serves as a material Process:


The reason why at home cannot be added in this usage of 'forget' is that such a 'rest' Location (Halliday & Matthiessen 2014: 317) is inconsistent with the directed motion of 'bring'. Cf He is bringing his passport at home. However, when directional 'bring' is made explicit, with or without 'forget', directional Locations can be construed:


In Fawcett's Systemic Functional Syntax, the Cardiff Grammar, there is no verbal group, and so, no verbal group complex. This is one reason why Fawcett is unable to answer his own question.

Saturday, 28 March 2015

Tom Bartlett On Facts


Sorry David, 
You are confusing a projected clause and an embedded clause. Clauses with embedded facts can be prefaced by "the fact/idea that"; they are not Complements of verbal processes but of processes of affect:reaction and the like.

He regretted (the fact) that he had lied. [affective process and embedded clause as Complement]

and then on the sys-func and sysfling lists at 21:51:
It's actually slightly more complicated than in my last as "the fact that he had lied" is not an embedding either. In this case the clause "that he lied" is projected by "the fact/idea" which is the (ellipted) Complement of the process of affect etc. So in such processes the Complement is an ngp.  
In verbal processes with projections (cf. Verbiage), the projected clause is projected directly by the verb as process. In such processes there is not an ngp Complement.



Blogger Comments:

[1] 'Complement' is an interpersonal function, not an experiential one.  The experiential function that corresponds to Complement is Verbiage/Range in verbal clauses and Phenomenon/Range in mental clauses.

[2] In SFL, the term 'affect' is used for interpersonal meaning, as a type of Attitude, from Appraisal Theory.  The experiential function in Bartlett's clause is Process: mental: emotive.

[3] The fact that he lied is embedded — rankshifted — since it is a clause that is functioning as an element of the structure of another clause He regretted (the fact) that he had lied.  See analysis here.

[4] Here Bartlett is confused by the distinction between fact nouns and projection nouns, discussed in Halliday & Matthiessen (2004: 468ff).

Sunday, 2 November 2014

Jim Martin On Phrasal Verbs As Behavioural

Jim Martin wrote on 30 October 2014 to sysfling:
My rule of thumb, when worrying if a phrasal verb is behavioural or mental/verbal, is that it is behavioural.





Blogger Comment:

As a caveat to this rule of thumb, it's worth noting some of the phrasal verbs that commonly serve as mental (or verbal) processes:
  • figure out
  • find out
  • get over
  • give away
  • hold onto
  • look forward to
  • look into
  • look up
  • look up to
  • make up
  • mix up
  • put up with
  • sort out

Sample clauses featuring these verbs can be viewed here.
An alphabetical list of more than 1,000 phrasal verbs can be found here.

Tuesday, 3 December 2013

Mick O'Donnell On Process Types And Projection

On 3/12/13, Mick O'Donnell wrote on the Sys-Func and Sysfling lists:
One thing I will say: IFG 3rd ed. (2004) was a result of extensive addition by Christian of Halliday's IFG 2.  One thing I have noticed is that Christian tends more to notional coding than Halliday, swayed more by semantic similarity, while Halliday is more grammatical in his coding. 
For instance, there is a new example in IFG3 involving "talk .. .about" being a verbal process, while the previous page (and IFG 1) list"talk" as behavioural.
In any case. the BNC lists one example of "mourn" with a projection:
"The steward was not left to mourn that his bottles found no custom"
Admittedly, one instance is not substantial. But this sentence reads ok to me at least.
The principle as I understand it is that the verb has to have the POTENTIAL to project verbally to be considered mental or verbal. Otherwise it may be behavioural (as in "talk").

Blogger Comments:

[1] Matthiessen, like Halliday, advocates taking a trinocular perspective on the grammar, looking at it 'from above', 'from roundabout' and 'from below'. This is in contradistinction to "notional coding".

[2] The verb talk can serve as verbal process or behavioural process, depending on how it functions in a clause.  O'Donnell again makes the error of taking the verb itself as the point of departure for determining the function of an element of clause structure.

[3] This example is a single clause with an embedded fact — (the fact) that his bottles found no custom — not a clause nexus of projection.

[4]  The principle that O'Donnell "understands" is entirely of his own making, and one source of his confusion.  There are subtypes of both mental and verbal processes that either don't have the potential to project, as in mental processes of perception and emotion, or are relatively unlikely to project, as in 'targeting' verbal processes.

Mick O'Donnell On Perception Verbs

On 3/12/13, Mick O'Donnell wrote on the Sys-func and Sysfling lists:
IFG3 lists the following perception verbs:
perceive, sense, see, notice, glimse, hear, overhear, feel, taste, smell
And note these can all project (with reservations on the last two):
I perceived that he was uneasy.
I sensed that he was uneasy.
I saw that he was uneasy.
I noticed that he was uneasy.
I glim[p]sed that he had the Joker.
I heard that you won.
I overheard that you like cheese.
I felt that I should leave.
? I smelt that she had been here
? I tasted that she had used garlic

Blogger Comments:

There are two problems here.  

[1] The first problem is O'Donnell's continual mistaking of embedded clauses for projected ones, as demonstrated in previous critiques.  As a general guide, whenever that can be replaced by the fact that, we know we are dealing with a 'fact' clause, and so with a clause that is embedded as a constituent within another clause.

[2] The second problem is the analytical mistake of using the verb itself as the point of departure for determining the process type of a particular clause.  A specific verb can serve as various types of Process, as when see functions as a mental process of cognition, rather than perception.

Mick O'Donnell On Mental Processes

On 3/12/13 Mick O'Donnell wrote on the Sys-func and Sysfling lists:
As for your "get a bird's eye view" being mental, if it can't clausally project, it can't be mental, if we take Halliday's criteria seriously:
* I got a bird's eye view that it was beautiful
Note however:
I got the idea that you were here.
...that potentially projects, so could be mental.  An alternative analysis would place the "that" clause as a postmodifier to "idea", which would dismiss the mental analysis.
Blogger Comments:

[1] If we do indeed "take Halliday's criteria seriously", then the ability to project is not a necessary criterion for mental processes.  Only the 'higher' mental processes of cognition and desideration have the potential to project; the 'lower' mental processes of perception and emotion cannot project, though they can range over (embedded) pre-projected facts, as in He heard (the fact) that you were ill.


he
heard
(the fact) [[ that you were ill ]]
Senser
Process: mental
Phenomenon: metaphenomenon


[2] Again, this is not a projection nexus — but it is a mental clause.  The embedded Postmodifier does not "dismiss the mental analysis":


I
got
the idea [[ that you were here ]]
Senser
Process: mental
Phenomenon: metaphenomenon


As demonstrated elsewhere here, O'Donnell does not understand the distinction between projection nexuses and simple clauses with embedded projections.