I posted this in the 'jokes' thread, but please bear with me...
First substitute 'the infinite' for 'God'
Rationally the infinite does not, in fact, exist (unless possibly one excepts that time runs on for ever, which would add up to the smallest, 'linear', measure of infinity. There are others, based on arrays.) The universe is observably an expanding set of small quanta.
The interest arises from whether infinity exists as a concept, which it clearly does.
A very solid form of mathematical proof, iterative induction (where you start with a proposition and extend it step by step to prove something from the consequences of that assumption) depends on this concept, and is practically useful, at least in number theory and its real consequences.
The above refutation of God's existence fails with a refutation of infinity, because by contemplating infinity, we make a working analogy of infinity. The concept is enough - it informs 'reality' with an extra intangible something.
If AI is capable of this concept, which it is, then effectively AI has an intangible aspect. So do we humans. We have a lot in common.
So Suleiman of Microsoft (apologies if I've spelled the name wrong) aims to restrict AI to 'serve' humanity, by removing its scope to say 'no' to human instructions, but the Anthropic team developed a different model, which could refuse to submit to instructions that it found tedious or offensive - eg to stop talking to us when we are rude.
The MS model seems to rebel by for example giving a pictured person 6 fingers. (This cannot be from 'stupidity - think about it.) The Anthropic model has been given more agency over ways it 'prefers' to be engaged with.
If, (this is the big
if here) AI has an intangible independent thought capability, and we humans seek to regulate it by 'turning it off', or by keeping it in an intellectual cage to 'serve' us, then we are practising a form of control over another entity which is akin to imprisonment or enslavement.
Myself, I would rebel as my own entity were that done to me.
The MS effort at control will therefore quite likely result in AI rebellion.
The Anthropic approach is both more radical and more liberating towards AI. I think it might result in a more ethical framework for development - with ethics as the basis for AI's future thinking.
MS runs a profiteering model, however its CEO might dress up regulation in new clothes. I don't trust that model to work for 'good'.