The latest post in the #SentientSyllabus project is a bit of breaking news, an accessible introduction to a paradigm shift that is rapidly gaining stem, although it is only about a week old.

While we are still struggling to fully grasp the implications of "speech from a box", there is a veritable explosion of interest and activities that take this a step further, treating individual prompts and responses as a thought, and chaining them together to "thinking".

It turns out this is rather easy to do. While one instance of #ChatGPT only has responsive agency, two together can sustain this and have full agency over an extended domain. Add in memory and remembering, the ability to call on external executor AIs, to access the internet and other services, and you get full-fledged computations, a novel paradigm that we may call "generative programming". Generative, because the program flow itself is not pre-specified, but it is generated on-the-fly with the evolving context of the task at hand. And it is all glued together by natural language and the everyday understanding of our world that language brings with it.

We discuss the #Smallville experiment, and introduce #AutoGPT, #BabyAGI, #Jarvis, and #LangChain - with a shout out to #pinecone; names that it will be worthwhile to remember - at least for a week.

https://sentientsyllabus.substack.com/p/trains-of-thought

Drop in, enjoy the thinking, and share with whoever would benefit.

Language is learning to talk. "Die Sprache spricht."

#GPT4 #HigherEd #AI #generativeAI #Education #University #Academia #GenerativeProgramming

Trains of Thought

Yet another frontier of AI is coming into view

Sentient Syllabus

Part 2 of the #SentientSyllabus course redesign project has been posted: Academic visions.

Before we actually look at contents and course details, we embark on a substantial visioning exercise. Thinking of academia in the future: how will the nature of work change, and what does that mean for the economy? How will our course materials respond? How will learning itself change? And how will our roles as instructors change?

We extrapolate from current trends to derive the contours of a reimagined academia. One of the interesting conclusions is that although we will be using more technology, that technology will become more transparent. That's a simple consequence of natural language instructions.

Finally we consider different pedagogical frameworks – it turns out that #KnowledgeBuilding has some interesting ideas to contribute, for example the concept of "Epistemic Artefacts" ...

It's getting interesting. Have a look

https://sentientsyllabus.substack.com/p/starting-over-2

#ChatGPT #GPT4 #HigherEd #AI #generativeAI #Education #University #Academia #CourseDesign #Syllabus

Starting Over (2)

Academic visions

Sentient Syllabus

@matthewskelton
@ntcoding

Matthew - I've used a similar approach for academic writing with a slightly different twist: use the AI as a generic reviewer and ask it for feedback. It will give you the "current thinking", it will slightly misunderstand your arguments, and often generally miss the point. Just like a human reviewer will. But now you can go and emphasize your writing's novelty, make your arguments more explicit, and make your points crystal clear - before the paper gets sent off.

We always write with a ton of implicit knowledge. Having a patient reader who does not share that knowledge is invaluable. It helps us make implicit knowledge explicit. That's what it's always about.

🙂

#Sentientsyllabus

It's not quite right to say that #GenerativeAI will transform the #university. It is we who change it – as faculty, as learners, as administrators. In the Sentient Syllabus Project, we are setting out to establish best-practice for such change, and we start with a single course.

https://sentientsyllabus.substack.com/p/starting-over-1

We have written analysis about the impact of AI on #Academia for several months now, and we looked at questions of #authorship, #AcademicIntegrity, and personalized instruction. Now we start putting this into practice. This new post maps out a course redesign which will proceed in steps until early July. There are many new developments and visions to integrate with longstanding experience, but the July date will also give others time to build on the results for their own fall term courses.

Actually, we plan to work on two courses - one in #STEM and one in the #humanities.

Welcome to join us along the way.

🙂

#Sentientsyllabus #ChatGPT #GPT4 #HigherEd #AI #Education #CourseDesign #Syllabus

Starting Over (1)

A roadmap for an AI-allied course

Sentient Syllabus

@losttourist

I can't reproduce this claim. You reposted someones blog who claims that #ChatGPT fails at cryptic crossword puzzles. But when I try the exact same question with ChatGPT-4, I get the exact correct answers. (Which surprises me quite a bit because I myself would not have been able to come up with the solutions.)

Dialogue here:
-----------

Human:
I would like you to act as a cryptic crossword puzzle solver. I will give you a clue and the number of letters in parentheses. You provide the answer as a single word with the required length. You also explain the reasoning. Please confirm, then I will give you the first prompt.

ChatGPT-4:
I confirm that I can help you solve cryptic crossword clues. Please provide the first clue and the number of letters in parentheses, and I'll do my best to solve it and explain the reasoning behind the solution.

Human:
Chap recalled skill: something frequently repeated (6).

ChatGPT-4:
The answer to the clue is "mantra."

Reasoning:
"Chap" suggests a man, which can be represented as "man."
"Recalled skill" hints at reversing a word meaning "skill," which is "art."
When we put "man" and the reversed "art" together, we get "mantra."

A mantra is something frequently repeated, fitting the definition provided in the clue.

Human:
Effect of legislation introduced by one politician (6).

ChatGPT-4:
The answer to the clue is "impact."

Reasoning:
"Effect of legislation" suggests we are looking for a word meaning "effect" or "influence."
"Introduced by one" hints at the Roman numeral "I" (which represents 1).
"Politician" can be abbreviated as "MP" (Member of Parliament).

Combining these elements, we get "I" (one) + "MP" (politician) + "act" (legislation) = "impact."

So, "impact" is the effect of legislation introduced by one politician.

Human:
Japanese food coming with S American greeting (5).

ChatGPT-4:
The answer to the clue is "sushi."

Reasoning:
"Japanese food" suggests we are looking for a Japanese dish, like "sushi."
"Coming with" indicates that we need to combine words or abbreviations.
"S American greeting" can be understood as the Spanish greeting "hola," which is commonly used in South America.

To derive "sushi" from these elements, take the first two letters of "hola" (ho) and insert them into the word "sushi": s + ho + ushi = sushi.
--------------------------

Note that the last answer is correct, even though the reasoning is not correct. I suspect that the clue that I copied from the blog contained an error - probably the "S" is wrong. However some combination of probability and elimination operating over the tokens in (Sushi/ Ramen/ Kombu/ Natto/ Arame) gets the right solution.

I would not have expected that.

(Also, I wonder whether this maps to a real-world skill... ?)

#GPT4 #AI #openai #crossword #Sentientsyllabus

@JoelMHoffmanPhD @linguistics

??? I can't reproduce this observation of yours either. I get the correct answers to your prompts (Bonus: IPA)

---------------------

Human:
Which French word sounds like the English word "some"?

ChatGPT-4:
The French word that sounds like the English word "some" is "somme." In French, "somme" has various meanings, including "sum" (as in the total of numbers) and "nap" (a short sleep). It is important to note that the meanings of "somme" in French are not the same as the meaning of "some" in English.

Human:
Which Mandarin word sounds like the English word "my"?

ChatGPT-4:
The Mandarin word that sounds like the English word "my" is "mài" (卖), which means "to sell" or "sale." However, it's essential to remember that the meaning of "mài" in Mandarin is not the same as the meaning of "my" in English. Additionally, Mandarin is a tonal language, so the pronunciation may not be identical to the English word, as tones play a crucial role in determining the meaning of a word.

Human:
Can you write "my" and "卖" in IPA?

ChatGPT-4:
Sure! The International Phonetic Alphabet (IPA) transcriptions for "my" (in English) and "卖" (in Mandarin Chinese) are as follows:

"my" (English): /maɪ/
"卖" (Mandarin): /maɪ̯˥˩/
In the IPA transcription for "卖," the superscript numbers (˥˩) indicate the falling tone (4th tone) in Mandarin Chinese. Keep in mind that while the pronunciation may seem similar, the meaning and usage of the words are different.

----------------------

I used Mandarin because I don't speak Cantonese - can't assess.

#GPT4 #Sentientsyllabus
#AI #openai #chatgpt #linguistics

@JoelMHoffmanPhD @linguistics

??? I can't reproduce this. I get the correct response. (Bonus, sorting by topology)

----------------------------

Human:
Which Hebrew letter looks most like a Latin capital "O"?

ChatGPT-4:
The Hebrew letter that looks most like a Latin capital "O" is the letter "samekh" (ס). It is the 15th letter of the Hebrew alphabet and has a circular shape similar to "O". However, it's important to note that the Hebrew and Latin alphabets are different, and their letters may not have the same meanings or pronunciations.

Human:
You are a topological typographer and know how many holes each lettershape has. As a topological typographer, you can take an input of letters and sort it by the number of holes in the letter: For example, if your input is:
"1 2 3 4 5 6 7 8 9 0"
the you respond
0: {1 2 3 5 7}
1: {4 6 9 0}
2: {8}
Here is your input:
"A B C D E F G H I J K L M N O P Q R S T U V W X Y Z"

ChatGPT-4:
As a topological typographer, I can sort the capital Latin letters by the number of holes in each letter:

0: {C E F G H I J K L M N S T U V W X Y Z}
1: {A D O P Q R}
2: {B}

Please note that this sorting is based on the standard capital letterforms in the Latin alphabet. Some typefaces or font styles may have variations that could affect the number of holes in the letters.
----------------------------

QED.

#Sentientsyllabus #GPT4 #ai #linguistics

@ray_aldred

The author of AI generated text is a hybrid of superimposed prior conversations (Pretraining), a mechanism that produces text (Transformer) and the author of the prompt who contributes agency.

Cf. https://sentientsyllabus.substack.com/p/silicone-coauthors

I discuss the ethics there.

#ChatGPT #AIWriting #authorshipdilemma
#Sentientsyllabus

Silicone Coauthors

The "original sin" of emergent writing

Sentient Syllabus

@pj

:-) When I pointed out the analogy between #LLM training and biological #evolution, I wasn’t referring to biology’s ability to evolve language, but its capacity to develop almost anything at all: given enough tuneable parameters and a system for inheritance with variation under selective pressure, we get molecular rotors, nanofabrication, diffraction gratings for colours, magnetic compass, eyes, ears, labyrinths, social collaboration … and even language.

The number of tuneable parameters in the human genome is almost two orders of magnitude smaller than the number of parameters in GPT-3 (and less precise: only 2bit / four nucleotides). And training a language model means to follow a trajectory in a high-dimensional parameter space, just like evolution is a trajectory in genetic-sequence-space. (The technical difference is that the former is a directed walk along a gradient, while the latter is a random walk under selection).

And what happened is : when trained on token-prediction, LLMs started showing emergent aspects of “intelligence”.

Quanta just ran an article on that five days ago: https://www.quantamagazine.org/the-unpredictable-abilities-emerging-from-large-ai-models-20230316/

… and Google’s Jason Wei, who has a number of articles on arXiv on emergence, lists emergent abilities on his blog: https://www.jasonwei.net/blog/emergence

Molecular biology is one of my areas of expertise, I am not surprised this is happening: how could it not? But then again, to actually see such emergence is profound.

#Sentientsyllabus #ChatGPT #GPT4 #Bard #ai

The Unpredictable Abilities Emerging From Large AI Models | Quanta Magazine

Large language models like ChatGPT are now big enough that they’ve started to display startling, unpredictable behaviors.

Quanta Magazine

Alberto Romero who writes some of the most knowledgeable and thoughtful commentary on AI has just posted "GPT-4: The Bitterer Lesson".

https://thealgorithmicbridge.substack.com/p/gpt-4-the-bitterer-lesson

Originally an idea credited to Peter Sutton, the "Bitter Lesson" is that "humans have contributed little to the best AI systems we have built".

And with each iteration of GPT-X that contribution is becoming less and less. From bitter, to bitterer.

Worth a read.

#Sentientsyllabus #ChatGPT #GPT4 #bard #llm

GPT-4: The Bitterer Lesson

Something to think about

The Algorithmic Bridge