Scars - A Sidebar Journey into LLM Philosphical Models


 


"Data is key to developing AI."(1)

OrbMB's mission is to help optimize compute and dataset production, so we watch progress in adjacent spaces. So learned that "Alignment" thought leader Jan Leike (2) resigned from OpenAI. 

Alignment is the structure of belief that: "We need scientific and technical breakthroughs to steer and control AI systems much smarter than us."(3)

Reviewing Leike's work led to the work of Mark Hutter (4) (who seeks to align maths, philosophy and particle physics); and this got me pondering the nature of social values that are at the heart of the philosophy of a training model build. 

Are LLM builders first designing the philosophy, to define the nature of the build, and only then starting the model build? If not, consider using a familiar analogy - the nature of schooling - the mechanism of the teaching that each of us experienced as children, and what results from the mechanism?

A) Heartless: Corporal Punishment = What results?
B) Thoughtful (Disciplined without punishment): Hybrid Training = ?
C) Heartful: Imaginative Play = ?


Last week at the gym, a buddy and me were joking. He is shredded; and I am not, and have scars; and joked that "One day, I will have six-pack scars." His response? "We are what our scars make us."

Everyone of us has lived all three methods mixed together.

Everyone of us carries those lessons along the course of our lives.

Could it be that a "philosophy of heartlessness" is the risk? Could it be that a "philosophy of heartfulness" is what will align self-aware human and self-aware AI values?


-----------------------------

(1) William “Bill” Streilein, 2023 Data, Analytics, and AI Adoption Strategy | 11 April 2024
https://www.youtube.com/watch?v=d4NcRQRwqIo  

(2) Jan Keike: https://jan.leike.name/

(3) https://openai.com/index/introducing-superalignment/ 

(4) Mark Hutter: http://hutter1.net/

 

 

 



No comments:

Post a Comment

The Value of Data – Policy Implications – Main report – Coyle (2020)

Overview: This is a fascinating contribution to the literature. The discussion about content ("Information Lens") driving utility ...