Later this month (or maybe in a month or two, I forget), I need to do an AI Smackdown. Of course, what an AI Smackdown means for me is different than what it means for someone else. Since I tend to over plan my sessions, a failing that causes me no small amount of angst, I’m tempted to also include instructions on how to run an AI model locally. It’s not that hard, it just takes a resource-rich device.

Aside: Please do click the link and like the video on YouTube to give Greg a boost.

Greg Kulowiec, of the Kulowiec Group, was kind enough to do a session on AI Literacy. In it, he cites several tools you can use to run LLMs at home. He shares these links and resources:

• Webinar Video Playback via YouTube – 2.5.25 Webinar Recording
• Tokens for Education – Visualizing Text Output
• Chatbots Don’t Make Sense, They Make Words – Furze
• We Can’t Outpace AI – Donahue

Running AI On A Local Machine (as opposed to remote access)

• GPT4all – OpenSource / Offline Generative AI
• Ollama – OpenSource / Offline Generative AI

A Few Thoughts and an Experiment

To his list of how to run AI on a local machine, I would add LM Studio and Sanctum. For fun, I ran the We Can’t Outpace AI article through several models with ChatGPT Plus and Mistral AI as web-based AI options.

The prompt?

Summarize the following into a 3-2-1 format (3 key ideas, 2 quotes, and 1 question), inserting headers and using markdown format. Avoid commonly used words such as embark, empower, journey, delve, dive, discover, unlock, ensure, Dive into,tapestry, vibrant, landscape, realm, moreover, navigate, arguably, as well as phrases such as It’s important to note…, Important to consider…, Based on the information provided…, Remember that…, Navigating the [landscape]/[complexities of], A testament to…, As an AI language model… , As of my last…

I’d like to say I adhered to my prompt strictly for each run, but I didn’t. I found that the home/local hosted models (e.g. Sanctum with Llama, LM Studio with DeepSeek) required a little more support, such as the headings, markdown, and avoid commonly used words instruction.

The results appear below the forwarded info.

ChatGPT Plus trained on how to do 3-2-1s:

3-2-1 Summary of “We Can’t Outpace AI, but We Can Still Teach Our Students the Value of Writing”

3 Key Ideas

1. Writing as a Process of Discovery
   • Writing is not just about producing an essay; it’s about critical thinking, self-exploration, and making new connections that wouldn’t exist otherwise.
2. The Danger of AI-Driven Pedagogical Shifts
   • Many teachers are shifting away from long-form writing due to concerns about AI cheating, replacing essays with in-class assessments, discussions, and presentations. This shift risks limiting students’ creative and analytical thinking.
3. Revision and Reflection Build Stronger Thinking
   • Encouraging students to revise their work leads to deeper insights and more nuanced arguments, as shown by a student’s improved analysis after being given time to expand on an in-class essay draft.

2 Quotes

1. “Because here’s the thing about allowing for longer processing time — the brain can find the heart.”
2. “Instead of changing individual students, it’s easier to change the system.”

1 Question

• How can educators balance AI’s capabilities with fostering original, deep thinking in student writing?

Mistral AI Personal (Free via the Web)

3-2-1 Summary

3 Key Ideas:

1. Value of Writing: The author emphasizes the importance of teaching students the value of writing, despite the challenges it presents. Writing involves deep thinking, creativity, and personal growth.
2. Concerns About AI: The author is concerned about teachers’ responses to AI, such as limiting writing to timed, in-class essays, which may stifle creativity and intrinsic learning.
3. Long-Term Thinking: The author argues that long-form writing assignments encourage deeper thinking and cognitive endurance, which are essential for addressing complex issues and fostering personal growth.

2 Quotes:

1. “When they emerge on the other side and take pride in their accomplishments, we are all the better for it.”
2. “Because here’s the thing about allowing for longer processing time — the brain can find the heart.”

1 Question:

• How can educators balance the need for efficiency and accountability with the fostering of intrinsic learning and creativity in the face of AI advancements?

Sanctum (running on my home computer)

3-2-1 Format

3 Key Ideas

The value of long-form writing

• Long-form writing allows students to delve deeper into topics, explore complex ideas, and develop critical thinking skills.
• By giving students more time to write, we can help them develop a more nuanced understanding of the material.

The risks of relying on AI

• Over-reliance on AI can lead to a lack of depth and nuance in student work.
• By relying too heavily on AI, we may be missing out on opportunities for students to develop their critical thinking skills.

The need for sustained assignments

• Sustained assignments allow students to develop their writing skills over time, rather than just meeting short-term goals.
• By giving students more time to work on sustained assignments, we can help them develop a more nuanced understanding of the material.

2 Quotes

“When we take that approach [of limiting writing to timed essays], we are essentially training our students to mimic the predictive thought patterns of AI.”

“Because here’s the thing about allowing for longer processing time — the brain can find the heart.”

1 Question

What do you think is the most significant impact of over-reliance on AI in student writing?

LM Studio with DeepSeek

Summary: AI’s Impact on Student Writing and Teacher Concerns

Key Ideas

1. The Reality of Teaching Writing: Despite the challenges, teaching students to write is an essential skill that requires effort from both teachers and students. It involves critical thinking, creativity, and precision.
2. The Downside of AI in Education: While AI can assist with writing prompts or basic grading, relying too much on it risks diminishing the intrinsic value of student writing and learning. Teachers are cautious about reducing long-form assignments to adapt to AI’s capabilities.
3. The Importance of Extended Assignments: Long-form essays allow students to engage deeply with texts, develop nuanced arguments, and reflect on their own growth as writers. This process fosters critical thinking and a more authentic understanding of literature and ideas.

Quotes

1. “We can’t outpace AI, but we can still teach our students the value of writing.”
2. “Instead of panicking over test scores, let’s rethink how we measure learning and student success.”

Question

How can teachers balance reducing grading time to adapt to AI’s capabilities without compromising the critical thinking and creativity that come from extended assignments?

Playing Around

Of course, this involves playing around with AI running local, but I like the idea of running AI models locally on my machine. I will have to explore “RAG” approaches, since for me, that is the real value.