Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I take on another big topic: how to conceptualize the process of adding AI to your workflow, department/team, or institution/organization.

I also remind you about my webinar this coming Friday, which will concern Zapier.

📝 This Friday: 
Creating AI Automations with Zapier

This Friday, May 2, from 12 until 1:30pm Eastern, I’m going to cover how to use Zapier (and similar apps) to improve your AI-powered workflows and processes.

If you don’t know, Zapier is a no-code/low-code automation tool that enables you to connect any 2 or more apps together, from ChatGPT’s o3 model to Gmail to Microsoft Excel (and 5000+ more), in a workflow that is automated based on triggers, time periods, etc.

In short, it’s an easy way to get data and software, including AI, to talk to each other in a way that saves you time and headaches.

I would argue that Zapier — or another tool like it, such as Make or n8n — is one of the most important tools you learn to use in the AI era, on a par with LLMs like ChatGPT themselves. I save tons of time with it every week, and it was key to running AutomatED while teaching full-time.

As part of this webinar, I will convince you that you should use it (trust me, this won’t take long), before pivoting to demonstrating 3 simple ways to use it that can change your life as an educator:

1. Responding to students’ queries and needs in a dynamic and timely way

2. Meeting management — before, during, and after

3. Grading and feedback — never do rote work again, and instead focus on what makes you special as an evaluator

These 3 demonstrations will show you general strategies for using Zapier that you can apply to whatever interests you in automating.

All registrants will receive the recording afterwards, even if they don’t attend live.

Webinar Details:

• Cost: $25 ($0 for ✨Premium subscribers, like all webinars this year; discount code here, if you’re logged in)

• Format: ~70% presentation, ~30% discussion (come ready with questions and comments)

👉👉👉

📢 Quick Hits:
AI News and Links

1. Anthropic launched Claude for Education, their education-focused AI offering (similar to Google's LearnLM) featuring "Learning mode" that uses Socratic questioning rather than providing answers directly. They've established partnerships with Northeastern, LSE, and Champlain College for campus-wide access, and are collaborating with Instructure to integrate with Canvas LMS. The initiative includes a Campus Ambassadors program and API credits for student projects.

2. Relatedly, Anthropic released a study on how university students use Claude, analyzing one million conversations from higher education emails. Key findings: STEM students, especially Computer Science (36.8% of conversations despite only 5.4% of U.S. degrees), are early adopters, while Business, Health, and Humanities show lower adoption rates. Most concerning for educators: Claude primarily completes higher-order cognitive functions like Creating (39.8%) and Analyzing (30.2%) from Bloom's Taxonomy — suggesting students may be outsourcing exactly the cognitive skills we most want them to develop.

3. OpenAI released o3 and o4-mini, their "smartest and most capable models to date," which can now use all ChatGPT tools (web search, file analysis with Python, image understanding, and image generation) while thinking through problems. Unlike standard models, these "reasoning models" are trained to think longer before responding, resulting in significant performance improvements in coding, math, science, and visual tasks. I have been especially impressed by o3 in my testing so far (it’s the model that has been powering Deep Research; previously, this was the only way to use it).

4. Anthropic launched "Research", a new capability that transforms how Claude finds and processes information. Unlike typical search, Claude conducts multiple searches that build on each other, determining what to investigate next while systematically exploring different angles. This complements their new Google Workspace integration, which connects Claude to your Gmail, Calendar, and Google Docs — enabling it to search emails, review documents, and consider calendar commitments when answering questions. For educators and students, this means Claude can now analyze learning materials, scan notes from past courses, search the latest academic research, and create personalized study plans. Available in early beta for Max, Team, and Enterprise plans in the US, Japan, and Brazil.

5. A fascinating new field experiment from Harvard with 776 Procter & Gamble professionals found that AI fundamentally transforms teamwork dynamics. The study revealed three key insights: (1) individuals with AI matched the performance of human teams without AI; (2) AI eliminated functional silos between R&D and Commercial professionals, helping both groups produce balanced solutions regardless of background expertise; and (3) AI's interface prompted positive emotional responses, partially fulfilling the social role traditionally provided by human teammates.

💡 Idea of the Week:
Reconceptualize AI’s Role

The Friday before last, I found myself in St. Petersburg, giving two presentations/workshops at the University of South Florida. The first session included local businesspeople and community leaders. What always strikes me about this sort of interdisciplinary session is what people — very different from me in expertise and background — find interesting or useful.

There was one topic that several businesspeople discussed with me afterwards: namely, my suggestion that we need to stop treating AI tools like software purchases and start approaching them as new team members we're bringing onboard.

Having spent the last year helping institutions, professors, instructional designers, and companies navigate their AI adoption journeys — some gracefully, others with considerable struggle — I've become convinced this mental shift is critical.

Let me walk you through why this matters and how it might transform your approach to AI integration, whether as an individual or as a member of a bigger organization.

Traditional Approach: AI as “Software”

Most of us have been part of a software acquisition decision-making process at some point. We create feature comparison spreadsheets, check for LMS compatibility, verify FERPA compliance, and wade through licensing terms. Or, as individuals, we Google options, skim user reviews, and seek expert-evaluated comparisons. (I think I — “cutting-edge AI guy” — just dated myself a little bit. Oops!)

When ChatGPT burst onto the scene, many institutions and individuals defaulted to these same evaluation processes.

This approach isn't entirely wrong — Claude, ChatGPT, and Gemini are, after all, software in some sense. And it made a lot of sense early in AI’s development, like up until 2023, perhaps.

But watching higher educators of many stripes struggle with implementation, especially as AI has become more intelligent and more tool-connected over these past two years (see above for two examples from Claude and ChatGPT), makes it clear that something crucial is missing from this framework.

Better Approach: AI as “New Team Member”

Here's the perspective that resonated with those USF faculty:

Today's AI systems — whether Deep Research, Operator, or more advanced setups like Google’s Co-Scientist — aren't just executing pre-programmed routines like traditional software. They're dynamically adapting to your specific needs/data, learning from feedback, and operating with increasing autonomy, much like a new colleague would.

Consider how differently we approach these scenarios:

Software acquisition: "Does this product have all the features we need right now? What's the annual cost? Is it bundled with something we are already buying? Who handles maintenance?"

Team member acquisition: "How quickly can they learn our processes? What information do they need to succeed? Will they work well with our existing team? How much supervision will they need? Do their working methods align with our department's approach?"

This second set of questions gets much closer to what actually determines AI implementation success in higher ed settings, here at mid-2025 and going forward.

It’s a version of the approach I first outlined from a different angle a little over a year ago in my newsletter titled “Will Students Need Management Skills as AI Develops?”

What This Means for Different Roles in Higher Ed

For Department Chairs: When faculty propose developing a department-wide AI tool for assignment feedback, don't just ask about cost and security. Ask: "Who will 'mentor' this AI on our department's assessment approach? How will we ensure its work aligns with our program learning outcomes? In what ways should our process be modeled on how we train teaching assistants and adjuncts?"

Just as you shouldn't hire an adjunct or task a graduate student with grading 100 papers and immediately turn them loose without orientation, training, or some sort of verification process, you shouldn't deploy AI without similar onboarding, either via native functionality, tool integration, or prompt engineering.

For Instructional Designers: You're often bridging faculty needs with technological capabilities. Instead of just showing professors how to use AI features, help them develop "training protocols" — collections of exemplars, rubrics, and style guides that help the AI understand their specific teaching approach — or use the latest AI tools that do this for them.

For Individual Faculty: Think about the "working relationship" you want with AI tools. Do you want ChatGPT to be your research assistant, teaching assistant, or content developer? Each role requires different "training" approaches, tool needs, and supervision levels. What would you tell a generalist human — smart but not knowledgeable about your domain or tasks — to get them up to speed? How would you check behind them? When would you decide to let them operate without oversight, or with less?

Upskilling Ourselves as "AI Managers"

This new paradigm requires us to develop skills more akin to personnel management than technical administration, as I predicted in my piece a year ago:

• Effective onboarding: Creating clear documentation and examples that teach AI systems about your specific context and expectations, or integrating them with a team or environment that trains them on-the-go (this will become more and more common as AI has native access to our data).

• Appropriate delegation: Identifying which tasks benefit from AI augmentation and which require human touch.

• Ongoing supervision: Establishing review procedures that ensure AI outputs maintain quality and alignment with goals and values.

• Performance evaluation: Developing metrics beyond technical functionality — Is the AI actually helping students learn? Is it reducing faculty workload or just shifting it?

Some of these skills aren't typically covered in standard faculty development workshops but are becoming essential as AI becomes more deeply integrated into our work.

I believe this perspective shift from "software" to "team member" represents more than just an implementation strategy — it's a fundamental reorientation that will determine which individuals, departments, and institutions successfully navigate the AI transition.

In the coming years, we'll see increasing autonomy in AI systems. Those treating AI as merely another software purchase will find themselves with powerful tools that nonetheless fail to integrate effectively into their teaching and research ecosystems. Meanwhile, institutions that have developed robust "AI onboarding" and "training" protocols will leverage these systems to enhance student support, accelerate research, and create more personalized learning environments.

Put simply, the most forward-thinking universities and organizations aren't asking "Which AI tools should we buy?" They're asking "How do we build effective working relationships with increasingly capable AI systems?" and “Who — not what — would I want in my work ecosystem, if I could have them on demand?”

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I try to reframe your thinking around AI’s role in general and in higher education. When thinking about AI, it’s most productive to think not about what knowledge work AI can do, but rather about how much it would cost to get it to do what needs to be done.

I also share the sign-up link for Friday’s $25 webinar on AI grading and feedback (a popular topic I present on to institutions around the world).

📝 Save the Date: Webinar This Friday

This Friday (April 11th, 12-1:30pm ET), I'm hosting a Zoom webinar about all the different ways you can save time and improve your grading/feedback with AI.

Here’s what I'll cover:

• Options that fit your views on the ethics of using AI for these tasks, whatever your views are

• AI-driven feedback methods that don’t share student work with AI

• Ways of grading student work with AI that overcome AI weaknesses and don’t violate students’ data privacy rights

• How I help specific, real professors save time — and avoid headaches — with AI feedback/grading workflows

Webinar Details:

• Cost: $25 ($0 for ✨Premium subscribers, like all webinars this year; discount code here, if you’re logged in)

• Format: ~70% presentation, ~30% discussion (come ready with questions and comments)

👉👉👉

💡 Idea of the Week: Integration Effort

One of the most frequent misconceptions about AI in higher education is that AI models are incapable of truly advanced, specialized tasks. But in my experience — developing AI tutoring solutions for institutions, custom AI graders for individual professors, and sophisticated content with subject matter experts — there’s no knowledge work AI can’t at least assist with significantly.

The real sticking point is what I call “integration effort.”

Integration effort is essentially the work (or cost, in the broadest sense) required to prompt AI, give it the right context or data, connect it to the right software, and manage quality control so it can actually complete the task you have in mind.

For a simple filler assignment or routine email text, integration effort might be near-zero. But when you’re building a sophisticated AI tutor that needs specialized domain knowledge, a consistent “voice” over a whole course, and resistance to student jail-breaking, the integration effort can be substantial.

Below, I want to argue that while integration effort is currently a significant obstacle for some tasks, it’s decreasing rapidly and unlocking more and more tasks for AI each semester. And, crucially, I’m seeing that those who don’t invest in understanding, analyzing, and minimizing integration effort in their domains are lagging far behind.

AI Can Do (Virtually) Anything — If We Let It

Over the last year, I’ve worked with clients who were convinced that aspects of their work “just can’t be done by AI.”

One instructional designer I worked with believed that AI could never produce the nuance needed for an advanced philosophy of education module; then I showed them a multi-step prompting workflow using two models in succession (one for initial drafting, another for in-depth editing) and a third process for content validation. The result, produced with $5 of API calls and taking ~15 minutes, rivaled what human designers typically produce in weeks.

In my experience at this point in time in 2025, the barrier is rarely AI’s inability. Instead, the biggest challenge is the integration effort required to set everything up:

• designing custom prompts

• weaving in relevant references/information

• developing a multi-step “flow” that chains the prompts together and handles quality assurance/errors/etc.

• and training the humans (faculty, staff, students) to create, use, and modify these processes effectively.

Practically any knowledge task can be done, but prompting and process design is a skill in itself. When folks assume AI simply “can’t do that,” they often haven’t either (i) used the latest models or (ii) explored the flow-creation techniques that unlock the real power of these tools.

This leads me to my next point…

Determining Integration Effort is Key

Because integration effort can be the difference between massive success and total frustration, it’s critical to figure out — as early as possible — how much integration effort is needed for any valuable task.

This is especially true in higher ed, where time is a premium and academic units often move at a glacial pace, as we’ve all seen.

If you’re a professor who wants to grade 200 midterm essays in a few hours with the help of AI, you need to know how much time you’ll need to spend on prompt calibration, flow creation, etc. to handle edge cases and detect certain nuances. Is it worth it to do this, rather than simply committing to an AI-free method to grade them all over a week or two (like it’s 2009)?

It’s easy to miss these hidden costs. Yet, your approach to integration effort can determine how quickly you see real gains in efficiency and quality. If you ignore it altogether, you’re making decisions in the dark about which tasks AI can (or cannot) take off your plate.

Some Tools Make Integration Easier

AI development companies are trying to reduce friction.

NotebookLM from Google, for instance, can dramatically cut the time it takes to onboard your documents and have an AI agent refer to them accurately. That means you can set it up to read your syllabus, lecture notes, or student questions, and produce relevant responses without too much engineering.

Similarly, specialized tools like OpenAI’s “Operator” and “Deep Research” are being designed to reduce the headache of context management and tool integration, so you can minimize how much prompt engineering, tool connections, etc. you need to do.

Yet, from my vantage point, so many use cases in higher ed still require tailor-made solutions. Maybe you need advanced data analysis features connected to your LMS or your scheduling apparatus, or a system that can handle your institution’s unique compliance requirements.

At that point, the built-in functionalities of a prepackaged AI product can’t cover it — bespoke solutions (and their associated integration effort) might pay off. But you won’t know until you begin scoping out the task itself, per the above.

Many Are Behind on Integration Effort (and Skills)

In my consulting work, I’m consistently surprised by how many teams (from faculty to staff and admin) are months or years behind the current capabilities and best practices of AI.

Picture a department that’s still debating whether AI can write good multiple-choice questions for basic 100-level content (it can do very easily, regardless of subject), while, meanwhile, entire college systems are developing customizable AI tutors, structuring their unstructured advising data with AI, or using AI to turn out entire modules of HR training content in a day.

The main difference is that the latter group has recognized that success with AI depends on devoting time and resources to bridging that integration effort.

Don’t let your institution stay in a secure bubble of “We’re just not sure AI is up to it yet.” With the advent of the reasoning models and more powerful tools, the question is never “Can AI do the work?” so much as “What do we need in order to integrate AI effectively?” and “Is that worth it?”

These are the new baseline questions in the age of advanced AI.

Over Time, AI Itself Lowers Integration Effort

One of the most remarkable developments (even in the last six months) is how prompt adaptability and context management have become core features of new AI releases.

Just as we see with Deep Research, AI can begin to handle tasks like context retrieval and data pipeline set-up on your behalf, gradually collapsing its own integration effort. We’re seeing the earliest versions of AI that can chain together tasks, or fetch third-party data and tools on demand with minimal human guidance.

Eventually, many of the workflows we currently find “too involved” will become automated. That’s the horizon some call “frictionless integration,” where AI can do all of the background data wrangling, validation, and creative rearranging we currently manage ourselves.

At that point, the role of humans in the workplace will shift even more radically than it already is, and higher education won't be an exception. A system that can produce, cross-verify, and deliver tailored content in real time to thousands of students simultaneously will reorganize the entire educational infrastructure — how we staff, how we design curricula, and how we conceive of knowledge transmission itself.

It may feel futuristic, but it’s not as far away as you might think. And, even if you think I’m wrong about this, proving it would require you to join me in trying to figure out the relevant level of integration effort. That’s my point.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Yes, I am still alive! For those keeping track, I didn’t send a newsletter the last two weeks. (In short, I was on vacation and then I was sick.) But I am back in the groove now…

Today, I share 5 notable AI developments from recent weeks, plus my commentary on their relevance for higher educators.

I also announce two webinars for April.

❓ 5 Big Recent Developments in AI

1. OpenAI’s New Image Generator

What Happened: OpenAI integrated a much more powerful image generator directly into GPT-4o, making it the default image creator in ChatGPT. Unlike previous image models, this one excels at accurately rendering text in images, precise visualization of diagrams/charts, and multi-turn image refinement through conversation.

Why It’s Big: For educators, this represents a significant advancement in creating educational visuals, infographics, diagrams, and other instructional materials with unprecedented accuracy and control. It’s not perfect, but you can now quickly generate custom illustrations that accurately display mathematical equations, chemical formulas, or process workflows — previously a significant hurdle in digital content creation — without requiring graphic design expertise or expensive software. This capability dramatically reduces the time between conceptualizing a visual aid and implementing it in course materials. And, perhaps most crucially, the improved text rendering means created materials are more accessible to students, as text within images is now clear and legible rather than distorted or illegible as with previous generators. You don’t need to add labels afterwards, in many cases, and instead can direct for them to be added by ChatGPT.

How to Try It: Free, Plus, Pro, and Team tiers can use it now, with Enterprise and Edu coming soon. To use it, select 4o with the model selector in the upper left corner of your chat screen, then click the “…” button right below the chat input box, then click “Create image.” See below…

2. Google Releases More Educator-Focused AI Courses

What Happened: Google continues to put money into AI education initiatives, including two new courses specifically for K12 (click here) and higher education instructors (click here) on using Google AI effectively in educational settings. These complement their existing resources like the Generative AI for Educators course (created with MIT RAISE), the updated Guardian's Guide to AI, and the Experience AI program.

Why It’s Big: These free, specialized resources arrive just as many institutions are scrambling to develop faculty AI competencies without dedicated training budgets. (Trust me, I know, as funding is often the main obstacle for institutions trying to hire me for PD, trainings, consultations, etc.) For teaching centers and faculty development offices, Google's education-specific courses provide ready-made professional development that addresses pedagogical applications rather than just technical skills. Department chairs can now direct curious but overwhelmed faculty to structured learning paths rather than ad-hoc exploration, potentially accelerating AI adoption across disciplines. Sure, it’s all Google-focused, but it’s better for major tech companies and AI developers to invest in high-quality education-specific AI training than not.

How to Try It: It’s all free, so just click the link above that interests you and go from there! The higher ed one starts with free Google AI functionality and goes to the Premium stuff afterwards. And, at worst, the Premium functionality referenced requires a Gemini Advanced account, but you probably have one for free through your institution or can get one for $10-20 a month (mind you, almost everything can be done in Google AI Studio for free or using the free level of NotebookLM; more from me on the Plus version here).

3. Claude Search

What Happened: Anthropic added web search capabilities to Claude, enabling it to access real-time information from the internet and provide cited sources in responses.

Why It’s Big: For academics and researchers, this means Claude can now help gather current literature, identify research gaps, and assist with building stronger grant proposals, literature reviews, etc. Claude is still behind OpenAI Deep Research and Google Deep Research, but this is an important step in the right direction. Given the frontier capabilities of Claude’s top model (Sonnet 3.7) — I prefer it to o1, o3-mini-high, and Gemini 2.0 Flash Thinking for many tasks — it’s good to see Anthropic begin to expand its functionality with tools like this.

How to Try It: The feature is currently available in "feature preview" to all paid Claude users in the United States (with free tier and international access coming soon). Turn it on with the slider at the bottom of your chat window:

4. Gemini 2.5 Pro

What Happened: Google DeepMind released Gemini 2.5 Pro Experimental, which they describe as their "most intelligent AI model" designed for complex problems. It's a reasoning model that’s currently #1 on the LMArena leaderboard (which measures human preferences), and claims state-of-the-art performance across reasoning, math, and coding benchmarks. For instance, it achieved 18.8% on "Humanity's Last Exam" and 63.8% on SWE-Bench Verified (for coding).

Click here for the full table from Google.

Why It’s Big: Unlike OpenAI's o3-mini-high or Claude 3.7 Sonnet with their 200k token context windows, Gemini 2.5's million-token context window combines with its reasoning power to enable us to complete complex and deep tasks. For instance, you could analyze entire semesters of course materials simultaneously — not just individual lectures or assignments — revealing semester-long progression issues that shorter-context models miss. Grant-writing professors can feed Gemini 2.5 the funding opportunity, their preliminary data, multiple papers establishing the research gap, institutional facilities descriptions, and previous reviewer comments all at once, receiving integrated feedback that shorter-context models simply cannot provide when documents must be chunked or summarized. (I covered this use case with Gemini 1.5 Pro already, and all of my prior discussion still applies with this new, smarter version.)

How to Try It: It’s available now for free in Google AI Studio (select it in the model selector on the right side once you are in the prompt view) and to Gemini Advanced subscribers, with a 1 million token context window (expanding to 2 million "soon").

5. Microsoft’s New Agents

What Happened: Microsoft introduced two AI "reasoning agents" for Microsoft 365 Copilot: Researcher and Analyst. Researcher combines OpenAI's Deep Research model with Copilot's orchestration to help with complex, multi-step research tasks by analyzing work data alongside web information. Analyst, built on OpenAI's o3-mini reasoning model, functions like "a skilled data scientist" to transform raw data into insights using Python (with viewable code for verification).

Why It’s Big: It’s big that Microsoft is taking Deep Research, which is already a beast on its own, and combining it with their pre-existing data organization strengths. To pick one domain for examples, these specialized agents could revolutionize administrative work across higher education, dramatically reducing the time senior leaders spend gathering information for institutional decision-making…

• Program directors might use Analyst to transform years of enrollment and outcome data into compelling visualizations that strengthen program review documentation or accreditation materials without requiring dedicated data science staff.

• Research administrators could expedite grant applications by having Researcher quickly assemble relevant institutional performance metrics and compliance information alongside funding trends.

• For deans and provosts, these tools offer new capabilities to conduct just-in-time analyses of budget allocations, faculty productivity, or student success metrics — turning previously month-long projects into afternoon tasks while maintaining the transparency needed for shared governance through the viewable code.

How to Try It: Both agents will roll out to Microsoft 365 Copilot license holders starting in April through a new "Frontier" program for early access to Copilot innovations.

📝 Two Webinars in April

Due to some scheduling obstacles, I couldn’t host my March webinar. But I’ve got you covered with 2 webinars on the books for April!

1. Friday, April 11th: Using AI for Grading and Feedback

Next Friday, from 12 until 1:30pm Eastern, I’m going to cover all the different ways you can save time and improve your grading/feedback workflows with AI.

As part of this webinar, I will provide a range of options that fit your views on the ethics of using AI for these tasks; regardless of what you think about, say, sharing student work with AI, I will have an AI solution for you to help you do your job better and faster.

Interested? If so, just answer “Yes” in the below poll and I will send you an email with more information and the sign-up link. (Note: the cost is $0 for Premium subscribers and $25 for all others.)

All registrants will receive the recording afterwards, even if they don’t attend live.

2. Friday, April 25th: Why You Should Be Using Zapier (And How)

Then, on Friday, April 25, from 12 until 1:30pm Eastern, I’m going to cover how to use Zapier (and similar apps) to improve your AI-powered workflows and processes.

If you don’t know, Zapier is a no-code/low-code automation tool that enables you to connect any 2 or more apps together, from ChatGPT’s o1 model to Gmail to Microsoft Excel (and 5000+ more), in a workflow that is automated based on triggers, time periods, etc.

In short, it’s an easy way to get data and software, including AI, to talk to each other in a way that saves you time and headaches.

I would argue that Zapier — or another tool like it, such as Make or n8n — is one of the most important tools you learn to use in the AI era, on a par with LLMs like ChatGPT themselves. I save tons of time with it every week, and it’s key to running AutomatED while teaching.

As part of this webinar, I will convince you that you should use it (trust me, this won’t take long), before pivoting to demonstrating 3 simple ways to use it that can change your life as an educator:

1. Responding to students’ queries and needs in a dynamic and timely way

2. Meeting management — before, during, and after

3. Grading and feedback — never do rote work again, and instead focus on what makes you special as an evaluator

These 3 demonstrations will show you general strategies for using Zapier that you can apply to whatever interests you in automating.

Interested? If so, just answer “Yes” in the below poll and I will send you an email with more information and the sign-up link. (Note: the cost is $0 for Premium subscribers and $25 for all others.)

All registrants will receive the recording afterwards, even if they don’t attend live.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I share results from an experiment where OpenAI's o1-pro AI model provided remarkably thorough and helpful feedback on an economics research paper, revealing that advanced AI can serve as a valuable thought partner for us and offering promising applications for research development and student feedback.

As I note, if you want to participate in this experiment with your research, respond to this email to let me know!

The future of presentations, powered by AI

Gamma is a modern alternative to slides, powered by AI. Create beautiful and engaging presentations in minutes. Try it free today.

💡 Idea of the Week:
How Good is AI as a Thought Partner?

Can any current AI serve as a genuinely useful thought partner for academic researchers operating at the frontiers of their fields?

To explore this question and provide evidence to you all about the answer, I am conducting a simple experiment with OpenAI's o1-pro, their most advanced reasoning AI model (which requires a $200/month subscription via ChatGPT Pro; its newer, faster, but slightly dumber sibling, o3-mini, is available to all in a low-compute version).

A few months ago, when o1-pro came out, I invited professors to volunteer drafts of their academic papers, which I would then share with o1-pro, asking it to provide thoughtful feedback as a colleague might. The AI would evaluate the paper and offer suggestions for improvement, after which I'd gather the professors' reactions to assess the value of this AI-assisted thought partnership.

Today, I'm sharing results from one particularly illuminating case: a paper about economics education titled “Relevance, Belonging, and Growth Mindsets in Economics: Differences across Institution Types.” The paper was co-authored by Caroline Krafft, Kristine West, Allen Bellas (my correspondent), Ming Chien Lo, Adriana Cortes Mendosa, Gabrielle Agbenyiga, J Dombroski, Nayomi Her, and Joy Moua. Allen Bellas and Ming Chien Lo are at Metropolitan State University, St. Paul, MN, while the rest of the co-authors are at St. Catherine University in the same city.

Crucially, I did not turn on Deep Research, which would have connected o1-pro with the internet (notably, Deep Research is now available to all paying ChatGPT users; more on it here, here, and here). Instead, I tested o1-pro’s ability to engage with the paper based on its training data alone.

In short, the authors received extensive, structured feedback from o1-pro that impressed them in multiple ways, as researchers and as teachers of research methods.

What's most striking is how little guidance the AI needed, all due to the power of o1-pro — like other reasoning models — to prompt itself.

Let's look at what happened.

The Paper

The paper I shared with o1-pro examines why economics as a field has struggled with diversity and inclusion compared to STEM disciplines, focusing on psychological aspects (relevance, belonging, and growth mindset — collectively "RBG") across different institutional settings, including minority-serving institutions (MSIs) and women's colleges.

This was a substantive, data-driven paper with a robust methodology section, analysis of survey data from 24 colleges and universities, and thoughtful discussion of implications for economics education. At 15 pages, single-spaced (excluding the 4 pages of references and 15 tables), it represented the kind of complex academic work that typically requires careful review from knowledgeable colleagues.

My Prompt

The prompt I used relied on no field-specific expertise, as I have none (I majored in economics a long time ago but let’s be honest here). Lengthier prompts with more background information, criticisms from knowledgeable colleagues of the paper, etc. would likely get even better results (more on this below). My prompt just conveys the broad context of my request, without any special insight into how to proceed.

Here is my prompt:

The AI Feedback

Given this limited and generic prompt, o1-pro developed its own comprehensive feedback plan with eight distinct parts:

1. High-Level Framing and Organization

2. Literature Review and Theoretical Foundations

3. Data and Sampling Strategy

4. Measurement of Key Constructs (RBG) and Empirical Methods

5. Presentation and Interpretation of Results

6. Discussion, Contributions, and Limitations

7. Writing Style and Readability

8. Future Directions and Broader Implications

For each section, the AI provided detailed, thoughtful analysis that balanced acknowledgment of strengths with suggestions for improvement. The feedback totaled over 10,000 words — longer than many published papers themselves!

Here's a sample from the "High-Level Framing and Organization" section to give you a flavor of the feedback:

The feedback wasn't just superficial; it engaged deeply with the paper's methodology. For instance, on sampling strategy:

o1-pro also went beyond critiquing the paper to offering thoughtful extensions and implications for future research:

The AI consistently balanced affirmation with constructive critique, maintaining a collegial tone throughout. It identified genuine strengths while suggesting concrete improvements — much like an ideal peer reviewer.

The Professors' Response

The professors were genuinely impressed by the quality and thoroughness of the AI feedback. As Bellas wrote:

While they noted that "the length of the feedback was a bit daunting," they appreciated that "the excellent structure made it easier to read through and digest the feedback and to identify specific things to work on."

Bellas reported that their colleagues immediately recognized the educational potential:

Takeaways and Implications

What does this experiment tell us about AI as a thought partner for academic work? Here are a few of my thoughts:

1. Minimal prompting of the reasoning models like o1-pro can yield high-quality results

The most surprising aspect of this experiment was how little guidance the AI needed. I didn't provide detailed instructions about what constitutes "good feedback" or specify a particular structure. As noted, I don’t know anything about the subject matter, so this prompt is about as good as it’s going to get! Instead, I simply described the basic task in general terms and let the AI determine how to approach it. This may mean that for certain professional tasks, sometimes the best prompt is the simplest one for reasoning models like o1-pro — allowing the AI's capabilities to shine through without constraining them with overly specific instructions. (This matches with the advice of the AI developers, mind you.) But it also leaves room for the possibility that more information in the prompt, which could be provided by a subject-matter expert, would get even better results. I’ve found that the latter can be true in some cases where I do have expertise.

2. AI feedback offers unique advantages over traditional peer review

AI feedback offers several distinctive benefits over human peer review and collaboration:

• Exceptional thoroughness by default

• Consistent structure and organization (the use of bullet points is borderline compulsive from these models, I’ve found, but it is useful for this sort of case)

• No personal biases or academic politics (though there may be biases in the training data, of course)

• Immediate availability (no waiting for busy colleagues)

• A balanced approach that acknowledges strengths while suggesting improvements (reasoning models do this almost to a fault)

3. It's particularly valuable for structure and organization

The AI excelled at analyzing the paper's overall structure, flow, and organization — aspects that even experienced academics sometimes struggle to evaluate objectively in their own work. (I’ve definitely had issues with this…) By offering a fresh perspective on how arguments are sequenced and connected, AI feedback can help researchers strengthen the fundamental architecture of their papers.

4. There are still important limitations

Despite its impressive performance, AI thought partnership has clear boundaries. The AI can't evaluate the factual accuracy of novel research findings (without source material being provided to compare), can't bring disciplinary expertise beyond what's in its training data or what’s shared in the prompt, can't fully understand the nuanced dynamics of academic publishing in specific fields, etc.

5. The educational applications are particularly promising

The authors immediately recognized the potential for using AI feedback in their teaching. For students, receiving detailed, non-threatening feedback from an AI might feel less personal and more constructive than instructor comments. The AI can provide a first round of comprehensive feedback, edited by the instructor if needed, allowing instructors to focus on higher-level guidance or areas the AI might have missed. Furthermore, providing this level of feedback from one professor for all 20, 40, 60, or more students would be extremely time consuming.

✨Pedagogical Suggestions

Here are some practical approaches for integrating this technology into your teaching, including some $0 AI models that are comparable to o1-pro (and how to access them):

✨ What Premium Members Get

As I improve ✨Premium subscribers’ benefits, it can be hard to keep track, especially if you’re new to AutomatED. Here’s a summary…

Core Benefits

• $0 monthly webinars on timely AI topics (last one: Feb. 28, on “Using AI to Create Course Content”; next one: on using AI for non-pedagogical productivity, at the end of March), while everyone else pays $25

• Access to all our practical Guides, including topics like AI-aware assessment design and student AI policies, and Tutorials on how to use AI tools, from using ChatGPT for analyzing teaching data to using LearnLM for tutoring

• Discounts on our focused courses (like our new custom GPT course)

• Annual 1-hour consultation to discuss your specific challenges

• Premium-only sections in weekly newsletters, like the above

You can see all the benefits, including all the Guides and Tutorials, here.

Nearly 100 professors and learning specialists already use these resources to save time and enhance their teaching. Want to join them?

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I share all the big news from last week, including the announcement of the new GPT-4.5, Claude 3.7 Sonnet, and the wider availability of OpenAI Deep Research. But first, we have an awesome guest post on several AI-powered voice tools.

📣 By the way, I just spun up a little website to explain the AI tools I’ve developed to help department course schedulers:

PS - There are only 2 more department slots available for this semester.

Your daily AI dose

Mindstream is your one-stop shop for all things AI.

How good are we? Well, we become only the second ever newsletter (after the Hustle) to be acquired by HubSpot. Our small team of writers works hard to put out the most enjoyable and informative newsletter on AI around.

It’s completely free, and you’ll get a bunch of free AI resources when you subscribe.

Click here to subscribe

🎤 What is the Future of Voice in Education?

A Guest Post by Elliot Roe and Duncan Johnson

Voice-based AI tools are becoming more common in education, offering a potential solution to AI misuse. But do they represent a genuine opportunity to improve student outcomes, or are they just another layer in the cat-and-mouse game of academic integrity?

Duncan and I are student researchers at Tufts University and Georgia Tech, respectively, and we've spent the last 4 months researching and designing a voice-based tool for submission to the Learning @ Scale conference. We started exploring voice-based AI learning tools to see if they could help foster student-to-student connections in online classes but have shifted our approach significantly since then based on our exploration. We spoke with online education professionals and tested various tools before building our own voice-based tool and piloting it in classes. Along the way, we've learned a lot — both about how students are actually interacting with the tech and about the realities of integrating voice AI into education.

We'll discuss three existing voice-based AI tools that we found, each using voice AI in a unique way. Then, we’ll provide a quick breakdown of how we approached our own design and share our thoughts on where this technology is heading.

Socratic Mind

Voice-based assessment methods — like oral exams — have become an accepted way of "AI-proofing" assignments. But oral exams tend not to be very scalable, which is exactly what Socratic Mind aims to solve.

Built by researchers at Georgia Tech, Socratic Mind replicates oral exams asynchronously with AI. Here's how it works: Instructors set up assignments by adding questions and writing an "ideal" answer for each. Then, when students take the exam, the AI uses Socratic questioning to dig into their knowledge and guide their thinking.

While it's great to see how effectively Socratic Mind can help students develop their understanding through this back-and-forth, we've heard from students and educators who’ve used the tool that it can balloon the length of assignments.

Sherpa Labs

Where Socratic Mind tackles comprehensive oral exams, Sherpa Labs takes a different approach with quick, 10-minute quizzes on course content. Their main innovation is in content transformation — instructors simply drag and drop a PDF reading and specify a few key areas they want the questions to cover. What makes Sherpa interesting is that it's not trying to replace traditional assessments with oral exams. Instead, they're bringing an extra layer of security to lower-stakes activities.

This seems like it could work well alongside essays or other assignments. But there's a catch: the tool generates a fixed set of questions for each reading, and some educators have noted that students can still attempt to game the system by preparing scripts in advance. It's a trade-off between simplicity and security — you get a streamlined process, but you might not get the full benefits of spontaneous oral assessment.

MirrorTalk by Swivl

MirrorTalk, developed by Swivl, is a voice-AI tool designed to support self-reflection in education. It allows students and teachers to record spoken reflections and receive AI-generated insights.

We include MirrorTalk here because scaffolding reflection with a voice-AI tool is a novel and potentially powerful idea. However, where MirrorTalk falls short is its focus. It’s designed to integrate with Swivl’s co-teacher devices and assist in self-reflection for teachers. While activities can be designed and sent to students as well, it’s clear — from template activities on their platform to their product’s marketing — that student usage is not their first priority. To our knowledge, no independent educators have shared their experiences with the tool beyond Swivl’s promotional materials. So, while it could provide an interesting way for your students to reflect, it doesn’t feel as realistic to do so.

Verse

Learning from these platforms, we saw an opportunity to create something more conversational. We created Verse. While other tools mix text and audio or follow structured question-answer formats, their interactions often feel mechanical and chatbot-like. We wanted to build a purely voice-based experience that feels like a natural discussion, where students can work through course concepts in real-time synthesis.

Assignment Creation View

Student View

This informal approach is intended to let us capture students genuinely grappling with ideas. However, it presents a unique challenge: evaluating free-flowing discussions is more complex than grading structured essays.

To address this, we've incorporated an automated specifications grading system. Instructors define both core discussion questions and specific learning criteria. The system then analyzes each conversation transcript, identifying relevant quotes that demonstrate how students met these criteria. Students can review their evaluation and choose to either refine their ideas through another conversation or submit their transcript directly to their LMS.

Evaluation Output

Product Comparison

What’s Our Take?

Voice-AI in education is still in its early stages. Currently, Socratic Mind shows the most promise with its well-defined use case for oral exams and strong research backing. While Sherpa Labs achieved the highest adoption among these tools, their focus seems to have shifted elsewhere since the tool's creation.

But looking beyond these specific implementations, we see voice-AI's real potential in formative feedback — if we can make it practical for everyday classroom use. This has led us to focus on two key questions:

1. How can we create voice-AI-based activities that build on the best parts of synchronous, teacher-led discussions?

2. How do we provide efficient and equitable feedback to both instructors and students on these voice-based activities?

The answers to these questions will likely determine whether voice-AI becomes a transformative educational tool or just another fancy CAPTCHA in the ever-growing collection of edtech solutions. What do you think?

This section was written by Elliot Roe, who is an Undergraduate Research Assistant at the Georgia Tech Play and Learn Lab, and Duncan Johnson, who is an Undergraduate Researcher with the Tufts University Center for Engineering Education and Outreach.

📢 Quick Hits:
AI News and Links

1. OpenAI announced GPT-4.5, which they describe as their "largest and most knowledgeable model yet." In short, its “innate” strengths are representing empirical facts, avoiding hallucinations, and conversing more naturally, but it is worse at complex reasoning tasks like coding and STEM than their o models (o1, o1-pro, o3-mini, o3-mini-high) and these models’ competitors. Crucially, 4.5 is also worse at representing and finding empirical facts than Deep Research, which is OpenAI’s agentic fusion of their reasoning models with advanced search capabilities (see below for news on it, by the way). So, the sense in which it is strong at representing empirical facts is that, when limited to training alone and not combined with other functions/tools, it does the best. This leaves it in a weird position in our AI toolkit, and it reduces OpenAI to suggesting that its socioemotional intelligence may be the source of its lasting value (and that the benchmarks that they normally tout “don’t always reflect real-world usefulness”):

Many commentators are arguing that the limitations of 4.5 prove the limitations of “unsupervised learning” training methods, although perhaps combining 4.5 with the reasoning models and functions/tools will result in “something far more powerful.” You can access 4.5 via ChatGPT Pro right now or via Plus later this week.

2. In more exciting news, Anthropic released Claude 3.7 Sonnet, their "most intelligent model to date" and the first "hybrid reasoning model" on the market. It can produce either near-instant responses or engage in extended step-by-step thinking that's visible to users. The model shows particular improvements in coding capabilities, with partners like Cursor, Cognition, Vercel, Replit, and Canva confirming its exceptional performance. Many commentators think it is significantly ahead when it comes to real-world development tasks. Anthropic also introduced Claude Code, a "command line tool for agentic coding" in limited research preview, which enables delegating substantial engineering tasks to Claude directly from your terminal.

3. OpenAI expanded access to Deep Research, its web browsing agent that creates comprehensive research reports, to all paying ChatGPT users. Previously only available to $200/month Pro subscribers, the feature is now included with ChatGPT Plus, Team, Enterprise, and Edu plans (limited to 10 queries monthly, while Pro users get 120). This follows Google's similar move last week extending their Deep Research agent to all Gemini Advanced users, highlighting the competition between OpenAI, Google, and Perplexity to deliver value through advanced research capabilities.

4. ICYMI: Google launched “Career Dreamer,” an AI-powered career exploration tool that helps people identify transferable skills and discover new career paths. It uses Gemini to help craft career identity statements, explore job possibilities, and draft application materials. This could be particularly valuable for career services offices and academic advisors working with students on their career pathways. (More info here.)

5. ICYMI: Google also unveiled an "AI co-scientist," a multi-agent system built on Gemini 2.0 that assists researchers in generating novel hypotheses and experimental designs. In real lab experiments, it successfully predicted new drug treatments for leukemia and proposed liver fibrosis targets that showed "significant anti-fibrotic activity." Perhaps most impressively, it independently rediscovered a novel bacterial gene transfer mechanism that had been recently found (but not yet published) by researchers at Imperial College London. Google is opening access to research organizations through a Trusted Tester Program, and you can sign up here.

Google, “Accelerating scientific breakthroughs with an AI co-scientist.”

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I answer 3 reader questions on topics big and small related to tech/AI and pedagogy.

📣 By the way, I just spun up a little website to explain the AI tools I’ve developed to help department course schedulers:

PS - There are only 2 more department slots available for this semester.

There’s a reason 400,000 professionals read this daily.

Join The AI Report, trusted by 400,000+ professionals at Google, Microsoft, and OpenAI. Get daily insights, tools, and strategies to master practical AI skills that drive results.

Sign up now for free and work smarter, not harder.

📢 Quick Hits:
AI News and Links

1. Google launched “Career Dreamer,” an AI-powered career exploration tool that helps people identify transferable skills and discover new career paths. It uses Gemini to help craft career identity statements, explore job possibilities, and draft application materials. This could be particularly valuable for career services offices and academic advisors working with students on their career pathways. (More info here.)

2. Google also unveiled an "AI co-scientist," a multi-agent system built on Gemini 2.0 that assists researchers in generating novel hypotheses and experimental designs. In real lab experiments, it successfully predicted new drug treatments for leukemia and proposed liver fibrosis targets that showed "significant anti-fibrotic activity." Perhaps most impressively, it independently rediscovered a novel bacterial gene transfer mechanism that had been recently found (but not yet published) by researchers at Imperial College London. Google is opening access to research organizations through a Trusted Tester Program, and you can sign up here.

Google, “Accelerating scientific breakthroughs with an AI co-scientist.”

3. In a piece parallel to mine from a few months ago on AI and prestige, Hollis Robbins argues that “it’s later than you think,” in the sense that universities must hurry to radically reimagine their value proposition as AGI emerges: "If universities cannot articulate in detail how their faculty exceeds AGI capabilities, what value are they offering to tuition-paying students?" She predicts universities will retain only faculty who either advance original research beyond AGI capabilities, teach sophisticated physical skills, or work with previously undiscovered materials, and she argues that the other factors that make higher ed valuable, like social skill development, aren’t sufficient to justify the existence of higher ed.

4. OpenAI released a major update to their Model Spec, the document defining how their AI models should behave.

❓ My Answers to 3 Reader Questions

The mailbag returns! Here are a few of the inquiries I’ve received in the last two weeks from subscribers and clients, as well as my answers.

Remember that you can share your questions and comments by responding to any of my emails — responses to any AutomatED email come straight to my inbox — or by submitting a comment on one of my polls.

✨1. “What do you think of using NotebookLM Plus as an AI tutor, rather than a custom GPT?”

The person asking this question noted that NotebookLM seems to offer better control than a custom GPT over the knowledge base that the LLM relies on in responding to user queries.

As I detailed last week, NotebookLM Plus's ability to share notebooks in "chat-only" mode while enforcing "Guide" style interactions is compelling for tutoring use cases. Students can engage with your curated course materials through AI-guided discussion, with the system staying reliably grounded in those sources.

And yes, in my testing, NotebookLM's current technology does a better job staying focused on its knowledge base compared to custom GPTs' deployment of retrieval-augmented generation (RAG); the latter requires significant prompt engineering and testing to get good performance, partly because it seems that OpenAI hasn’t improved custom GPTs in this dimension in quite some time.

However, I would recommend to not write off custom GPTs just yet, whether for tutoring or otherwise. Major updates are coming in the next few months from OpenAI that could change this calculus dramatically.

Let me explain, starting with a key piece of information recently shared by OpenAI.

2. "Did you get Deep Research for free as a demo?"

A reader asked this after my enthusiastic review of OpenAI's new research tool. She was (jokingly?) skeptical that anyone would be this positive about a $200/month service without some... incentives.

Fair enough! That $200 monthly charge is painfully real!

However, as I told her via email, despite writing about AI tools for years, I've never received a free account or demo from any AI company. (OpenAI, Google, if you're reading this... 👀)

But her skepticism highlights something important: I only praise tools I've thoroughly tested with my own money and time. I spend 4-10 hours a day working with AI tools, so it takes a lot to get me pumped. If I am enthusiastic, it’s because I really believe what I am saying.

Deep Research actually impresses me a lot, citation quirks and all. And, by summer, those citation issues I noted will likely be sorted out, with even more features added as OpenAI works to stay ahead of Google.

3. "What's the most common tool that your consultation clients ask for help with?"

I got this question in a recent 30-minute exploratory meeting with a curious subscriber.

My answer won’t come as a surprise.

As I develop more and more custom AI tools for clients (including my department course scheduler), I find that teaching professors benefit the most from tools that help them with their feedback processes.

There are two reasons for this.

1. By and large, professors have always disliked (hated?) grading and feedback tasks, unless they are working one-on-one with a student in real-time. These tasks are time-consuming and draining because they are cognitively demanding and it often feels like you’re sending your feedback out into the abyss.

(Side note: this is one reason why I love doing and advocate for oral exams with live feedback, when feasible.)

2. LLMs are hard to efficiently and ethically use out-of-the-box for grading and feedback.

The solutions I build vary by context, but they often involve creating workflows that let professors focus on what they can uniquely provide — expertise-dependent evaluation —while AI handles everything else about generating their feedback. This avoids data privacy issues as well.

I have one client for whom I’m developing a series of tools to help with two different assignment types. For one assignment type, the professor used to spend 30 minutes per student submission, including time inputting everything into their LMS. They now spend 10 minutes per submission. With 40 students per semester and 5 such assignments, that’s 4,000 minutes saved per semester. I charged them $1250 for this tool, which amounts to ~$18.75 per hour saved. Yet, since they plan to use it for 3+ semesters with the same teaching load, that rate goes to $6.25 per hour at most. As they said to me, their time is worth a lot more than $6.25 per hour (indeed, it’s worth a lot more than $18.75!).

This brings up a longer discussion, but a crucial fact about this client is that they are paying for my services out of pocket. This isn’t uncommon either — most faculty don’t have funds from their universities for stuff like this. However, it’s my view that their institutions should be developing scalable solutions like this for them, not expecting them to either spend the time or the money themselves.

📝 Save the Date: ($0) Webinar This Friday

Want to learn more about on using AI to generate course content?

If so, just answer “Yes” in the below poll and you are thereby registered for my February Zoom webinar.

It will be this Friday, February 28th from noon to 1:30pm Eastern.

All registrants will receive the recording afterwards, even if they don’t attend live.

The rest of my webinars this semester will have an entrance fee, so this is your chance to attend without spending a dime.

If you select “Yes”, that’s enough to register. You’ll get a follow-up email this afternoon with more information, including the Zoom link.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I take a look at NotebookLM — Google’s way of bringing documents and other source materials to life via summaries, audio overviews (podcasts) and chat experiences — and its new premium version (“Plus”).

📣 By the way, feel free to email me if you handle your department’s faculty-to-course or course-to-room scheduling and you’re interested in the AI tools I’ve developed to help improve your processes — saving you time and producing more optimal schedules, without requiring any new inputs from your colleagues. I’ve got only 2 more slots available for this semester.

The future of presentations, powered by AI

Gamma’s AI creates beautiful presentations, websites, and more. No design or coding skills required. Try it free today.

📝 Save the Date: ($0) Webinar Next Friday

Want to learn more about on using AI to generate course content?

If so, just answer “Yes” in the below poll and you are thereby registered for my February Zoom webinar. It will be on Friday, February 28th from noon to 1:30pm Eastern. All registrants will receive the recording afterwards, even if they don’t attend live.

The rest of my webinars this semester will have an entrance fee, so this is your chance to get in on the action without cost.

If you select “Yes”, that’s enough to register. You’ll get a follow-up email on Monday of next week with more information.

🧰 An AI Tool For Your Toolbox: 
NotebookLM

Another month, another AI subscription to consider. This one, though, might be available to you for free.

Google One AI Premium ($20/month after the first two months) now includes NotebookLM Plus, an enhanced version of their document-focused AI assistant.

However, Plus now also comes as a part of Google Workspace and Google Cloud for businesses, schools, universities, and other organizations.

But price and availability aside, is Plus worth adding to our growing stack of AI tools?

The answer depends on how you work with course materials and research documents, and it depends on how you want to facilitate your students doing so, but I think it’s probably “Yes” for many of us.

While the free version of NotebookLM can already analyze documents and generate summaries and podcasts, the Plus tier adds features that might interest higher educators — particularly those who want to create collaborative AI workspaces around course content.

At its core, NotebookLM functions like an AI research assistant that thoroughly reads whatever sources you provide, from lecture slides and academic papers to YouTube videos and web articles. It differs from general-purpose AI chat tools by staying more strictly grounded in your uploaded sources, with inline citations for every claim.

The Plus version adds the ability to customize the AI's interaction style and, perhaps most interestingly, lets you share focused versions of your notebooks where others can interact with your curated sources through AI-powered chat.

How It Works

After creating a notebook in NotebookLM, you start by uploading your sources. The platform accepts a wide range: PDFs, Google Docs, slide decks, web pages, YouTube videos, or copied text.

Each notebook can hold up to 300 sources in Plus — a significant increase from the free version's 50-source limit.

Once your sources are loaded, NotebookLM generates an automatic summary (a “Briefing Doc”) and can quickly produce an Audio Overview of the sources, and you can chat with any subset of the sources in the middle window.

But the real power comes from the "Studio" panel on the right side of your screen. Here you can:

• Create Audio Overviews (i.e. podcasts) that convert your sources into engaging dialogues between AI hosts, and there’s a beta feature to join in with the speakers

• Generate study guides, FAQs, timelines, or briefing documents

• Take AI-assisted notes that link directly back to source material

Beyond enabling more Audio Overviews, notebooks, queries, and sources, the Plus version has three distinctive features:

1. You can share notebooks in two ways:

   1. full access, where collaborators can see all your sources and add their own

   2. chat-only access, where others can interact with your sources without seeing the raw documents (more info here, including sharing limits based on account type)

2. You can customize how the AI engages with your content through new "chat styles", like "Guide” or “Analyst”, and output length options, like “Longer” or “Shorter” (note: the button to changer these settings is easy to miss, but it’s the triple-slider-bar icon, which is in line with the “Chat” and “Studio” headers)

   • This means you can combine the prior feature, where you share a notebook with chat-only access, with the “Guide” setting to build something akin to a tutor for your students or colleagues (more on this below)

3. You can also view data on user access to your shared notebooks, including how many of them have used it and the queries they’ve made

How We Can Use It

For higher educators, NotebookLM Plus opens up several possibilities that go beyond basic document analysis.

First, it's a powerful tool for course preparation.

You could upload all your lecture slides, reading materials, past student feedback, etc. into a single notebook. The AI can help identify themes across materials, suggest ways to better connect topics, and generate review materials that accurately reflect your specific content. Since everything stays grounded in your sources — or, at least, the answers of NotebookLM require a lot less prompt engineering to remain well-grounded, and you can check the “citations” — you're getting insights based on your actual course materials.

Second, and this is where the Plus features become interesting, it can help create guided learning environments, as I foreshadowed above. For example:

• Build a notebook with supplementary readings and share it in "chat-only" mode, letting students explore complex topics through AI-guided discussion without getting overwhelmed by raw source material

• Create topic-specific study guides where the AI acts as a "Guide" (using Plus's chat styles) to help students understand difficult concepts, always citing specific passages from your course materials

• Use the audio overview feature to generate accessible versions of dense readings, which is particularly helpful for students who learn better through listening

Given that I suspect many students will already be using Plus on their own — whether you like it or not — it’s a serious question whether you should try to get ahead of them and provide more structure or just your own flavor to their studying experience.

The analytics feature in Plus also lets you see how students are actually using these resources, including which topics they're asking about most frequently and how deeply they're engaging with the material. This gives you formative information that can guide your in-class activities and topic coverage.

My Take

If you already use Google Workspace through your institution, you should definitely check out NotebookLM Plus since it’s included in your account.

If you don’t, Plus may still be worth exploring if you frequently work with large collections of course documents, have a source-focused course, or can envision using its sharing features. They might justify the cost.

Still, the free version offers solid functionality and you shouldn’t feel pressured to pay.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I discuss the second “Deep Research” AI tool released in the past few months. This time around, the tool comes from OpenAI, competing with Google’s version, and it has many academics impressed and worried. I explain how it works and share one of its outputs below so you can see for yourself what it can do.

📣 By the way, feel free to email me if you handle your department’s faculty-to-course or course-to-room scheduling and you’re interested in the AI tools I’ve developed to help improve your processes — saving you time and producing more optimal schedules, without requiring any new inputs from your colleagues. I’ve only got 2-3 more slots available, as a range of departments and other academic units around the world are going to be using my service this semester.

Keep your meeting data safe

Worried about all the AI bots joining your meetings?

Fellow is the only AI meeting assistant built with security controls and permissions.

Thousands of organizations rely on Fellow to capture their meeting transcripts, summaries, and action items – all in one secure platform.

Stop sharing your meeting data with AI note-takers that lack proper security.

Claim 30 days of unlimited AI notes today.

Get started free

🧰 An AI Tool For Your Toolbox: 
OpenAI's Deep Research

Should you get ChatGPT Pro for $200/month?

A month ago, my answer would have been "probably not."

o1-pro, the reasoning AI model that was the main benefit of Pro, truly is amazing. In fact, I’ll show off some of its powers next week when I discuss its viability as a thought partner to cutting-edge researchers.

But other tools are enough for most use cases, from the freely available Gemini models in Google AI Studio to the custom GPTs you can build with ChatGPT Plus for $20/month.

And this is all the more true now that everyone can freely use o3-mini, which goes toe to toe with o1-pro, via ChatGPT.

However, OpenAI's new Deep Research feature, launched last week, changes the equation and should tempt all of us to find the funds to get access to ChatGPT Pro.

It's the first AI tool I've seen that can immediately assist with academic research — both your own and your students' — without the user having both field-specific knowledge AND prompting skills.

OpenAI’s Deep Research is more than just ChatGPT with web access (that’s ChatGPT Search). It's a specialized research agent that spends 5-30 minutes autonomously exploring academic sources, analyzing findings, and producing detailed reports with proper citations.

And the crucial thing is this: it’s really good at playing this role, out of the box.

Unlike Google's similar tool, which aggregates a wide range of Internet sources quickly, OpenAI's version performs something closer to genuine scholarly synthesis: it identifies patterns across sources, draws meaningful connections, and structures findings based on your specific interests and parameters. (Google’s tool is limited to a narrow range of output formats.)

And you can guide OpenAI’s research process through back-and-forth dialogue, much like working with a research assistant, while Google’s tool is somewhat inflexible in my experience.

One month ago, I declared, after testing Google’s tool, that "the research report is dead and we have killed it” and that Google’s tool was to the research report what ChatGPT was to the essay. I was very impressed, despite the flaws of Google’s Deep Research.

Only one month later, I’m blown away by how much better OpenAI’s tool is, although I’m sure Google will provide good competition throughout this year and beyond.

How It Works

To access it after purchasing ChatGPT Pro, you select "Deep Research" from button below the chat field.

The Deep Research button.

You can pair it with different models via the model selector in the upper left corner of your screen, but its best performance comes with smarter reasoning models like o3-mini-high or o1-pro.

In terms of prompting, no special prompt engineering skills are needed.

It is key to be detailed about what you want — the format, scope, other relevant information, and type of sources to focus on — because it performs best when you provide a ton of context and background. Don’t be afraid to dump more information in!

Deep Research then plans its approach, clarifies what you want (if necessary), systematically explores sources while you watch (if you want), and delivers a comprehensive report with clear citations/links.

Deep Research while conducting research.

You can further refine the output through follow-up questions or by providing additional context.

Some back-and-forth where I clarified my needs (I asked it to help improve my syllabus readings).

How We Can Use It

For professors and learning specialists, Deep Research opens up two key possibilities:

First, it's a powerful tool for your own research and course development.

Whether you're designing a new syllabus, keeping up with developments in your field, or preparing lecture materials, Deep Research can accelerate the initial stages of academic investigation. Unlike standard ChatGPT, it provides verifiable citations and draws from current academic sources, so long as they are available in some form on the Internet.

A task that might have taken hours of preliminary research — like finding alternative readings for a course unit or surveying recent developments in your field — can be completed in minutes, letting you focus on the deeper analysis and synthesis that requires your expertise.

Second, and perhaps more importantly, Deep Research changes how we need to think about teaching research skills.

Just as ChatGPT transformed writing pedagogy, this tool requires us to rethink how we teach students to conduct research. The ability to quickly compile and cite sources is no longer a differentiator — instead, we need to focus on teaching students how to:

• Frame sophisticated research questions

• Evaluate and critique AI-generated research syntheses

• Identify what Deep Research misses or misunderstands

• Use AI as one tool in a broader research workflow

But I will go more into pedagogical implications at a later date. For now, my focus is on showing you what the tool can do.

Let me demonstrate Deep Research's capabilities with a real example from my own course development...

✨ Demonstration & Discussion

To test Deep Research's capabilities in course development, I asked it to analyze Module 2 of my "AI and the Future of Humanity" syllabus. The philosophy course, which I taught several times at UNC-CH, covers the ethical, political, practical, metaphysical, and epistemological challenges and opportunities presented by AI. (The screenshots above are from this request.)

Specifically, I wanted it to find and review nine key readings — from Sven Nyholm on self-driving cars and Regina Rini on deepfakes to Natasha Singer on AI tutors and Philippe Van Parijs on universal basic income — and suggest potential improvements to my syllabus that would better serve the course objectives. I only provided it with a prompt and a copy-paste of my syllabus, with each reading identified only by the author’s last name and a topic under which it fell.

Ideally, I would have provided more information, both about my readings and about ways that I already know my course could be improved, but it still performed amazingly, all things considered.

Deep Research figured out which journal article or think piece I referred to (from context plus its searches) and proposed a really impressive set of alternative readings.

Here’s the prompt I used, followed by a link to the results and my discussion of the upshots of this new tool:

After reviewing, analyzing, and synthesizing a report on 19 sources over 7 minutes, Deep Research produced this report that I share via the “share conversation” link (so you can see the full context):

📢 Quick Hits:
AI News and Links

1. Google has outlined eleven ways educators can use its AI tools in 2025, including:

• NotebookLM for creating lesson plans and study guides with source citations

• Gemini integration into learning management systems like Canvas

• NotebookLM Plus which allows professors to create shared notebooks containing course materials.

2. ICYMI (“in case you missed it”): OpenAI has announced o3-mini, a cost-efficient version of its reasoning model that matches OpenAI o1's performance in STEM fields while being 24% faster. The model is available through both ChatGPT and API, with free users getting limited access for the first time (just select “Reason” in the message composer). Notable features include three "reasoning effort" levels, function calling capabilities, and integration with web search, though it lacks vision capabilities. Their showed users preferred o3-mini's responses to o1-mini 56% of the time, with 39% fewer major errors. I’ve found it is extremely reliable and powerful for a range of my AI tool development use cases.

3. Here’s a deep dive into how LLMs were developed, how to conceptualize them, and how to use them, from Andrej Karpathy (an OpenAI co-founder).

4. Statistician Nate Silver argues that AI will be a major political issue after being largely absent from the 2024 election. He criticizes the political left for dismissively comparing AI to crypto, arguing they risk being "dealt out of the hand" on crucial policy decisions. Silver suggests AI will rank at least "a high 7 or low 8" on his "Technological Richter Scale" of societal disruption, even without achieving superintelligence, and estimates a 5-10% chance of existential risk aligned with expert consensus.

5. Google has made Gemini 2.0 generally available, releasing three versions: Flash (their workhorse model with 1M token context), Pro (their most capable model with 2M token context, especially for coding), and Flash-Lite (a more cost-efficient option). While all versions currently support multimodal input with text output, Google says additional output modalities like image generation and text-to-speech are coming soon. (Try them in their raw forms in Google AI Studio here; Tutorials on using this tool here and here).

6. OpenAI has launched "ChatGPT for Education,” a new newsletter run by their education team. It will start with profiling 30 educators who are effectively using AI in teaching.

📝 Register for February’s Webinar

Want to learn more about on using AI to generate course content?

If so, just answer “Yes” in the below poll and you are thereby registered for my February Zoom webinar. I think it will be on February 28th from noon to 1:30pm Eastern, although this isn’t set in stone…

If you select “Yes.”, that’s enough to register. You’ll get a follow-up email in a few weeks with more information.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I discuss two ways in which AI tools are getting more powerful, as well as what they mean for educators who need to assess students. There are still many options available to instructors but using version history tracking soon won’t be one of them…

Last Friday, I hosted January’s AutomatED webinar on “Building Better AI Tutors.” It went great! Thanks again to all who registered.

February’s webinar won’t have any entrance fee — the only such webinar of this semester — and will cover creating course content with AI. All it takes to sign up: a “Yes” response to the poll at the bottom of today’s newsletter.

Learn AI in 5 minutes a day

This is the easiest way for a busy person wanting to learn AI in as little time as possible:

1. Sign up for The Rundown AI newsletter

2. They send you 5-minute email updates on the latest AI news and how to use it

3. You learn how to become 2x more productive by leveraging AI

Sign up to start learning.

🤖 The Robots are Gaining Power

Last summer, I updated my Premium ✨Guide for preventing and discouraging student misuse of AI. I outlined six broad strategies for professors to prevent and discourage AI misuse in academic settings:

1. motivate students to use AI ethically and for learning through relationship-building and incentive-aligned course design

2. require students to complete work in AI-free zones, like with in-class assessments or with proctoring

3. design AI-immune assignments that students complete with access to AI

   • either increase AI immunity with format requirements (like an essay that is completed with version history tracking turned on in a Google Doc)

   • or increase AI-immunity with content requirements that focus on what AI struggles with (like meeting technical field-specific standards that the professor has determined to be challenging for AI to meet)

4. pair AI-vulnerable assignments with AI-immune verification tasks that check genuine understanding, like an oral exam completed without AI paired with a take-home essay (that they could have used AI to complete)

5. combine these approaches across one’s course (note: this is my recommended solution)

6. do nothing in cases where other pedagogical priorities take precedence or where the instructor simply needs to operate as if the students are working in good faith

Many of these strategies remain live options, but there are two growing challenges…

First, AI’s “intelligence” continues to increase, with a stepwise improvement coming with powerful reasoning models like o1, o1-pro, o3-mini (now available to ChatGPT Plus, Team, and Pro users, with free plan users able to “try OpenAI o3-mini by selecting ‘Reason’ in the message composer or by regenerating a response”), Gemini 2.0 Flash Thinking (available for free in Google’s AI Studio), and DeepSeek’s open-source R1 (also available for free from Microsoft in Azure). These AI tools narrow the range of assignments that AI cannot complete satisfactorily, and their high intelligence is widely available.

Second, AI’s ability to manipulate our environments continues to increase, with OpenAI recently releasing “Operator,” an AI system that can control computers just like a human would, to Pro users in the US. Anthropic previously released Claude’s “computer use” functionality in beta form (video demo here). Both can navigate websites, type in text fields, click buttons, and interact with computer interfaces in ways that are nearly indistinguishable from human behavior. (A deep dive on how Operator works is here.)

To illustrate the challenge to some AI immunity strategies, here’s a video I made of Operator writing a paper with the resultant version history (note: the video is sped up 3x to save you some time):

OpenAI Operator vs Google Docs Version History

A video showing — at 3x speed — how Operator can write essays in your students’ Google Docs.

vimeo.com/1052822032/da926eab76

The resultant version history looks fairly authentic with little effort. Errors and misteps abound, but this is still a sign of things to come.

(LATE EDIT: And then, yesterday, OpenAI also released its own “deep research” tool to Pro users, which is an “agent that uses reasoning to synthesize large amounts of online information and complete multi-step research tasks for you,” just like Google’s Deep Research but focused on tougher tasks. More on it next week...)

So, what do these developments mean for AI immunity for those of us looking for ways to get our students to complete some assignments or tasks without relying on AI in a problematic way?

Below, I explain where things stand.

(Of course, this is not to assume that there are no cases where AI should be used, but it is to recognize that there are reasonable pedagogical views where AI use needs to be curtailed, including for the development of fundamental skills like critical thinking or judgment.)

✨ What Instructors Can Do

One of my recommendations in the aforementioned Guide was to use Google Docs version history or similar tracking tools in Microsoft Word to detect AI misuse. The idea was simple — AI-generated content would typically appear in large blocks of pasted text, while genuine student work would show a more natural writing process with gradual development, revisions, and refinements.

Version history could reveal these telltale patterns, helping professors identify potential AI misuse and enabling them to create rubrics students to use the “correct” AI-independent process. (Sure, a student could type in something they produced separately with AI, pretending to write it themselves, but this would be annoying enough that many would be incentivized to not do it.)

This was part of a more general shift toward what some call "process verification" rather than "output verification." Instead of trying to detect AI use through the final product (which AI can increasingly simulate), we should focus on verifying the student's engagement with the learning process itself.

But tools like Operator fundamentally change this dynamic. They can simulate the natural writing process with remarkable fidelity by typing gradually, making occasional typos and corrections, taking breaks between sections, and creating version histories that look entirely organic. The "fingerprint" of AI use that we once were capable of relying upon is becoming increasingly difficult to detect.

What about the more powerful reasoning from o1 to R1? In short, as noted above, they reduce the domain of AI-immune content — content that AI struggles to produce. While there are some strategies one might want to try to carve out a space where they fail, but other moves are surer bets.

Let me explain.

📢 Quick Hits:
AI News and Links

1. ICYMI (“in case you missed it”): A new study in BJET by Yizhou Fan et al. reveals concerning findings about AI use in education: while students using ChatGPT showed better immediate performance on writing tasks, they exhibited "metacognitive laziness" — reduced self-regulated learning and deeper engagement with the material. The researchers found no difference in motivation between students using ChatGPT versus other tools, but those using AI were more likely to become dependent on it without developing transferable knowledge or skills.

2. The U.S. Copyright Office released Part 2 of its AI report on AI and copyright, concluding that:

• Copyright requires human authorship and cannot protect purely AI-generated content

• AI used as an assistive tool does not affect copyrightability

• Current technology's prompts alone don't provide sufficient creative control for copyright protection

• Copyright can cover human-authored elements in AI outputs and creative modifications/arrangements of AI-generated content

The Office found no need for new legislation or sui generis rights for AI-generated works, noting that providing such protection could actually discourage human creativity by flooding markets with AI content. The report represents the first comprehensive U.S. government guidance on AI and copyright.

3. The Allen Institute for AI announced Tülu 3 405B, an open-source AI model claiming to outperform DeepSeek V3 and GPT-4o on several benchmarks (note: these aren’t the reasoning models mentioned elsewhere in this piece).

4. A Times report reveals OpenAI is investigating whether Chinese startup DeepSeek violated its terms of service by using "distillation" — training new AI systems using data generated by OpenAI's models. The allegations come after DeepSeek's recent breakthroughs challenged assumptions about required computing resources. OpenAI's spokesperson said they're working with the U.S. government on protecting advanced models, while noting Chinese groups are actively working to replicate U.S. AI capabilities.

5. US President Trump announced a $500 billion "Stargate Project" to boost U.S. AI infrastructure, with SoftBank, OpenAI, and Oracle as key partners. Initial funding of $100 billion will expand to $500 billion over four years. As part of the deal, Microsoft's exclusive cloud arrangement with OpenAI will become a "right of first refusal" agreement. Trump also revoked Biden's 2023 AI risk reduction executive order. Fortune reports that Wedbush analysts suggest this could trigger up to $1 trillion in additional U.S. AI investments.

✨ What Premium Members Get

As I improve ✨Premium subscribers’ benefits, it can be hard to keep track, especially if you’re new to AutomatED. Here’s a summary…

Core Benefits

• $0 monthly webinars on timely AI topics (last one: this past Friday, on “Building Better AI Tutors”; next one: on generating course content with AI, at the end of February), while everyone else pays $25

• Access to all our practical Guides, including topics like AI-aware assessment design and student AI policies, and Tutorials on how to use AI tools, from using ChatGPT for analyzing teaching data to using LearnLM for tutoring

• Discounts on our focused courses (like our new custom GPT course)

• Annual 1-hour consultation to discuss your specific challenges

• Premium-only sections in weekly newsletters

You can see all the benefits, including all the Guides and Tutorials, here.

Nearly 100 professors and learning specialists already use these resources to save time and enhance their teaching. Want to join them?

📝 Register for February’s Webinar

Want to learn more about on using AI to generate course content?

If so, just answer “Yes” in the below poll and you are thereby registered for my February Zoom webinar. I think it will be on February 28th from noon to 1:30pm Eastern, although this isn’t set in stone…

If you select “Yes.”, that’s enough to register. You’ll get a follow-up email in a few weeks with more information.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I discuss some striking findings from the Digital Education Council’s just-released Global AI Faculty Survey. If you have any influence over your institution’s AI literacy trainings and resources, you’ll want to pay attention to this…

Remember, too, that my first AutomatED webinar of 2025 is this Friday from 12-1:30pm Eastern on Zoom. I'll dive deep into creating AI tutors using various approaches including custom GPTs, Google Gems, LearnLM, and APIs. You can register here for $25, which includes a discount code for our custom GPT course (free for ✨Premium subscribers; discount code here if logged in). While basic familiarity with prompting and custom GPTs is recommended (and available through the course), this webinar will focus on advanced implementation strategies and common pitfalls in AI tutoring. The session will be 65% presentation and 35% discussion, and the recording will be available for those who cannot attend live.

Save 1 hour every day with Fyxer AI

• Organizes emails so important ones are read first.

• Drafts replies in your tone of voice.

• Takes notes, writes summaries, drafts follow-up emails.

Free 7 Day Trial

💭 What Do Faculty Think About AI?

The Digital Education Council just released their Global AI Faculty Survey of 1,681 faculty members from 52 institutions across 28 countries, and the findings are eye-opening. (Click here if you missed their analogous survey of students.)

While 86% of faculty see themselves using AI in their future teaching [p. 21], only 6% strongly agree that their institutions have provided sufficient resources to develop their AI literacy [p. 35].

This is a concerning gap between the recognized power of AI and institutional support, and it's a clear signal about where higher education needs to focus in 2025.

Speaking with faculty about AI around the world, I've seen this firsthand. But let's dig into the survey’s findings.

The Regional Picture

Before getting into individual issues, I found interesting some of the regional variations on broad stances on AI. For instance, faculty viewing AI as an opportunity vs. challenge varies significantly by region [p. 13]:

• Latin America: 78% opportunity / 22% challenge

• Asia-Pacific: 70% / 30%

• Europe/Middle East/Africa: 65% / 35%

• USA & Canada: 57% / 43%

Likewise, interest in using AI in teaching in the future varied along parallel lines:

Page 21 of the Digital Education Council Global AI Faculty Survey 2025

Faculty Tool Use Outstrips Support

Setting aside regional variations, there’s a noticable gap between faculty using AI tools and using them regularly with expertise:

• 61% of faculty have already used AI in teaching [p. 6]

• 75% of AI-using faculty use it to create teaching materials [p. 7] (see here and here for some of my content on this topic)

• 50% of AI-using faculty use it for teaching students to use and evaluate AI in class [p. 7] (see here for one of my pieces on that topic)

• Yet 88% of these users report only "minimal to moderate" use [p. 8]

• And 40% of faculty identify as complete beginners or have “no understanding” of AI, and only 17% consider themselves "advanced" or "expert" in AI proficiency [p. 16]

Why the gap? Well, one explanation is that faculty lack institutional support.

The survey reveals that…

• 80% of faculty don't find their institutional AI guidelines comprehensive [p. 32]

• 80% say their institutions haven't made clear how AI can be used in teaching [p. 33]

• The top barrier to AI adoption, at 40%? "I don't have time or resources to explore AI" [p. 9]

• The second-highest barrier, at 38%? “I am not sure how to use AI in my teaching” [p. 9]

Faculty’s Concerns About Students

Looking at what keeps faculty up at night when it comes to students using AI…

• 66% agree that incorporating AI is necessary to prepare students for future job markets [p. 22]

• 83% are concerned about students' ability to critically evaluate AI outputs [p. 29]

• 82% worry about students becoming too reliant on AI [p. 30]

• 54% believe current student evaluation methods need "significant changes" [p. 23]

• 50% say they'll need to redesign assignments to be more "AI resistant" [p. 24]

On the latter two topics, see my ✨Premium Guides on how to design assignments and assessments in the age of AI and how professors can discourage and prevent AI misuse.

The Tools & Resources Faculty Actually Want

Here's where it gets particularly interesting. The survey reveals what faculty believe will enable them to integrate AI effectively [p. 36]:

• 65% want better access to AI tools and resources. But it's not just about having the tools — it's about knowing how to use them effectively.

• 64% are calling for training in AI literacy and skills. This matches what I've been hearing in my webinars and faculty workshops — there's a hunger for practical, hands-on guidance.

• 60% want a collection of best practices and use cases.

• 50% need clear guidelines on AI in teaching.

• 31% want environments that encourage innovation and tolerate failure in AI use.

Page 36 of the Digital Education Council Global AI Faculty Survey 2025

Again, while 86% see themselves using AI in future teaching [p. 21], a mere 6% feel their institutions are fully supporting their AI literacy development [p. 35].

It's a gap that needs urgent attention.

What Do You Think?

The survey shows that, in general, faculty worldwide aren't resistant to AI — quite the opposite, especially beyond the USA and Canada. They're eager to embrace it but need proper support.

If you’re here reading AutomatED, you’re probably in the same boat. But this survey makes me wonder: how can I provide you the most valuable resources?

I've created a brief 5-minute survey to understand what you need most, if you have a few minutes to complete it. It’s been a while since I’ve run one of these and would like to get some more insight into what you, my subscribers, want to read or watch.

Click here to share your views.

I will share the responses in aggregate form later on, so stay tuned for that.

📢 Quick Hits:
AI News and Links

1. A new podcast episode from Ed-Technical reveals details about Google's "LearnLM," a family of large language models specifically designed for education. These models are fine-tuned with pedagogical behaviors that can't be achieved through prompt engineering alone. The episode features Google DeepMind researchers explaining their multidisciplinary approach. (Click here for my ✨Premium Tutorial on LearnLM, in case you missed it this past weekend. The first use case is before the paywall.)

2. A New York Times report reveals how Chinese AI startup DeepSeek built a competitive AI model (DeepSeek-V3) using only 2,000 specialized Nvidia chips — far fewer than the 16,000+ typically used by U.S. companies like Google and OpenAI. (Next week, I will discuss reasoning models and the more ed-focused impacts of “agentic” applications of them.) The achievement supposedly cost just $6 million in computing power compared to Meta's hundreds of millions developing Llama and highlights China's growing influence in open-source AI development.

3. A VentureBeat analysis provides deeper context on the performance of the soon-to-be released o3 model (from OpenAI) on the ARC-AGI benchmark, which is intended to test an AI system’s ability to adapt to novel tasks and demonstrate fluid intelligence (hence ‘AGI’). While o3 achieved an unprecedented 87.5% score with high compute (75.7% under standard conditions), experts emphasize this doesn't equate to AGI. The article reveals the high computational cost — $17-20 per puzzle at standard compute, and 172 times more for high-compute performance.

4. Speaking of which, a new 3,000-question test developed by the Center for AI Safety and Scale AI — “Humanity’s Last Exam” — is intended to measure advanced AI capabilities. Questions were sourced from experts who were paid up to $5,000 per accepted submission. Current leading AI models performed poorly — OpenAI's o1 scored highest at just 8.3% — but researchers expect scores to surpass 50% by year's end.

5. A new study in BJET by Yizhou Fan et al. reveals concerning findings about AI use in education: while students using ChatGPT showed better immediate performance on writing tasks, they exhibited "metacognitive laziness" — reduced self-regulated learning and deeper engagement with the material. The researchers found no difference in motivation between students using ChatGPT versus other tools, but those using AI were more likely to become dependent on it without developing transferable knowledge or skills.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

Each week, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

In this ✨Premium edition, I present a Tutorial explaining 4 ways to use Google’s LearnLM (a version of Gemini fine-tuned for learning). I cover how to use LearnLM

• to create sophisticated assessments that promote learning

• to develop clearer and more effective assignment instructions

• to provide more constructive feedback on student work, and

• to support student learning through guided tutoring

🧪👀 Why You Should Try LearnLM

Today's generative AI models often struggle to truly teach. They excel at presenting information but fall short of guiding students through the learning process. Over the past few years, many studies have found that this is the primary problem with students having access to these tools (see, e.g., here, here, or here), as anyone in the classroom already noticed. Effective teaching requires more than just providing answers; it requires understanding how people learn and adapting to individual student needs.

Google's LearnLM, a version of Gemini fine-tuned for learning, offers a promising solution. Unlike general-purpose models, LearnLM is designed to understand and apply pedagogical principles. However, it doesn’t assume that its creator’s theory of learning is correct; it can adapt its teaching approach based on specific instructions, a method Google calls "pedagogical instruction following."

For example, you can instruct it to use Socratic questioning or provide feedback that encourages metacognition. This flexibility allows it to support a wide range of teaching styles and learning contexts.

Early testing from Google and their collaborators suggests LearnLM outperforms other AI models in areas like inspiring active learning, managing cognitive load, adapting to learner needs, and stimulating curiosity. (You can read the lengthy white paper from the LearnLM team here.)

So, LearnLM is worth exploring as a tool to help (higher) educators, especially since it’s free to use (more on access below).

There is one catch: while LearnLM is a version of Gemini — most notable because of its massive context window — LearnLM is limited to 32,000 input tokens, not 2 million like most other versions of Gemini. (See the glossary at the end of this piece for explanations of terms like these.) I expect this to change over time, but for now it is an annoying aspect of LearnLM.

Still, LearnLM is very useful for educators for the above reasons, especially when combined with other LLMs that can condense large swathes of information to give it as inputs, as I explain below.

This Tutorial explores four key ways professors can use LearnLM to enhance their teaching.

I'll show you how to…

• create sophisticated assessments that promote learning

• develop clearer and more effective assignment instructions

• provide more constructive feedback on student work, and

• support student learning through guided tutoring.

These are the four “cases” I cover below. With each case, I provide detailed, practical guidance for working with LearnLM, including how to structure your course materials, craft effective prompts, and refine the model's outputs.

As long-time readers might expect, the net result is a very long block of text with extensive explanations and examples.

Since I know you probably don’t have time to read it all, check out my tip below for a way to quickly apply the Tutorial to your needs…

❓❓ Case 1: Create Quizzes and Tests from Course Content

Creating assessments that both measure and support student learning takes significant time and expertise. While we want our assessments to help students integrate concepts and think critically, it’s often the case that we lack the bandwidth to create ideal assessments. (I’m assuming I’m not alone in this…)

Let's explore how to use LearnLM to create effective assessments, from organizing your materials through refining the final product.

Step 1: Organize and Prepare Your Source Materials

To prepare your materials effectively, follow these six sub-steps, which I'll explain in detail below:

1. Gather all relevant course materials, from teaching content to supporting documents

2. Convert everything to digital, machine-readable formats

3. Structure your documents with clear headers and section markers for LearnLM to reference

4. Break down large materials into topic-focused chunks

5. Use other LLMs to condense lengthy content when needed

6. Remove sensitive information and organize content logically

First, gather your course content comprehensively. This means collecting whatever is relevant to the assessments you are trying to build. For instance: lecture recordings, presentation slides, class handouts, readings, homework assignments, and supporting documents. Include materials that define your educational goals, such as learning objectives, curriculum maps, and assessment criteria.

The goal is to give LearnLM access to both what you teach and how you want students to learn it. However, keep in mind LearnLM's 32,000 token context window — you'll likely need to break this content into smaller, focused chunks organized by topic or learning objective.

Next, make your materials accessible to LearnLM by converting them to easily parsed digital formats and managing their size. LearnLM can work with various file formats, but focused, text-based content chunks are most effective for assessment creation. Here’s a table for your reference:

The third step — structuring your documents — is crucial for both LearnLM's understanding and managing content within its 32,000 token context window. Use clear, consistent headers and section markers throughout your materials. These act as navigation points that help you both refer to specific content when creating questions and divide content into manageable chunks for LearnLM to process.

For example, start main sections with descriptive headers like "Unit 3: Macroeconomic Policies - Fiscal and Monetary Tools" or "Week 5: Quantum Mechanics Foundations - Wave-Particle Duality." Use subsection headers to mark important concepts within each main topic. This hierarchical structure makes it easier to split content into focused segments that fit within LearnLM's context window while maintaining coherence.

Order topics logically, whether chronologically or by complexity. Cross-reference related concepts explicitly in your section headers or summaries, but keep in mind that you may need to feed related sections to LearnLM separately due to its context window limitations. The goal is to create well-structured material chunks that help LearnLM understand both individual topics and their connections to other segments you'll introduce separately.

Fourth, and relatedly, consider enhancing your document structure with brief introductory summaries at key points (read: use brief prompts to get an LLM like ChatGPT to do this). These summaries are particularly valuable when working with LearnLM's context window limitations, as they help maintain coherence across separate chunks of content. They serve multiple purposes: they state learning objectives, highlight essential concepts, and most importantly, make explicit connections between different parts of your course that may need to be processed separately.

If you think the linkages are self-evident within each content chunk, this last sub-step isn't necessary. You could also explain the linkages in your prompts (more on this below).

Step 2: Access and Configure LearnLM

Begin by accessing Google AI Studio and logging in with your Google account. Create a new prompt and select LearnLM from the model dropdown menu (it will be under “Preview” and may be labeled “LearnLM 1.5 Pro Experimental”). The interface shows four main components: a system instruction box (at the top), an upload area (marked by a plus symbol), a prompt input window (“Type something”), and a “Run” button. There are other settings on the right side panel but you can ignore them.

At this stage, upload your prepared course materials using the plus symbol, but don't click "Run" yet — we'll craft an effective system instructions and prompt first in Step 3. The interface will list your uploaded documents in the upload area.

Remember that LearnLM will work with the internal structure you created in Step 1, using your headers and markers to understand relationships between concepts. (Or if you didn’t do enough of that, prepare to flag it explicitly in your prompts.)

Step 3: Craft Structured Instructions

Like Gemini and other LLMs, LearnLM works best with structured instructions that guide it through complex tasks. Your instructions have two components: “system instructions” and “prompts.”

The system instructions provide big-picture context about the role LearnLM is playing, who you are, and what you need. Here’s a schematic template for such a system instruction with filler bracketed parts.

After you insert this system instruction, input a prompt that has several layers, including any relevant background information, assessment question examples, desired output formats (what you want from the LearnLM beyond the questions themselves), and more detailed instructions for how LearnLM should proceed.

Here again is a schematic version of such a prompt, which I explain at greater depth afterwards:

The first layer of the prompt explains the structure and content of your uploaded materials. This helps LearnLM understand how to navigate and use your course content effectively. Describe the organization and relationships between your files, referencing the headers and markers you created in Step 1.

If you can or want, it is an option to paste the documents’ contents into the prompt itself, providing headers along the way (you can use markdown to demarcate structure, as I am in the above examples; #x for H1, ##y for H2, etc). This is more work but may get better results because it guarantees the textual content is in a format that LearnLM can parse.

After establishing the overall context and providing your files as background information, give several concrete examples that demonstrate the types of questions you want. These examples serve as models for LearnLM to follow, showing both the structure and the level of sophistication you expect.

Next, provide a clear format for the output. Ideally this would match the format of the examples above, but it isn’t necessary (this is extra work; I don’t do this here). This structure ensures consistency and makes the assessment easier to review and implement. The format should capture both the question itself and its pedagogical purpose:

Conclude with step-by-step instructions that explain how a generalist pedagogy expert (LearnLM) should proceed through what you provide to achieve your goals.

Step 4: Review and Refine Generated Assessments

Review the assessment both holistically and question by question. Does it create a coherent learning experience? Check how LearnLM has referenced your course materials and explained its pedagogical choices.

When you find areas for improvement, structure your revision requests clearly. For example:

You can request multiple improvements simultaneously:

Given its context window size, LearnLM remembers previous versions and feedback throughout refinement, allowing you to reference specific elements when requesting changes. Through this process, you can develop an assessment that both measures and supports student learning.

(If you go on for a while, or if you have a lot of documents or files, you will reach the end of the context window and may need to start a new conversation to ensure your initial prompt is retained.)

📄✏️ Case 2: Improve Pedagogical Quality of
Assignment Instructions and Rubrics

Clear assignment instructions and well-designed rubrics are essential for student success, yet crafting them requires balancing detail with clarity. Students need to understand both what to do and how their work will be evaluated, while instructors need rules or guidance for consistent grading across many submissions (and many levels of fatigue).

What makes LearnLM particularly valuable for this task is its understanding of pedagogical scaffolding and assessment design. The model can analyze your current materials and suggest improvements that clarify expectations, highlight learning goals, and create better alignment between instructions and evaluation criteria.

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I report back from the field: I share some of the good questions faculty have asked me lately, as well as what I said in response.

You may have some of the same questions, so I hope this is useful to you, but feel free to respond to this email to ask me other questions — I’ll include my answers in a later edition.

Remember, too, about my next public AutomatED webinar, which will be on January 31 on Zoom and will focus on techniques to build better AI tutors.

❓ My Answers to 5 Faculty Questions

This year, I plan to keep you all more aware of what I’m doing and learning while helping faculty engage with and integrate AI.

Two weeks ago, I spoke to faculty at NOVA during the WONDER conference, then flew to Benton Harbor, Michigan to speak to faculty at Lake Michigan College. This past week, I went back to the same neck of the woods to deliver two hands-on sessions on prompting and AI usage to faculty at Southwestern Michigan College. I wrapped up my trip with a brief session with a pedagogy seminar for graduate students at Notre Dame.

(If you’d like to book me for this spring, or discuss options, click here.)

Here are 5 questions I got from the faculty I spoke with. I figure you might find my answers useful…

1. “What if some of my students can afford premium AI tools and others cannot? This is a serious equity issue!”

It’s a legitimate concern and there isn’t a silver bullet. Here are some thoughts.

While there are pricey premium tools like GPT-o1-pro (at $200/month), almost all tools either have comparable free versions or are $20/month (e.g. ChatGPT Plus, Gemini Advanced, Claude Pro).

The bright side is that the free tools are amazing — better than premium tools from ~6 months ago — and aren’t significantly worse than the paid ones for most tasks. 

This means students’ opportunities and access have increased in absolute terms — that is, for goods that they can accrue regardless of how much of them their peers accrue.

The dark side is that there are some key tasks, relevant in the university setting, where the difference is significant. GPT-o1-pro is significantly better than GPT-4o at anything complex, and crucially requires less prompting skill.

This means that students’ opportunities and access have decreased in relative terms, at least if they can’t afford what their peers can.

(Imagine, to make it stark, a course graded on a curve with only perfect-scoring students able to get As, where GPT-o1-pro access guarantees perfect outputs on the assessments but where GPT-4o is imperfect.)

One solution: instructors should try to leverage AI tools in their free versions and create assignments/assessments that don’t reward students who have the means to leverage the premium tools. This requires regular testing of the main tools’ capabilities but also course design that has key moments that are AI free — and those need to be the moments where everyone can shine, including with respect to their grades.

This is the same type of solution we deploy to mitigate other sources of unjust inequalities.

Another option, shared with me by Maria H. Andersen on my LinkedIn post on this topic, is as follows:

I think this is a good idea. It’s just like if you were to “share” access to an expert — access that not everyone has — and discuss/analyze what they told you with your colleagues or peers.

But everything is easier if your institution provides a high-quality baseline AI tool to all students. More on that below… 

2. “What’s the highest impact way to deploy an AI chatbot in my classes? The easiest?”

The best bang for your buck is a custom GPT. 

In essence, custom GPTs are modular or prepackaged AI chatbots that you can share via hyperlink. You do the modularization or packaging; you add meta-prompts or “instructions” and a knowledge base of files to enable them to simulate you (e.g. for tutoring or syllabus knowledge), your teaching assistants (e.g. for grading), or your students (e.g. for peer review or group work).

You spend $20/month for ChatGPT Plus (which is required to build them), you build the custom GPTs, and your students pay nothing to use them. (On the free plan, your students do face usage limits; these can be removed if they pay $20/month.)

You can read more about custom GPTs in my ✨Premium Tutorial dedicated to them.

If you want to learn how to build better custom GPTs, I have created two resources for you beyond the Tutorial:

1. Our new $25 course

   • Early feedback has been very positive, with one learning specialist saying that the price is “bargain basement” for what you get and with a professor describing it as “interesting,” “useful,” and “helpful.”

2. My free-for-you webinar on Friday January 31 at noon Eastern on Zoom 

And you get a discount on the course if you purchase the webinar, for a combo deal.

(For more information on the webinar, see my email from yesterday, if you haven’t registered already.)

3. “Why isn’t it feasible for me to change nothing about my courses, which are ‘old school’ in structure and content (device-free, in-class pencil-only tests, lecture-heavy), despite the power of AI?”

It isn’t feasible and here’s why:

Imagine you are teaching your “old school” course and all of a sudden every student correctly expects to live their life with immediate access to high-IQ tutors, mentors, and consultants who know a whole lot about nearly everything, including your field.

Imagine, too, that within a few years, these “assistants” will be 10x more powerful and integrated with nearly all aspects of your students’ lives, careers, and environments.

That is, outside of a few contrived contexts where they can’t query, direct, and rely on these people, your students will be able to leverage them for a very low cost and will be expected to do so by their managers, family members, friends, etc.

You wouldn’t — and shouldn’t — leave your course unchanged in such a scenario.

You are in such a scenario, with AI.

So, change what you need to change.

(One compact case for thinking you are in such a scenario is as follows. The capabilities we are seeing or expecting from the latest models, whether GPT-o1-pro, GPT-o3 (soon to be released publicly), or Gemini 2.0, are genuinely impressive and go beyond the capabilities of most humans on most knowledge tasks. Personally, I’m finding o1-pro to be incredibly powerful in a range of use cases, and I am not alone — I’ll share other professors’ takes on its abilities in the coming months. Further, many of the past obstacles to AI success are being overcome, from context window limitations to hallucinations. Finally, the AI developers from OpenAI to Google are only gaining speed and resources, and they are repeatedly signaling that we are much closer to AGI and superintelligence than they expected to be at this point.)

4. “Which AI tool is best for <task X> in <my field>?”

You, expert, need to find out yourself by experimenting. I don’t know what high-quality outputs look like in your field, so I can’t tell you.

I can give you some initial guidance on where to look, though.

In descending order (internal to each category)…

For reasoning-heavy fields: 

• GPT-o1-pro

• GPT-o1

• Gemini 2.0

• Claude 3.5 Sonnet

• Gemini 1.5 Pro = GPT-4o

For research-heavy fields:

• Elicit

• Perplexity

• Gemini 2.0

• Google Deep Research

• ChatGPT Search

For writing-heavy fields:

• Claude 3.5 Sonnet

• GPT-4o

• Gemini 2.0

For coding-heavy fields:

• GPT-o1-pro

• GPT-o1

• Claude 3.5 Sonnet

• GPT-4o

With most of these tools, you’ll need to be able to prompt them effectively to get expert-level results. For that, I recommend the various ✨Premium Tutorials I have in the Archive dedicated to the topic (e.g. on prompting Gemini and long context more generally, or on prompting ChatGPT4o for image and data analysis), or wait until my next prompting webinar (later this spring).

(Yes, you really need to dive in and get your hands dirty with the tools, prompting them for — minimally — several dozen hours over the coming semester to better understand what they can do. To be completely frank, if at this point you don’t have significant experience testing the best AI tools for the tasks that play central roles in your field and life, you’re behind and need to catch up.)

✨5. “Which large language model (LLM) should my institution purchase for all students to use?”

📢 Quick Hits:
AI News and Links

1. Want to catch up on AI development over the past few years? Here are 50 papers that explain the latest LLMs, the benchmarks that are used to evaluate them, big moments in prompt engineering, agents, vision, voice, fine-tuning, and more.

2. ICYMI (“in case you missed it”): Google updated NotebookLM with three major changes: a new three-panel interface for better content management, interactive voice conversations with AI hosts during Audio Overviews, and a premium "Plus" subscription for power users that offers 5x higher usage limits. The Plus version will be included in Google One AI Premium in early 2025.

3. A new analysis in Lawfare argues that OpenAI's o3 model, which reportedly scored 87.5% on the ARC-AGI benchmark (above human performance at 85%), represents a fundamental shift in AI development. The authors say this unexpected breakthrough — jumping from 5% to 87.5% in months — proves powerful AGI requires immediate regulatory action. They call for proactive governance frameworks, global coordination, and economic preparation for widespread AI transformation.

4. Google is starting its push of including Gemini as a non-optional feature in all Workspace plans, starting with Business and Enterprise, and increasing their price slightly as a result.

5. Microsoft announced several new AI agents for Microsoft 365 Copilot users, including:

• A SharePoint agent that provides instant answers based on site content

• A "Facilitator" agent for Teams that takes real-time meeting notes and summarizes group chats

• An "Interpreter" agent coming in 2025 that provides real-time speech-to-speech translation in 9 languages

• A "Project Manager" agent in Planner that can create and execute project plans

The agents require a Microsoft 365 Copilot license and are rolling out in preview to customers.

6. Microsoft 365 Copilot is coming to Personal and Family subscribers (in place of Copilot Pro), by default in most markets.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I take a closer look at Google’s new Deep Research tool, which is to the research report what ChatGPT was to the essay.

I also announce the next AutomatED webinar, which will be on January 31 on Zoom and will focus on advanced techniques to build better AI tutors.

Save 1 hour every day with Fyxer AI

Fyxer AI automates daily email and meeting tasks through:

• Email Organization: Fyxer puts your email into folders so you read the important ones first.

• Automated Email Drafting: Drafts replies as if they were written by you; convincing, concise and with perfect spelling in every language.

• Meeting Notes: Stay focused in meetings while Fyxer takes notes, writes summaries and drafts follow-up emails.

Fyxer AI is even adaptable to teams!

Setting up Fyxer AI takes just 30 seconds with Gmail or Outlook.

Free 7 Day Trial

🧰 An AI Tool For Your Toolbox:
 Google’s Deep Research

What is it?

As I reported last week, Google just launched Deep Research, an AI research assistant in Gemini Advanced that autonomously explores complex topics and compiles comprehensive reports with source links. As Google describes it:

This week, I explain how it works in greater detail and give my judgment on its relevance to teaching faculty.

How can one get access to it?

First, go to https://gemini.google.com/advanced and sign up for a Google One AI Premium plan. A one month trial is available for first-time users; the rest pay $9.99 for two months and then $19.99 for month three onward.

Once you’re logged in, click the dropdown menu in the upper left and select 1.5 Pro with Deep Research:

How does it work?

It proceeds through 8 phases:

1. Accepting input (a simple chat/search bar; you input a question or direction):

2. Planning (Gemini 1.5 Pro, the LLM, comes up with the best approach to tackle your question; you wait):

3. Accepting revisions to the plan (a dialogue bar, like chatting with Gemini in other contexts; as you can see in the screenshot above, you can click the “Edit plan” button and then tell it what to change in a conversational way, or not)

4. Researching (Google Search combines with Gemini 1.5 Pro in a way that we cannot observe to search for what the plan specifies; you wait)

5. Analyzing (Gemini 1.5 Pro processes all the text and other media it has gathered; you wait)

6. Creating the report (Gemini 1.5 Pro begins to generate text based in what it analyzed and what the plan concerned; you wait)

7. Delivering the report (Gemini 1.5 Pro delivers a report in preview form, with the ability to open it in its entirety in Docs; you click “Open in Docs” or ask for revisions)

8. Accepting requests for revisions to the output (a dialogue bar, like chatting with Gemini in other contexts; you can tell it what to change in a conversational way, or not)

Finally, since Gemini is in Docs for those with Gemini Advanced, you then have another option for further revisions:

9. Accepting requests for revisions, summaries, analyses of the output (a dialogue bar, like chatting with Gemini in Docs; you can tell it what to change in a conversational way, or not)

✨What do I recommend teaching professors do?

I conducted two preliminary tests of Deep Research’s abilities, each focused on a research question that, for different reasons, I have significant familiarity with:

1. Why has the proportion of adjunct faculty increased at colleges and universities in the US since the 1950s? (some screenshots from this test are included above)

2. What are some of the strongest arguments for and against attributing moral responsibility to AI systems, supposing they qualify as superintelligent (as Sam Altman thinks they soon will) or AGI?

First, I will share what Deep Research did in each case.

After that, I will share my recommendations for what teaching professors should do in light of this new tool.

In short, it is a very big deal for educators who assign research, like ChatGPT was for those who assign essays.

📢 January 31 Webinar:
On Building Better AI Tutors

The results of my subscriber surveys in: the next webinar will be on Zoom on Friday, January 31 from 12pm-1:30pm Eastern time, and it will cover building better AI tutors, with a focus on OpenAI’s custom GPTs, Google’s Gems, and Claude’s Projects, as well as more advanced implementations.

If you want to tutor your students with an AI chatbot — simulating a teaching assistant, a mentor, a peer-reviewer, someone who knows the syllabus really well, or … — this is the webinar for you.

✨Premium subscribers get in for free, while the price is $25 for everyone else.

However, the webinar will assume, as a prerequisite, that you have a solid grip on the basics of building custom GPTs.

If you aren’t confident that you do, I recommend that you take our recently released custom GPT course, now live on LearnWorlds for $25. Those who sign up to the webinar will get 20%-off discount code for the course.

In terms of format, the webinar will be roughly 65% presentation, 35% discussion or Q&A. The presentation part of the webinar will be on more advanced topics like:

• strengths and weaknesses of custom GPTs vs Gems vs Projects

• how to address common tutoring pitfalls with them

• when to pivot to creating more bespoke solutions with LLMs’ APIs, like how to link custom GPTs to other LLMs like LearnLM or how to use AI to regulate itself

In the discussion part of the webinar, you can ask questions, hear what others are doing, and get my take on how to tutor students with these amazing tools.

Sign up here:

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

Today, I explain why I think 2025 is a key moment for many educational institutions and educators, at least with respect to the growing AI digital divide.

I also provide some AutomatED updates, including the release of our new custom GPT course and the release of my AI-powered department course scheduler (email me if interested; more information on it at the bottom of this message).

💡 Idea of the Week:
Don’t Let Your Colleagues Wait

This week, I will be speaking about AI at the WONDER conference hosted by NOVA and then at Lake Michigan College.

The following week, I return to Michigan to talk with faculty at Southwestern Michigan College and then go a little south to discuss AI pedagogy with graduate students at Notre Dame.

The commonality across these diverse audiences is that they are all working hard to stay ahead of the AI curve.

This is not just wise — it is essential. AI is yet another source of digital divides, and those institutions, departments, faculty, and staff who aren’t working hard on how it can be useful for them are going to fall behind.

I think 2025 is a turning point; it is the year where the AI digital divide becomes stark.

Consider two recent developmenets that illustrate why:

Google just launched "Deep Research," an AI research assistant in Gemini Advanced that autonomously explores complex topics and compiles comprehensive reports with source links. As Google describes it (here’s also a video that conveys how it works):

Meanwhile, OpenAI just announced o3, their next frontier model (‘o2’ is being skipped because it’s copyrighted). Their internal testing shows it outperforming PhD-level experts on scientific reasoning tasks and beating all of their programmers (except one?) on coding benchmarks. In fact, o3 can solve novel mathematical problems that would "take professional mathematicians hours or even days to solve." Here’s their YouTube video with more:

On the basis of this progress, OpenAI's CEO Sam Altman stated in a blog post released yesterday that the company is now “confident we know how to build AGI” [artificial general intelligence] and predicting that in 2025, “we may see the first AI agents join the workforce and materially change the output of companies.”

Many faculty I talk to about developments like these are already behind. They don’t know basic facts about its functionalities, aren’t working to integrate it with their workflows, data, and field-specific tasks, and aren’t teaching their students how to use it, despite their students’ interest in it (for evidence of the latter, see here, here, here, and here).

Those of you reading this newsletter are likely among the minority of faculty who see what's coming, even if you differ with me and each other about the details. You're in what I observe to be the smallest of four groups:

1. Those who are already there; power users or informed skeptics who have thought deeply about AI's implications

2. Those who wish they knew more and are actively working to learn and adapt

3. Those who wish they knew more but haven't made the time

4. Those who actively resist engagement, often virtue signaling about AI's risks while remaining willfully ignorant of its functionality and its impacts

2025 will be defined by two major trends that make your role as an early adopter crucial for your department and institution:

First, agential AI — AI that can guide itself with more autonomy — will become increasingly capable. Tools like Google's Deep Research aren't just research assistants; they're precursors to AI systems that can actively pursue complex academic tasks with minimal oversight. This isn't just Google's goal — it's an express aim of many major AI developers.

Second, AI will have increasing access to context-sensitive data. For those of us already working to connect AI with such data (like my department course scheduler project), we know its capabilities are remarkable when properly integrated with domain information or field-specific knowledge. From small projects like mine to massive initiatives at Apple and Microsoft, the integration of AI with institutional data and workflows is accelerating.

These trends mean that departments and programs that delay restructuring their curriculum and pedagogy around AI will quickly fall behind those that don't. The gap won't just be in efficiency — it will be in the fundamental quality of education they can provide. Students need to learn not just their field's content, but how to leverage AI within it.

This means you, as an early adopter in your department, have a crucial role to play in 2025. Your institution needs more than just AI policies, vague statements from the provost, and monthly reading groups (which, while well-intentioned, don't move any meaningful needles). It needs concrete plans for instructional integration, program restructuring, and faculty training.

Without them, you’ll end up on the wrong side of the latest digital divide.

Stay tuned as I report back on whether I am right.

Next week, I give my take on how well Deep Research works in its current form. (And if you have any tough problems for me to test o1-pro with, email me.)

🤖 New Custom GPT Course
& Other Updates

2025 brings many changes to AutomatED…

Weekly Newsletters Again but Shorter

I know that my newsletters are often too long and you’re always too busy. In 2025, I’ll be working hard to write more concisely.

But this brings a new problem: there is too much going on in AI land, and sometimes a deep dive is necessary for a tricky ethical, pedagogical, or technical issue.

Solution: I keep you updated with weekly newsletters, and you can get ✨Premium or come to the monthly webinars if you want deep dives.

Custom GPT Course

The course is now live on LearnWorlds (our e-learning host), and you can access it via this link:

I think you’ll like it a lot. Beta feedback has been very positive so far!

If you are a ✨Premium subscriber, your discount code for 20% off is immediately below:

✨Premium Improvements

2025 brings some big improvements to ✨Premium subscriptions — while the price remains the same ($99 per year):

• Free Access to Monthly Webinars

  • Going forward, webinars are free for paying subscribers. (Previously, Premium subscribers got 60%-off discounts.) They’ll also be cheaper — and, once per semester, free — for everyone else.

  • My next webinar will occur at the end of January, on a topic to be decided in polls (see below).

  • My last webinar, on December 6th, concerned “How to Use AI to Improve & Accelerate Student Feedback.”

• Discounts on Courses

  • I’ve been working on interactive courses with Charlie Fuller, an e-learning expert. The first one is on custom GPTs and costs $25, but ✨Premium subscribers get a 20% discount (see above).

  • We plan to release 5-10 more courses in 2025.

• Premium Sections in Weekly (Free) Newsletters

  • After this week, there will be a section in every Monday’s (free) newsletter that is only for Premium subscribers. I’ll include polls to help determine what information Premium subscribers want me to provide there, but it will definitely include prompting techniques, commentary and predictions, and insights into more advanced uses of AI.

• Free 1-Hour Consultation with Me Each Year

  • In addition to my presentations, I consult with dozens of professors each semester about their tech-related pedagogical questions/challenges, and I build custom AI tools for them, too. As a Premium subscriber, you’ll have access to an hourlong free consult each year where we can discuss anything you’d like.

• No Sponsor Advertisements Shown to You

This is in addition to all pre-existing ✨Premium benefits (all 17 Guides and Tutorials accessible here):

• Comprehensive Pedagogy Guides

• AI Use Case Tutorials

• AutomatED AI Tools

• Two New Premium Pieces Per Month

  • I’ve got a bit of a backlog right now, but at least the following 6 pieces will be sent in January and February:

    • Tutorial: Anonymize Canvas Submissions in Microsoft 365

    • Tutorial: How Profs Can Use Copilot in Microsoft 365

    • Tutorial: How Profs Can Use Gemini in Workspace

    • Tutorial: How to Use Google’s LearnLM

    • Tutorial: Zapier for Professors and Learning Specialists

    • Tutorial: How to Teach With Google’s Deep Research

January’s Webinar

As I mentioned at the end of last year, I am going to turn to more advanced topics more generally in 2025, in my ✨Premium content and in my paid webinars. Free newsletters and free webinars will stay more focused on the basics and keeping everyone up to speed.

The next webinar will be paid but free for ✨Premium subscribers. Please let me know via the below poll what you’d like it to cover (after you make a selection, you will be redirected to the website where you can also offer typed comments, if you want):

If I were to do one on custom GPTs, Gems, and Claude Projects, I would focus on topics about custom GPTs, Gems, Projects, etc. that are not covered in my pre-existing Tutorial or the new course. Topics like: API connections, workflow optimization, when to pivot to Zapier and LLMs’ APIs, etc.

🧪 AI Department Course Scheduler:
It’s Here

After 3 months of development, my department course scheduling AI tool is now ready.

The system can handle faculty-to-course assignments, course-to-room scheduling, or both, working directly with your existing spreadsheets and faculty preference data — no format changes needed and no proprietary forms.

Given the costs of developing the tool, running it, maintaining it, and ensuring user satisfaction with its outputs, I am now treating it as a “product” of AutomatED that I’ll offer at a (very low, relative to the market) price.

For the January-March scheduling period, I have about 20 remaining slots available.

I’m offering “beta” participants the following:

• Free initial compatibility check of your existing data (I prove to you that it can do your upcoming semester by doing your prior semester)

• Promised 5-day turnaround on optimized schedules

• Multiple revision cycles for adjustments (you’d be surprised how many contradictions, ambiguities, lacunae, etc. exist in the average dataset I encounter)

• Early access pricing

Interested?

The first step, in most cases, is to email me a sample of your past scheduling materials (Fall 2024 would be ideal) for a compatibility assessment.

But feel free to reach out to discuss first, if you’d like…

Note: I hope to have a self-supported web interface live in February. For now, beta interactions are via email with full support.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

In this last piece for 2024, I share…

1. the top 10 links you clicked this year

2. the top 4 newsletters by web views this year

3. the top 3 newsletters by click rate this year

4. the top 3 newsletters by email open rate this year

Let’s see what you — and the nearly 5000 other higher educators subscribed to AutomatED — found interesting and useful this year!

Last time I emailed you, I outlined seven tech- and AI-related tasks for professors to consider completing before the spring semester:

• experiment with the latest AI tools

• review past teaching performance

• update your course design

• build custom AI assistants

• organize your non-AI technology

• consider AI's role in your research

• take time to rest

Check it out via the link above if you missed it in the holiday rush…

I also announced that I have been collaborating with learning experience maestro Charlie Fuller on an interactive and engaging course that walks you through building custom GPTs. By the end, you have at least one custom GPT, fully ready to deploy. This course is like giving steroids to my ✨Premium Tutorial on the topic. It will be released next week.

If this interests you, express interest via the poll below so we can keep you in the loop:

Now, for this week, I’ve dug through my analytics dashboard to extract several lists of the top AutomatED content from the past year.

I know it’s easy to have missed important tidbits when so much is going on with tech and AI right now.

And it doesn’t help that I send so many emails... Apparently, I’ve sent 144,400 this year, across all subscribers:

But what do I mean by “top AutomatED content”? I am referring to what you — my {{active_subscriber_count}} subscribers (~70% PhDs) — opened and clicked, as well as what garnered the most interest from web viewers. (Most web viewers are not subscribers, and they arrive via direct links or organic search.)

Below are four sections:

1. the top 10 links you clicked

2. the top 4 newsletters by web views

3. the top 3 newsletters by click rate

4. the top 3 newsletters by email open rate

Stay tuned next week for my thoughts on where AI is headed in 2025, what to keep an eye on if you are going to be teaching, and my plans for AutomatED.

Thanks for a great year!

🔗 Top 10 Links from 2024

1. “Microsoft Education AI Toolkit: A navigator for education institutions to plan their AI journey" by Microsoft

2. “Empowering Education Leaders: A Toolkit for Safe, Ethical, and Equitable AI Integration” by the DOE’s Office of Educational Technology

3. “How Close is AI to Taking Over the Role of the Instructional Designer” by Philippa Hardman

4. “Course Design Wizard - a custom GPT designed to help professors and other university/college educators create better assignments, rubrics, and course syllabus policies in the AI era” by me

5. “Learn how to write AI prompts in 5 easy steps with this new course from Google” by Google

6. "Claude 3.5 Sonnet for sparking creativity" by Anthropic (click the below image; it’s a YouTube video)

7. “How I Use ‘AI’” by Nicholas Carlini (Google engineer/researcher)

8. Google AI Studio (where you can access Google Gemini, LearnLM, etc for free)

9. Survey on “Generative AI and Postsecondary Instructional Practices” by Ithaka S+R

10. Moral AI by Jana Schaich Borg, Walter Sinnott-Armstrong and Vincent Conitzer

🌐 Top 4 AutomatED Pieces from 2024,
by Web Views

✨Tutorial: How to Build (Better) Custom GPTs

A comprehensive how-to for the ultimate (and now free) tech tool for personalization.

automatedteach.com/p/tutorial-how-to-build-custom-gpt-tutor

10 Ways I Use LLMs like ChatGPT as a Professor

ChatGPT-4o, Gemini 1.5 Pro, Claude 3.5 Sonnet, custom GPTs - you name it, I use it. Here's how...

automatedteach.com/p/10-ways-to-use-llms-ai-chatgpt-professor

✨Guide: How to Train Students to Use AI

Helping you teach your students to use AI, in general and for field-specific tasks.

automatedteach.com/p/guide-teach-train-students-how-to-use-ai

GPT-4o is Here and GPT-4 + Custom GPTs are Now Free

Plus I release a custom GPT-4o for digitizing anything handwritten.

automatedteach.com/p/gpt4o-custom-gpts-handwritten-student

Keep your meeting data safe

Worried about all the AI bots joining your meetings?

Fellow is the only AI meeting assistant built with security controls and permissions.

Thousands of organizations rely on Fellow to capture their meeting transcripts, summaries, and action items – all in one secure platform.

Claim 90 days of unlimited AI notes today… and stop sharing your meeting data with AI note-takers that lack proper security.

Get started free

🖱️ Top 3 AutomatED Pieces from 2024,
by Click Rate

Claude 3 for Lesson Planning, and Positioning AI Well

Can Sonnet outperform ChatGPT?

automatedteach.com/p/claude-3-lesson-planning-positioning-ai-well

How to Cite AI

Should students shirk credit for AI-generated work? Plus, SearchGPT and the Canvas+Khan collab.

automatedteach.com/p/how-to-cite-ai-mla-apa

AI Training and Developing Good Judgment

I discuss a common misunderstanding, highlight amazing recent AI advances, and ask for your input.

automatedteach.com/p/ai-training-students-judgment

✉️ Top 3 AutomatED Pieces from 2024,
by Email Open Rate

AI Literacy and "Technical" Knowledge

Plus, my upcoming webinar on using AI for feedback.

automatedteach.com/p/ai-literacy-and-technical-knowledge

ChatGPT's Search Engine is Here

Plus, a Dec. 6 webinar on using AI for feedback.

automatedteach.com/p/chatgpt-search-engine-is-here

Don't Let AI Make You Forget "Dumb" Tech

Especially when it can enhance AI. Take the case of Google's underrated Apps Script.

automatedteach.com/p/gemini-gmail-to-google-docs-apps-script

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

In this second-to-last piece for 2024, I…

• outline 7 tasks you might consider doing in the next few weeks, including one that probably shouldn’t be called a ‘task’

• share the latest AI news, including some surprising developments from the big dogs

• and reflect on my free webinar from December 6th (and ask for your opinion about the next one)

Let’s dive in!

💡 7 Tasks to Do Before Spring

When I give talks, trainings, and webinars, many professors report to me that they appreciate it when I reveal more of my own views and predictions on the “state of play” of the AI-education space, especially during Q&A periods (I guess that’s when I loosen up a bit).

I figure now is a good time to do something analogous here, with a focus on what tasks I personally think you should be working on now.

Here they are, in rough order of operations…

1. Experiment With the Latest AI

The AI landscape is constantly evolving — the amount of money, effort, and intellectual firepower involved in developing and improving AI tools is absolutely massive right now — and it has shifted dramatically in just the last few weeks. As I detail in my “Quick Hits” news section below, we're seeing groundbreaking developments from both Google and OpenAI, from autonomous research assistants to more powerful language models to sophisticated video generation tools.

If you haven't hands-on tested these tools recently, your mental model of AI's capabilities is outdated. The rate of development makes staying up to date hard, but being outdated is a matter of degree, and you don’t want to be too far out of date, whether as a teacher or as a researcher.

In other words, this isn't just about staying informed in an abstract sense — it's about understanding how these advances impact your field.

For instance, Google's new Gemini 2.0 (which I explain below) isn't just another incremental update; it's being implemented now to deploy supervised "agentic" capabilities that could transform how we approach complex academic tasks. Google launched "Deep Research," an AI research assistant in Gemini Advanced that can autonomously explore complex topics across the web and compile comprehensive reports with source links. Meanwhile, OpenAI's new premium LLM “o1 pro mode” is showing unprecedented reliability on advanced academic problems. (Below, I ask you to send me any tough problems to feed to the beast; I bought it for a month, for science.)

Take advantage of this time to experiment with these tools in your specific domain.

Sure, you can also read about what they can do, but I think you can’t just read about them — you need to test them with real academic challenges from your field and your own classes, especially given you have unique expertise and knowledge. Your firsthand experience with these tools will help you make informed decisions about how to integrate them into your teaching, how to modify your methods to avoid their pitfalls, and how to guide your students in using them effectively.

Relevant Resources:

ChatGPT’s Search Engine is Here
AI That Can Click and Type?!
GPT-o1’s Arrival is Pivotal
Google’s Custom GPTs (Gems) are Here

2. Review How Last Semester Went

Now that grades are submitted, it's worth taking a systematic look at how your courses went. Tools like ChatGPT's Advanced Data Analysis can help analyze your (anonymized) gradebook data in ways that weren't easily accessible before. Beyond simple grade averages, you can explore correlations between different assignments, identify where students consistently struggled, and spot patterns across different types of assessments.

The data might surprise you. Perhaps those early writing assignments weren't actually predictive of final essay performance, or maybe quiz scores in certain units highlighted conceptual gaps that persisted throughout the term. Understanding these patterns can help you adjust your approach for spring — whether that means restructuring assignment sequences, rethinking assessment types, or identifying where students need additional support.

Just as importantly, reflect on how AI impacted your teaching this past term. What worked about your AI policies and what needed clarification? Were students asking for more guidance on appropriate AI use in specific contexts? Did you notice any patterns in how students incorporated (or misused) AI tools? Taking stock now, while the semester is fresh in your mind, will help you make thoughtful adjustments for spring (a topic I cover in the next item on this list).

Relevant Resources:

✨Tutorial: How to Analyze your Teaching with ChatGPT
✨Guide: How to Ethically Use AI with Student Data
GPT-4o Democratizes Data Analysis

3. Engage in AI-Sensitive Course Design

The break between terms is your chance to fundamentally rethink your courses through an AI lens. With new AI tools emerging every other month and students becoming increasingly sophisticated in their use, last semester's course design might already be outdated. This isn't just about tweaking a few assignments — it's about reimagining your entire course structure, assessment methods, etc.

Start by evaluating each assignment and assessment against current AI capabilities. Which ones are still achieving their intended learning objectives, and which have become vulnerable to AI shortcuts? Consider whether traditionally written assignments might work better as oral presentations, or if take-home essays should shift to in-class writings. Multimedia is still a big challenge for AI. But remember that format changes alone aren't enough — you need to think about content too. Tasks requiring specialized knowledge application or complex, multi-step reasoning often remain more resistant to AI than those asking for simple synthesis or summary, although this gap is shrinking (see above).

But don't just focus on preventing AI misuse. Think about where AI tools could actually enhance learning in your course. Could a custom GPT help students brainstorm research topics? Might ChatGPT serve as a practice partner for language learners? The key is designing a course that thoughtfully incorporates AI where it adds value while maintaining the integrity of core learning experiences that need to remain AI-free.

Finally, reflect on whether you want to fundamentally change the paradigm around your use of student data, with AI or otherwise. If, for instance, there are tons of ways to use student data that you wish you had student consent to carry out, now’s the time to implement a way to acquire and manage informed student consent.

Relevant Resources:

✨Guide: Designing Assignments and Assessments in the Age of AI
✨Guide: How to Train Students to Use AI
✨Guide: How Professors Can Discourage and Prevent AI Misuse
✨Guide: Crafting Your Syllabus' AI Policy
✨Tutorial: Easy Student Consent Management in Microsoft 365
✨Tutorial: Easy Student Consent Management in Google Workspace
3 Strategies to Discourage AI Misuse
The 4-Step Process to Teach Students AI
How to Cite AI

4. Build Custom GPTs, Gems, Projects, … For Each Use Case

Now's also the time to create AI tools tailored to your specific teaching, research, and administrative needs. With custom GPTs, Google Gems, and Claude Projects, you can build AI assistants that understand your context, are encapsulated for a specific use case, and perhaps even shareable. The key is to develop these tools before the semester starts, when you have time to test and refine them.

Start by identifying specific use cases where AI could enhance your teaching, say. Maybe you need a feedback assistant to help grade more efficiently, a course design wizard to help plan assignments, or a tutor to guide students through complex problem-solving.

Building these tools effectively requires careful planning and testing. Your instructions need to be clear and comprehensive, your knowledge base needs to be well-organized and relevant, and you need to experiment with different approaches to find what works best.

Relevant Resources:

✨Tutorial: How to Build (Better) Custom GPTs
Google's Custom GPTs (Gems) are Here
GPT-4o is Here and GPT-4 + Custom GPTs are Now Free

5. Get Your “Dumb” Tech Sorted Out, Too

While we're all excited about AI (or maybe it’s just me…), don't forget about the basic tech tools that can make your life easier. Here are four quick wins to implement during your break:

First, set up automated shortcuts for your daily routines. Whether using Apple Shortcuts, Windows Power Automate, or Google App Script, create simple automations for repetitive tasks: launch your morning browser tabs in one click, display your daily meeting schedule at a glance, or create a pipeline from voice notes to email drafts. These small time-savers add up.

Second, declutter your digital workspace. Clean up your inbox with rules that automatically sort incoming emails (e.g., student emails by course section, department announcements, or committee work). Archive old files, organize your cloud storage, and create a logical folder structure for the upcoming semester.

Third, optimize your notifications. Most of us have our devices interrupting us hundreds of times daily. Take 30 minutes to audit your notification settings: silence non-urgent apps during teaching hours, set up VIP contacts for important messages, and create focus modes for different types of work (grading, research, meetings).

Fourth, configure your browser for efficiency. Set up bookmark folders for each course, install useful extensions like Zotero for research management or Grammarly for typo catching, and organize your tabs into groups by project or course.

Relevant Resources:

✨Tutorial: How to Use AI with Canvas LMS
✨Tutorial: Anonymize Canvas Submissions in Google Workspace
Don't Let AI Make You Forget "Dumb" Tech

6. Reflect on AI’s Role in Your Research

The AI capabilities that are transforming teaching are equally revolutionary for research. With tools like Google's Deep Research assistant (see above), ChatGPT Pro's enhanced academic reliability, and specialized research models being deployed at major institutions, now is the crucial time to consider how AI fits into your scholarly work.

We’re getting to the point that AI can help with almost any text-related tasks, including highly advanced ones like your research. You don’t want to look up in 2026 or 2030 and be woefully behind a paradigm shift in methodologies.

Consider setting up a controlled experiment with your own research: take a small piece of your current work and try processing it through different AI tools. Test Perplexity for literature review, see how ChatGPT Pro handles complex theoretical analysis in your field (or send me a sample challenge for me to do it), or explore how these tools might help with data analysis or writing.

Relevant Resources:

✨Tutorial: How to Draft Grant Applications with Gemini
10 Ways I Use LLMs like ChatGPT as Professor

7. Take a Nap

No, seriously! You deserve it.

📢 Quick Hits:
AI News and Links

1. Google launched "Deep Research," an AI research assistant in Gemini Advanced that can autonomously explore complex topics across the web and compile comprehensive reports with source links. The feature, available now on desktop and coming to mobile in 2025, represents Google's first "agentic" feature that can perform multi-step tasks under user supervision.

This is a development educators should take a close look at — and keep an eye on through 2025. I will do a deep dive on it early in the new year.

2. The launch of Deep Research is part of Google’s announcement of a new frontier model, Gemini 2.0 that is especially well-suited for "agentic" capabilities that allow the AI to take actions on users' behalf (with supervision). Key features include native image/audio output and tool integration. They're also showcasing research prototypes like Project Astra (for phones/glasses) and Project Mariner (for web browsing), though access is currently limited to “trusted testers.” 2.0 Flash, an experimental version, is available now in the Gemini app.

3. Finally, Google updated NotebookLM with three major changes: a new three-panel interface for better content management, interactive voice conversations with AI hosts during Audio Overviews, and a premium "Plus" subscription for power users that offers 5x higher usage limits. The Plus version will be included in Google One AI Premium in early 2025.

4. OpenAI announced ChatGPT Pro, a $200/month tier giving access to their most powerful models including a new more compute-intensive "o1 pro mode" (as well as higher usage limits on "o1," "o1-mini," and "GPT-4o"). The pro mode showed significantly better reliability on PhD-level science questions and coding challenges, with OpenAI announcing plans to award initial grants to medical researchers at leading institutions.

OpenAI, “Introducing ChatGPT Pro”

I went ahead and bought it for one month (for science). Please email me with any hard problems you want me to give to it from your field and I will report back on the results, unedited:

(Also, at the start of the new year, I will be discussing the growing disparities in model access that I predict are coming — as well as why there are still a lot of bright sides of the coming year of AI.)

OpenAI also released Projects, which help you organize your chats, and launched Sora Turbo, an improved version of their text-to-video model, available now on sora.com to ChatGPT Plus and Pro subscribers. The new version is significantly faster and includes features like 1080p resolution, 20-second videos, and a storyboard tool. Notably, all generated videos will include C2PA metadata for transparency and verification, with strict safeguards against misuse like deepfakes. (Be sure to check out Google’s Veo 2, too.)

5. A small study in Computers & Education found that students using ChatGPT for help with essay writing showed markedly different patterns than those working with human teachers. Students using ChatGPT tended to skip evaluating the help received and jumped straight to implementation, while also showing more "executive help-seeking" behaviors (asking for direct answers rather than guidance). The researchers suggest this indicates a need for better scaffolding to ensure students engage metacognitively when using AI tools.

6. Microsoft released Phi-4, a small LM that “excels at complex reasoning in areas such as math, in addition to conventional language processing” and like, Meta Llama 3.3, a new free open-source LLM you can run on your own computer, is comparable in performance to GPT-4. Remember: GPT-4 was released in March 2023 and was far ahead of all others for 6+ months; it’s the model that powered ChatGPT to popular awareness. (This is related to the “bright sides” I mentioned above.)

7. Google DeepMind's new AI weather forecasting model "GenCast" has achieved unprecedented 15-day forecasts, outperforming the European Center for Medium-Range Weather Forecasts (the current world leader) 97.2% of the time. Unlike traditional supercomputer forecasting, GenCast learns weather patterns from 40 years of historical data and can generate probabilistic predictions much faster. (Original paper in Nature here. Discussion in the New York Times here.)

✉️ What You, My Subscribers, Are Saying

My December 6th Webinar
on Feedback & Assessment

Two weeks ago, I hosted my last webinar of 2024 on "How to Use AI to Improve & Accelerate Student Feedback." With nearly 100 educators signed up, we explored concrete strategies for using AI to provide better feedback faster while maintaining student data privacy. The 90-minute session included live demonstrations of ChatGPT, Claude, and custom GPTs for feedback generation, along with detailed discussions of ethical considerations and implementation strategies.

The response was overwhelmingly positive, with attendees especially appreciating the practical, hands-on approach and ready-to-use prompts for different teaching contexts. As with previous webinars, all attendees received the full recording, slides, AI-generated summary, and several Premium resources focused on AI-assisted feedback and student data privacy.

Thanks to all who attended or engaged with me after viewing the recording.

Your Comments

Here are some of your comments:

Thanks for the feedback!

What Should the Next One Cover?

Now the question is:

Please tell me your answer, if you didn’t get a chance to do so last week (note: after you make a selection, you will be redirected to the website where you can also offer typed comments, if you want):

I did get a good comment/question from one attendee of the webinar who is a Premium subscriber. If I were to have a webinar on how to build custom GPTs, the person asked me whether there be a lot of overlap with my pre-existing ✨Tutorial: How to Build (Better) Custom GPTs:

In short: I am going to turn to more advanced topics more generally in 2025, in my Premium content and in my paid webinars. Free newsletters and free webinars will stay more focused on the basics and keeping everyone up to speed, but the webinar at issue here would focus primarily on topics about custom GPTs, Gems, Projects, etc. that are not covered in my pre-existing Tutorial. Topics like: API connections, workflow optimization, when to pivot to Zapier and LLMs’ APIs, etc.

This is especially true since Charlie Fuller and I are about to release a course on basic- and intermediate-level aspects of custom GPT creation (see above).

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

📣 Friday's AI Feedback Webinar Now Free!

After conversations with many of you about the end-of-semester crush, I've decided to make this Friday's webinar on "How to Use AI to Improve & Accelerate Student Feedback" free.

‘Tis the season!

(This also marks the start of me offering one free professional development session each semester.)

You can register simply by clicking “Yes” below (that’s all it takes to register; after a brief delay, you'll receive the Zoom link and pre-webinar materials via email).

Note: Attendance is still capped at 75 to ensure meaningful interaction.

What You'll Learn

In this 90-minute session (Friday, December 6, 12-1:30pm EST on Zoom), I'll show you how to:

• Use AI to provide better feedback faster while maintaining student data privacy

• Implement concrete strategies for efficient grading workflows

• Apply ready-to-use prompts for your specific teaching context

Even if you cannot attend live, you will still receive:

1. Complete webinar recording, AI-generated summary, and presentation slides

2. Three free ✨Premium pieces:

   • Tutorial: How to Build (Better) Custom GPTs

   • Guide: How to Ethically Use AI with Student Data

   • Tutorial: How to Anonymize Canvas submissions with Google Workspace

3. Several feedback-specific prompts for common assignment types

How to Join

Simply click “Yes” in the following poll to register and you'll receive the Zoom link and pre-webinar materials after a brief delay (clicking “Yes” is all it takes to register).

Note: All previous registrants will receive full refunds today.

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

In this week’s piece, I…

• share 3 easy ways to use AI to make the end of the semester hurt less

• reflect on last week’s reflection on AI literacy (and share your responses to the poll)

• explain which topics institutions request that I speak to them about (note: January’s booked solid)

• and explain why I’m excited about Google’s now-available LearnLM

Let’s dive in!

🧰 3 AI Use Cases for Your Toolbox:
Semester’s End Edition

For Accelerating Grading and Feedback

At the end of the year, it’s rewarding to see how far your students have come.

However, it’s very draining to grade and give feedback at scale, especially if you have a backlog by this time in the semester/term (and a lot of students).

AI can help you grade faster while maintaining quality. You can sign up for my upcoming December 6th webinar on AI-assisted feedback to learn a range of strategies, or try the one I explained in my spring piece on how I use ChatGPT to grade 2-3x faster.

For the latter, you use an LLM to convert your rough notes on each student’s work into polished ones in a target format; you focus on content, the LLM focuses on presentation. By only inputting your own notes, not student work, you maintain student data privacy.

You can kick it up a notch by creating a custom GPT or Google Gem for the purpose. (By the way, as of a recent update, you can now upload up to 10 files to each Gem, giving them additional context to provide more tailored and helpful responses.)

✨Relevant Premium Resources:

GPT: Educational Feedback Accelerator (pre-built GPT for this purpose)
Tutorial: How to Build (Better) Custom GPTs
Tutorial: Grading Handwritten Multiple-Choice Quizzes with ChatGPT Vision
Guide: How to Ethically Use AI with Student Data

For Making Office Hours More Productive

I find that end-of-term office hours often involve answering the same questions repeatedly. There is convergence in the content that my students are confused about, and there is convergence in how they ask about it.

Although you could address this issue with whole-class “office hours” that take place during normal teaching periods, there are downsides to that approach: you lose invaluable instructional time, students often haven’t thought enough about what they are curious about, they are shy in front of their peers, etc.

Here's how to use AI to enhance student meetings, which are typically one-on-one, so that they fill this gap and are more efficient for everyone:

1. Make office hours virtual

2. Record your office hours sessions using your institutional or preferred virtual meeting platform (e.g. Zoom, Microsoft Teams, or Google Meet)

3. Use your platform's built-in AI features — like Zoom AI Companion — to generate detailed transcripts from the recording, or use a data-safe LLM to do the same

4. Use another data-safe LLM like your institution’s Microsoft Copilot or Gemini for Workspace to extract and anonymize key Q&A pairs from these transcripts

5. Copy/paste these anonymized Q&A pairs into a shared cloud-hosted Google Doc or Word document for all students to reference

6. You can also make viewing this document a precondition on accessing your office hours sign-up link on, e.g., Calendly, if you use one

This approach respects student privacy while avoiding duplicate questions and saving everyone time — and helping those who couldn't or don’t want to attend.

✨Relevant Premium Resources:

Tutorial: How to Integrate Zoom AI Companion with Google Workspace
Tutorial: How to Integrate Zoom AI Companion with Microsoft 365
Tutorial: How to Run Open-Source Local LLMs on Your PC for Privacy
Guide: How to Ethically Use AI with Student Data

For Analyzing Areas for Review

End-of-term review sessions are more effective when guided by data.

Using the methods from my free newsletter from June on how ChatGPT’s Advanced Data Analysis tool democratizes data analysis for educators, you can analyze patterns in your anonymized gradebook before final exams or papers in order to address gaps in your students’ understanding.

One option would be to upload your anonymized current grade data and ask the AI to analyze statistically significant correlations between different assignments to identify weaknesses in how you scaffolded to end-of-semester summative assignments. You can then recognize which formative assignments — intended to prepare students and inform you about their understanding — fell short in their desired effect and need to be remediated in review.

Or, for targeted interventions, you could upload the same file and look for individual student performances that are significantly worse, statistically, than those of their peers.

Or you could do the same with assignments themselves, in order to inspect their content for areas where the whole class slipped.

This approach helps you prioritize review topics and target specific concepts where students need additional support.

✨Relevant Premium Resources:

Tutorial: How to Analyze your Teaching with ChatGPT
Guide: How to Ethically Use AI with Student Data

🤖 AutomatED Updates

📝✅ December 6th Webinar:
On Feedback & Assessment

Given the positive response to our recent webinars, I will be hosting one final Zoom webinar for the year. The topic: accelerating and improving feedback with AI.

You can check out the dedicated webinar webpage for more detail or sign up directly below, but the following bullet points convey the highlights.

Dates and Numbers

• Location, Date, Time: Zoom on Friday, December 6th from 12pm to 1:30pm EST

• Standard Price: $150

• Early Registration Price: $75

• ✨Premium Subscribers’ Price: $60 (discount visible on webinar page for logged in users)

• Early Registration Deadline: Monday, December 2nd at 11:59pm

• Total Available Seats: 50

• Minimum Participation: 20 registrations by Monday, December 2nd; if we do not reach 20 registrations by this date, all early registrations will be fully refunded and the webinar will be canceled/rescheduled

• Money-Back Guarantee: You can get a full refund up to 30 days after the webinar’s date, for any reason whatsoever

What To Expect

1. Live 90-Minute Interactive Webinar on Zoom:

   • Framework for evaluating when and how to use AI in feedback

   • Live demonstrations of feedback generation with ChatGPT, custom GPTs, and Claude

   • Practical strategies for maintaining student data privacy

   • Concrete examples of using LLMs as mentors, student simulations, and teaching assistants

   • Extended ethics discussion and Q&A session (with me, Dr. Graham Clay)

2. High-Value Post-Webinar Resources:

   • Complete video recording, AI-generated summary, and presentation slides

   • Three complimentary ✨Premium pieces:

     • Tutorial: How to Build (Better) Custom GPTs

     • Guide: How to Ethically Use AI with Student Data

     • Tutorial: How to Anonymize Canvas Submissions with Google Workspace

   • Curated collection of feedback-specific prompts for common assignment types

🧪 Beta Test Next Week:
AI Course Scheduler

The beta version of my AI department course scheduler is now ready for trials, with beta participants being contacted with details next week.

The tool accepts your existing faculty preference spreadsheets and scheduling data — no need to change your current data collection process — and then uses AI to interpret and analyze this information like a human scheduler would. The ultimate result is faculty-to-course assignments (and optional room scheduling), all while respecting and optimizing within your constraints.

Interested? Email me to:

• Join beta testing to receive a discounted rate going forward

• Get notified when it's publicly available

• Learn more about pricing and features

Know someone who handles scheduling? Please share this with them!

Consultations and Presentations

My January external webinar/presentation calendar is now full with 6 sessions booked at institutions around the globe.

Popular sessions include big-picture primers to get whole departments or institutions up to speed on AI pedagogy, deep dives on custom GPTs (or Gems) and how to build a community of practice around them, and training students to use AI. (Not to mention the ever-popular AI misuse prevention talk.)

Limited February and March slots remain for these sessions, as well as for one-on-one AI pedagogy consultations and custom AI workflow development.

Interested in one of these? Feel free to schedule a free 30-minute exploratory call or email me:

✉️ What You, Our Subscribers, Are Saying

On AI Literacy

In my “Idea of the Week” last week, I reflected on a paradox I encountered while building an AI-powered faculty-to-course scheduler: while it seems you'd need deep technical knowledge to effectively use AI for complex tasks, sometimes the reverse is true. I argued that with sophisticated enough prompting skills and broad domain understanding, you can often acquire technical knowledge along the way through AI itself.

This challenged my previous stance that field-specific expertise was always necessary for effective AI use. (See here for a free piece on this topic, and see here for a ✨Premium deep dive on it.) I explored how this "prompting paradox" might suggest a new kind of technical literacy — one more focused on problem decomposition and AI communication/management than traditional technical skills.

In a poll, I asked you to weigh in on what AI literacy requires, offering options ranging from prompting ability (option A) to pre-existing domain expertise (B) to an understanding of AI itself (C) and of AI ethics (D).

While my “Idea of the Week” expressed a shift toward emphasizing prompting skills over pre-existing domain knowledge, I want to note that two factors shaped my evolving view. These have become clearer to me after thinking about this topic more.

First, my course scheduler project benefits from clear empirical testing at each stage — I can verify if the AI-generated code works, whether there are errors, etc. without needing deep programming expertise. This isn't true in many other contexts where external validation isn't available (in a timely fashion, at least), making pre-existing knowledge more crucial.

Second, as AI systems become increasingly reliable at producing high-quality outputs regardless of prompting approach, the importance of pre-existing domain expertise may diminish. Just as we need less technical oversight when working with highly competent human specialists, the game changes when AI reliability reaches a certain threshold. AI can complete relatively straightforward coding tasks with great reliability already. This may have been skewing my thinking.

Anyway, without further ado, here are the results of the poll:

Here are some of your comments:

Feel free to share your thoughts if you didn’t get a chance to do so last week:

👀 Google’s LearnLM is Here

Google has released LearnLM, an experimental task-specific model fine-tuned to align with learning science principles, for all to access. Available for free through Google AI Studio, Google claims LearnLM excels at inspiring active learning, managing cognitive load, adapting to learners, stimulating curiosity, and deepening metacognition. The model comes with pre-built system instructions for various educational tasks like test prep, concept teaching, text releveling, guided learning activities, and homework help. Each instruction set is carefully designed to implement specific learning science principles while maintaining engagement and effectiveness.

Model selection options in Google AI studio.

From my perspective, the challenge for (higher) educators lies in getting LearnLM into students' hands via user-friendly interfaces. While students can access it directly through Google AI Studio, this isn't ideal for structured learning environments. I’ve written a lot about how Google AI Studio can be used by educators for uses like quiz creation and writing grant applications, but LearnLM is a model that has its greatest potential when used by the students themselves.

I think the most promising deployment options would be through Google Gems (if Google enables LearnLM as a model choice) or via API integration with other educational tools like custom GPTs.

I am exploring ways to easily deploy LearnLM for student use in a future ✨Premium Tutorial. It would be nice to deploy LearnLM to create adaptive homework help systems, build scaffolded writing assistants that grow with student ability, develop interactive exam prep tools, or … .

More soon!

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

In this week’s piece, I consider the relationship between knowing how to use AI effectively and technical knowledge. I also remind readers that sign ups are open for a December 6 webinar on using AI for feedback on student work.

💡 Idea of the Week:
What is AI Literacy?

I’ve been thinking a lot lately about AI literacy.

Here's a paradox of AI prompting I’ve been debating with myself: while it seems you'd need deep technical and field-specific knowledge to effectively use AI for challenging and complex tasks, sometimes you need none if you have more general skills.

With sophisticated enough prompting skills, general problem-solving abilities, and broad domain understanding, you can use AI to acquire the technical knowledge you need along the way.

And this includes technical knowledge of how AI works; often, you don’t need much of it to prompt AI effectively. (However, I will note that a lack of it can be very costly in some specific contexts, and sometimes you don’t know you’re in such a context if you lack this knowledge — yikes!)

In the past, I have argued that you almost always need pre-existing field-specific knowledge and skills to know when AI’s outputs are high quality. (See here for a free piece on this topic, and see here for a ✨Premium deep dive on it.)

I’m not saying I’ve completely changed my mind, but I’m less confident than I was.

The contours of this paradox have become clearer to me over the past few months as I have been developing an AI-powered department course scheduler that takes unstructured faculty, course, and room data as inputs and generates an optimal schedule from it.

I began with little knowledge of Python, linear programming, or optimization libraries that combine the two to create optimal faculty-to-course-to-room assignments. Although I have software development and IT experience, I’m a philosopher by training — analysis, synthesis, logic, and ethics are my strengths — not a computer scientist or mathematician.

What I do have are three crucial things:

1. An advanced understanding of how to prompt LLMs and how to connect their inputs/outputs with information and other software

2. A solid grasp of the problem space: the real-world constraints departments face in scheduling, the outcomes they desire, and — given user-submitted sample data (thanks, guys!) — the spreadsheets and data formats they have historically used to schedule manually

3. A strong foundation in logical and conceptual thinking that enables me to map out the problem and solution space, addressing difficulties along the way

For instance, I could see that any viable solution would need to progress through several stages: raw data extraction, sorting, standardization, and only then optimization.

I could see that there would need to be meta-level error checking at various points, combined with looping to prior points in the workflow as needed.

I knew that optimization algorithms become very costly to run at certain orders of complexity, so the hard work to shortcut and reduce constraints prior to optimization would pay off later.

This logical scaffolding has helped me guide the AI toward teaching me the technical skills I needed, precisely when I needed them. My effectiveness hasn’t come from a wealth of pre-existing computer science knowledge. Instead, it stemmed from knowing how to break down complex prompts, maintain context across long exchanges, and iteratively refine outputs — techniques I've developed and shared in my free newsletter and in my ✨Premium Tutorials on advanced prompting.

When I needed to learn constraint programming, I didn't take a course; I engaged in focused dialogues with AI, using my understanding of both the scheduling problem's logic and LLM capabilities to acquire specific technical knowledge in context.

But here's a powerful counterargument: perhaps what I'm calling "advanced prompting skills" is itself a form of programming literacy — a kind of meta-technical knowledge that's just as demanding as traditional computer science expertise.

After all, the ability to break down complex problems, maintain structured dialogues, and guide AI through sophisticated technical tasks requires many of the same cognitive skills as software development.

Could it be that I'm not really bypassing the need for technical knowledge, but rather shifting it to a higher level of abstraction?

This tension raises questions about the future of AI literacy and expertise, the answers to which I am not confident about.

If I'm right, we should focus on teaching students and faculty how to be sophisticated AI communicators and logical problem decomposers, rather than loading them up with traditional technical knowledge.

But if my objector is right, we need to recognize that advanced prompting is itself a technical skill — perhaps even a new kind of programming paradigm — and adjust our curriculum accordingly.

Either way, one thing is clear: the traditional boundaries between "technical" and "non-technical" expertise are blurring, and our approach to education must evolve to reflect this new reality.

Perhaps the best analogy is to effective technical team management, a topic I covered months ago when I first thought more deeply about the parallels. A skilled technical manager doesn't need to know every programming language their team uses, but they do need to understand system architecture, problem decomposition, and how to communicate effectively with specialists. They rely on team members for implementation details while maintaining oversight of the larger solution space.

My interaction with AI on the course scheduler mirrors this dynamic — I provided the high-level direction and problem understanding, while the AI filled in technical details about Python syntax and optimization algorithms.

The key difference is that instead of managing human programmers, I'm "managing" AI systems through advanced prompting techniques.

This comparison suggests a third way forward: maybe the distinction between my view and my objector's is less important than understanding how AI is transforming the nature of technical work itself.

Just as the rise of high-level programming languages made software development more accessible without eliminating the need for deep technical knowledge, advanced AI prompting might be creating a new layer of abstraction in technical work — one where success depends on a hybrid skill set combining logical thinking, domain expertise, and sophisticated communication with AI systems.

The question for educators then becomes not whether to teach traditional technical skills or advanced prompting, but how to prepare students for a world where both approaches coexist and complement each other.

But let me know what you think via the poll below (note: I will include anonymized responses in my next newsletter).

📝✅ December 6th Webinar
on Feedback & Assessment

Given the positive response to our recent webinars, I will be hosting one final webinar for the year.

The topic: accelerating and improving feedback with AI.

On October 4th, I hosted a webinar on how to use LLMs like ChatGPT as a professor. Just like my September 6th webinar on how to train your students to use AI, the feedback was very positive, with 100% of responding participants giving it an A (“Excellent!”) afterwards.

Here’s some of the feedback I received:

Let’s keep the party rolling!

You can check out the dedicated webinar webpage for more detail or sign up directly below, but here are the highlights.

Dates and Numbers

• Date and Time: Friday, December 6th from 12pm to 1:30pm EST

• Standard Price: $150

• Early Registration Price: $75

• ✨Premium Subscribers’ Price: $60 (discount visible on webinar page for logged in users)

• Early Registration Deadline: Monday, December 2nd at 11:59pm

• Total Available Seats: 50

• Minimum Participation: 20 registrations by Monday, December 2nd; if we do not reach 20 registrations by this date, all early registrations will be fully refunded and the webinar will be canceled/rescheduled

• Money-Back Guarantee: You can get a full refund up to 30 days after the webinar’s date, for any reason whatsoever

What To Expect

1. Live 90-Minute Interactive Webinar on Zoom:

   • Framework for evaluating when and how to use AI in feedback

   • Live demonstrations of feedback generation with ChatGPT, custom GPTs, and Claude

   • Practical strategies for maintaining student data privacy

   • Concrete examples of using LLMs as mentors, student simulations, and teaching assistants

   • Extended ethics discussion and Q&A session (with me, Dr. Graham Clay)

2. High-Value Post-Webinar Resources:

   • Complete video recording, AI-generated summary, and presentation slides

   • Three complimentary ✨Premium pieces:

     • Tutorial: How to Build (Better) Custom GPTs

     • Guide: How to Ethically Use AI with Student Data

     • Tutorial: How to Anonymize Canvas submissions with Google Workspace

   • Curated collection of feedback-specific prompts for common assignment types

📢 Quick Hits:
AI News and Links

1. ICYMI: Google has launched a new "Prompting Essentials" course to teach effective AI prompting in five steps, building on its AI Essentials course (supposedly Coursera's most popular AI course globally).

2. A new study found that AI-generated poetry is not only indistinguishable from human-written poetry, but is actually rated more favorably by readers. Participants performed below chance (46.6% accuracy) in identifying AI vs human-written poems, and were more likely to attribute AI-generated poems to humans. The researchers suggest this is because AI poems are more straightforward and accessible, making them easier for non-expert readers to understand and appreciate compared to more complex human poetry.

3. A top MBA program, IMD, has reorganized its curriculum around AI, focusing on 10 key human-centered skills including systems thinking, strategic communication, and structured problem-solving.

4. Michael Muthukrishna argues that large language models may solve three fundamental problems in behavioral science: poor theory building, unreliable measurement, and limited generalizability of findings. He suggests AI models could enable rapid testing of social science theories through "synthetic populations" before costly real-world trials — potentially revolutionizing how we validate teaching interventions.

5. Lecturer Alice Evans, whose newsletter generally focuses on gender, has a few pieces on her views on AI in education, spanning topics from device-free learning to gender gaps in AI usage.

6. OpenAI published a guide for students on writing with ChatGPT, emphasizing ways to use AI that enhance rather than shortcut learning. Key suggestions include using AI for citation formatting, getting background on new topics, channeling historical figures for deeper understanding (a topic I’ve covered several times before), and improving flow through iterative feedback. They recommend students generate shareable links to their ChatGPT conversations and include them in bibliographies — this is the most minimal thing I recommended in my more comprehensive reflection on how to cite AI from July.

7. A new randomized trial found that having access to GPT-4 did not improve physicians' diagnostic reasoning compared to using conventional resources like UpToDate. Yet, surprisingly, GPT-4 alone outperformed both physician groups (scoring 92% vs ~75%). The authors suggest effective AI integration requires better training in prompt engineering and workflow design rather than just providing access.

🧪 Call For Interest:
AI Course Scheduler for Departments

As I reported two months ago, I finalizing the beta version of an AI department/school/unit course scheduler.

It accepts as inputs the spreadsheets and narrative data departments currently use for faculty teaching assignments: course lists, faculty preferences, room details, etc. It then interprets these inputs approximately like a human scheduler would.

A standardized input form will be available but optional; I am assuming that most (human) department course schedulers don’t want to try to wrangle their faculty to use it and that they would rather dump in whatever data they currently gather for a human to conduct scheduling.

The system outputs faculty-to-course assignments, can suggest course adjustments within given constraints, and has the option to add a layer for course-to-room assignments.

If you’re interested in this AI tool, email me either to be notified when it's available (at a competitive price point) or to participate in beta testing at a discount.

Email me by responding to this email or clicking the below button:

And if you don’t handle scheduling for your department/school/unit but know who does, tell them about this to help them out!

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!

Welcome to AutomatED: the newsletter on how to teach better with tech.

In each edition, I share what I have learned — and am learning — about AI and tech in the university classroom. What works, what doesn't, and why.

In this week’s piece, I discuss the relevance of ChatGPT search for research and for educators training students to conduct research. I also open sign ups for a December 6 webinar on using AI for feedback on student work, share some recent studies on AI uptake, and explain a high-impact tip for LLM prompting.

📝✅ December 6th Webinar
on Feedback & Assessment

Given the positive response to our recent webinars, I will be hosting one final webinar for the year.

The topic: accelerating and improving feedback with AI.

On October 4th, I hosted a webinar on how to use LLMs like ChatGPT as a professor. Just like my September 6th webinar on how to train your students to use AI, the feedback was very positive, with 100% of responding participants giving it an A (“Excellent!”) afterwards.

Here’s some of the feedback I received:

Let’s keep the party rolling with one final webinar for the year!

You can check out the dedicated webinar webpage for more detail or sign up directly below, but here are the highlights.

Dates and Numbers

• Date and Time: Friday, December 6th from 12pm to 1:30pm EST

• Standard Price: $150

• Early Registration Price: $75

• ✨Premium Subscribers’ Price: $60 (discount visible on webinar page for logged in users)

• Early Registration Deadline: Monday, December 2nd at 11:59pm

• Total Available Seats: 50

• Minimum Participation: 20 registrations by Monday, December 2nd; if we do not reach 20 registrations by this date, all early registrations will be fully refunded and the webinar will be canceled/rescheduled

• Money-Back Guarantee: You can get a full refund up to 30 days after the webinar’s date, for any reason whatsoever

What To Expect

1. Live 90-Minute Interactive Webinar on Zoom:

   • Framework for evaluating when and how to use AI in feedback

   • Live demonstrations of feedback generation with ChatGPT, custom GPTs, and Claude

   • Practical strategies for maintaining student data privacy

   • Concrete examples of using LLMs as mentors, student simulations, and teaching assistants

   • Extended ethics discussion and Q&A session (with me, Dr. Graham Clay)

2. High-Value Post-Webinar Resources:

   • Complete video recording, AI-generated summary, and presentation slides

   • Three complimentary ✨Premium pieces:

     • Tutorial: How to Build (Better) Custom GPTs

     • Guide: How to Ethically Use AI with Student Data

     • Tutorial: How to Anonymize Canvas submissions with Google Workspace

   • Curated collection of feedback-specific prompts for common assignment types

🔎 ChatGPT Search: First Reflections

Last week, OpenAI announced that ChatGPT now has much improved web search capabilities. (This is what had been called the “SearchGPT” prototype, which I reported on in July.)

On the one hand, “ChatGPT search” is a way to supplement ChatGPT’s static knowledge base — its abilities to create text, analyze and produce images, listen and speak with Advanced Voice Mode, and conduct data analyses in Python are all grounded in training data from the past. Now ChatGPT is significantly better at drawing from real-time information and providing clickable links to original sources.

On the other hand, what OpenAI seems to be aiming for is something beyond merely a new conduit for information. By combining the ability to search the web with an improved information-display interface and the contextualization that its LLM capabilities provide, ChatGPT search is intended to move ChatGPT closer to the role of research assistant, like Perplexity.

How does it work? OpenAI explains here:

The partners they list include the Associated Press, Reuters, Le Monde, and more, and they say that “any website or publisher can choose to appear⁠ in ChatGPT search.”

Available at chatgpt.com through both web and mobile interfaces, ChatGPT search offers specialized displays for different types of information including current events, data, and maps. While currently limited to Plus and Team users, the feature will roll out to Enterprise and Education users in the coming weeks, with free users gaining access over the coming months.

In some initial testing, I found that it worked quite well, displaying good access to recent academic research on nuanced topics I am familiar with, like work related to some of my publications. My only complaint would be that it would sometimes misdescribe the results in minor ways. Fortunately, none of these misdescriptions were significant. After more testing, I will provide a Tutorial on using it and Perplexity for educational use cases.

ChatGPT search rightly identifying my co-authored article on AI ethics as relevant to my query.

Why Care?

Here are two reasons to take note of this development, one general and one specific to educators:

1. Hallucination Issues Continue to Shrink

Over the past several years, one of the main focuses of AI developers has been to reduce the rate at which their tools produce text outputs that misrepresent the truth.

“Hallucinations” come in many forms. They can arise from AI tools’ training data alone — when a context-less query triggers the AI to produce an output that misrepresents a fact, say — and from AI tools failing to properly analyze information provided to them. The latter are serious obstacles to using AI for many use cases with great utility, like summarization.

AI developers have found significant success in addressing this problem.

For instance, Google’s current Gemini 1.5 Pro is significantly better than the version from February, as well as 1.0 Pro and 1.0 Ultra, at “needle in a haystack” recall. This test involves tasking the LLM with finding and accurately representing a bit of information in its context — a single sentence on a topic in a sea of novel data submitted to it (in-depth explanation from DeepMind here). Gemini 1.5 Pro shows impressive performance even as the context increases to 1 million tokens and beyond (it’s better than ChatGPT-4 at all points, including beyond the latter’s 128,000-token context window).

To use another example that requires reasoning plus recall, the May version of GPT-4o gets an 88.7% accuracy rate on the MMLU benchmark, which consists of 10,000+ multiple-choice questions about several dozen subjects. Human domain-experts in each subject are estimated by the creators of MMLU to have an average accuracy rating of 89.8%. At its best, GPT-3 was at 43.9% in 2020.

As hallucination in its many forms improves for AI tools like Gemini and ChatGPT, their ability to accurately represent completely new information — that isn’t found in their training data — improves.

ChatGPT search wouldn’t be a viable tool if the information it receives and (seemingly) displays was typically inaccurate and if we had reason to think that its developers were not making fast progress on remaining accuracy issues.

2. Training of Research Skills Requires Reevaluation

With the libraries of old, research required navigating indices of printed works, interfacing heavily in person with human librarians, manually writing transcriptions, etc.

With computer-enabled libraries, research evolved, requiring us to know how to navigate search engines, access electronic-only journal articles behind paywalls, etc.

With AI-enabled libraries where the AI suffers from serious inaccuracies, research still further evolves, as the AI can help brainstorm ideas and provide critiques or sparks of insight. Think early ChatGPT.

With AI-enabled libraries where the AI is as accurate as domain experts but lacks access to new information, it is a crystallized assistant, like a domain expert who you ask questions after they’ve retired and moved to Bermuda to do something new.

With ChatGPT search, Perplexity, and other AI tools that can access and represent new information to users, we see the combination of (ever-increasing) domain expertise and the ability to draw upon it in real time.

This means that teaching research skills must evolve yet again.

The traditional emphasis on finding reliable sources remains crucial, but we must now teach students to critically evaluate AI-mediated research processes.

How do we ensure students understand the difference between an AI summarizing multiple sources versus reading those sources directly? When should they do one and when should they do the other? What skills do they need to verify AI-provided information effectively? What does research look like when verification isn’t needed?

These questions become especially pertinent as tools like ChatGPT search become more sophisticated at presenting complex information. When an AI can coherently synthesize dozens of sources and present them with citations, the core research skills shift from finding disparate information to prompting and evaluating syntheses.

For educators, we need to update our information literacy curricula to account for these new tools. The $1,000,000 question is the degree to which these tools and future versions of them will — and should — simply supplant or replace traditional research skills.

What will the library of 2100 look like?

📢 Quick Hits:
AI News and Links

1. ICYMI: The Department of Education’s Office for Educational Technology has released a new report: “Empowering Education Leaders: A Toolkit for Safe, Ethical, and Equitable AI Integration.”

2. Over 25% of all new code at Google is now generated by AI and then reviewed by human engineers, CEO Sundar Pichai revealed during the company's Q3 earnings call, demonstrating AI's growing role in Google's internal operations. The tech giant reported strong financial results with Google Services revenue up 13% to $76.5B and Cloud revenue up 35% to $11.4B, driven partly by AI product adoption.

3. A new Ithaka S+R survey reveals that while 63% of biomedical researchers have experimented with AI, only 7% use it regularly, with most citing concerns about accuracy as the main barrier to adoption. The study found AI is primarily used for writing/editing and literature review tasks rather than actual experiments, with 31% using it for grammar review but just 4-7% using it for hypothesis testing or experimental design.

4. “How NotebookLM Was Made,” a discussion with its creators.

5. Adobe has unveiled its Firefly Video Model, enabling AI-generated video content through text prompts and extending its successful Firefly platform (which has already generated over 12 billion images and vectors). Coming to Premiere Pro in beta later this year, the technology will help editors create B-roll footage, extend clips, and generate new video elements — and it is training only on permissioned content.

6. Google has launched a new "Prompting Essentials" course to teach effective AI prompting in five steps, building on its AI Essentials course (supposedly Coursera's most popular AI course globally).

7. Weekly usage of generative AI among senior business leaders has nearly doubled from 37% in 2023 to 72% in 2024, according to a new Wharton-GBK Collective report surveying 800+ executives at large organizations. The study finds that while AI excels at specific tasks like data analysis and contract drafting, business sentiment has shifted from initial "curiosity" to being "pleased" and "excited," though companies are still working to determine AI's full ROI impact. (Executive summary here; full report here.)

📬 From Our Partners:
An AI Agent Customized to Help You

Your own AI clone, with memory

Imagine if you had a digital clone to do your tasks for you. Well, meet Proxy…

Last week, Convergence, the London based AI start-up revealed Proxy to the world, the first general AI Agent.

You can sign up to meet yours!

Meet your Proxy today

🧪 Call For Interest:
AI Course Scheduler for Departments

As I reported a month ago, I am putting the finishing touches on the beta version of an AI department/school/unit course scheduler.

It accepts as inputs the spreadsheets and narrative faculty preferences departments currently use for faculty teaching assignments. It then interprets these inputs approximately like a human scheduler would.

A standardized input form will be available but optional; I am assuming that most (human) department course schedulers don’t want to try to wrangle their faculty to use it and that they would rather dump in whatever data they currently gather to conduct scheduling.

The system outputs faculty-to-course assignments and can suggest course adjustments within given constraints.

If you’re interested in this AI tool, email me either to be notified when it's available (at a competitive price point) or to participate in beta testing at a discount.

Email me by responding to this email or clicking the below button:

And if you don’t handle scheduling for your department/school/unit but know who does, tell them about this to help them out!

🧰 A High-Impact Tip for Your AI Toolbox

Here’s one crucial tip for working with all large language models (LLMs) except for GPT-o1:

Always break down complex tasks into steps,
even when you don't need to see the intermediate work.

To use a toy example, rather than asking ChatGPT "What are the key themes in 'The Great Gatsby'?", you might prompt as follows: "First, list the major characters and their primary motivations. Then, identify recurring symbols and their contexts. Finally, synthesize these elements into major themes."

(And then you could break these steps into further steps, and those into further steps, and … . For a deep dive on how to prompt for very complex use cases like grant applications, see my ✨Premium Tutorial.)

Directing LLMs to use a “step-by-step” approach (called “Chain of thought” in the academic literature dedicated to empirically testing prompts) works better for two distinct reasons.

First, the step-by-step guidance helps the LLM produce better responses, even if the LLM only produces the final output. That is, it gets better results even if the outputs produced in response to the intermediate steps are not sequentially represented in the LLM’s message to you. Strange, but true!

Second, and more powerfully, you can ask the LLM to show its work at each step, which then is entered into its context for subsequent generation. When the LLM's final conclusions are grounded in its explicit intermediate analysis, they tend to be more accurate and better supported.

This is key with accuracy-sensitive use cases, like grading multiple-choice quizzes or complex data analysis.

Graham

Let's transform learning together. If you would like to consult with me or have me present to your team, discussing options is the first step: Schedule Free 30-minute Exploratory Zoom Feel free to connect on LinkedIN, too!