Module 3: Language modeling foundations

Module 3: Language modeling foundations#

AINS6004 — Natural Language Processing

Essential Question#

What does a language model learn from context?

Scenario#

a product team evaluating an NLP workflow before using it in customer-facing communication

Stakeholders: product manager, support lead, privacy reviewer, and model evaluator

Core Moves#

  • Define the decision boundary

  • Compare baseline and alternative

  • Interpret evidence and assumptions

  • Identify failure modes

  • Recommend next action

Lab & Assignment#

Evaluate next-token predictions and failure modes.

Artifact: NLP evaluation packet with task framing, retrieval/evaluation design, and deployment guardrails focused on language modeling foundations: Evaluate next-token predictions and failure modes.