CS 370 - Spring 2025. 4/21/2025

[Home]

Welcome to CS 370!

Video of the Day

Meet NEO, Your Robot Butler in Training | Bernt Børnich | TED See Bernt Børnich The home is the source of rich and diverse training data for robots.

A New Philosophy on Artificial Intelligence | Kristian Hammond | TEDxNorthwesternU See Kristian Hammond

Canvas Quiz of the Day (need daily password)

Most days, there will be a simple canvas quiz related to the lecture. You need a password to activate the quiz, which I will provide in class. These quizzes will count toward your class participation grade. The quiz is available only during class. You get full credit for class participation by completing half of the quizzes.

Click for today's quiz.

Lecture 24: Natural Language Processing.

Announcements

Administrivia

  • I have office hours Wednesdays from 4-6 p.m. via Zoom, meeting ID 459 434 2854. This is the last week of office hours for me.

  • The TF's office hours are posted on Ed Discussion.

  • I am available for lunch on Mondays at 1 pm in Morse. No more this term.

  • Homework assignments: [Assignments]. hw7 is now available. Note: there will be no hw8. Projects due next Monday, April 28th on gradescope. Papers due May 6th on canvas.

    Guest Lecture: Alexandra Slade

    Online at https://meet.google.com/oqh-deow-hux?hs=224

    Check out ahead of time: Blog post: https://blog.google/products/search/ai-mode-search/
    Sign up for AI mode and try a few queries: https://labs.google.com/search/experiment/22

    Bio:

    Alexandra Slade (Pierson '15) has spent most of her career at Google, particularly working on various aspects of Google Search for Education. This has included structured features such as syllabi for Indian exams, as well as semi-structured features such Questions & Answers, and now fully AI driven features such as Learn About and AI Mode. While at Yale, she majored in Computer Science and did Computer Music projects alongside participating in several a capella groups.

    You may contact Alexandra directly: aslade@google.com She would be happy to hear your thoughts and ideas.

    Asides from previous lectures

  • Chekhov's Gun - lit crit LLM paper
  • Pizza Glue
  • Grice's Maxims.
  • Hapax legomenon.
  • Eskimo words for snow. Sapir-Whorf Hypothesis. See The great Eskimo vocabulary hoax Geoffrey Pullum, 1989.

    AI in the news

  • Access to the Atlantic
  • Access to Economist (Economist.com)
  • Access to Financial Times
  • Access to Wall Street Journal from Yale.
  • Q and AI Bloomberg.
  • Access to Bloomberg.com from Yale.

    NLP and LLMs

  • AIMA Slides:

    Vanilla Natural Language Processing

  • NLP Progress Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks. (BLEU for machine translation.)

    AIMA Jupyter notebooks:

  • text.html
  • nlp.html
  • nlp_apps.html

  • WordNet open-source, hand-curated dictionary in machine readable form. provides the categories used by ImageNet.
  • Penn Treebank.
  • Natural Language Corpus Data Norvig, Beautiful Code (the actual data)

    Deep Learning for Natural Language Processing

  • Word embeddings: fastText, word2vec (Google TensorFlow), and GloVe (Stanford).
  • Moore's Law vs the More Law.
  • Hands-on large language models : language understanding and generation Jay Alammar, O'Reilly, 2024. (Yale library online book).
  • C4 (Colossal Clean Crawled Corpus)
  • Efficient Estimation of Word Representations in Vector Space the word2vec paper, by Jeff Dean and the Google guys. 2011. github with paper and code
  • Attention is All You Need Vaswani et al. 2017. Introduced the transformer architecture.

    LinkedIn

    Many of you may have social media accounts on Facebook, X, Instagram, and others. You may also use Github as a code repository and portfolio to show to prospective employers.

    All good. I recommend that you also create a LinkedIn account as an online resume. I invite all of my Yale students to connect to me on LinkedIn to leverage my network, such as it is. I also am interested in following your trajectory, but not in a creepy way.

    On Monday, my daughter Alexandra spoke to the class about her current work. Down the road, if you have some ideas or thoughts you would like to share with future generations of Yalies, let me know. I would be happy to welcome you back, if not for a lecture, maybe a cup of coffee.

    [Home]