Machine Learning: July 2025 B
Unit 10: Natural Language Processing
Unit Notes
The objective of this unit was to continue developing familiarity with transformer-based architectures such as BERT and GPT, as well as to review advances in natural language processing techniques and architectures.
My takeaway was an understanding of the components and standard architectural patterns used to develop NLP models and systems, as well as the standards for evaluating the accuracy and utility of their outputs.
I also summarized a collaborative discussion on the subject of written material produced by ANNs, and the legal risks associated with developing generative writing ANNs from copyrighted training material.