Brain Dump: Foundation models and future AI infrastructure

I've had a chance to read a few papers, books, and blog posts to wrap my head around new AI models. I'm going to use this blog post as a way of tracking every thing I've read and will eventually summarize a lot of it for my understanding.

• Neural Networks and Deep Learning

• A Simple Alpha(Go) Zero Tutorial

• The Illustrated Transformer

• Auto-Encoding Variational Bayes

• Denoising Diffusion Probabilistic Models

  • https://huggingface.co/blog/annotated-diffusion

• GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models

• Segment Anything Model

• Learning Transferrable Visual Models From Natural Language Supervision

• Learning to Summarize From Human Feedback

• Zero-Shot Text-to-Image Generation

• BLOOM: A 176B-Parameter Open-Access Multilingual Language Model