Day 19: Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL)

What is Artificial Intelligence (AI)?

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think and learn like humans. These systems can perform tasks such as visual perception, speech recognition, decision-making, and language translation.

What is Machine Learning (ML)?

Machine Learning (ML) is a subset of AI that involves the development of algorithms and statistical models that enable computers to improve their performance on a specific task over time without being explicitly programmed. This improvement comes through exposure to data and learning from it.

What is Deep Learning (DL)?

Deep Learning (DL) is a specialized form of machine learning that uses neural networks with many layers (hence "deep") to analyze various factors of data. These artificial neural networks are inspired by the human brain and are particularly effective for complex problems such as image and speech recognition.

Amazon Machine Learning and AI Services

Amazon SageMaker

Amazon SageMaker is a fully managed service that provides the tools to build, train, and deploy machine learning models at scale. It supports various ML frameworks such as TensorFlow, PyTorch, and Apache MXNet.

Apache MXNet on AWS

Apache MXNet is an open-source deep learning framework supported by AWS. It is designed for flexibility and scalability, allowing developers to build and deploy deep learning models efficiently.

TensorFlow on AWS

TensorFlow is an open-source machine learning library developed by Google. AWS supports TensorFlow for building and deploying machine learning models.

PyTorch on AWS

PyTorch is an open-source machine learning framework developed by Facebook. It is known for its ease of use and flexibility in developing deep learning models.

Amazon SageMaker Ground Truth

Amazon SageMaker Ground Truth is a data-labeling service that uses humans to label datasets, which are then used to train machine learning models.

Amazon Augmented AI (A2I)

Amazon Augmented AI allows for human review of machine learning predictions. If a model's confidence in a prediction is low, it can be flagged for human review to ensure accuracy.

Amazon CodeGuru

Amazon CodeGuru is a machine-learning-powered service for code reviews. It helps improve code quality by suggesting changes and pinpointing performance issues.

Amazon Lex

Amazon Lex is a service for building conversational interfaces using voice and text. It enables the creation of chatbots with natural language understanding.

Amazon Personalize

Amazon Personalize is a real-time recommendation service that uses the same technology as Amazon.com to suggest products to customers.

Amazon Polly

Amazon Polly is a text-to-speech service that converts written text into spoken audio, producing natural-sounding human speech.

Amazon Rekognition

Amazon Rekognition provides image and video analysis services to detect and label objects, people, and activities.

Amazon Transcribe

Amazon Transcribe is a speech-to-text service that converts audio files into written text.

Amazon Textract

Amazon Textract is an OCR (Optical Character Recognition) service that extracts text from scanned documents, making it easy to digitize paper forms.

Amazon Translate

Amazon Translate is a neural machine translation service that provides accurate and natural-sounding translations.

Amazon Comprehend

Amazon Comprehend is a Natural Language Processing (NLP) service that uncovers insights and relationships in text data, such as customer emails and support tickets.

Amazon Forecast

Amazon Forecast uses machine learning to generate accurate forecasts for business outcomes, such as product demand and resource needs.

AWS Deep Learning AMIs and Containers

AWS Deep Learning AMIs are pre-installed with popular deep learning frameworks, making it easy to start using deep learning on EC2 instances. AWS Deep Learning Containers are Docker images that simplify the deployment of deep learning models.

AWS DeepComposer, DeepLens, and DeepRacer

• AWS DeepComposer: A machine-learning-enabled musical keyboard for generating music.

• AWS DeepLens: A video camera with deep learning capabilities.

• AWS DeepRacer: A toy race car that uses machine learning for autonomous driving.

Amazon Elastic Inference

Amazon Elastic Inference allows you to attach low-cost GPU-powered acceleration to EC2 instances, reducing the cost of running deep learning inference.

Amazon Fraud Detector

Amazon Fraud Detector is a fully managed service that identifies potentially fraudulent activities, such as online payment fraud and fake account creation.

Amazon Kendra

Amazon Kendra is an enterprise search service that uses machine learning to provide more accurate answers to natural language queries.

Big Data and Analytics Services

What is Big Data?

Big Data refers to massive volumes of structured and unstructured data that are so large and complex that they cannot be processed using traditional database and software techniques.

Amazon Athena

Amazon Athena is a serverless interactive query service that allows you to analyze data in Amazon S3 using standard SQL.

Amazon CloudSearch

Amazon CloudSearch is a fully managed service for integrating search capabilities into applications.

Amazon Elasticsearch Service

Amazon Elasticsearch Service (ES) is a managed service that makes it easy to deploy, secure, and operate Elasticsearch, a popular open-source search and analytics engine.

Amazon EMR

Amazon Elastic MapReduce (EMR) is a cloud-native big data platform for processing vast amounts of data using open-source tools such as Hadoop, Spark, and Hive.

Amazon Kinesis

• Kinesis Data Streams: A real-time streaming data service for building custom, real-time applications.

• Kinesis Firehose: A fully managed service for loading streaming data into data lakes, data stores, and analytics services.

• Kinesis Data Analytics: Enables you to process and analyze streaming data using SQL.

• Kinesis Video Streams: Enables you to stream video from connected devices for analytics and machine learning.

Managed Kafka Service (MKS)

Amazon Managed Streaming for Apache Kafka (MKS) is a fully managed service that makes it easy to build and run applications using Apache Kafka.

Amazon Redshift

Amazon Redshift is a fully managed petabyte-scale data warehouse service in the cloud.

Amazon QuickSight

Amazon QuickSight is a business intelligence (BI) service that provides data visualization and insights through interactive dashboards.

AWS Data Pipeline

AWS Data Pipeline automates the movement and transformation of data between different AWS services.

AWS Glue

AWS Glue is an ETL (Extract, Transform, Load) service for preparing and loading data for analytics.

AWS Lake Formation

AWS Lake Formation helps you build a secure data lake in days. It centralizes and curates data from different sources into a single, searchable repository.

AWS Data Exchange

AWS Data Exchange provides a catalog of third-party data sets that can be subscribed to or purchased.

Generative AI

What is Generative AI (Gen AI)?

Generative AI is a type of artificial intelligence capable of generating new content, such as text, images, music, or other media, by learning patterns from existing data.

ML and DL Frameworks and Tools

Common Frameworks

• Apache MXNet: An open-source deep learning framework supported by AWS.

• TensorFlow: A machine learning library developed by Google.

• PyTorch: A machine learning library developed by Facebook.

• Keras: A high-level neural networks API written in Python, capable of running on top of TensorFlow.

• Apache Spark: An open-source unified analytics engine for large-scale data processing, with built-in modules for SQL, streaming, machine learning, and graph processing.

• Chainer: A flexible and intuitive deep learning framework.

Hugging Face

Hugging Face is an AI community with a repository of pre-trained machine learning models and datasets, often used for natural language processing tasks.

Intel and GPUs

What is Intel?

Intel is a multinational corporation known for manufacturing semiconductor chips and processors, including the x86 series.

Intel Xeon Scalable Processors and Gaudi

• Intel Xeon Scalable Processor: High-performance CPUs designed for enterprise and server applications.

• Intel Habana Gaudi: AI training processors developed by Habana Labs, optimized for deep learning tasks.

What is a GPU?

A Graphics Processing Unit (GPU) is specialized for parallel processing, making it ideal for rendering images and video, as well as tasks like deep learning and scientific computation.

What is NVIDIA and CUDA?

• NVIDIA: A company known for its GPUs used in gaming and professional markets.

• CUDA: Compute Unified Device Architecture is a parallel computing platform and API model created by NVIDIA, allowing developers to use NVIDIA GPUs for general-purpose processing.

EC2 Instances with NVIDIA GPUs

AWS offers various EC2 instances with NVIDIA GPUs for different machine learning and deep learning workloads:

• P3 Instances: Up to 8 NVIDIA Tesla V100 GPUs.

• G3 Instances: Up to 4 NVIDIA Tesla M60 GPUs.

• G4 Instances: Up to 4 NVIDIA T4 GPUs.

• P4 Instances: Up to 8 NVIDIA Tesla A100 GPUs.