Amazon Bedrock Workshop

This hands-on workshop, aimed at developers and solution builders, introduces how to leverage foundation models (FMs) through Amazon Bedrock.

Amazon Bedrock is a fully managed service that provides access to FMs from third-party providers and Amazon; available via an API. With Bedrock, you can choose from a variety of models to find the one that’s best suited for your use case.

Within this series of labs, you'll explore some of the most common usage patterns we are seeing with our customers for Generative AI. We will show techniques for generating text and images, creating value for organizations by improving productivity. This is achieved by leveraging foundation models to help in composing emails, summarizing text, answering questions, building chatbots, and creating images. You will gain hands-on experience implementing these patterns via Bedrock APIs and SDKs, as well as open-source software like LangChain and FAISS.

Labs include:

• Text Generation [Estimated time to complete - 30 mins]
• Text Summarization [Estimated time to complete - 30 mins]
• Questions Answering [Estimated time to complete - 45 mins]
• Chatbot [Estimated time to complete - 45 mins]
• Image Generation [Estimated time to complete - 30 mins]
• Code Generation [Estimated time to complete - 30 mins]
• Chatbot Guardrails [Estimated time to complete - 45 mins]

You can also refer to these Step-by-step guided instructions on the workshop website.

Getting started

Choose a notebook environment

This workshop is presented as a series of Python notebooks, which you can run from the environment of your choice:

• For a fully-managed environment with rich AI/ML features, we'd recommend using SageMaker Studio. To get started quickly, you can refer to the instructions for domain quick setup.
• For a fully-managed but more basic experience, you could instead create a SageMaker Notebook Instance.
• If you prefer to use your existing (local or other) notebook environment, make sure it has credentials for calling AWS.

You can run this workshop in the us-east-1 (N. Virginia) region (models can not work in other regions).
If you have any problems with setting up SageMaker connected with Failed to create domain: can't create SageMaker execution role. message, please contact your mentor - you don't have sufficient rights.

Enable AWS IAM permissions for Bedrock

The AWS identity you assume from your notebook environment (which is the Studio/notebook Execution Role from SageMaker, or could be a role or IAM User for self-managed notebooks), must have sufficient AWS IAM permissions to call the Amazon Bedrock service.

To grant Bedrock access to your identity, you can:

• Open the AWS IAM Console
• Find your Role (if using SageMaker or otherwise assuming an IAM Role), or else User

ℹ️ Note: If using default SageMaker setup, your role will look like 'AmazonSageMaker-ExecutionRole-YYYYMMDDTHHMMSS'

• Select Add Permissions > Create Inline Policy to attach new inline permissions, open the JSON editor and paste in the below example policy:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "BedrockFullAccess",
            "Effect": "Allow",
            "Action": ["bedrock:*"],
            "Resource": "*"
        }
    ]
}

⚠️ Note: With Amazon SageMaker, your notebook execution role will typically be separate from the user or role that you log in to the AWS Console with. If you'd like to explore the AWS Console for Amazon Bedrock, you'll need to grant permissions to your Console user/role too.

For more information on the fine-grained action and resource permissions in Bedrock, check out the Bedrock Developer Guide.

Clone and use the notebooks

To get into notebook environment, you have to start your Studio Classic application (it can take few minutes) and than open it.

ℹ️ Note: In SageMaker Studio, you can open a "System Terminal" to run these commands by clicking File > New > Terminal

Once your notebook environment is set up, clone this workshop repository into it.

sudo yum install -y unzip
git clone https://github.com/xebia/amazon-bedrock-workshop.git
cd amazon-bedrock-workshop

You're now ready to explore the lab notebooks! Start with 00_Intro/bedrock_boto3_setup.ipynb for details on how to install the Bedrock SDKs, create a client, and start calling the APIs from Python.

Content

This repository contains notebook examples for the Bedrock Architecture Patterns workshop. The notebooks are organised by module as follows:

Intro

• Simple Bedrock Usage: This notebook shows setting up the boto3 client and some basic usage of bedrock.

Generation

• Simple use case with boto3: In this notebook, you generate text using Amazon Bedrock. We demonstrate consuming the Amazon Titan model directly with boto3
• Simple use case with LangChain: We then perform the same task but using the popular framework LangChain
• Generation with additional context: We then take this further by enhancing the prompt with additional context in order to improve the response.

Summarization

• Small text summarization: In this notebook, you use use Bedrock to perform a simple task of summarizing a small piece of text.
• Long text summarization: The above approach may not work as the content to be summarized gets larger and exceeds the max tokens of the model. In this notebook we show an approach of breaking the file up into smaller chunks, summarizing each chunk, and then summarizing the summaries.

Question Answering

• Simple questions with context: This notebook shows a simple example answering a question with given context by calling the model directly.
• Answering questions with Retrieval Augmented Generation: We can improve the above process by implementing an architecure called Retreival Augmented Generation (RAG). RAG retrieves data from outside the language model (non-parametric) and augments the prompts by adding the relevant retrieved data in context.

Chatbot

• Chatbot using Claude: This notebook shows a chatbot using Claude
• Chatbot using Titan: This notebook shows a chatbot using Titan

Text to Image

• Image Generation with Stable Diffusion: This notebook demonstrates image generation with using the Stable Diffusion model

Code Generation, SQL Generation, Code Translation and Explanation

1. Code Generation: Demonstrates how to generate Python code using Natural language. It shows examples of prompting to generate simple functions, classes, and full programs in Python for Data Analyst to perform sales analysis on a given Sales CSV dataset.

2. Database or SQL Query Generation : Focuses on generating SQL queries with Amazon Bedrock APIs. It includes examples of generating both simple and complex SQL statements for a given data set and database schema.

3. Code Explanation : Uses Bedrock's foundation models to generate explanations for complex C++ code snippets. It shows how to carefully craft prompts to get the model to generate comments and documentation that explain the functionality and logic of complicated C++ code examples. Prompts can be easily updated for another programming languages.

4. Code Translation : Guides you through translating C++ code to Java using Amazon Bedrock and LangChain APIs. It shows techniques for prompting the model to port C++ code over to Java, handling differences in syntax, language constructs, and conventions between the languages.

Entity Extraction

• Entity Extraction with Claude v2: This notebook shows how LLM can be used to extract specific information from natural text.

Chatbot and LLMs Guardrails

• LLM & NeMo Guardrails: Explores the implementation of guardrails for Language Model (LLM) generated responses using Amazon Bedrock and NVIDIA's NeMo. It highlights the utility of guardrails in ensuring responses adhere to desired parameters, providing a more advanced mechanism over standard system prompts. This notebook demonstrates the integration and configuration of guardrails with NeMo and Bedrock, showcasing various guardrail configurations like Jailbreaking Rail, Topical Rail, Moderation Rail and Fact Checking for safer and more reliable AI interactions.

  • Further Reading:
    • Familiarize yourself with the basic concepts of guardrails and their implementation in NeMo by exploring the NeMo-Guardrails documentation. This section helps in understanding how guardrails contribute to the safety, reliability, and ethical handling of LLMs.

After workshop

After finishing workshop, please remove your SageMaker domain. To do it, you have to go into SageMaker Domains, choose your domain and then:

• go into User Details, choose your User and delete your app (it can take a while)
• click 'Edit' (still in your user details) and then 'Delete user'
• return to Domains, check your domain and click 'Edit', and then 'Delete domain'