Bedrust - invoke models on Amazon Bedrock

Bedrust is a command-line program you can use to easily invoke models on Amazon Bedrock, a managed service that makes it easy for developers to build and scale generative AI applications using foundation models (FMs) from leading AI model providers.

Bedrust is available as Rust source code, and you can build and run it on an Arm Linux computer.

What should I consider before installing Bedrust?

You will need an AWS account to access Bedrock, which you can create at https://aws.amazon.com . (Click on Create an AWS Account in the top right corner. Follow the instructions to register. See the Creating an AWS account documentation for full instructions.)

To use Bedrust you need to:

• Configure your AWS account credentials to talk to the Bedrock service
• Enable foundation model access in the Bedrock console

Configure credentials

To connect to Bedrock, you need to install the AWS CLI , generate an access key ID and secret access key, and use the aws configure command to enter your credentials.

Refer to AWS Credentials for more details.

Enable model access in Bedrock

To use Bedrock models you need to request access to specific foundation models through the AWS Bedrock console.

In your AWS account, navigate to “Model access” in the Bedrock console and select the models you want to use.

Refer to Getting started with Amazon Bedrock for additional documentation.

How do I download and install Bedrust?

The easiest way to install Bedrust is by using Cargo, the Rust package manager.

Install Rust

Ensure you have Rust and Cargo installed on your computer. If not, install them using the commands:

    

        
        
sudo apt install curl gcc -y
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y
source "$HOME/.cargo/env"

    

Refer to the Rust install guide for more information.

Clone the repository and install Bedrust

Get the Bedrust source code:

    

        
        
git clone https://github.com/darko-mesaros/bedrust.git
cd bedrust

    

With Rust and Cargo installed, you can install Bedrust:

    

        
        
cargo install bedrust

    

Verify the Installation

After installation, confirm that Bedrust is installed and available in your search path by checking the version:

    

        
        
bedrust --version

    

The output displays the installed version:

    

        
        bedrust 0.8.8

        
    

How do I configure Bedrust?

You can set the default foundation model you want to use:

    

        
        
bedrust --init

    

Use the menu to select the default model:

    

        
        📜 | Initializing Bedrust configuration.
? Select a default model to use press <enter> to skip ›
  meta.llama2-70b-chat-v1
  meta.llama3-1-405b-instruct-v1:0
  meta.llama3-1-70b-instruct-v1:0
  meta.llama3-1-8b-instruct-v1:0
  cohere.command-text-v14
  anthropic.claude-v2
  anthropic.claude-v2:1
  anthropic.claude-3-opus-20240229-v1:0
  anthropic.claude-3-sonnet-20240229-v1:0
  anthropic.claude-3-haiku-20240307-v1:0
  anthropic.claude-3-5-sonnet-20240620-v1:0
  anthropic.claude-3-5-sonnet-20241022-v2:0
  us.anthropic.claude-3-7-sonnet-20250219-v1:0
  anthropic.claude-3-5-haiku-20241022-v1:0
  ai21.j2-ultra-v1
  us.deepseek.r1-v1:0
  amazon.titan-text-express-v1
  mistral.mixtral-8x7b-instruct-v0:1
  mistral.mistral-7b-instruct-v0:2
  mistral.mistral-large-2402-v1:0
  mistral.mistral-large-2407-v1:0
  us.amazon.nova-micro-v1:0
  us.amazon.nova-lite-v1:0
  us.amazon.nova-pro-v1:0

        
    

How do I use Bedrust?

Just run bedrust to invoke the CLI with the default model.

    

        
        
bedrust 

    

You will see the prompt and can start asking questions like how do I install the AWS CLI? to see how it works.

    

        
        bedrust
██████╗ ███████╗██████╗ ██████╗ ██╗   ██╗███████╗████████╗
██╔══██╗██╔════╝██╔══██╗██╔══██╗██║   ██║██╔════╝╚══██╔══╝
██████╔╝█████╗  ██║  ██║██████╔╝██║   ██║███████╗   ██║
██╔══██╗██╔══╝  ██║  ██║██╔══██╗██║   ██║╚════██║   ██║
██████╔╝███████╗██████╔╝██║  ██║╚██████╔╝███████║   ██║
╚═════╝ ╚══════╝╚═════╝ ╚═╝  ╚═╝ ╚═════╝ ╚══════╝   ╚═╝


----------------------------------------
Currently supported chat commands:
/c	 - Clear current chat history
/s	 - (BETA) Save chat history
/r	 - (BETA) Recall and load a chat history
/h	 - (BETA) Export history as HTML(saves in current dir)
/q	 - Quit
----------------------------------------

----------------------------------------
🤖 | What would you like to know today?
😎 | Human:

        
    

How do I change foundation models?

You can use -m to change the model:

    

        
        
bedrust -m nova-micro

    

Your queries are now sent to the Amazon Nova Micro model.

How do I know which models I can use?

Use --help to see your models.

    

        
        
bedrust --help

    

The models are printed in the output:

    

        
        A command-line tool to invoke and work with Large Language models on AWS, using Amazon Bedrock

Usage: bedrust [OPTIONS]

Options:
      --init
  -m, --model-id <MODEL_ID>  [possible values: llama270b, llama31405b-instruct, llama3170b-instruct, llama318b-instruct, cohere-command, claude-v2, claude-v21, claude-v3-opus, claude-v3-sonnet, claude-v3-haiku, claude-v35-sonnet, claude-v352-sonnet, claude-v37-sonnet, claude-v35-haiku, jurrasic2-ultra, deep-seek-r1, titan-text-express-v1, mixtral8x7b-instruct, mistral7b-instruct, mistral-large, mistral-large2, nova-micro, nova-lite, nova-pro]
  -c, --caption <CAPTION>
  -s, --source <SOURCE>
  -x
  -h, --help                 Print help
  -V, --version              Print version

        
    

The output shows the model strings you can use. Make sure to enable the models you want to use in the Bedrock console.

Bedrust is a quick way to explore many Bedrock models and easily compare them.