Azure Blob Storage

Supermetal can stage your data in an Azure Blob Storage container before writing it into your target database.

This guide walks you through configuring an Azure Blob Storage container as a Supermetal buffer.

BYOC

Azure Blob Storage Buffer is automatically managed by Supermetal Control Plane.

Prerequisites

Before you begin, ensure you have an Azure account with permissions to create and manage:

  • Storage accounts
  • Blob containers
  • Access policies

Setup

Create a Storage Account and Container

Sign in to the Azure Portal and follow these steps:

  • Go to Storage accounts in the Azure services section.
  • Click + Create to create a new storage account.
  • Fill in the required details:
    • Select your Subscription and Resource Group.
    • Enter a unique Storage account name.
    • Choose a Region (select the same region as your Supermetal agent).
    • Select Performance tier and Redundancy options based on your needs.
  • Click Review + create and then Create to deploy the storage account.
  • Once created, navigate to the storage account.
  • Go to Containers in the left menu.
  • Click + Container to create a new container.
  • Enter a name for the container (e.g., "supermetal-buffer").
  • Select an access level (recommended: Private).
  • Click Create.
# Login to Azure
azure login

# Create a resource group (if needed)
az group create --name MyResourceGroup --location EastUS

# Create storage account
az storage account create \
    --name <storage-account-name> \
    --resource-group <resource-group> \
    --location <location> \
    --sku Standard_LRS

# Create container
az storage container create \
    --name supermetal-buffer \
    --account-name <storage-account-name>

Script Variables

Replace:

  • <resource-group> with your Azure resource group name.
  • <storage-account-name> with a globally unique storage account name.
  • <location> with your Azure region (e.g., eastus, westeurope).
  • supermetal-buffer with the name of the container you want to create.

Storage Region

The storage account region should match the region of your Supermetal agent to avoid cross-region networking costs and latency.

Create a Shared Access Signature (SAS)

  • Navigate to your storage account in the Azure Portal.
  • Go to Containers in the left menu.
  • Click on the container you created (e.g., "supermetal-buffer").
  • Click on Shared access tokens at the top of the container page.
  • Configure the SAS settings:
    • Select the required permissions (Read, Write, Delete, List).
    • Set the start and expiry time as needed (note that Azure requires an expiry date).
    • Select the allowed protocols.
  • Click Generate SAS token and URL.
  • Copy the generated SAS token or Blob SAS URL and save it securely.
# Generate container-specific SAS token
end=`date -u -d "1 year" '+%Y-%m-%dT%H:%MZ'`

az storage container generate-sas \
    --name supermetal-buffer \
    --account-name <storage-account-name> \
    --permissions rwdl \
    --expiry $end \
    --output tsv

Script Variables

Replace:

  • <storage-account-name> with your storage account name.
  • The expiry date sets the token to expire in 1 year. You can set a longer duration if needed, but Azure always requires an expiry date.
  • supermetal-buffer with the name of the container you created.

Connection Details

You'll need the following connection details to configure the buffer in Supermetal:

  • Storage account name
  • Container name
  • SAS token
  • Region

Last updated on

On this page

PrerequisitesSetupCreate a Storage Account and ContainerCreate a Shared Access Signature (SAS)