Azure Blob Storage

Overview

Export evaluation data to an Azure Blob Storage.

Everytime the FlushInterval or MaxEventInMemory is reached a new file will be added to Azure Blob Storage.

info

If for some reason the Azure Blob Storage upload fails, we will keep the data in memory and retry to add the next time we reach FlushInterval or MaxEventInMemory.

Configure the relay proxy

To configure your relay proxy to use the Azure Blob Storage exporter, you need to add the following configuration to your relay proxy configuration file:

goff-proxy.yaml

# ...
exporter:
  kind: azureBlobStorage
  container: test-goff
  accountName: goff
# ...

Field name	Mandatory	Type	Default	Description
kind		string	none	Value should be azureBlobStorage. This field is mandatory and describes which retriever you are using.
container		string	none	This is the name of your Azure Blob Storage container (ex: my-featureflag-container).
accountName		string	none	This is the name of your Azure Blob Storage account.
accountKey		string	none	This is the secret key of your Azure Blob Storage account.
flushInterval		int	60000	The interval in millisecond between 2 calls to the webhook (if the maxEventInMemory is reached before the flushInterval we will call the exporter before).
maxEventInMemory		int	100000	If we hit that limit we will call the exporter.
format		string	JSON	Format is the output format you want in your exported file. Available format: JSON, CSV, Parquet.
filename		string	flag-variation-{{ .Hostname}}-{{ .Timestamp}}.{{ .Format}}	You can use a config template to define the name of your exported files. Available replacements are {{ .Hostname}}, {{ .Timestamp}} and {{ .Format}
csvTemplate		string	{{ .Kind}};{{ .ContextKind}};{{ .UserKey}};{{ .CreationDate}};{{ .Key}};{{ .Variation}};{{ .Value}};{{ .Default}};{{ .Source}}\n	CsvTemplate is used if your output format is CSV. This field will be ignored if you are using format other than CSV. You can decide which fields you want in your CSV line with a go-template syntax, please check exporter/feature_event.go to see what are the fields available.
path		string	bucket root level	The location of the directory in S3.
parquetCompressionCodec		string	SNAPPY	ParquetCompressionCodec is the parquet compression codec for better space efficiency. Available options

Configure the GO Module

To configure your GO module to use the Azure Blob Storage exporter, you need to add the following configuration to your ffclient.Config{} object:

example.go

config := ffclient.Config{
    // ...
   DataExporter: ffclient.DataExporter{
        // ...
        Exporter: &azureexporter.Exporter{
            Container:   "test-goff",
            Format:   "json",
            Path:     "yourPath",
            Filename: "flag-variation-{{ .Timestamp}}.{{ .Format}}",
            AccountName: "goff",
            AccountKey: "XXXX",
        },
    },
    // ...
}
err := ffclient.Init(config)
defer ffclient.Close()

Field name	Mandatory	Default	Description
Container		none	Name of your Azure Blob Storage Container.
AccountName		none	This is the name of your Azure Blob Storage account.
AccountKey		none	This is the secret key of your Azure Blob Storage account.
FlushInterval		60000	The interval in millisecond between 2 calls to the webhook (if the maxEventInMemory is reached before the flushInterval we will call the exporter before).
MaxEventInMemory		100000	If we hit that limit we will call the exporter.
Format		JSON	Format is the output format you want in your exported file. Available format: JSON, CSV, Parquet.
Filename		flag-variation-{{ .Hostname}}-{{ .Timestamp}}.{{ .Format}}	You can use a config template to define the name of your exported files. Available replacements are {{ .Hostname}}, {{ .Timestamp}} and {{ .Format}
CsvTemplate		{{ .Kind}};{{ .ContextKind}};{{ .UserKey}};{{ .CreationDate}};{{ .Key}};{{ .Variation}};{{ .Value}};{{ .Default}};{{ .Source}}\n	CsvTemplate is used if your output format is CSV. This field will be ignored if you are using format other than CSV. You can decide which fields you want in your CSV line with a go-template syntax, please check exporter/feature_event.go to see what are the fields available.
Path		bucket root level	The location of the directory in S3.
ParquetCompressionCodec		SNAPPY	ParquetCompressionCodec is the parquet compression codec for better space efficiency. Available options