Using Azure Pipelines to restore a production database to another environment

Often we need a fresh copy of the production database in another environment (eg DEV/TEST/UAT). 

Previously this was a tedious task involving getting a backup file, copying it to another location, restoring the database.   Here is a solution to automate this process using Azure Pipelines.

User Story

Given a production database exists in subscription 1

When we do a release of the Azure Pipeline named ‘Refresh Database – DEV’

Then an copy of production is available in the DEV environment in subscription 2

And permissions are correct for the DEV environment

Pipeline Overview

For each environment that you wish to restore into create an Azure Pipeline with 3 stages.

image

Create variable groups that are scoped to specific stages

Each variable group contains deployment credentials that the specific stage will require to perform operations within the specific Azure Subscription.

image

Task 1 – Export

Create a PowerShell task to run a script and pass it the information for the production environment.

This runs against the production environment and creates a blog storage container that holds the exported BACPAC

image

View code for script production-export.ps1

{% gist https://gist.github.com/chrismckelt/cc3c2ea53d8500b7c02e3da43513cbae %}

Results in production once this script run should show the database BACPAC export

image

Task 2 – Import

Under the ‘import’ stage create a task that will import the BACPAC from the storage container in the production subscription.  This uses both production and the environment credentials.

image

View code for script production-import.ps1

{% gist https://gist.github.com/chrismckelt/629f992935f9a6aa6701e2c69ae49358 %}

Task 3 – Sanitise

Create a 3rd task in the ‘Sanitise’ stage. 

This will scramble any  information you do not want in that environment (eg emails).

Also remove any Production SQL user account and replace them with environment specific

View code for script sanitise

{% gist https://gist.github.com/chrismckelt/f1dcefb52db6e79b8e5514853067e774 %}


TADA!

Running the pipeline now copies the database to the DEV environment. Typically after this will run a software build which will automatically apply schema changes currently in DEV in the database. Happy restoring!

image