This quick start guide, which is excerpted from the larger User Guide, is intended to provide you with a focused overview of working with SAP ASE database objects in the Delphix Dynamic Data Platform. It does not cover advanced configuration options. It does not cover advanced configuration options or best practices for performance. It assumes that you are working in a Lab/Dev setting and attempting to quickly test Delphix Engine functionality. It assumes you will use the VMware Hypervisor. 

Overview

In this guide, we will walk through deploying a Delphix Engine, starting with configuring SAP ASE Source and Target environments. We will then create a dSource, and provision a VDB. 

The following diagram describes the engine topology for SAP ASE environments. It illustrates the recommended ports to be open from the engine to remote services, to the Delphix Engine, and to the Source and Target Environments. A detailed list can be referred to in the Network and Connectivity Requirements for SAP ASE Environments section of the manual.

For purposes of the QuickStart, you can ignore any references to Replication or Masking, such as the engines shown in the diagram below.


Delphix stays in sync with source databases by monitoring the ASE backup server log. When it sees a new database dump or transaction log has been created, it attempts to load it into the ASE staging instance.

Validated sync ModeSnapShot for FULL BACKUPSnapShot for TLOGSPoint-in-Time Restore
truncate log on chkpt = trueYesNoNo
truncate log on chkpt = falseNoYesNo
truncate log on chkpt = true + Log SyncYesNoNo
truncate log on chkpt = false + LogSyncNoYesYes

Before proceeding with setting up environments, decide where the databases will be located relative to the ASE staging instance. In the following diagram, we have two ASE hosts (production and staging).


If the database dumps (or transaction logs) are available locally to the staging Backup Server, Delphix considers them “local”. Whereas if they are available to a Backup Server on production, they are “remote”. If the files will be local to the staging server, there are many options to get them from the production host to the staging host including but not limited to:

  • Sharing the directory on the production host over NFS to the staging host.

  • Using Network Attached Storage (NAS) to replicate the files.

  • Using scp to copy the files from one host to the other.

If the files are only available on the production host, Delphix will login to the ASE staging instance and issue the “LOAD DATABASE” command using the remote server syntax (for example LOAD DATABASE pubs2 FROM "/dumps/pubs2.full.9_5_16" AT Prod_BS).

Deploy OVA on VMware

Use the Delphix-supplied OVA file to install the Delphix Engine. The OVA file is configured with many of the minimum system requirements and deploys to one 300GB hard disk with 8 vCPUs and 64GB RAM. The underlying storage for the install is assumed to be redundant SAN storage.

  1. Download the OVA file from https://download.delphix.com. You will need a support login from your sales team or a welcome letter.
    1. Navigate to "Virtual Appliance" and download the appropriate OVA. If you are unsure, use the HWv10 OVA type.
  2. Login using the vSphere client to the vSphere server (or vCenter Server) where you want to install the Delphix Engine.
  3. In the vSphere Client, click File.
  4. Select Deploy OVA Template.
  5. Browse to the OVA file.
  6. Click Next.
  7. Select a hostname for the Delphix Engine.
    This hostname will also be used in configuring the Delphix Engine network. 
  8. Select the data center where the Delphix Engine will be located.
  9. Select the cluster and the ESX host.
  10. Select one (1) data store for the Delphix OS.  This datastore can be thin-provisioned and must have enough free space to accommodate the 300GB comprising the Delphix operating system.
  11. Select four (4) or more data stores for Database Storage for the Delphix Engine.  The Delphix Engine will stripe all of the Database Storage across these VMDKs, so for optimal I/O performance each VMDK must be equal in size and be configured Thick Provisioned - Eager Zeroed.  Additionally, these VMDKs should be distributed as evenly as possible across all four SCSI I/O controllers.
  12. Select the virtual network you want to use.
    If using multiple physical NICs for link aggregation, you must use vSphere NIC teaming. Do not add multiple virtual NICs to the Delphix Engine itself. The Delphix Engine should use a single virtual network. For more information, see Optimal Network Architecture for the Delphix Engine.
  13. Click Finish.
    The installation will begin and the Delphix Engine will be created in the location you specified
  14. Once the installation has completed, power on the Delphix Engine and proceed with the initial system configuration as described in Setting Up Network Access to the Delphix Engine.

If your source database is 4 TB, you probably need 4 TB of storage for the Delphix Engine. Add at least 4 data disks of similar size for the Delphix VM. For example: for a source database of 4 TB, create 4 VMDKs of 1 TB each.

For a full list of requirements and best practice recommendations, see  Virtual Machine Requirements for VMware Platform.

Setup Network Access to Delphix Engine

  1. Power on the Delphix Engine and open the Console.
  2. Wait for the Delphix Management Service and Delphix Boot Service to come online.  
    This might take up to 10 minutes during the first boot. Wait for the large orange box to turn green.
  3. Press any key to access the sysadmin console. 
  4. Enter  sysadmin@SYSTEM  for the username and sysadmin for the password.
  5. You will be presented with a description of available network settings and instructions for editing.
     

    Delphix Engine Network Setup
    
    To access the system setup through the browser, the system must first be configured for networking in your
    environment. From here, you can configure the primary interface, DNS, hostname, and default route. When DHCP is
    configured, all other properties are derived from DHCP settings.
    
    To see the current settings, run "get." To change a property, run "set <property>=<value>." To commit your changes,
    run "commit." To exit this setup and return to the standard CLI, run "discard."
    
        defaultRoute    IP address of the gateway for the default route -- for example, "1.2.3.4."
    
        dhcp            Boolean value indicating whether DHCP should be used for the primary interface. Setting this value
                        to "true" will cause all other properties (address, hostname, and DNS) to be derived from the DHCP
                        response
    
        dnsDomain       DNS Domain -- for example, "delphix.com"
    
        dnsServers      DNS server(s) as a list of IP addresses -- for example, "1.2.3.4,5.6.7.8."
    
        hostname        Canonical system hostname, used in alert and other logs -- for example, "myserver"
    
        primaryAddress  Static address for the primary interface in CIDR notation -- for example, "1.2.3.4/22"
    
    Current settings:
    
        defaultRoute: 192.168.1.1
        dhcp: false
        dnsDomain: example.com
        dnsServers: 192.168.1.1
        hostname: Delphix
        primaryAddress: 192.168.1.100/24
  6. Configure the hostname. If you are using DHCP, you can skip this step.

    delphix network setup update *> set hostname=<hostname>

    Use the same hostname you entered during the server installation.

  7. Configure DNS. If you are using DHCP, you can skip this step.

    delphix network setup update *> set dnsDomain=<domain>
    delphix network setup update *> set dnsServers=<server1-ip>[,<server2-ip>,...]
  8. Configure either a static or DHCP address.

    DHCP Configuration

    delphix network setup update *> set dhcp=true

    Static Configuration

    delphix network setup update *> set dhcp=false
    delphix network setup update *> set primaryAddress=<address>/<prefix-len>

    The static IP address must be specified in CIDR notation (for example, 192.168.1.2/24)

  9. Configure a default gateway. If you are using DHCP, you can skip this step.

    delphix network setup update *> set defaultRoute=<gateway-ip>
    
  10. Commit your changes. Note that you can use the get command prior to committing to verify your desired configuration.

    delphix network setup update *> commit
    Successfully committed network settings. Further setup can be done through the browser at:
    
            http://<address>
    
    Type "exit" to disconnect, or any other commands to continue using the CLI.
  11. Check that you can now access the Delphix Engine through a Web browser by navigating to the displayed IP address, or hostname if using DNS.
  12. Exit setup.

    delphix> exit
    

Setting Up the Delphix Engine

Once you set up the network access for Delphix Engine, navigate to the Delphix Engine URL in your browser for server setup. 

The welcome screen below will appear for you to begin your Delphix Engine setup.

The setup procedure uses a wizard process to take you through a set of configuration screens:

  • Administrators
  • Time
  • Network
  • Network Security
  • Storage
  • Serviceability
  • Authentication
  • Network Authorization
  • Registration
  • Summary
  1. Connect to the Delphix Engine at http://<Delphix Engine>/login/index.html#serverSetup.
    The Delphix Setup application will launch when you connect to the server.
    Enter your sysadmin login credentials, which initially defaults to the username sysadmin, with the initial default password of sysadmin.  On first login, you will be prompted to change the initial default password.
  2. Click Next.

Administrators

The Delphix Engine supports two types of administrators:

  • System Administrator (sysadmin) - this is the engine system administrator. The sysadmin password is defined here.
  • Engine Administrator (admin) - this is typically a DBA who will administer all the data managed by the engine.

On the Administrators tab, you set up the sysadmin password by entering an email address and password. The details for the admin are displayed for reference. 

The default domain user created on Delphix Engines from 5.3.1 is known as admin instead of delphix_admin. When engines created before 5.3.1 are upgraded to 5.3.1 or later they will retain their old username 'delphix_admin'. To avoid complications Delphix recommends creating users with an admin role and then Disabling delphix_admin.

System Time

The engine time is used as the baseline for setting policies that coordinate between virtual databases and external applications.

Choose your option to set up system time in this section. For a Quick Start, simply set the time and your timezone. You can change this later.

Network

The initial out-of-the-box network configuration in the OVA file is set to use a single VMXNET3 network adapter.

You have already configured this in the initial configuration. Delphix supports more advanced configurations, but you can enable those later.

Storage

You should see the data storage VMDKs or RDMs you created during the OVA installation. Click Next to configure these for data storage.

Serviceability

Choose your options to configure serviceability settings.

For a Quick Start, accept the defaults. You can change this later.

Authentication

Choose your options to configure authentication services.

For a Quick Start, accept the defaults. You can change this later.

Registration

If the Delphix Engine has access to the external Internet (either directly or through a web proxy), then you can auto-register the Delphix Engine:

  1. Enter your Support Username and Support Password.
  2. Click Register.

If external connectivity is not immediately available, you must perform manual registration.

  1. Copy the Delphix Engine registration code in one of two ways:
    1. Manually highlight the registration code and copy it to clipboard. Or,
    2. Click Copy Registration Code to Clipboard.
  2. Transfer the Delphix Engine's registration code to a workstation with access to the external network Internet. For example, you could e-mail the registration code to an externally accessible e-mail account.
  3. On a machine with access to the external Internet, please use your browser to navigate to the Delphix Registration Portal at http://register.delphix.com.
  4. Login with your Delphix support credentials (username and password).
  5. Paste the Registration Code.
  6. Click Register.

Although your Delphix Engine will work without registration, we strongly recommend that you register each Delphix Engine as part of the setup. Failing to register the Delphix Engine will impact its supportability and security in future versions.

To regenerate the registration code for a Delphix Engine please refer to, Regenerating the Delphix Engine Registration Code. Delphix strongly recommends that you regenerate this code and re-register the engine regularly to maximize the Support Security of the Delphix Engine. Delphix recommends doing this every six months.

Summary

The final summary tab will enable you to review your configurations for System Time, Network, Storage, Serviceability, and Authentication. 

  1. Click the Back button to go back and to change the configuration for any of these server settings.
  2. If you are ready to proceed, then click Submit.
  3. Click Yes to confirm that you want to save the configuration.
  4. Click Setup to acknowledge the successful configuration.
  5. There will be a wait of several minutes as the Delphix Engine completes the configuration.

Requirements for SAP ASE Hosts and Databases

In order to begin using SAP ASE environments with Delphix, you will need to configure the source and target hosts with the requirements described on this page.

SAP ASE Source Host Requirements

There must be an operating system user, such as delphix_os, that meets the following requirements:

  • The $SYBASE environment variable is defined for non-interactive shells (such as via the .bashrc configuration file). 

    • Set the PermitUserEnvironment configuration parameter to "yes" in the sshd_config file

    • Add the variable to the user's .ssh/environment file

    • Restart the SSH daemon

  • To test this requirement:

ssh delphix_user@ase_hostname env | grep SYBASE


  • Can login to the source host via SSH (TCP port 22)

  • Delphix requires superuser permission to run pargs in order to discover Solaris ASE instances. For more information,  see Sudo Privilege Requirements for SAP ASE Environments.

  • Designating the Delphix operating system user’s primary group to be the same as the ASE instance’s means the file system permissions can be more restrictive and is a better security practice than granting world read access to the toolkit or the backup files. If the target host is used to host the staging databases, consider the following:

    • If you don’t add the Delphix operating system user to the ASE instance owner’s group, greater permissions will need to be granted to the backup files to ensure read access to the dumps and/or transaction logs. Delphix looks for the backup files on the staging host (unless a "remote" backup server is used in which case, the remote host is used which is often the source environment).

    • If you sync Delphix with a dSource by asking ASE to create a new backup, the ASE instance owner will need the write permission to the toolkit (or the mount point if you use the CLI to specify a directory other than the toolkit). Delphix will issue the "DUMP DATABASE" command to write to staging database's "temp" directory which is mounted on the staging host.
    • Has write permission for the mount-point directory (by default the toolkit directory but can be a separate mount point specified in the command line interface).

  • There must be a directory on the source host where you can install the Delphix platform toolkit, for example: /var/opt/delphix/Toolkit

    • The delphix_os user must own the directory

    • The directory must have permissions 0770, for example, -rwxrwx---. However, you can also use more permissive settings.

    • The directory should have 256MB of available storage.

Source Database Requirements

When adding a source ASE environment to Delphix, you may use a single login to discover the ASE instances and link the source databases OR you may use a single login to discover all of the ASE instances and separate logins to link each dSource.

  • Delphix uses a single database user for the discovery of all ASE instances and their databases for each environment added to Delphix.

    • The discovery database user (delphix_disc for example) must have SELECT privileges on the following tables for each ASE instance on the source host:

      • sysdatabases

      • sysservers

      • syslisteners

      • sysconfigures

      • syscurconfigs

  • Another user must be specified when linking each dSource (delphix_link for example) that has SELECT privileges on the above tables.

    • If you will select New Full Backup when linking, this user must also have privileges to take a new full database dump of the source database. For more information about linking options, see Linking an SAP ASE Data Source.

    • The link database user can be different for each instance and database on the source host.

If the source database is resized and trunc log on chkpt is disabled, take a transaction log dump immediately after the resize operation completes. If trunc log on chkpt is enabled, take a full database dump immediately after the resize operation completes. If multiple resizing operations are performed without taking transaction log dumps between each operation it may be necessary to manually sync the dSource with a new full database dump for Delphix to be able to continue ingesting source database dumps.

Target Host Requirements

  • The operating system on the target environment must be the same as, or binary compatible with, the operating system on the source environment.

  • As the Delphix Engine uses NFSv3 for mounting target host filesystems, the prerequisite packages to support NFSv3 client communication are required for normal operation, and the required services to support NFS client communications (including file locking) must be running.  This includes:

      1. portmapper / rpcbind
      2. status daemon (rpc.statd)
      3. NFS lock manager (rpc.lockd/lockmgr)
  • The SAP ASE major version on the target environment must be the same as the version on the source environment. However, EBF/SP version on target environment can be different. If the target is used as a staging server, the ASE major version must be the same. The only caveat is for ASE 15.7 - where the source and staging patch levels must both be either any version below SP64 or both be any version above SP100.

  • There must be an operating system user, such as delphix_os, that meets the following requirements:

    1. Set the PermitUserEnvironment configuration parameter to "yes" in the sshd_config file

    2. Add the variable to the user's .ssh/environment file

    3. Restart the SSH daemon

    • The $SYBASE environment variable is set for non-interactive shells (such as via the .bashrc configuration file).  Set the variable as follows:

    • To test this requirement:

ssh delphix_user@ase_hostname env | grep SYBASE


  • Can login to the target host via Secure Shell (SSH)

  • Can login to ASE instances using isql with LANG=C set

  • Designating the Delphix operating system user’s primary group to be the same as the ASE instance’s means the file system permissions can be more restrictive and is a better security practice than granting world read access to the toolkit or the backup files. If the target host is used to host the staging databases, consider the following:

    • If you don’t add the Delphix operating system user to the ASE instance owner’s group, greater permissions will need to be granted to the backup files to ensure read access to the dumps and/or transaction logs. Delphix looks for the backup files on the staging host (unless a "remote" backup server is used in which case, the remote host is used which is often the source environment).

    • If you sync Delphix with a dSource by asking ASE to create a new backup, the ASE instance owner will need write permission to the toolkit (or the mount point if you use the CLI to specify a directory other than the toolkit). Delphix will issue the "DUMP DATABASE" command to write to staging database's "temp" directory which is mounted on the staging host.
    • Has write permission for the mount-point directory (by default the toolkit directory but can be a separate mount point specified in the command line interface).

  • The following permissions are usually granted via sudo authorization of the commands. See Sudo Privilege Requirements for SAP ASE Environments for further explanation of this requirement, and Sudo File Configuration Examples for SAP ASE Environments for example file configurations.

    • Permission to run mount and umount as super-user.

    • On Solaris, permission to run pargs on Solaris

    • On AIX, permission to run the nfso command as super-user.

    • (Optional) On AIX and Linux, permission to run ps as super-user.

    • Disable tty for the delphix_os user for mount and umount.

  • There must be a directory on the source host where you can install the Delphix platform toolkit, for example: /var/opt/delphix/Toolkit

    • The delphix_os user must own the directory

    • The directory must have permissions 0770, for example, -rwxrwx--. However, you can also use more permissive settings.

    • The directory should have 1GB of available storage

    • Avoid using the home directory of the delphix_os user

    • If you intend to use the LogSync feature, it is recommended to make the toolkit directory as short as possible to keep the full path to the transaction log file names under ASE's 127 character limit. For example, create the toolkit directory as /tk. Alternatively, link the dSource using the command line interface and specify the "mountBase" parameter to mount the staging database's devices under a directory following your own naming convention.

Target Database Requirements

  • There must be a database user, such as delphix_db, with the sa_role on each instance on the target environment
  • The database user such as delphix_db for any staging instances must also have the sybase_ts_role
  • If the target host will be used as a staging target environment (see Managing SAP ASE Environments Overview), at least one of the following two options must be configured:
    • You must use sp_addserver to add the staging ASE instance's Backup Server to sysservers on the source ASE instance (so that remote database dump/load works)

      OR

    • Full and transaction dump files from the source database must be available locally to the staging database (over NFS, replication, scp, etc.)

Specific ASE Tuning Recommendations

  • In ASE 15.7 SP60 and higher, there is a configuration parameter named "enable large pool for load". ASE automatically tunes the caches for recovery on reboot, but does not do this for load database and load transaction recovery, since it could impact other databases on a production server. Delphix recommends that the staging ASE instance be separate from the ASE production instance and ASE instances hosting VDBs so enabling this parameter should have a beneficial impact on performance for the ASE staging instance.
  • Specify the "relaxed" strategy for replacing the cache in the default data cache (sp_cacheconfig ‘default data cache’, relaxed) in the ASE staging instance. Since the mount/unmount process invalidates the pages anyway, the page chain is really just unneeded overhead on the staging server.
  • Staging and target ASE instances should have disk mirroring disabled.

           sp_configure "disable disk mirroring" – run value should be 1, which is the default.  If it is 0, change it using

           sp_configure "disable disk mirroring", 1  – this parameter is static so the ASE instance must be restarted for this change to take effect.

  • Delphix will mirror the number of devices used on the source database for the staging database (dSource) and each VDB created from that source database. The number of devices parameter should be scaled appropriately based on the max number of virtual databases that will be provisioned to the ASE instance. This parameter can be changed using: sp_configure "number of devices", <max devices>.
ASE 15.7.0 SP100 and later releases support the shrink command. In some cases, Delphix must increase the number of devices used for databases if this command is used. Delphix creates a minimum of the same number of devices as the source database for the staging database (dSource) and each VDB and will add more devices for every 4TB of fragment holes. See SAP ASE issue CR#799273 for additional details.


To support multiple VDBs and the staging databases, you may need to increase the parameter number of alarms.

Delphix uses ASE operations which use alarm structures such as MOUNT and UNMOUNT. The number of alarms limits the number of these operations which can be run concurrently. Various ASE instance failures can occur if the available alarm structures are exhausted. The amount of memory consumed by increasing the number of alarm structures is small. Delphix recommends that the number of alarms value is increased to at least 4096.

Adding SAP ASE Source and Target Environments

Follow the steps below to add both source and target environments for SAP ASE.

  1. Login to the Delphix Management application.
  2. Click Manage.
  3. Select Environments.
  4. Click the Plus icon next to Environments.
  5. In the Add Environment dialog, select Unix/Linux.
  6. Select Standalone Host.
  7. Enter the Host IP address.
  8. Enter a Name for the environment.
  9. Enter the SSH port.
  10. The default value is 22.
  11. Enter a Username for the environment.
  12. Select Login Type.
  13. For Password, enter the password associated with the user in Step 10.
  14. For Password Login, click Verify Credentials to test the username and password.
  15. Enter a Toolkit Path.
  16. The toolkit directory stores scripts used for Delphix Engine operations. It must have a persistent working directory rather than a temporary one. The toolkit directory will have a separate sub-directory for each database instance. The toolkit path must have 0770 permissions.
  17. Click the Discover SAP ASE checkbox.
  18. Enter the database Username for an ASE instance on the environment.
  19. Enter the database Password associated with the database user in Step 15.
  20. Click Submit.

ASE Manual Discovery

When an environment is added, Delphix discovers your ASE instances. Manual discovery allows users to add instances that were not automatically discovered. This feature is currently only supported via the CLI.

This topic describes how to use CLI commands to manually add ASE repositories to an SAP ASE environment.  Discovery is the process by which the Delphix platform identifies data sources and data dependencies on a remote environment. ASE repository discovery is done automatically when an environment is added to the Delphix platform or when an already added environment is refreshed. In some cases, automatic discovery does not discover all of the repositories in an SAP ASE environment. These repositories may be added using manual discovery.

Unlike automatically discovered instances, manually discovered instances are not automatically deleted if the environment is refreshed when the instance isn't running. Manually discovered instances are not updated during an environment refresh either. So for example, if you upgrade ASE to a new version or change the listener port, you must manually update the repository.

To manually discover an ASE repository you will need to:

  • Add the environment to Delphix
  • Use CLI to manually discover a repository

Creating an ASE Environment

Please refer to Adding an SAP ASE Environment for detailed steps.

Manually discovering a repository

In the following example, we are using sc-dev3.dc2 as our example environment.

  1. Log into CLI and cd to repository menu:  

$ ssh delphix_admin@sc-dev3.dc2
Password:
sc-dev3.dc2> cd repository
sc-dev3.dc2 repository>

   2. Add (manually discover) an ASE repository instance:

The values used in the following code block are specific to the example instance we are adding.

sc-dev3.dc2 repository> create
sc-dev3.dc2 repository create *> ls
Properties
  type: ASEInstance
  credentials: (unset)
  dbUser: (unset)
  environment: (required)
  installationPath: (required)
  instanceName: (required)
  instanceOwner: (required)
  ports: (required)
  version: (unset)
sc-dev3.dc2 repository create *> set credentials.password=sybase
sc-dev3.dc2 repository create *> set dbUser=sa
sc-dev3.dc2 repository create *> set environment=sc-rhel64-sybase-ase-0
sc-dev3.dc2 repository create *> set installationPath=/opt/sybase/15-7
sc-dev3.dc2 repository create *> set instanceName=ASE1570_S1
sc-dev3.dc2 repository create *> set instanceOwner=sybase
sc-dev3.dc2 repository create *> set ports=5100
sc-dev3.dc2 repository create *> ls
Properties
  type: ASEInstance
  credentials:
      type: PasswordCredential (*)
      password: ******** (*)
  dbUser: sa (*)
  environment: sc-rhel64-sybase-ase-0 (*)
  installationPath: /opt/sybase/15-7 (*)
  instanceName: ASE1570_S1 (*)
  instanceOwner: sybase (*)
  ports: 5100 (*)
  version: (unset)
sc-dev3.dc2 repository create *> commit
  `ASE_INSTANCE-22
sc-dev3.dc2 repository>

Updating a repository

Adding onto the above, the following example illustrates updating an ASE instance's version after upgrading ASE:

sc-dev3.dc2> repository
sc-dev3.dc2 repository> select ASE1570_S1
sc-dev3.dc2 repository 'ASE1570_S1'> update
sc-dev3.dc2 repository 'ASE1570_S1' update *> set version="15.7 SP138"
sc-dev3.dc2 repository 'ASE1570_S1' update *> ls
Properties
   type: ASEInstance
   credentials:
       type: PasswordCredential
       password: ********
   dbUser: sa
   installationPath: /opt/sybase/15-7
   instanceOwner: sybase
   linkingEnabled: true
   ports: 5100
   provisioningEnabled: true
   servicePrincipalName: (unset)
   staging: false
   version: 15.7 SP138 (*)
sc-dev3.dc2 repository 'ASE1570_S1' update *> commit

Be careful when setting the version string. Make sure that it matches output as displayed by the "select @@version" query all the way out to the patch level (PL). For example "15.7 SP138" or "16.0 SP02 PL01".


Linking an SAP ASE Data Source

Prerequisites

Ensure that you have correctly set up the source and target environments, as described in Managing SAP ASE Environments.

Dump file requirements

    • Database and transaction log dumps that the Delphix platform will use must be taken using native ASE format.

    • Dump devices are not supported. Database and transaction dump the Delphix platform will use must be taken to filesystem files.

    • If ASE dump compression is being used, the dumps must be generated using the compression = compress_level syntax. The older compress::compress_level syntax is supported in Delphix version 4.3.4 or higher.

Procedure

  1. Login to the Delphix Management application.

  2. Click Manage.

  3. Select Datasets.

  4. Click the Plus icon.

  5. Select Add dSource.

  6. Alternatively, on the Environment Management screen, you can click the Add dSource link next to a database name to start the dSource creation process.

  7. In the Add dSource wizard, from the Requirements tab select Next.

    Changing the Environment User

    If you need to change or add an environment user for the source database, see Managing SAP ASE Environment Users.
  8. Select a data source.

  9. Enter your login credentials for the source database.

  10. Click Validate.


  11. Click Next.

  12. In the dSource configuration tab select:

    dSource Name

    Target Group

    Adding a dSource to a database group lets you set Delphix Domain user permissions for that database and its objects, such as snapshots. For more information, see the topics under Users, Permissions, and Policies.

  13. Click Next.

  14. From the Data management tab select Initial Load option and enter any additional settings needed. There are three different options for the initial load of the dSource:

    1. New Full Backup – Lets Delphix create a new full backup file and load it. Note that when Delphix creates the backup, it is dumped to Delphix storage, not the Backup Location specified in the next step. It will dump to the staging database's NFS mounted "temp" directory on the server hosting the staging ASE instance. This means that this option will work under two scenarios:

      1. If the source ASE instance resides on the same server as the staging ASE instance, the staging database's NFS mounted "temp" directory will be present for the source database to write to in response to the "DUMP DATABASE" command.

      2. If the source and staging ASE instances are configured to allow remote access to the backup servers and the dSource is linked using the "Remote Server" option as described below. Delphix will then issue the "DUMP DATABASE" command and append the "AT <staging_backup_server_name>" clause so that the dump is written to the staging backup server.

    2. Most Recent Existing Full Backup – Find the most recent existing full backup file in the Backup Location and load it. Choosing this option can delay completion of the dSource link as Delphix attempts to find and catalog every single backup listed in the source database's backup server log file.

    3. Specific Existing Full Backup – Specify which existing backup files in the Backup Location you want to load. Choosing this option is much faster because Delphix will skip directly to loading the desired backup and only start to search for and catalog backups in the background after the linking of the source database have completed.

    When using a dump taken with the deprecated compression syntax, select the Specific Existing Full Backup option for Initial Load and, for each stripe, type compress::<file name> into the text box.


    1. Enter the Backup Location. This is the directory where the database backups are stored. Delphix recursively searches this location, so the database backups or transaction logs can reside in any subdirectories below the path entered.

    2. Select the Staging Environment and ASE instance name.

    3. Enable or disable Validated Sync Mode. Validated Sync Mode (also known as ValidatedSync) is the background process that monitors the ASE Backup Server's log file for a new database or transaction log dumps. When Delphix detects a new dump is available it attempts to load it into the staging ASE database.

    4. Enable or disable LogSync. LogSync copies the transaction logs to Delphix storage which enables provisioning VDBs from a specific point in time in rather than just a particular backup.

      LogSync support limitations

      Due to ASE CR 800569, Delphix can only support transaction logs generated in intervals greater than one minute apart in ASE versions 16.0 SP02 through ASE 16.0 SP02 PL04. This ASE bug inadvertently removed the second and millisecond precision from the dump header sequence dates preventing Delphix from knowing what order to apply the transaction logs in when there are multiple transaction logs dumped within the same minute.
    5. Select Backup Location Type.

    6. Click Advanced to edit Source of Production Dump, External Data Directory, Retention policies, or Dump Password.

      External Data Directory

      The External Data Directory feature is not currently used with ASE dSources and is targeted for removal in a future release of Delphix.

      Remote Server should be selected when database dumps are not accessible on the Staging Environment. This options can be used with any of the initial load selections (New Full Backup, Most Recent Existing Full Backup or Specific Existing Full Backup). If selected, fill out additional settings as needed:

      1. Enter the Remote Server Name. This is the name of the backup server used when the dump was created.

      2. Select the Remote Host and Remote User that the backup server is located on.

      3. As noted, the interfaces file on both the staging and remote environments must be modified to point at each other's backup servers.

      Caution

      The Create Dump Password sets a dump password for the dSource. Select this only if the dump password option was used to create a password on the database dump or transaction log dump files. Setting this option causes Delphix to add the "WITH passwd=" clause to the "LOAD" commands.
    7. Click Next.

    8. Specify any Pre and Post Scripts.

    9. Review the dSource Configuration and Data Management information.

    10. Click Submit.

The Delphix platform will initiate two jobs, DB_Link and DB_Sync, to create the dSource. You can monitor these jobs by clicking Actions in the top menu bar, or by selecting System > Event Viewer. When the jobs have successfully completed, the database icon will change to a dSource icon on the Environments > Databases screen, and the dSource will be added to the list of My Datasets under its assigned group.


Dataset details

After you have created a dSource, you can view and edit information about it in the Dataset Details view by selecting the dataset from the dataset list. The center of the screen will show information about the status, Timeflow, and configuration of the dSource.

Provisioning an SAP ASE VDB

Prerequisites

  • You must have already linked a dSource from a source database, as described in Linking an SAP ASE Data Source, or have already created a VDB from which you want to provision another VDB.

  • You must have already set up target environments as described in Adding an SAP ASE Environment.

  • Ensure that you have the required privileges on the target environment.

  • If you are provisioning to a target environment that is different from the one in which you set up the staging database, you must make sure that the two environments have compatible operating systems. For more information on the staging database and the validated sync process, see Managing SAP ASE Environments Overview.

Procedure

  1. Login to the Delphix Management application.

  2. Click Manage

  3. Select Datasets.

  4. Select a dSource.

  5. Select a means of provisioning.

    For more information, see Provisioning by Snapshot and LogSync.

  6. Click Provision.

    The Provision VDB panel will open, and the Instance and Database Name fields will auto-populate with information from the dSource.

  7. Select whether to enable Truncate Log on Checkpoint database option for the VDB.

  8. Click Next.

  9. Select a Target Group for the VDB.

    Click the green Plus icon to add a new group, if necessary.

  10. Select a Snapshot Policy for the VDB.

    Click the Plus icon to create a new policy, if necessary.

  11. Click Auto VDB Restart to enable VDBs to be automatically restarted when staging/target host gets rebooted, if necessary.

  12. Specify any Hooks to be used during the provisioning process.

    For more information, see Customizing SAP ASE Management with Hook Operations.

  13. If your Delphix Engine system administrator has configured the Delphix Engine to communicate with an SMTP server, you will be able to specify one or more people to notify when the provisioning is done. You can choose other Delphix Engine users or enter email addresses.

  14. Click Submit.

When provisioning starts, the VDB will appear in the Datasets panel. Select the VDB and navigate to the Status tab to see the progress of the job. When provisioning is complete, more information can be seen on the Configuration tab.

Automatic VDB Restart on Target Server After Reboot

The Delphix platform now automatically detects whether a target server has been rebooted, and proactively restarts any VBD on that server that was previously up and running. This is independent of the data platform. It is done as if you realized a target server was restarted and issued a start command from the Delphix platform. This feature is compatible with Self-Service ordering dependencies and is limited to non-clustered VDBs.

To enable automatic restart, complete the following steps:

    1. When provisioning a new VDB in the VDB Provisioning wizard, check the Auto VDB Restart box.

Once the VDB has been provisioned, you will be able to turn Automatic VDB Restart on.

    1. In the Datasets panel, select the VDB.

    2. Select the Configuration tab.

    3. Select the Source sub-tab.

    4. Select Database edit.

Next Steps

Congratulations! You have provisioned your first virtual database!

Now, perform some simple functional tests with your application. You can connect your app to the VDB using standard TNS/JDBC techniques. Delphix has already registered the VDB for you on the target listener.

We suggest the following next steps:

    1. Drop a table and use the VDB Rewind feature to test the recovery of your VDB.
    2. Take a snapshot of your dSource and refresh your VDB to quickly get fresh production data.
    3. Provision a new VDB from your VDB to test sharing data quickly with other teams.
    4. Mask your new VDB to protect sensitive data. Provision new VDBs from that masked VDB to quickly provide safe data to development and QA teams.