This section describes the new features and enhancements on the Delphix products.
What's New in this Release
- HANA Staging Push
The HANA 2.0 plugin introduces the Staging Push feature. This feature provides a new data ingestion mechanism that helps users to push data into the Delphix provided mount point on their own. For more information, see Delphix Architecture with HANA.
- Multiple Device Removal
You can now remove multiple storage devices at a time when engines are over-provisioned or when moving to new storage. This is done only after ensuring sufficient resources to support the removal. For more information, see the "Device Removal for Storage Migration" section of Delphix Storage Migration.
Transparent Data Encryption (TDE) for Oracle Multitenant RAC (Oracle 12.2 and 21c)
The Oracle TDE feature encrypts the sensitive data (database tables and tablespaces) stored on the disk. This prevents misuse of the data if the disks or storage mediums are lost or stolen. The data is transparently decrypted for authorized users when they access the data. Our large enterprise customers leverage Oracle RAC configurations for their business-critical applications. We have added support for provisioning a TDE-encrypted vPDB to a linked (Physical CDB) target RAC environment on Oracle 18c and 19c in this release. For more information, see Provisioning a TDE-enabled vPDB to a Cluster Target.
- Oracle 21c on SLES 15 SP3 (220.127.116.11+)
- Oracle 19c on SLES 15 SP3 (18.104.22.168+)
- Oracle 21c on SLES 15 SP2 (22.214.171.124+)
- Oracle 19c on SLES 15 SP2 (126.96.36.199+)
- AppData on RHEL 8.4 (188.8.131.52+)
What's New in this Release
- OAuth2 API Support
The Virtualization and Masking engine APIs are now accessible via OAuth2 tokens that improve Delphix's security offerings. For more information, see Configuring OAuth2 Authentication for API Access.
- Oracle Support for Exadata, Exadata Cloud, or Exadata Cloud-at-Customer (ExaCC) Cluster
This release adds support for Exadata, Exadata Cloud, or Exadata Cloud-at-Customer (ExaCC) Cluster for Oracle databases. For more information, see Oracle Support Matrix.
- Apply Hotfixes using the Self-Service UI
You can now apply hotfixes using the self-service upgrade UIs.
- TDE for Oracle Multitenant - Support for Rekey
Oracle Advanced Security Transparent Data Encryption (TDE) provides the ability to create virtual pluggable databases with a new key (independent from the source database). This is to facilitate another layer of security - ensuring that different keys are used in the production and non-production systems. For more information, see Provisioning a TDE-enabled vPDB.
- Modify DBID for Non-multitenant Oracle VDBs after Provisioning
You can now generate a new DBID after a VDB is provisioned and refreshed. For more information, see Generate a New DBID for Oracle VDBs. Support for multitenant databases is currently not available.
- New Wizard for Creating Replication Profile
A new multi-step wizard is now available that replaces the previous in-place editing option to manage Replication Profiles. For more information, see Replication User Interface.
- Oracle 21c on RHEL 8.4, RHEL 8.3, SLES 15 SP1 (184.108.40.206+)
- Oracle 19c on RHEL 8.4 (220.127.116.11+)
- Exadata Cloud-at-Customer(ExaCC)/Exadata support for Oracle 12.2 on OEL 7.8 and OEL 7.9
- SQL Server-Support for Azure Storage Backups
SQL native backups can now be read directly from Azure Cloud storage. For more information, see Restoring SQL Backups Stored in Azure Cloud Storage.
- Support dSource Upgrades From Non-MT to MT in Oracle
Once a dSource is converted to a multitenant PDB, you will be able to share its storage blocks with its non-multitenant predecessor. Delphix will only store the incremental changes to the database. For more information, see Prepare and Upgrade a Non-MT Oracle dSource to MT.
- Oracle-Provision to the Latest Point-In-Time on RAC
Provision to the latest point-in-time is now supported.
- Flexible ORACLE_HOME Permissions Configuration
Removed the need to set permissions of the "$ORACLE_HOME/dbs" subdirectory using STARTUP SPFILE syntax to simplify Oracle operations. For more information, see Requirements for Oracle Hosts and Databases.
- Support for Manually Starting an Oracle VDB
An Oracle VDB can now be manually started. For more information, see Manually Starting a VDB.
- Attach and Detach Oracle CDB Containers
Detaching, attaching, and linking of the Oracle CDB containers is now supported via CLI. For more information, see CLI Cookbook: Attaching, Detaching, or Linking a CDB.
- Password Vaults and Remote Hooks for UI
In the 18.104.22.168 release, we introduced the ability to use password vaults with hooks. This allows our customers to ensure a high level of security with all operations with external systems. This can now be configured via the user interface. For more information, see Passing Credentials Securely to Hook Operations.
NFSv4 is now enabled by default. For more information, see NFSv4 Configuration.
- 12-month Support for Upgrades and Forward Compatible Replication (FCR)
To better align with the Delphix support program, Engine upgrades and FCR operations must be within versions no more than 12 months apart. For example, upgrading to version 22.214.171.124 will require the previous version to be at least 126.96.36.199. For more information, see Upgrade Matrix and Replication Overview.
- HANA Plugin Port Control
You can now keep the port numbers consistent throughout the HANA VDB life cycle so that the connections made to the VDBs are not disrupted during their life cycle. For more information, see Provisioning HANA VDBs: An Overview.
- User-Specified Mount Path For Db2 dSource
You can now specify a mount path of your choice to host the dSource dataset on the target host. For more information, see Linking a Db2 dSource.
- Staging Push Automation for Db2 dSource
You can now use a set of scripts that can be used to automate the restore and rollforward operations on the dSource. For more information, see Staging Push Automation.
Delphix Data Vault - Additions
In continuation to the Delphix Data Vault for ransomware protection released in 188.8.131.52, this release enables you to manage this feature from the Delphix Engine user interface and also lets you monitor the regular valid replication receives. For more information, see Delphix Data Vault.
- TLS 1.3
The TLS 1.3 support is added as an available secure connection option at the Engine Admin Console to be used between engines.
- Phonehome Data Collection Frequency
The default collection period for the Phonehome users is now changed to daily. For more information, see System Configurations - Enable Phone Home.
- Password Vaults for Remote Hooks
With this release, the hooks running on environments can now obtain credentials from the engine and its configured password vaults. These credentials can be used to perform custom authentication tasks in a secure manner. Currently, this feature is supported via the command line interface only. For more information, see Passing Credentials Securely to Hook Operations.
- Delphix Integrations (dxi) Docker Image
A new dockerized version of the dxi library is now available. For more information, see Docker Image.
- Delphix Data Vault
The Delphix Data Vault for ransomware protection (accessible via CLI) enables organizations to recover access to their application data much faster than traditional backup solutions after malicious attacks. It relies on the new Data Vault Replication feature, which replicates critical business DB data stored on Delphix engines to a new target engine called Data Vault. Once securely stored on the Data Vault, the replicated DB data can be used to recover business applications upon a ransomware attack with very low RTO and RPO.
- Dxi Executable and Support for Encrypted Credentials
We will be distributing the dxi CLI, a Delphix solution built to facilitate simpler and seamless integration of Delphix Platform Operations into existing workflows, as Windows, macOS and RHEL binaries. This will simplify adoption and remove the requirement on Python. Delphix has also adding encryption for the login credentials.
- Expansion of Retention Period on Replicated Objects
At present, when snapshots on the replication source engine are deleted (either due to retention policies or user action), the next replication job will delete those snapshots on the replication target engine. This improvement will allow you to extend the retention period of replicated objects on target engines while keeping the original retention at the source. Once the object in the target engine reaches its retention period, it will be flagged and deleted by the policy agent based on a daily schedule.
- Db2 Staging Push
Delphix now supports Staging Push for non-DPF Db2 databases. The Staging Push architecture will allow organizations to bring their data to Delphix, with their own tools and standard processes. This facilitates the use of any backup tool, a major ongoing source of requests. This should dramatically increase the volume of data that can be easily managed by Delphix.
- HANA Plugin Staged Architecture
Delphix introduces a staging architecture for HANA virtualization. This will make it consistent with other virtualized data sources. This new architecture will build a foundation for future staging push capabilities, as Delphix has begun to introduce for other platforms. These changes, together, will allow us to support more prospective organizations with various SAP-certified, 3rd-party backup applications for HANA. Delphix will continue to support the pull ingestion method with HANA native backups and logs.
ASE Native Encryption Support
SAP ASE version 16.0 introduces the ability to fully encrypt databases, provides protection for all the data, indexes, and transaction logs in a database. This offers full database protection while allowing the user to query and manage the data as usual, as the encryption is transparent to existing functions. In response to customer demand, we have added a security enhancement to support encrypted ASE databases. This allows customers to maintain the ASE encryption that is active on their sources and propagate that through to their VDBs.
System Tunable Interface
A new web service API is introduced which allows you to set or receive the values of a system tunable via Delphix CLI. A Support engineer can now provide context via Support case to modify these values.
Oracle Customized Full Backups
There is a rarely-seen bug in Oracle that results in some blocks not being written to the datafiles during an Oracle SnapSync operation. When this happens, the datafiles can become incomplete and provisioning/refreshing from that snapshot might fail. We are providing a SnapSync option via CLI that you can customize to accept all datafiles during an Oracle SnapSync operation to prevent this error.
- Simplified Connection Management for Oracle databases
This feature streamlines the way that Delphix communicates and interacts with Oracle databases by simplifying the connection management infrastructure. Prior to this release, connections were established to Oracle databases using two different methods (remote connections from the Delphix Engine and local connections from the Delphix toolkit) and communication was performed with Oracle databases using two different users (a Delphix OS user and a Delphix DB user). Starting with this release, all communication with Oracle databases will be performed locally on the Oracle host and all connections to Oracle databases will be established using OS authentication. Existing Oracle dSources and VDBs will continue to function with no user intervention required. This feature results in several key benefits for Oracle DB customers such as elimination of the requirement for a Delphix DB user when linking, automated PDB discovery, elimination of Delphix interaction with any network listener, and many more.
Virtualization SDK Support for Password Vaults
Building off of the existing CyberArk and Hashicorp support for Oracle, SQL Server, and SAP ASE database user credentials, Delphix Virtualization will extend password vault coverage to the virtualization SDK (vSDK). This will enable data sources that are connected via a vSDK plugin to incorporate this more secure method of authentication.
SAP ASE Device Mapping Improvements
The Delphix Virtualization experience with SAP ASE heavily relies on and mirrors a database’s device allocation from the initial load (creating the dSource) to provision (creating VDBs). As these source device allocations shift over time, Delphix maps these changes and propagates them to their associated Delphix objects. However, dramatic device layout changes can negatively impact performance. This enhancement provides a quality-of-life (QoL) improvement to the overall SAP ASE experience by providing better error handling and escape valves should a dSource get into a bad state due to a major device layout shift.
Improved Storage Utilization for Large Pools
Up through the 6.0.6 release, Delphix Virtualization has enforced a storage usage limit of 85%. Once met, this limit will cause certain API operations to be disabled to ensure engine data integrity. In the 6.0.7 release, this threshold is relaxed significantly. The new thresholds are as follows:
“Warning”: when 85% of the total storage quota is reached or 1536GB of free storage is remaining (whichever is less), which can be resolved/ignored, with no impact on system behavior.
“Critical”: when 90% of the total storage quota is reached or 1024GB of free storage is remaining(whichever is less), which cannot be resolved/ignored, with some impact on system behavior.
“Minimum”: when 95% of the total storage quota is reached or 512GB of free storage is remaining (whichever is less). In this case, a critical fault is raised and cannot be resolved/ignored, with a substantial impact on system behavior (stop policies, VDB operations, etc).
- PVSCSI support
In addition to LSI Logic, with the 6.0.7 release, Delphix has added support for the VMware Paravirtual vSCSI controller (aka PVSCSI). While VMware designed PVSCSI to support very high throughput with minimal processing cost, the performance improvements on Delphix engines can vary from case to case. In 6.0.7, we also support manual changes from LSI Logic to PVSCSI for currently deployed engines.
- Solaris x86 to Linux x86 Oracle DB Provisioning
This feature allows provisioning of Oracle Virtual Databases from Solaris x86 dSources to Linux x86 target environments.
TDE for Oracle Multitenant
Oracle Advanced Security Transparent Data Encryption (TDE) provides the ability to encrypt sensitive application data on storage. Delphix will now support TDE for Oracle 12cR2, 18c and 19c multitenant. This release introduces support for single-instance linked container databases (CDBs) using software keystores. Virtual Container Database (vCDBs), RAC and rekeying of the TDE encryption keys are not supported in this release.
Please note the following important restrictions for TDE for Oracle Multitenant feature:
- TDE-enabled vPDBs must be provisioned to a linked CDB, not a vCDB.
- RAC dSources and target CDBs are not supported.
- The Oracle version must be 12.2 or higher (12.1 is not supported).
- System tables or tablespaces either in the PDB or CDB must not be encrypted.
- Oracle Key Vault is not supported.
- Hardware keystores are not supported.
- Keystores must not be on ASM storage.
- The dSource from which the initial provision is done must be encrypted when it is linked. Existing dSources cannot be encrypted without unlinking and creating a new dSource.
- Encrypting an already-provisioned unencrypted vPDB (with clear data) which is managed by Delphix is not supported.
- Single to Multitenant VDBs
Oracle announced the end of support for non-multitenant databases in their 20c release, and as such, Oracle DB customers are planning their upgrade and migration programs. Delphix will now support provisioning a virtual pluggable database from a non-multitenant virtual database.
- Added support for HashiCorp namespaces.
- ASE 15.7/16 on RHEL 7.9
- Oracle 12.1 on RHEL 7.9 and SLES 12 SP5
- Oracle 12.2 on RHEL 7.9 and SLES 12 SP5
- Oracle 19c on RHEL 7.9 and SLES 12 SP5
- ESXi 7.0 U1
- NFSv4 Support:
Support has been added for Oracle and ASE on AIX.
Expanded Replication: Replication of non-data objects
Our customers are increasingly using replication to facilitate moves of data across network boundaries, to the cloud and for DR purposes. We've had long-standing requests to replicate more than just the data, and in this release, we will support replication of users, roles, permissions, policies and configuration templates.
Upgraded Windows Connector:
The Windows Connector will now support newer versions of Microsoft’s .NET framework (4.x), which encompasses myriad higher security standards, new functionality, etc. Previously, the connector relied on .NET 3.5 due to two dependencies: SQL Server and Powershell, both have since been removed with SQL Server 2016+ and Powershell update in 184.108.40.206.
Db2 Extensible Ingestion:
We will now support an extensible model for ingesting Db2 data. In this new, additive, model, we will support customers manually performing a restore & roll forward of their staging database to Delphix from native backups or arbitrary third-party backup tools which integrate directly with Db2. This will allow customers to bring data from whatever system or backup they have and restore to an exact point in time, as needed.
ASE 16.0 on RHEL8.1 and RHEL8.2 on 6.0.4+
ASE 16.0 on SLES12.4 on 6.0.4+
Oracle 19.7 on RH7.8 and RH8.0 on 5.3.9+ and 6.0.3+
NFS v4 support on AIX
IBM Cloud Catalog. Delphix is now available in the IBM Cloud Catalog, a private marketplace for trusted IBM Technology partners that is offered to large IBM enterprise customers. In 6.0.5 we will start with a few certified instances for virtualization and masking and will grow our presence as more the business justifies the cost and efforts. Specifically, we support the following instances:
Oracle Cloud: The following are newly supported instance types:
HashiCorp and expanded CyberArk Support:
Delphix has extended both CyberArk and HashiCorp Vault support to Oracle Database Users in addition to previously supported ASE and MSSQL domain users. GUI support for HashiCorp Vault has been added during setup to authenticate host users and database users.
The HashiCorp namespace Enterprise feature is supported starting 220.127.116.11.
- NFSv4 Support:
Support has been added for SuSE and Db2 on AIX.
- OCI Support
- NFSv4 support for Db2 on AIX and SuSE
- SQL Server Instances with a Managed Service Account
CyberArk and Hashicorp Vault Support for Virtualization:
Delphix is introducing password vault support to authenticate environment and database linking and will support both CyberArk with Oracle and Hashicorp with CLI only.
Understanding where and how storage is used on Virtualization Engines can be a challenge, in particular, understanding how and where space is held and how to recover it. In this release, Delphix provides better details of held space, particularly around locked objects, and provides clear instructions about what steps are required to free up space.
Additional performance health-check analytics in phone-home have been added to better troubleshoot and understand customer problems.
- Powershell Upgrade:
Delphix is reducing our requirements for Windows hosts running PowerShell by allowing you to use any PowerShell version from 2.0 to 5.1. Delphix will now use the default available PowerShell version on each host. When specifying hooks (such as “configureClone”), users may specify whether to use 2.0 or whatever PowerShell version is installed on the host.
- Support for Oracle Read-only Homes:
Delphix is introducing support for Oracle read-only homes, which is a new Oracle feature starting with Oracle 18c. In a read-only Oracle home, all the configuration data and log files reside outside of the read-only Oracle home. This feature allows you to use the read-only Oracle home as a software image that can be distributed across multiple servers.
- Replication Performance:
Delphix will continue to improve replication performance for replication specifications that include multiple objects and single-object replication throughput.
- SAP ASE Support for VDB Upgrade:
SAP ASE Customers will now be able to validate DBMS Upgrades with this feature that enables provisioning VDBs to a higher version than the source DB (e.g. ASE 15.7 > ASE 16).
Shared NFS for Toolkits
With this release, Delphix introduces shared NFS for clustered environments. Customers wish to use a common NFS mount point, in which the Delphix toolkit for each cluster node can be deployed. The product today only creates a directory with appliance UUID and OS user in the folder name and uses this for detection to determine if a host is already managed by that Engine. As such, this prevents the customer from utilizing common NFS storage due to name conflict.
When a new environment is created, upgraded or if the toolkit path is changed, a new toolkit is created with naming convention Delphix_COMMON_<last 12 characters of engine ID>_<last 12 characters of host ID>_<user ref>_<host or cluster> for common directory and Delphix_<last 12 characters of engine ID>_<last 12 characters of host ID>_<user ref>_<host or cluster> for user directory.
With this change, the customer can use mounts on shared file systems (like NFS) as a toolkit path for clustered environments without any naming conflict.This change is not intended for windows environments.
EBS 12.2 with RHEL 7.6
PostgreSQL 12.1 & 12.2 with RHEL 7.8
Oracle 11g R2 and Oracle 19c with RHEL 7.8 on 18.104.22.168 and 6.0.2+
- Support for Db2 Database Partition Feature (DPF):
Delphix has long supported distributed Db2 (running on Unix/Linux Systems). However, Db2 supports partitioned databases as a means of scaling to larger, more complex systems. With this release, Delphix will now support Db2 DPF allowing you to scale to an increasing number of your Db2 databases.
Windows Authentication for SQL Server:
You will now be able to use Windows Authentication to link SQL Server databases. Rather than providing both a database user and a Windows user to ingest data, you can leverage one set of credentials (a Windows OS user) to perform all source operations. This capability will simplify SQL Server deployments and reduce Delphix’s security requirements on source databases.
Smart Failover allows the Delphix Administrator to simplify failover processes by automating object conflict resolution. By selecting a new option “Automate Object Conflict Resolution” before the failover process starts, the failover process will rename all conflicting objects and show a report of all object changes at the end.
NFSv4 Support: In 6.0.2 Delphix will start providing NFSv4 for data sources running on RedHat 7.0 or later. NFSv4 can be enabled using the CLI. Support for additional host OS versions will be added in subsequent releases. Delphix will consider enabling NFSv4 by default for those supported configurations in a future release.
Support Bundles not Required for Upgrade: When upgrading from 6.0.0 or greater to a release 6.0.2 or greater, we no longer require support bundles to be sent to Delphix. This allows you to execute more self-service upgrades.
ASE 16.0 on AIX 7.1
AWS r5n Instance Support: r5n.2xlarge, r5n.8xlarge, r5n.16xlarge
Azure E Series Instance Support: E8s_v3, E16s_v3, E32s_v3
- Masking support of Oracle 19c.
Masking Extended Connectors: A very common request for masking has been to support additional data sources, outside of the currently supported list. Thus, the next step in the strategy is the release of Masking Extended Connectors, which will allow our customers to add JDBC drivers to the masking engine to facilitate the masking of additional data sources. This will allow masking to be used for other common databases that can be accessed via JDBC, like SAP HANA, Informix, etc.
SQL Server CDC Support: We have expanded our support for SQL Server databases using Change Data Capture (CDC), a SQL Server feature that captures all the change information that is applied to the databases and stores it in change tables. Now, users will have the ability to preserve CDC data and enable CDC for SQL Server VDBs.
- ASE 16 and 15.7 with Solaris SPARC 11U3 and SPARC 11U4
- ASE 16 and 15.7 with RHEL 7.7
- SQL Server 2019 Support with Windows 2016 and Windows 2019
- Oracle 19c with SUSE SLES 15 SP1
- Oracle 19c with Solaris 11 U4 and U3 x86
Hypervisors: The following hypervisors have been certified in 6.0.1.
VMware ESX 6.5 U1, U2, U3
VMware ESX 6.7 U3
Google Cloud Support: Delphix now supports running in Google Cloud Platform for existing supported databases.
Enhanced Networking Adapter (ENA) Support: Delphix supports networking on AWS instances with the Elastic Network Adapter (ENA). This offers our customers enhanced networking capabilities and more economical options. Notably, this includes the AWS R4 instance types.
Masking NFS/CIFS Mount: Our customers increasingly are masking files alongside their databases. The masking engine has classically supported this via FTP/SFTP but now to make things easier Delphix has introduced the ability to directly mount and mask a file system - over NFS and CIFS. This should dramatically simplify the process of file masking.
Oracle Quality: Continued focus on Oracle quality and have introduced several quality improvements with our 6.0 release.
Masking API Updates: 6.0 introduces a significant number of new endpoints, including mainframe control, as well as updates for existing endpoints. This release also introduces versioning for the masking API, allowing our customers to upgrade without risk of breaking their integrations.
AdoptOpenJDK 8 for the Delphix Toolkit: Delphix has changed the Java Development Kit (JDK) that is included with the toolkit, and is sent to all Delphix connected environments. Customers who require using Oracle Java may continue to do so with the feature to provide their own Java, which shipped in 5.3.5.
Removed Instance Check: When running in AWS or Azure, the product will no longer raise a fault when it detects that it is running on an unsupported instance. This enables Delphix to certify previously released software on new instances without having to modify the software.
The product will still detect what instance it is running on and include this information in the user interface and phone home bundles. We will also continue to publish a matrix of supported instances for Azure, AWS, and GCP in the product documentation. Delphix provides no guarantee of performance or support for unsupported instance types.
Upgrade Process: The upgrade to 6.0 will be an in-place upgrade like other Delphix releases, there are a few changes that will improve the process overall for 6.0:
We will require an upgrade to an interim release first (either 5.3.6). This can be done at the same time as the customer upgrades to 6.0 or in the months prior.
We will be introducing new upgrade checks to ensure that customers are not using features that have been removed. For a list of removed features see Deprecated and Removed Features.
We will provide an upgrade image specific for each platform we support with Virtualization (VMWare, AWS, Azure, GCP). This will allow us to be more precise in customizing the images for each.