This section describes the new features and enhancements on the Delphix products.

Release 6.0.10.0

Virtualization

  • SQL Server-Support for Azure Storage Backups
    SQL native backups can now be read directly from Azure Cloud storage. For more information, see Restoring SQL Backups Stored in Azure Cloud Storage.
  • Support dSource Upgrades From Non-MT to MT in Oracle
    Once a dSource is converted to a multitenant PDB, you will be able to share its storage blocks with its non-multitenant predecessor. Delphix will only store the incremental changes to the database. For more information, see Prepare and Upgrade a Non-MT Oracle dSource to MT.
  • Oracle-Provision to the Latest Point-In-Time on RAC 
    Provision to the latest point-in-time is now supported.
  • Flexible ORACLE_HOME Permissions Configuration
    Removed the need to set permissions of the "$ORACLE_HOME/dbs" subdirectory using STARTUP SPFILE syntax to simplify Oracle operations. For more information, see 
    Requirements for Oracle Hosts and Databases.
  • Support for Manually Starting an Oracle VDB 
    An Oracle VDB can now be manually started. For more information, see Manually Starting a VDB.
  • Attach and Detach Oracle CDB Containers
    Detaching, attaching, and linking of the Oracle CDB containers is now supported via CLI. For more information, see 
    CLI Cookbook: Attaching, Detaching, or Linking a CDB.
  • Password Vaults and Remote Hooks for UI
    In the 6.0.9.0 release, we introduced the ability to use password vaults with hooks. This allows our customers to ensure a high level of security with all operations with external systems. This can now be configured via the user interface. For more information, see Passing Credentials Securely to Hook Operations.
  • NFSv4
    NFSv4 is now enabled by default. For more information, see NFSv4 Configuration.
  • 12-month Support for Upgrades and Forward Compatible Replication (FCR)
    To better align with the Delphix support program, Engine upgrades and FCR operations must be within versions no more than 12 months apart. For example, upgrading to version 6.0.10.0 will require the previous version to be at least 6.0.4.0. For more information, see Upgrade Matrix and Replication Overview.
  • HANA Plugin Port Control
    You can now keep the port numbers consistent throughout the HANA VDB life cycle so that the connections made to the VDBs are not disrupted during their life cycle. For more information, see Provisioning HANA VDBs: An Overview.
  • User-Specified Mount Path For Db2 dSource
    You can now specify a mount path of your choice to host the dSource dataset on the target host. For more information, see Linking a Db2 dSource
  • Staging Push Automation for Db2 dSource
    You can now use a set of scripts that can be used to automate the restore and rollforward operations on the dSource. For more information, see Staging Push Automation.

Masking

  • New Mapping Algorithm
    A more powerful and faster mapping algorithm is now available. This allows running the same mapping algorithm across multiple jobs and across multiple engines. Running the same mapping algorithm across multiple engines requires a compatible external database. New APIs now support migrating mappings from existing mapping algorithms to the new mapping algorithms.
  • Algorithm Replacement APIs
    APIs are now being introduced to list and replace algorithms. 
  • New Phone Masking Algorithm
    A new masking algorithm for the phone number framework for US and international numbers is now available. Migration from the old phone masking algorithm to the new one is required. For more information on transition, see this Delphix Community Post.
  • Select Connector
    The new Select Connector for Salesforce, sensitive data discovery, and Masking algorithm assignment are now automatically handled for the Salesforce default schema. This connector provides a simpler deployment option to manage and secure business-critical data. Furthermore, it facilitates data orchestration, allowing customers to backup, version, and restore Salesforce data.
  • New Custom SQL API
    This release extends the list of API endpoints by adding a new table-metadata endpoint to generate custom SQL for the given tableMetadataId. Custom SQL gives the ability to customize records being input into the Masking Engine. The new API endpoint is as follows:

    GroupEndpointsDescription
    tableMetadataGET /table-metadata/{tableMetadataId}/generateCustomSQLGenerates a custom SQL

Data Control Tower

  • DCT Accessibility Improvements
    This release meets the WCAG 2.1 Level AA accessibility compliance for Data Control Tower. It equalizes the user experience of impaired users with that of non-impaired users and facilitates easier transition for heavily regulated and government organizations.
  • Updated DCT MC
    The next version of Data Control Tower Multicloud is now available. It provides a single point of automation for those who want to manage their own infrastructure. This next version includes APIs for virtual database creation, control, and monitoring allowing for deeper and simpler enterprise automation.
  • Environment APIs
    In continuation of the APIs, a new SaaS API endpoint on api.delphix.com is released to enumerate all virtualization environments. It drives all orchestration from a single point - either on DCT SaaS or DCT Multicloud.
  • Data Version Control API
    A new bookmark API on api.delphix.com is now available that allows customers to version data across any number of data sets and store this reference alongside their code or other artifacts.

Certifications

Virtualization

Masking

  • OCI VM.Standard.E4
  • AWS r5n.24xlarge

Release 6.0.9.0

Virtualization

  • Delphix Data Vault - Additions
    In continuation to the Delphix Data Vault for ransomware protection released in 6.0.8.0, this release enables you to manage this feature from the Delphix Engine user interface and also lets you monitor the regular valid replication receives. For more information, see Delphix Data Vault.

  • TLS 1.3
    The TLS 1.3 support is added as an available secure connection option at the Engine Admin Console to be used between engines.
  • Phonehome Data Collection Frequency
    The default collection period for the Phonehome users is now changed to daily. For more information, see System Configurations - Enable Phone Home.
  • Password Vaults for Remote Hooks
    With this release, the hooks running on environments can now obtain credentials from the engine and its configured password vaults. These credentials can be used to perform custom authentication tasks in a secure manner. Currently, this feature is supported via the command line interface only. For more information, see Passing Credentials Securely to Hook Operations.
  • Delphix Integrations (dxi) Docker Image
    A new dockerized version of the dxi library is now available. For more information, see Docker Image.

Masking

  • Secure Shuffle Algorithm
    A new version of the Secure Shuffle algorithm is now available. This algorithm takes existing values in a user's dataset and sorts them in order. This also provides robust performance and supports a large shuffle set.
  • Email Masking Algorithm
    A new algorithm framework that supports masking email addresses to unique values is now available. This algorithm also provides the ability to independently choose how different parts of an email address such as the name and domain are masked.
  • Masking Extensibility SDK
    The name "Masking Algorithm SDK" is now changed to "Masking Extensibility SDK" to reflect the additional functions that can be extended via the SDK.
  • Masking Custom Tasks
    Extended connectors have been made more powerful by providing the ability to add custom tasks. These custom tasks include commonly-requested steps such as disabling triggers or constraints which will be executed in a masking job before and after the transformation step. In future releases, this functionality will include additional connector types.
  • Batch Masking - Enhancements
    Batch masking processing is now added to the Masking Extensibility SDK. This allows an algorithm to receive multiple inputs, mask them, and then provide the set of results back to the masking job. This feature allows an algorithm to implement logic that considers the values of multiple inputs at once.

Data Control Tower (Formerly, Central Management)

  • DCT Multi-Cloud API Gateway
    A new product, Data Control Tower Multi-Cloud has been offered with this release. This product brings an API control point to our users who want to run their integrations either on-premises or in a cloud of their choice.
  • Expansion of api.delphix.com
    A set of endpoints has been added to list the virtualization data object sources (dSource and VDBs). These new API endpoints enable Data Control Tower users to query dataset information, without regard to individual engines, power reporting workflows, and monitor data set usage.

Certifications

Release 6.0.8.0

Virtualization

  • Delphix Data Vault
    The Delphix Data Vault for ransomware protection (accessible via CLI) enables organizations to recover access to their application data much faster than traditional backup solutions after malicious attacks. It relies on the new Data Vault Replication feature, which replicates critical business DB data stored on Delphix engines to a new target engine called Data Vault. Once securely stored on the Data Vault, the replicated DB data can be used to recover business applications upon a ransomware attack with very low RTO and RPO.
  • Dxi Executable and Support for Encrypted Credentials
    We will be distributing the dxi CLI, a Delphix solution built to facilitate simpler and seamless integration of Delphix Platform Operations into existing workflows, as Windows, macOS and RHEL binaries. This will simplify adoption and remove the requirement on Python. Delphix has also adding encryption for the login credentials.
  • Expansion of Retention Period on Replicated Objects
    At present, when snapshots on the replication source engine are deleted (either due to retention policies or user action), the next replication job will delete those snapshots on the replication target engine. This improvement will allow you to extend the retention period of replicated objects on target engines while keeping the original retention at the source. Once the object in the target engine reaches its retention period, it will be flagged and deleted by the policy agent based on a daily schedule.
  • Db2 Staging Push
    Delphix now supports Staging Push for non-DPF Db2 databases. The Staging Push architecture will allow organizations to bring their data to Delphix, with their own tools and standard processes. This facilitates the use of any backup tool, a major ongoing source of requests. This should dramatically increase the volume of data that can be easily managed by Delphix.
  • HANA Plugin Staged Architecture
    Delphix introduces a staging architecture for HANA virtualization. This will make it consistent with other virtualized data sources. This new architecture will build a foundation for future staging push capabilities, as Delphix has begun to introduce for other platforms. These changes, together, will allow us to support more prospective organizations with various SAP-certified, 3rd-party backup applications for HANA. Delphix will continue to support the pull ingestion method with HANA native backups and logs. 
  • ASE Native Encryption Support
    SAP ASE version 16.0 introduces the ability to fully encrypt databases, provides protection for all the data, indexes, and transaction logs in a database. This offers full database protection while allowing the user to query and manage the data as usual, as the encryption is transparent to existing functions. In response to customer demand, we have added a security enhancement to support encrypted ASE databases. This allows customers to maintain the ASE encryption that is active on their sources and propagate that through to their VDBs.

  • System Tunable Interface
    A new web service API is introduced which allows you to set or receive the values of a system tunable via Delphix CLI. A Support engineer can now provide context via Support case to modify these values.

  • Oracle Customized Full Backups
    There is a rarely-seen bug in Oracle that results in some blocks not being written to the datafiles during an Oracle SnapSync operation. When this happens, the datafiles can become incomplete and provisioning/refreshing from that snapshot might fail. We are providing a SnapSync option via CLI that you can customize to accept all datafiles during an Oracle SnapSync operation to prevent this error.

Masking

  • Full Name Algorithms
    Delphix Masking introduces a new FullName algorithm that masks full name strings into first names and last names that are stored separately. This has traditionally been a major driver of custom algorithms.
  • Algorithm Chaining Framework
    Delphix Masking will now support building algorithms from a combination of existing algorithms. For example, the aforementioned full name algorithm is based on existing first name and last name algorithms. This is a major driver of custom algorithms, which will allow you to move to supportable frameworks. 

  • Escape Character Support for Delimited File Masking
    Delphix Masking will now support the configuration of escape characters for enclosure characters in file masking with the following: 

    • Doubling the enclosure

      • e.g. Test data using double ""enclosure"" for enclosure escaping.

    • Using custom character with enclosure

      • e.g. Test data using a backslash  \"enclosure\" for enclosure escaping.

Release 6.0.7.0

Virtualization

  • Simplified Connection Management for Oracle databases
    This feature streamlines the way that Delphix communicates and interacts with Oracle databases by simplifying the connection management infrastructure. Prior to this release, connections were established to Oracle databases using two different methods (remote connections from the Delphix Engine and local connections from the Delphix toolkit) and communication was performed with Oracle databases using two different users (a Delphix OS user and a Delphix DB user). Starting with this release, all communication with Oracle databases will be performed locally on the Oracle host and all connections to Oracle databases will be established using OS authentication. Existing Oracle dSources and VDBs will continue to function with no user intervention required. This feature results in several key benefits for Oracle DB customers such as elimination of the requirement for a Delphix DB user when linking, automated PDB discovery, elimination of Delphix interaction with any network listener, and many more.
  • Virtualization SDK Support for Password Vaults 
    Building off of the existing CyberArk and Hashicorp support for Oracle, SQL Server, and SAP ASE database user credentials, Delphix Virtualization will extend password vault coverage to the virtualization SDK (vSDK). This will enable data sources that are connected via a vSDK plugin to incorporate this more secure method of authentication.

  • SAP ASE Device Mapping Improvements 
    The Delphix Virtualization experience with SAP ASE heavily relies on and mirrors a database’s device allocation from the initial load (creating the dSource) to provision (creating VDBs). As these source device allocations shift over time, Delphix maps these changes and propagates them to their associated Delphix objects. However, dramatic device layout changes can negatively impact performance. This enhancement provides a quality-of-life (QoL) improvement to the overall SAP ASE experience by providing better error handling and escape valves should a dSource get into a bad state due to a major device layout shift. 

  • Improved Storage Utilization for Large Pools
    Up through the 6.0.6 release, Delphix Virtualization has enforced a storage usage limit of 85%. Once met, this limit will cause certain API operations to be disabled to ensure engine data integrity. In the 6.0.7 release, this threshold is relaxed significantly. The new thresholds are as follows:

    • “Warning”: when 85% of the total storage quota is reached or 1536GB of free storage is remaining (whichever is less), which can be resolved/ignored, with no impact on system behavior.

    • “Critical”: when 90% of the total storage quota is reached or 1024GB of free storage is remaining(whichever is less), which cannot be resolved/ignored, with some impact on system behavior.

    • “Minimum”: when 95% of the total storage quota is reached or 512GB of free storage is remaining (whichever is less). In this case, a critical fault is raised and cannot be resolved/ignored, with a substantial impact on system behavior (stop policies, VDB operations, etc).

  • PVSCSI support
    In addition to LSI Logic, with the 6.0.7 release, Delphix has added support for the VMware Paravirtual vSCSI controller (aka PVSCSI). While VMware designed PVSCSI to support very high throughput with minimal processing cost, the performance improvements on Delphix engines can vary from case to case. In 6.0.7, we also support manual changes from LSI Logic to PVSCSI for currently deployed engines.

Masking

  • New Date Masking Frameworks
    Delphix introduces new date masking frameworks including date replacement, date shift, and multi-column dates.  These new frameworks obviate the need for many of the custom date algorithms that were required in the past. Delphix also introduces new default implementations of common date-masking functionality.  The new date masking frameworks are briefly described below.
    • Date Replacement: Selects a replacement value from a customer configurable date range.

    • Date Shift: Produces a replacement value by randomly shifting the input date by a customer configurable increment range.

    • Multi-column Date: Masks date values that have a dependency, such as admission and discharge date using the same algorithm as Date Shift.  This allows masking of both the initial date and the difference between the dates.

  • New Credit Card Masking Algorithms
    Delphix introduces a robust payment-card masking framework as well as a default algorithm implementation for credit card data. The legacy credit card algorithm, which produced random values, is being replaced by the new default instance which provides consistent masking results, a unique output for every valid input, always changes a valid input value, and preserves all non-digit portions of the input value.

  • Masking Engine changes for Users and Groups
    This enhancement adds stronger on-Masking Engine safeguards to the users and group's experience delivered in  Data Control Tower in which the access to a Masking Engine’s objects is determined by assigning authorization via global access groups. Specifically, when an engine opts into the global model, it relinquishes local control of object access.  With this enhancement, the local enforcement of global (Data Control Tower) settings is strengthened by deactivating local object access in the UI, thus ensuring the local values will not be overridden via frequent, periodic scans from Data Control Tower. 
  • New Forgot and Reset password APIs
    In this release, Delphix has extended the list of API-endpoints by adding two new APIs related to the existing Forgot and Reset password feature for a user, which was available via GUI only till now.

    The two new sets of API endpoints are :

    GroupEndpointsDescription
    userPOST /users/forgot-passwordSend reset password mail to the user.

    POST /users/reset-passwordReset a new password for the user.

    The forgot-password API will generate and send a password reset link to the registered email id of the user, for which the password has to be reset.

    The reset-password API will use the token sent via the password reset link, to set the new password.

Release 6.0.6.0

Virtualization

  • Solaris x86 to Linux x86 Oracle DB Provisioning 
    This feature allows provisioning of Oracle Virtual Databases from Solaris x86 dSources to Linux x86 target environments.
  • TDE for Oracle Multitenant
    Oracle Advanced Security Transparent Data Encryption (TDE) provides the ability to encrypt sensitive application data on storage. Delphix will now support TDE for Oracle 12cR2, 18c and 19c multitenant. This release introduces support for single-instance linked container databases (CDBs) using software keystores. Virtual Container Database (vCDBs), RAC and rekeying of the TDE encryption keys are not supported in this release. 

    Please note the following important restrictions for TDE for Oracle Multitenant feature:

    • TDE-enabled vPDBs must be provisioned to a linked CDB, not a vCDB.
    • RAC dSources and target CDBs are not supported.
    • The Oracle version must be 12.2 or higher (12.1 is not supported).
    • System tables or tablespaces either in the PDB or CDB must not be encrypted.
    • Oracle Key Vault is not supported.
    • Hardware keystores are not supported.
    • Keystores must not be on ASM storage.
    • The dSource from which the initial provision is done must be encrypted when it is linked.  Existing dSources cannot be encrypted without unlinking and creating a new dSource.
    • Encrypting an already-provisioned unencrypted vPDB (with clear data) which is managed by Delphix is not supported.
  • Single to Multitenant VDBs
    Oracle announced the end of support for single-tenant databases in their 20c release, and as such, Oracle DB customers are planning their upgrade and migration programs. Delphix will now support provisioning a virtual pluggable database from a single-tenant virtual database.
  • Added support for HashiCorp namespaces.

Masking

  • Multi-Column Algorithm
    In this release, Delphix has introduced a Multi-Column Extended Algorithm mechanism, which allows masking multiple columns of the same table conditional to their values (or using any other logic needed by the customer). The Multi-Column Algorithm Framework is to be created via the Masking SDK and to be installed to the Masking Engine via the Extended Algorithm Plugin.

Data Control Tower (Formerly, Central Management)

  • Global Masking Users and Groups:
    As part of the broader Users and Groups project, Data Control Tower will support the central administration of masking users and permissions.

Certifications

  • Virtualization
    • ASE 15.7/16 on RHEL 7.9
    • Oracle 12.1 on RHEL 7.9 and SLES 12 SP5
    • Oracle 12.2 on RHEL 7.9 and SLES 12 SP5
    • Oracle 19c on RHEL 7.9 and SLES 12 SP5
  • Hypervisors/Clouds
    • ESXi 7.0 U1
  • Masking
    • DB2 on iSeries 7.4
    • GCP Cloud SQL Postgres (available now)
    • GCP Cloud MySQL (available now)
    • GCP Cloud SQL Server (available now)

Release 6.0.5.0

Virtualization

  • NFSv4 Support:
    Support has been added for Oracle and ASE on AIX.
  • Expanded Replication: Replication of non-data objects
    Our customers are increasingly using replication to facilitate moves of data across network boundaries, to the cloud and for DR purposes. We've had long-standing requests to replicate more than just the data, and in this release, we will support replication of users, roles, permissions, policies and configuration templates.

  • Upgraded Windows Connector:
    The Windows Connector will now support newer versions of Microsoft’s .NET framework (4.x), which encompasses myriad higher security standards, new functionality, etc. Previously, the connector relied on .NET 3.5 due to two dependencies: SQL Server and Powershell, both have since been removed with SQL Server 2016+ and Powershell update in 6.0.3.0.

  • Db2 Extensible Ingestion:
    We will now support an extensible model for ingesting Db2 data. In this new, additive, model, we will support customers manually performing a restore & roll forward of their staging database to Delphix from native backups or arbitrary third-party backup tools which integrate directly with Db2. This will allow customers to bring data from whatever system or backup they have and restore to an exact point in time, as needed.

Masking

  • Character Mapping Algorithm: We are introducing a replacement for the Segment Mapping algorithm, the Character Mapping algorithm. The new Character Mapping algorithm is built using the recently released algorithm SDK, and in most common configurations this new algorithm will be faster and require less memory than the existing segment mapping algorithm. In addition, this new version does not have a length limitation for the input string and can handle non-ASCII characters.

Data Control Tower (Formerly, Central Management)

  • Data Control Tower Attributes/Groups Support:
    We recently introduced the concept of user groups and data access groups in the Data Control Tower. These provide the ability to manage data and users across engines, greatly simplifying data access. We are now introducing the ability to control data access via Identity Provider attributes. A customer can create these attributes directly in their identity provider or by federating Active Directory or LDAP with their identity provider.

  • Data Control Tower Upgrade Notification:
    We will now directly notify our customers in Data Control Tower when new versions of appliance software are available. This represents a continued integration between our SaaS and appliance offerings that ensures our clients are aware of the latest offerings and paves the way for more direct communication with our customers.

  • CM: Agent download proxy (UI)

Certifications

  • Virtualization
    • ASE 16.0 on RHEL8.1 and RHEL8.2 on 6.0.4+

    • ASE 16.0 on SLES12.4 on 6.0.4+

    • Oracle 19.7 on RH7.8 and RH8.0 on 5.3.9+ and 6.0.3+

    • ESX 7.0

    • NFS v4 support on AIX

    • IBM Cloud Catalog. Delphix is now available in the IBM Cloud Catalog, a private marketplace for trusted IBM Technology partners that is offered to large IBM enterprise customers. In 6.0.5 we will start with a few certified instances for virtualization and masking and will grow our presence as more the business justifies the cost and efforts. Specifically, we support the following instances:

      • mx2-8x64

      • mx2-16x128

      • mx2-32x256

      • mx2-48x384

    • Oracle Cloud: The following are newly supported instance types:

      • VM.Standard2.8

      • VM.Standard2.16

      • VM.Standard2.24 

  • Masking

    • MySQL 8

    • Postgres SQL 12

    • DB2 LUW 11.5

    • Oracle Database Cloud Services on Virtual Machines

    • Oracle Database Cloud Services on Bare Metal

    • Google Cloud SQL for PostgreSQL

    • Google Cloud SQL for MySQL

    • Google Cloud SQL for SQL Server

Release 6.0.4.0

Virtualization

  • HashiCorp and expanded CyberArk Support:
    Delphix has extended both CyberArk and HashiCorp Vault support to Oracle Database Users in addition to previously supported ASE and MSSQL domain users. GUI support for HashiCorp Vault has been added during setup to authenticate host users and database users.

    The HashiCorp namespace Enterprise feature is supported starting 6.0.6.0.

  • NFSv4 Support:
    Support has been added for SuSE and Db2 on AIX.

Masking

  • Masking Job Memory Improvements:
    Memory management has been dramatically improved. Not only can jobs run with less memory, but the Masking Engine will also now ensure that jobs can only run if enough memory is available and that the engine cannot run out of memory.

  • Extensible Connector Permissions Change: The first iteration of the Masking Extensible Connectors, supporting the ability to upload and use JDBC drivers, required that the permissions for each driver be enumerated at install time. Delphix has now replaced this mechanism with a fixed security policy blocking only the most dangerous permissions (specifically those that could inflict harm to the Masking Engine), removing the need for user management of permissions. It remains the case that the engine administrator must ensure that only trusted JDBC driver software is installed.
  • New Secure Lookup Algorithm:
    In 6.0.3, Delphix introduced the Masking Algorithm SDK. In addition to enabling our partners and customers to write new algorithms, Delphix also intends to use this to introduce new variants of our built-in algorithms. The first of these is a new Secure Lookup Algorithm.
    The new Secure Lookup Algorithm framework provides improved masking performance, stronger encryption, the ability to call this built-in algorithm from inside an extended algorithm, and options for case sensitivity.

  • File Masking Performance:
    The performance of file masking has been significantly improved. 
  • Builtin Extended Secure Lookup Framework:

    Delphix has added a builtin, configurable Secure Lookup Algorithm Framework, based on the Extended Algorithms
    feature (introduced in 6.0.3.0 release).

    This framework provides better performance and new features when compared with the Legacy Secure Lookup Algorithms.

    It allows configuring the case sensitivity of input values (true/false), and the case configuration of the output values:

    Preserve Lookup File Case // i.e. as found in Lookup File
    Preserve Input Case // i.e. preserve case of input value - UpperCase / LowerCase / Mixed
    Force all Lowercase // forces output to LowerCase
    Force all Uppercase // forces output to UpperCase

    The algorithm instance (based on the new Secure Lookup Algorithm Framework) might be managed via the existing Algorithm API, similar to any other plugin algorithm.
    The GUI has been changed for configuring/editing the Secure Lookup Algorithm. For details please see Secure Lookup Algorithm Framework

  • Job Scheduler Removed: 
    As of this release, Delphix has removed the Job Scheduler feature. The introduction of Masking’s REST API several releases ago allowed customers to schedule job executions using their preferred job scheduler. As a result, the integrated scheduler is seldom used.

Data Control Tower (Formerly, Central Management)

  • Users and Groups:
    Delphix is introducing a new model of managing access to data. Rather than assigning each individual user ownership on a per-engine, per-data set basis, customers can create data access groups, by defining access for groups of datasets that can span multiple engines and the set of users that can then access these groups. Access to these groups may be set on a per-user basis or via attributes/groups defined in the customers’ identity providers (including LDAP/Active Directory via federation). 
  • Connectivity Update:
    To simplify the customer onboarding process, Delphix has made changes to how the engines connect to Data Control Tower. First, an engine’s cloud agent will respect any configured proxy settings. Second, the engine will automatically route all traffic through api.delphix.com if direct access to our certificate management service (GoDaddy) is unavailable. 

Certifications

  • Virtualization
    • OCI Support
    • NFSv4 support for Db2 on AIX and SuSE
    • SQL Server Instances with a Managed Service Account
  • Masking

    • SQL Server 2017 and 2019

Release 6.0.3.0

Virtualization

  • CyberArk and Hashicorp Vault Support for Virtualization:
    Delphix is introducing password vault support to authenticate environment and database linking and will support both CyberArk with Oracle and Hashicorp with CLI only.

  • Capacity Management:
    Understanding where and how storage is used on Virtualization Engines can be a challenge, in particular, understanding how and where space is held and how to recover it. In this release, Delphix provides better details of held space, particularly around locked objects, and provides clear instructions about what steps are required to free up space. 

  • Diagnosability:
    Additional performance health-check analytics in phone-home have been added to better troubleshoot and understand customer problems. 
  • Powershell Upgrade:
    Delphix is reducing our requirements for Windows hosts running PowerShell by allowing you to use any PowerShell version from 2.0 to 5.1. Delphix will now use the default available PowerShell version on each host. When specifying hooks (such as “configureClone”), users may specify whether to use 2.0 or whatever PowerShell version is installed on the host.
  • Support for Oracle Read-only Homes: 
    Delphix is introducing support for Oracle read-only homes, which is a new Oracle feature starting with Oracle 18c. In a read-only Oracle home, all the configuration data and log files reside outside of the read-only Oracle home. This feature allows you to use the read-only Oracle home as a software image that can be distributed across multiple servers.
  • Replication Performance:
    Delphix will continue to improve replication performance for replication specifications that include multiple objects and single-object replication throughput. 
  • SAP ASE Support for VDB Upgrade:
    SAP ASE Customers will now be able to validate DBMS Upgrades with this feature that enables provisioning VDBs to a higher version than the source DB (e.g. ASE 15.7 > ASE 16).
  • Shared NFS for Toolkits

    With this release, Delphix introduces shared NFS for clustered environments. Customers wish to use a common NFS mount point, in which the Delphix toolkit for each cluster node can be deployed. The product today only creates a directory with appliance UUID and OS user in the folder name and uses this for detection to determine if a host is already managed by that Engine. As such, this prevents the customer from utilizing common NFS storage due to name conflict.

    When a new environment is created, upgraded or if the toolkit path is changed, a new toolkit is created with naming convention Delphix_COMMON_<last 12 characters of engine ID>_<last 12 characters of host ID>_<user ref>_<host or cluster> for common directory and Delphix_<last 12 characters of engine ID>_<last 12 characters of host ID>_<user ref>_<host or cluster> for user directory.

    With this change, the customer can use mounts on shared file systems (like NFS) as a toolkit path for clustered environments without any naming conflict.

    This change is not intended for windows environments.

Masking

  • Extended Algorithms
    We introduced a new, radically simpler, method to create new masking algorithms. With the new framework, Delphix partners and customers can create and share new algorithms. Extended algorithms and their related algorithm plugins can be managed through the following APIs:

    GroupEndpointsDescription
    pluginGET /pluginGet all plugins

    POST /pluginInstall plugin

    DELETE /plugin/{pluginId}Delete plugin

    GET /plugin/{pluginId}Get plugin detail by pluginid

    PUT /plugin/{pluginId}Update plugin

    Existing algorithm API is extended with the following endpoints:

    GroupEndpointsDescription
    algorithmGET /algorithm/frameworksGet all algorithm frameworks

    GET /algorithm/frameworks/id/{frameworkId}Get algorithm framework by frameworkId
  • UI-based Environment Sync
    Over the past several releases Delphix has introduced and refined the ability to synchronize objects between Masking Engines via the API. In 6.0.3, Delphix now supports importing and exporting environments via the UI.

    In this release, the deprecated XML import/export functionality has been removed. If you used the XML import/export feature in previous releases, you'll find the new Sync Environment feature to be a more robust and complete solution with complete API support in addition to being available in the UI.
  • New SQL Server JDBC Driver

    The product switched from the jTDS JDBC driver to Microsoft's official open-source JDBC driver. This was done to obtain improved support for recent versions of SQL Server.

    All SQL Server basic connectors will be converted transparently. If you used a SQL Server Advanced connector or a Generic connector using the jTDS driver, you will need to manually convert your JDBC URL to the Microsoft JDBC driver's format. To perform this conversion, please see the references for the jTDS parameters and the Microsoft JDBC parameters. Delphix Customer Support's upgrade validation checks will detect any SQL Server Advanced connectors and Generic connectors using the jTDS driver in your installation and they will notify you of the need to manually convert those connectors.

  • AzureSQL Managed Databases
    This release is certified to be compatible with the following AuzreSQL Managed Databases:
    • Azure Database for PostgreSQL service
    • Azure Database for MySQL service
    • Azure Database for MariaDB service
    • Azure Database for SQL

You must enable support for non-TLS connections.

  • File Masking Performance
    This release contains significant performance improvements for delimited and XML file masking.

Certifications

  • Masking

    • AzureSQL

    • Azure Database for PostgreSQL service

    • Azure Database for MySQL service

    • Azure Database for MariaDB service

  • Virtualization

    • EBS 12.2 with RHEL 7.6

    • PostgreSQL 12.1 & 12.2 with RHEL 7.8

    • Oracle 11g R2 and Oracle 19c with RHEL 7.8 on 5.3.9.0 and 6.0.2+

Release 6.0.2.0

Virtualization

  • Support for Db2 Database Partition Feature (DPF):
    Delphix has long supported distributed Db2 (running on Unix/Linux Systems). However, Db2 supports partitioned databases as a means of scaling to larger, more complex systems. With this release, Delphix will now support Db2 DPF allowing you to scale to an increasing number of your Db2 databases.
  • Windows Authentication for SQL Server:
    You will now be able to use Windows Authentication to link SQL Server databases. Rather than providing both a database user and a Windows user to ingest data, you can leverage one set of credentials (a Windows OS user) to perform all source operations. This capability will simplify SQL Server deployments and reduce Delphix’s security requirements on source databases.

  • Smart Failover:
    Smart Failover allows the Delphix Administrator to simplify failover processes by automating object conflict resolution. By selecting a new option “Automate Object Conflict Resolution” before the failover process starts, the failover process will rename all conflicting objects and show a report of all object changes at the end.

  • NFSv4 Support: In 6.0.2 Delphix will start providing NFSv4 for data sources running on RedHat 7.0 or later. NFSv4 can be enabled using the CLI. Support for additional host OS versions will be added in subsequent releases. Delphix will consider enabling NFSv4 by default for those supported configurations in a future release.

  • Support Bundles not Required for Upgrade: When upgrading from 6.0.0 or greater to a release 6.0.2 or greater, we no longer require support bundles to be sent to Delphix. This allows you to execute more self-service upgrades.

Masking

  • Mainframe Data Set Improvements for Masking
    This release delivers multiple quality-of-experience enhancements around mainframe masking workflows:
    • Mainframe Masking Performance: Anyone masking mainframe data sets may see a large improvement in performance.
    • Engine Sync Support for Mainframe: The Sync APIs and workflows now support mainframe objects: connectors, rule sets, jobs, and file formats.
    • Mainframe Support for Record Type APIs: This enhancement builds upon the recent release of Record Type APIs to include mainframe support. You will now be able to create and manage Mainframe file record types via REST API, including redefine conditions.
  • JDBC to Delimited Files Support
    On-the-fly masking jobs with a JDBC source and delimited file target are now supported. This is targeted at users with data lake applications. This is targeted at users with data lake applications who wish to extract unmasked data using a JDBC connection and insert masked data back using a bulk file load mechanism.
  • Environment Sync Support for Masking
    With this release, an entire environment is now syncable with a single operation via the Sync REST APIs. Previously, Sync users would have to export/import objects on an individual basis, the process now is far more streamlined. Note: Environment Sync APIs are the preferred way of handling environment export/import versus XML-based transfer.
  • New API version 5.1.2 in this release
    To reflect the API improvements mentioned above, the API version increased to 5.1.2 in this release. For a complete listing of version 5.1.2, see the Masking API Client page.

Certifications

  • ASE 16.0 on AIX 7.1

  • AWS r5n Instance Support: r5n.2xlarge, r5n.8xlarge, r5n.16xlarge

  • Azure E Series Instance Support: E8s_v3, E16s_v3, E32s_v3

  • Masking support of Oracle 19c.

Release 6.0.1.0

  • Masking Extended ConnectorsA very common request for masking has been to support additional data sources, outside of the currently supported list. Thus, the next step in the strategy is the release of Masking Extended Connectors, which will allow our customers to add JDBC drivers to the masking engine to facilitate the masking of additional data sources. This will allow masking to be used for other common databases that can be accessed via JDBC, like SAP HANA, Informix, etc.

  • SQL Server CDC Support: We have expanded our support for SQL Server databases using Change Data Capture (CDC), a SQL Server feature that captures all the change information that is applied to the databases and stores it in change tables. Now, users will have the ability to preserve CDC data and enable CDC for SQL Server VDBs.

Certifications

  • Virtualization
    • ASE 16 and 15.7 with Solaris SPARC 11U3 and SPARC 11U4 
    • ASE 16 and 15.7 with RHEL 7.7
    • SQL Server 2019 Support with Windows 2016 and Windows 2019
    • Oracle 19c with SUSE SLES 15 SP1
    • Oracle 19c with Solaris 11 U4 and U3 x86
  • Hypervisors: The following hypervisors have been certified in 6.0.1.

    • VMware ESX 6.5 U1, U2, U3

    • VMware ESX 6.7 U3

Release 6.0.0.0

Google Cloud Support:  Delphix now supports running in Google Cloud Platform for existing supported databases.

Enhanced Networking Adapter (ENA) Support: Delphix supports networking on AWS instances with the Elastic Network Adapter (ENA). This offers our customers enhanced networking capabilities and more economical options. Notably, this includes the AWS R4 instance types.

  • Masking NFS/CIFS Mount: Our customers increasingly are masking files alongside their databases. The masking engine has classically supported this via FTP/SFTP but now to make things easier Delphix has introduced the ability to directly mount and mask a file system - over NFS and CIFS. This should dramatically simplify the process of file masking.

  • Oracle Quality: Continued focus on Oracle quality and have introduced several quality improvements with our 6.0 release. 

  • Masking API Updates: 6.0 introduces a significant number of new endpoints, including mainframe control, as well as updates for existing endpoints. This release also introduces versioning for the masking API, allowing our customers to upgrade without risk of breaking their integrations.

  • AdoptOpenJDK 8 for the Delphix Toolkit: Delphix has changed the Java Development Kit (JDK) that is included with the toolkit, and is sent to all Delphix connected environments. Customers who require using Oracle Java may continue to do so with the feature to provide their own Java, which shipped in 5.3.5.

  • Removed Instance Check: When running in AWS or Azure, the product will no longer raise a fault when it detects that it is running on an unsupported instance. This enables Delphix to certify previously released software on new instances without having to modify the software.
    The product will still detect what instance it is running on and include this information in the user interface and phone home bundles. We will also continue to publish a matrix of supported instances for Azure, AWS, and GCP in the product documentation. Delphix provides no guarantee of performance or support for unsupported instance types.

  • Upgrade Process: The upgrade to 6.0 will be an in-place upgrade like other Delphix releases, there are a few changes that will improve the process overall for 6.0:

    • We will require an upgrade to an interim release first (either 5.3.6). This can be done at the same time as the customer upgrades to 6.0 or in the months prior.

    • We will be introducing new upgrade checks to ensure that customers are not using features that have been removed. For a list of removed features see Deprecated and Removed Features.

    • We will provide an upgrade image specific for each platform we support with Virtualization (VMWare, AWS, Azure, GCP). This will allow us to be more precise in customizing the images for each.