2020.9 - DataClarity New Features and Enhancements

DataClarity 2020.9 brings the following new features and enhancements:

Data Preparation

Storyboards

Data Science

Installation & Configuration

 

DATA PREPARATION

Apply number formatting

In this release, dataset modelers can control how to display values in numeric columns. The column format defines how values are displayed in a dataset and in visualizations on a storyboard. Number formats only determine the appearance of the values but do not change how the actual values are stored.

You can format numeric columns as number, currency, or percentage. Each format has its own set of properties. For example, you can define how many decimals to show, what separator symbols to use for decimals and thousands, select the appearance of negative numbers, or whether to use abbreviations for large numbers such as K, M, G, B, or T.

You can define a number format in Step 2 and Step 3 of the dataset preparation process. For example, in the Data preview table, point to a numeric column, click column options, and then select Format.

 

 

In the Column format dialog, select which format type to apply: Number, Currency, or Percentage. Then, you can customize the individual format properties as needed.

 

 

Apply date & time formatting

This release also allows you to control the appearance of the columns containing dates, date-time, or time information. The column format defines how values are displayed in a dataset and in visualizations on a storyboard. Date formats only determine the appearance of the values but do not change how the actual values are stored.

For a date column, you can select a format from a predefined list. For example, you can choose to display a long date, a short date, include a weekday, or spell out month names:

  • 03-Dec-20
  • 12/03/20
  • 03/12/20
  • 03/12/2020
  • 2020-12-03
  • December 03, 2020
  • 03-Dec-20 13:30:00
  • 03-Dec-20 1:30:00 PM
  • Thursday, December 3, 2020
  • Thu, December 3, 2020

You can select a date format in Step 2 and Step 3 of the dataset preparation process. For example, in Step 3, go to the Data preview table, point to a date column, click column options, and select Format. In the Column format dialog, select a format and click OK.

 

 

For a time column, you can also select one of the predefined formats.

 

 

Rename all columns in a table

Before, you could bulk rename columns only in the last step of the data preparation process. The user experience has been improved, and now, you can rename all table columns right after you select a data source for a dataset.

In the Selected items section, hover over a selected table and click Rename all columns. Then, in the Rename all columns dialog, you can choose how to rename the columns:

  • Add prefix – Add a data source name or a custom string in front of the column name.
  • Add suffix – Add a data source name or a custom string after the column name.
  • Format – Capitalize the column names: only first letter, all uppercase, or all lowercase.
  • Replace – Enter the text that you want to replace and specify a new text. For example, you can substitute the underscore with the space character.

 

 

Dataset columns structured in Tableau

When you work with DataClarity datasets in Tableau, the dataset columns are now organized by data sources. If you open a Tableau workbook file generated for a dataset, the columns are grouped in folders by data sources the same way as in Data Preparation.

 

 

Consistent naming for aggregations

The aggregation options are now using the same naming conventions in Step 2 and Step 3 of the data preparation process, as follows:

  • Sum (instead of Total)
  • Average (instead of Avg)
  • Minimum (instead of Min)
  • Maximum (instead of Max)

 

 

In the Explore dataset pages, the aggregation options are also using non-abbreviated names consistently.

 

 

Rename columns used in calculations

Now, when creating dataset calculations, you can rename any column that is used in a calculation formula. If you do so, the dataset calculations are automatically updated to use the new column names. Note that you still need to review the calculations created in storyboards if any of the input columns have been renamed in Data Preparation. This constraint will be removed in the upcoming release.

 

 

TM1 Cube View connection details

When connecting to the TM1 Cube View, the Server and Port fields have been merged into a single URL field, where you can provide the full address (including the protocol and port) to the server with TM1 cube view.

 

 

STORYBOARDS

Date & number formatting

In this release, users can visualize the data columns with the number and date formatting applied in Data Preparation. For example, if a dataset modeler formatted a numeric column with price information as currency, the column will use this format by default.

The legacy local widget formatting has been renamed to Default number format and Default date format. By default, the local widget formatting is turned off and applies only to the columns with no defined formatting in Data Preparation.

 

 

If you select On for Override for all columns, all the columns will use local widget formatting. For example, the discount value of 7% (formatted as a percentage in Data Preparation) will be displayed as a number, 0.07.

 

 

If a dataset modeler changes some formats after you create visualizations for a given dataset, you will need to re-visualize your widgets to update the columns with the new formats.

 

HTML code widget

In this release, power users can use the HTML code widget to add an HTML code and execute it on a storyboard page. For example, you can add some new interface elements, customize pages, and use the HTML button and HTML input widgets to execute more complex scenarios.

To add your code in the widget, click manage html code, paste the code, and click Save. If you do not want to run the code when your storyboard is in Edit mode, turn on Execute in View mode only. This way, switching a storyboard to View mode will be a trigger to execute the code.

You can find the new widget in the Widgets pane, on the Other widgets tab.

 

 

 

HTML input widget

With the new HTML input widget, you can add a text field to enter some input data directly from the storyboard. The input data can be used in a script added in the HTML code widget or in the Custom JavaScript code section added for a storyboard page.

On the data tab, you define the field’s reference data, add a default value and a placeholder to let users know what is expected in the text field for further processing.

You can find the new widget in the Widgets pane, on the Other widgets tab.

 

 

HTML button widget

With the new HTML button widget, you can add and style a button on a storyboard page. The button can be used to run the script provided in the HTML code widget or in the Custom JavaScript code section for a storyboard page.

On the data tab, you define the button’s reference data. On the appearance tab, you can specify its size, font, background color, and borders.

You can find the new widget in the Widgets pane, on the Other widgets tab.

 

 

Add CSS and JavaScript to a storyboard page

In this release, advanced users can add JavaScript code and CSS to customize storyboard pages or to design additional elements on a page.

 

 

The new options are placed in the Other section of the Pages pane.

 

 

To customize a page’s appearance or some elements on a page with your custom CSS code, click  Manage custom CSS code, and define the styles. For example, you can color each cell with a different color.

To add code to a storyboard page, click  Manage custom JavaScript code. For example, you can add code for a button (widget) to open a certain storyboard page.

 

 

View storyboards’ recipients in List view

Previously, the Subscribers column appeared as a shortcut to the Share dialog for each storyboard, even if it was not shared. The column has been renamed to Shared with, and the corresponding icon appears only if a storyboard is shared. Moreover, you can quickly see how many users received the storyboard: the first number represents group recipients, and the second one represents user recipients.

 

 

Filter the data by one column in Table

If you use filtering actions with the Table widget, you can now choose which filtering value to use for the target widget. By default, clicking a cell will filter the data by the value in that cell. With the new Filter by first column only option, the data is filtered by a specific column no matter where a user clicks in the table row. In this case, the column used for filtering is the first column selected in the Columns field on the data tab.

You can find the new option on the advanced tab of the widget settings pane, in the Actions section.

 

 

Clear filter on cell toggle in Table

In this release, you can choose how to interact with the filtering actions in the Table widget. Previously, clicking a cell for the second time always cleared the applied filter. If you set the new Clear filter on cell toggle setting to Off, the target widget will stay filtered even after the second consecutive click on the same table cell.

You can find the new option on the advanced tab of the widget settings pane, in the Actions section.

 

 

Use additional columns for visualization queries

Now, users have a dedicated field to add the columns that are not used directly in the visualization layout but are included in the query scope. For example, you create a complex script calculation based on some columns that should not be plotted on the visualization itself. In this case, you add these columns in the Other field on the data tab of the widget settings pane.

 

 

 

Other enhancements in Table

The Table widget has been enhanced to improve the user experience:

  • When you change the Group data switch to On, each measure’s aggregation automatically changes from NONE to the measure’s default aggregation.
  • When you hover over the column header, the divider line is shown to help you resize the column more quickly.

 

 

Column search in Filter & Highlighter

Now, selecting a column in the Filter and Highlighter widgets has become faster. Users can now search for a column directly in the Column field, and the column list is filtered as you type. Moreover, the columns are sorted alphabetically.

 

 

 

Text & date formats in Single Value

The Single Value widget can now display text and dates. The Format drop-down list now includes Text and Date. To use these display formats, you should create an aggregated calculation. For example, to view the earliest sales date, you can use a formula similar to min([Sales Date]).

 

 

Consistent naming for aggregations

The aggregation options are now using the same naming conventions in visualizations, script calculations, and the Table widget. The “Total” aggregation has been renamed to “Sum.”

When selecting aggregation for a column, you will see the full aggregation names like Average or Maximum on the menu. However, the visualizations’ data settings and layout use the abbreviated options, such as (Avg) or (Max), which improve the readability of the labels.

 

 

Preview a script code

Previously, you could only preview the connector ID, output data type, and the columns selected for the script. Now, after adding code in the script editor, the code also appears in the Calculations pane as a preview. Additionally, when hovering over the preview area, you can see a message instructing how to open the script editor.

 

 

The default size for some widgets

Now, instead of automatic snapping to a cell, some widgets have certain default sizes if you drag them from the Widgets pane to the page area:

  • Single Value (default size 250x250px)
  • Image (default size 250x250px)
  • Text (default size 250x250px)
  • Html button (default size 200x100)
  • Html code (default size 200x100)
  • Html input (default size 300x100)

If you want any of these widgets to be automatically snapped, add them from within a cell.

 

 

Cancel visualizing a widget

Previously, if a widget’s data could not be visualized for some reason, the spinner was displayed infinitely with no possibility to cancel the query. Now, you can use the Cancel button to stop visualizing data when needed.

 

 

Percentage sign in Pareto charts

The Pareto charts now display a percentage sign after the numbers representing cumulative percentage on the respective axis and in tooltips.

 

 

DATA SCIENCE

Deploy custom Python libraries

Now, administrators can deploy the company’s own custom Python libraries. The Python libraries location is now persistent, python_server/scripts/, where you can add any Python libraries needed for AI projects.

The libraries’ location can be found in Kubernetes, under Config and Storage > Persistent Volume Claims. Click the custom-python-script-pvc and then open the volume name link. The Path is specified under the Source box.

JupyterHub integration

In this release, administrators can deploy a fully integrated JupyterHub server. When JupyterHub is deployed, data scientists can create and share Jupyter notebooks.

 

 

INSTALLATION & CONFIGURATION

Deploy the platform behind the external SSL balancer

Administrators can now deploy the platform behind an external SSL balancer while the internal connection does not use SSL. The installation script now includes two new options:

  • Disable HTTPS – This option allows you to select whether to enable HTTPS.
  • Disable built-in SSL termination – If an administrator enabled HTTPS, this option allows to place a gateway (reverse proxy) that will handle SSL offloading in front of the platform.

 

 

Create a tenant in Access Manager

Now, master administrators can create a fully configured tenant directly from the Access Manager interface. Under the realms drop-down list, click Add realm and then adjust realm configuration settings as needed.

 

 

Release Notes (other formats)

 

Was this article helpful?
0 out of 0 found this helpful

Comments

0 comments

Article is closed for comments.