> For the complete documentation index, see [llms.txt](https://academy.dnanexus.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://academy.dnanexus.com/mlaccelerator/dataprofiler/tablelevelscreen.md).

# Table Level Screen

A license is required to access the Data Profiler on the DNAnexus Platform. For more information, please contact DNAnexus Sales (via <sales@dnanexus.com>).

The Table-level screen appears when you select one particular table in the Navigator.

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2FesaD8qEvAEbR7mIsR7Oc%2Funknown.png?alt=media&amp;token=f966b9d6-16c1-48bc-9ad7-9670a271c4f5" alt="" height="323" width="624">

Table-level Screen of a table in Data Profiler

### Table Overview

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2FsWiSr18Rlb3WkbzHlRzt%2Funknown.png?alt=media&amp;token=8939c3d1-c8f4-4f8e-ae97-fb68cf0105fd" alt="" height="280" width="443">

Overview details on the header of the Table-level screen

On the header of the Table-level screen, you can find overall statistics on the selected table, that include:

* Table size: number of rows and columns of the table
* Missing rate: the rate of empty cells in the table
* Duplicate rate: the rate of duplication of an entire row in the table

### Composition of Column Types

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2FLzcyfATnjVB7iTgrUELs%2Funknown.png?alt=media&amp;token=2eac3acc-a84b-4b82-8e98-e56688c002ca" alt="" height="224" width="426">

Pie chart of Column types on the header of the Table-level screem

The pie chart shows the composition of column types in the table. The size of each part of the pie is determined by the number of columns of that type. You can also hover on the chart to get the count value.

### Table-level charts

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2FUOz7tp7hpcbYSZaMKUOc%2Funknown.png?alt=media&amp;token=ab21e367-6685-4d9c-ad7e-30f08583908f" alt="" height="324" width="624">

Table-level screen has a Controller section that configures the visualization in the Chart area

The main function of the Table-level Screen is the Chart Area, which is controlled by a Controller in the top right corner of the screen. There are 2 main types of visualizations: Completeness and Column Profiles.

#### Completeness

Completeness is the default mode of the Table-level screen. It aims to provide an overview on the count/rate of non-null values in a table. Completeness has 2 options: One-way view and Two-way view

**One-way View: Bar chart**

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2Ft6jYGFGEKABUKFMLcjKP%2Funknown.png?alt=media&amp;token=ba62c359-f26c-4059-b338-6b545125d679" alt="" height="273" width="624">

One-way view in Table-level screen

One-way view is a stacked bar chart that displays the percentage of missing values, non-duplicates, and duplicates for each column in the table. You can click on the Legend/Key to show or hide specific statistics on the chart. Hover over each column to view detailed statistics.

**Two-way View: Heat map**

Two-way view in Table-level screen

Two-way view is a heat map showing data completeness for all columns in the table. The Y-axis of the heatmap is the columns of the table. The X-axis of the heatmap is the unique values of the group-by column. The value of the heatmap shows how many entities (in the Raw count mode, or percentage in the Percentage mode) of the table have non-null values on the columns (y-axis) with respect to the value of the group-by column (x-axis). You can choose another column as the grouping factor. Each label in this Group-by column is a column in the heat map. Only categorical columns which have a maximum of 30 unique values will show up as the options.

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2Fhp1Ku8bW5H7AupdxJZjH%2Funknown.png?alt=media&amp;token=5540f1bd-fb81-4b73-bc52-2dc8dc7eca3f" alt="" height="150" width="448">

The Controller of Two-way view

The values in the heatmap can be viewed in two modes:

* Raw Count: Displays the exact number of available values in each column.
* Percentage: Shows data completeness as a percentage, ranging from Highly Missing to Fully Complete.

When viewing the heatmap in Percentage mode, the values are calculated as follows:

* Table level: The denominator is the total number of records in the table.
* Category level (x-axis): The denominator is the total number of records within each category.

**Two-way View: Heat map, cross-table analysis**

You can also join the current table of another table using the Join with table options. By joining with another table, you can use a column from that table as the Group-by column.

| FAQs                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |
| ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| <p>Question: Can I use the Two-way View to check how many female patients have sequencing data?</p><p>Answer: Yes. Assuming that your question involves 2 metadata: patient\_sex (from the patient table) and sequencing\_run\_id (from the sequencing table). The patient and sequencing table are join-able by patient\_id. If that is the case, you can open the patient table with the Two-way View; join it with the sequencing table; and choose patient\_sex as the Group-by column. On the sequencing.sequencing\_run\_id, you can see the completeness rate broken down by each sex in patient\_sex.</p> |

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2FY8gEIE61kbCSREk4JfNk%2Funknown.png?alt=media&amp;token=a89b2a64-0792-44ba-9553-571fe9613dd0" alt="" height="154" width="488">

The heatmap options controller when doing cross-table analysis. We are joining “procedures” table into the “patient” table

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2F4FA95XfAFGBZhPmKCS9w%2Funknown.png?alt=media&amp;token=4c7ec94c-48d4-4b6a-bb96-2d5d3fcd23ba" alt="" height="273" width="547">

Completeness heatmap in case of cross-table analysis. In this example, the main table is "patients", the joined table is "observations". This heatmap shows how many patients who have available data (not-null values) on the fields which respect to the patient race: white, black, asian, native, or other.&#x20;

#### Column Profiles

<img src="https://1979569080-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FPtCOm9rXoRi4P9rh1ET8%2Fuploads%2F1S6qEJSRnf09ogyogxgX%2Funknown.png?alt=media&amp;token=95c29d05-5731-4bd5-a4d1-6889506d70a4" alt="" height="396" width="624">

Column Profiles mode shows each column as a tile. The chart type depends on the type of the column.

This screen provides detailed statistics and distribution charts for the columns in the table. For all column types, it displays the **missing rate** and the **duplication rate**.

For columns containing string data, it shows the **number of unique values** and the **value frequency** of the 5 most frequent values in the column, which is represented in a distribution chart.

For columns containing float data, the screen provides information about the **variance, standard deviation**, and the **value range frequency,** which is displayed in a distribution chart. Additionally, a box plot is shown, illustrating the **maximum value, Q3 (upper quartile), median, Q1 (lower quartile),** and **the minimum value**.

For columns containing datetime data, the screen displays the **variance, standard deviation,** and **value** range frequency on a distribution chart. A box plot is also provided, showing the **maximum value, Q3 (upper quartile), median, Q1 (lower quartile),** and **the minimum value.**

### Resources

[Full Documentation](https://documentation.dnanexus.com/)

To create a support ticket if there are technical issues:

1. Go to the Help header (same section where Projects and Tools are) inside the platform
2. Select "Contact Support"
3. Fill in the Subject and Message to submit a support ticket.
