Using custom search in Data Scanner

You can enjoy a better experience on our platform and the ability to gain valuable and actionable results by creating tailored custom searches in the Data Scanner. 

How to create a custom search

Follow these steps to create a custom data scanner search. You will need to be an Account Admin to create a custom data scanner search. See Scanning data in apps for sensitive information for an overview of this process. 

1. From the Admin Console, select Apps.
2. Find the app you would like to scan. Click the View link in the Data Scanner column.
3. The main page of Data Scanner for this App displays. Here you can create Custom scans by clicking on Manage Configurations:
   

Adding a new custom scan

1. To add a new custom scan, click Manage configuration. The Scan configurations and rules page displays:
   
2. Click Add configuration to create a new custom search. Enter a new name for your configuration. 
3. Enter a percentage of probability for the scan threshold for your scans, so you can view results above certain probability. The minimum is 30%.
4. Select the data you would like to scan and click Save.

Adding custom rules

1. If you would like custom rules for your scan, click the Custom Rules tab.
   Enter a name for each rule, an optional description, any keywords, and set the likelihood that the regex will correctly identify the data it's searching for, with 100 being extremely likely.
   Note: If the scan's probability threshold set is higher than the regex's probability score you set , data won't be included in scan results.
   When you use key words, it increases the detection confidence of the entity you are searching for in case a specific word appears before or after it in the searched field. You can enter more than one key word with a comma delimiter (max length is 1024 characters). For example:  arrhythmia,bradycardia,tachycardia
2. Enter a valid regular expression. 
3. Click Save.

What is a regular expression?

A regular expression is a sequence of characters that specifies a match pattern in text. A regular expression, often called a pattern, specifies a set of strings required for a particular purpose. Regular expressions are extremely powerful. 

Regular Expression Syntax Summary

Here are some common Regular Expression syntax.

Special characters

Special sequences

Quantifiers

Examples

Here are some of examples:

Date Finder

To recognize a date as "mm/dd/yyyy or mm/dd/yy".

r"\b(([1-9]|0[1-9]|1[0-2])/([1-9]|0[1-9]|[1-2][0-9]|3[0-1])/(\d{4}|\d{2}))\b"

Date validation

This checks for a valid date format:

\d{4}-\d{2}-\d{2}

In this example, the code validates if given date string matches this pattern: YYYY–MM–DD, for example, 2019–12–18.

How to view and edit configurations

Follow these steps to view and edit a configuration. 

1. From the Admin Console, select Apps. Find the app you would like to scan. Click the View link in the Data Scanner column.
2. The main page of Data Scanner for this App displays. Here you can access configurations and rules by clicking on Manage Configurations
   
3. You can view or edit your custom searches. 

How to start a custom search

Follow these steps to start a custom data scanner search. You will need to be an Admin for the app you want to scan.

1. From the Admin Console, select Apps. Find the app you would like to scan. Click the View link in the Data Scanner column.
2. Click on the View link for the app you want to create a custom scan. The Custom Scan page displays:
   
3. Select a configuration from the Scan configuration dropdown.
   
   
4. Click Start Scan.
   
   

We store scan details for 31 days. Click Export scan history to CSV, to save the scan results locally.

Limits

The following are the known limits with the custom search functionality .

• Number of Configurations for Scan Regex - 50 per account

• Number of Configurations for Scan Patterns - 50 per account

• Max Min Probability - Maximum probability is 100 % , minimum selectable probability is 30 %