Data Management > Data Retention > Data Retention Configuration > Nomenclature of Index Pattern

Nomenclature of Index Pattern

When configuring Data Retention settings in vuSmartMaps™, understanding the nomenclature of the index pattern is essential. The index prefix you provide plays a crucial role in specifying which data to apply the retention settings to.

💡Note:

  • The default Data Retention Settings are that of Index Pattern 1-*
  • For any particular Index Name if Data Retention Settings are not configured then the default Data Retention Settings will be followed.
  • In case of a mismatch between Index Pattern and Index Name, the default Data Retention Settings will be followed.

Case 1

If all the indices to be archived have a common Index Name followed by Date in format name-of-the-index-YYYY-MM-DD then the Index Pattern to be entered in Data Retention Settings should be name-of-the-index 

Example: If the indices to be archived are:

vunet-1-1-aruba-airwave-trend-2022.07.11
vunet-1-1-aruba-airwave-trend-2022.07.10
vunet-1-1-aruba-airwave-trend-2022.07.09
vunet-1-1-aruba-airwave-trend-2022.07.08
vunet-1-1-aruba-airwave-trend-2022.07.07


These all have same Index Name which is vunet-1-1-aruba-airwave-trend followed by date therefore the Index Pattern to be entered in Data Retention Settings should be vunet-1-1-aruba-airwave-trend

💡Note: Avoiding Common Mistakes

  • If the Index Pattern is named as vunet-1-1-aruba-airwave-trend-*
    This will result in mis-match between the Index Name & Index Pattern and the default Data Retention Settings will be followed.
  • If the Index Pattern is named as vunet-1-1-aruba-airwave-trend*
    This will result in matching with some additional Index Names which may not be required in this case.

Example: If the Index Pattern is named as vunet-1-1-aruba-airwave-trend* then in addition to the above-mentioned  Indices which are

vunet-1-1-aruba-airwave-trend-2022.07.11
vunet-1-1-aruba-airwave-trend-2022.07.10
vunet-1-1-aruba-airwave-trend-2022.07.09
vunet-1-1-aruba-airwave-trend-2022.07.08
vunet-1-1-aruba-airwave-trend-2022.07.07

Other Indices such that:

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10
vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11
vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08
vunet-1-1-aruba-airwave-trend-chennai

Will also be archived and later deleted, resulting in unwanted archival or deletion of data.

Hence, Indices archived using Index Pattern vunet-1-1-aruba-airwave-trend are a subset of the Indices archived using Index Pattern vunet-1-1-aruba-airwave-trend*

Case 2

If the indices to be archived have different Index Names as shown in example below:

vunet-1-1-aruba-airwave-client-data    
vunet-1-1-aruba-airwave-data-2022.07.11           
vunet-1-1-aruba-airwave-trend-2022.07.11  
vunet-1-1-aruba-airwave-trend-2022.07.10

Here,

vunet-1-1-aruba-airwave-client-data

has Index Name

vunet-1-1-aruba-airwave-client-data

vunet-1-1-aruba-airwave-data-2022.07.11

has Index Name

vunet-1-1-aruba-airwave-data

vunet-1-1-aruba-airwave-trend-2022.07.11

and

vunet-1-1-aruba-airwave-trend-2022.07.10

have Index Name 

vunet-1-1-aruba-airwave-trend

Then the Index Pattern to be entered in Data Retention Settings to archive all the above-mentioned  Indices should be part of the Index Name common to all followed by *

Here, the part of Index Name common to all of these below:

vunet-1-1-aruba-airwave-client-data    
vunet-1-1-aruba-airwave-data-2022.07.11           
vunet-1-1-aruba-airwave-trend-2022.07.11  
vunet-1-1-aruba-airwave-trend-2022.07.10

is 

vunet-1-1-aruba-airwave-

So the Index Pattern should be vunet-1-1-aruba-airwave-*

Example:

Below is the list of all the indices

vunet-1-1-aruba-airwave-trend-2022.07.11
vunet-1-1-aruba-airwave-trend-2022.07.10
vunet-1-1-aruba-airwave-trend-2022.07.09
vunet-1-1-aruba-airwave-trend-2022.07.08
vunet-1-1-aruba-airwave-trend-2022.07.07
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10
vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11
vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08
vunet-1-1-aruba-airwave-trend-chennai
vunet-1-1-aruba-airwave-client-data  
vunet-1-1-aruba-airwave-data-2022.07.11
vunet-1-1-aruba-temp-airwave-client-data
vunet-1-1-aruba-new-airwave-client-data

Index Pattern

Index Names Matched

vunet-1-1-aruba-airwave-trend

vunet-1-1-aruba-airwave-trend-2022.07.10

vunet-1-1-aruba-airwave-trend-2022.07.09

vunet-1-1-aruba-airwave-trend-2022.07.08

Vunet-1-1-aruba-airwave-trend-2022.07.07

vunet-1-1-aruba-airwave-trend*

vunet-1-1-aruba-airwave-trend-2022.07.10

vunet-1-1-aruba-airwave-trend-2022.07.09

vunet-1-1-aruba-airwave-trend-2022.07.08

vunet-1-1-aruba-airwave-trend-2022.07.07

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10

vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11

vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08

Vunet-1-1-aruba-airwave-trend-chennai

vunet-1-1-aruba-airwave-trend-*

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10

vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11

vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08

vunet-1-1-aruba-airwave-trend-chennai

vunet-1-1-aruba-airwave-trend-bangalore-*

No Match

vunet-1-1-aruba-airwave-trend-bangalore

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10

vunet-1-1-aruba-airwave-trend-banga*

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10

vunet-1-1-aruba-*

vunet-1-1-aruba-airwave-trend-2022.07.11

vunet-1-1-aruba-airwave-trend-2022.07.10

vunet-1-1-aruba-airwave-trend-2022.07.09

vunet-1-1-aruba-airwave-trend-2022.07.08

vunet-1-1-aruba-airwave-trend-2022.07.07

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10

vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11

vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08

vunet-1-1-aruba-airwave-trend-chennai

vunet-1-1-aruba-airwave-client-data    

vunet-1-1-aruba-airwave-data-2022.07.11

vunet-1-1-aruba-temp-airwave-client-data

vunet-1-1-aruba-new-airwave-client-data

vunet-1-1-aruba*

vunet-1-1-aruba-airwave-trend-2022.07.11

vunet-1-1-aruba-airwave-trend-2022.07.10

vunet-1-1-aruba-airwave-trend-2022.07.09

vunet-1-1-aruba-airwave-trend-2022.07.08

vunet-1-1-aruba-airwave-trend-2022.07.07

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10

vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11

vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08

vunet-1-1-aruba-airwave-trend-chennai

vunet-1-1-aruba-airwave-client-data    

vunet-1-1-aruba-airwave-data-2022.07.11

vunet-1-1-aruba-temp-airwave-client-data

vunet-1-1-aruba-new-airwave-client-data

vunet-1-1-aruba-airwave-*

vunet-1-1-aruba-airwave-trend-2022.07.11

vunet-1-1-aruba-airwave-trend-2022.07.10

vunet-1-1-aruba-airwave-trend-2022.07.09

vunet-1-1-aruba-airwave-trend-2022.07.08

vunet-1-1-aruba-airwave-trend-2022.07.07

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10

vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11

vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08

vunet-1-1-aruba-airwave-trend-chennai

vunet-1-1-aruba-airwave-client-data

 

  • The matching of the Index Pattern and Index Name follows an order. Index Patterns are in the order of their creation. While matching, the Index Name tries to match itself with the Index Pattern one by one from the first one in the order, if the Index Name finds a match it will take the Data Retention Settings of that Index Pattern and ignore all others, but if does not find a match with any Index Pattern then it would take the default Data Retention Settings of Index Pattern 1-* lying at the last in the order of Index Patterns.

Settings of that Index Pattern and ignore all others, but if does not find a match with any Index Pattern then it would take the default Data Retention Settings of Index Pattern 1-* lying at the last in the order of Index Patterns.

Example:

Suppose this is the exhaustive list of indices that we have

vunet-1-1-aruba-airwave-trend-2022.07.11
vunet-1-1-aruba-airwave-trend-2022.07.10
vunet-1-1-aruba-airwave-trend-2022.07.09
vunet-1-1-aruba-airwave-trend-2022.07.08
vunet-1-1-aruba-airwave-trend-2022.07.07
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10
vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11
vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08
vunet-1-1-aruba-airwave-trend-chennai
vunet-1-1-aruba-airwave-client-data  
vunet-1-1-aruba-airwave-data-2022.07.11
vunet-1-1-aruba-temp-airwave-client-data
vunet-1-1-aruba-new-airwave-client-data

Scenario 1:

Order of Index Pattern

Active Data

Inactive Data

Archive Data

vunet-1-1-aruba-airwave-trend*

1

2

3

vunet-1-1-aruba-airwave-trend

4

5

6

In this scenario,

vunet-1-1-aruba-airwave-trend-2022.07.10
vunet-1-1-aruba-airwave-trend-2022.07.09
vunet-1-1-aruba-airwave-trend-2022.07.08
vunet-1-1-aruba-airwave-trend-2022.07.07
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10
vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11
vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08
vunet-1-1-aruba-airwave-trend-chennai

Will take Settings of vunet-1-1-aruba-airwave-trend-* which is 1 day for Active Data, 2 days for Inactive Data and 3 days for Archive Data.

No Index Name will match with Index Pattern vunet-1-1-aruba-airwave-trend

Scenario 2:

Order of Index Pattern

Active Data

Inactive Data

Archive Data

vunet-1-1-aruba-airwave-trend

4

5

6

vunet-1-1-aruba-airwave-trend*

1

2

3

In this scenario,

vunet-1-1-aruba-airwave-trend-2022.07.10
vunet-1-1-aruba-airwave-trend-2022.07.09
vunet-1-1-aruba-airwave-trend-2022.07.08
vunet-1-1-aruba-airwave-trend-2022.07.07

Will take Settings of vunet-1-1-aruba-airwave-trend which is 4 days for Active Data, 5 days for Inactive Data and 6 days for Archive Data.

And,

vunet-1-1-aruba-airwave-trend-bangalore-2022.07.11
vunet-1-1-aruba-airwave-trend-bangalore-2022.07.10
vunet-1-1-aruba-airwave-trend-mumbai-2022.07.11
vunet-1-1-aruba-airwave-trend-kolkata-2022.07.08
vunet-1-1-aruba-airwave-trend-chennai

Will take Settings of vunet-1-1-aruba-airwave-trend-* which is 1 day for Active Data, 2 days for Inactive Data and 3 days for Archive Data.

Resources

Browse through our resources to learn how you can accelerate digital transformation within your organisation.

Unveiling our all powerful Internet and Mobile Banking Observability Experience Center. Click Here