Data Retention Configuration

Configuring Data Retention

1. The Data Retention page can be accessed from the platform left navigation menu by navigating to Data Management > Data Retention.
   
   
   
   
2. This will navigate you to the landing page where all existing data retention policies are listed.
   
   
   

Data Retention Settings: Listing Page

Upon accessing the Data Retention page, you will land on the default tab for HyperScale Data Store Retention Settings. The landing page lists, the following details for the configured data retention policies, for Data Store:

• Data Name: Displays the name of the data associated with the retention policy.
• Data Category: Indicates the category to which the data belongs, providing insights into its nature and relevance. It supports seven distinct data set categories, enabling users to choose and configure their preferred data sets: Traces, RUM, Logs, Metrics, Events, Transactions, and Custom.
• Table Name: Specifies the name of the table associated with the data retention policy.
  It is to be noted that the policies will apply to tables with specific prefixes as outlined below:
  
  

💡Note: For proper data retention in vuSmartMaps, tables must include a mandatory timestamp column.

• Hot (Days) – Live: Reflects the retention period for Hot Storage in days, defining the duration for immediate and frequent access.
• Warm (Days) – Live: Specifies the retention period for Warm Storage in days, governing intermediate storage for less frequently accessed but still relevant data.
• Archive (Days): Illustrates the retention period for Archived Storage, outlining the duration for long-term archival and storage of historical or rarely accessed data.
• Actions: Provides quick access to perform actions on the data retention policy.
  1. Edit: Enables administrators to modify the existing policy by adjusting retention periods for Hot, Warm, and Cold storage tiers.
  2. Delete: Allows deletion of user-defined policies when they are no longer needed, ensuring efficient data management.

Default Data Retention Settings

As an administrator in vuSmartMaps, you have the capability to efficiently manage the Default data retention policy. This allows you to optimize storage usage and enhance performance across different storage storages, including Hot, Warm, and Archived. The Default policy is applicable for all data if there is no user-defined policy configured.

💡Note: It is to be noted that initially, default retention periods will be set as 15, 5, and 10 days for the Hot, Warm, and Archived data storages.

Editing Default Policy

1. To edit the default retention policy, Click on the Edit icon under Actions column for Default policy row.
2. Modify retention period values for Hot, Warm, and Archived storage tiers as needed.
   
   
   
3. Click Save to apply the updated values.

💡Note: Deletion of the Default policy is not permitted.

Creating New Data Retention Setting

1. To create a new Data Retention setting, click on the + button located in the top right corner of the table.
   
   
   
   
2. Complete the form with the following details:
   
   • Select Data Category: Category of the data for which this Data Retention is applicable. It supports seven distinct data set categories, enabling users to choose and configure their preferred data sets: Traces, RUM, Logs, Metrics, Events, Transactions, and Custom.
     
     💡Note: When creating a new Data Retention setting, note that data category options for which retention is not already configured will be the only ones available in the drop-down menu.
     
   • Data Name: The system assigns default names after selecting the category. For custom categories, data names can be provided.
   • Tables included in this category: The system assigns table names after selecting the category. For custom categories, table names can be selected from the dropdown.
     
     💡Note: For a custom data category, an optional field to select “Table Name Wildcards” will be available. In this field, you can specify prefixes for the table names. To add multiple items, please use comma-separated values. Use a wildcard to identify the index or group of indices. The prefix can include numbers, hyphens, and asterisks, but must include at least one alphabet character.
     
     
   • Data Retain Period:
     
     1. For Live Data:
        • Retain HOT Data storage data for (days): Configure the number of days for which data in tables matching the criteria in this policy will be kept in Hot storage. Data in Hot storage reside in high-speed disks (like SSD) which allows for quick live searches and data analytics. After the configured number of days, data will be moved to the Warm storage or will be deleted from the hot storage as per the Warm storage data retention configuration.
        • Retain WARM Data storage data for (days): Configure the number of days for which data in tables matching the criteria in this policy will be kept in Warm storage. Data in the Warm storage are available for live queries with lower speed than data in the Hot storage. After the configured number of days, data will be deleted from the Warm storage.
     2. For Archived Data:
        
        • Retain Archive storage data for (days): Configure the number of days for which data in tables matching the criteria in this policy will be kept in the Archived storage. Data in the Archived storage is not available for live queries. At any point, data in the Archived storage can be brought back to the Warm storage using the restore option on the data storage page. After the configured number of days, data will be deleted from the Archived storage.
3. Click Save to enable and apply this retention setting.

💡Note: If the Archive retention period is set to 0, archival is not configured. Data will not be moved to the Archive storage and will not be retained for long-term storage. Ensure that a positive value is set for the Archive retention period if archival functionality is required.

Managing Data Retention Policies

To edit or delete a specific data retention policy in vuSmartMaps, follow these simple steps:

1. Edit and Delete Individual Policies:
   
   • Locate the particular data retention policy in the table.
   • Utilize the Edit and Delete icons located under the Actions Column to make individual adjustments.
     
2. Delete Multiple Policies:
   
   • To delete multiple policies simultaneously, select them using the checkboxes.
   • Use the delete icon located at the top of the table to perform a batch deletion.
     

💡Note: Deletion of the Default policy is not permitted. This policy serves as a baseline and cannot be removed to maintain the integrity of data management.

By using these features, administrators can efficiently manage data retention policies, ensuring a streamlined and organized approach to data management within vuSmartMaps.