Docs > Data Management > Data Storage

Data Storage

Efficient data storage management is crucial for ensuring seamless operations and optimal performance within vuSmartMaps. With dedicated modules for both HyperScale and NoSQL Data Stores, administrators gain comprehensive control over organizing and accessing data.

The HyperScale Data Store offers a tiered approach, dividing data into Hot, Warm, and Cold storage states, each serving distinct purposes in data management and access. Similarly, the NoSQL Data Store introduces concepts of Open, Closed, and Archived indices, providing flexibility in managing data resources. From restoring cold data to archiving and retrieving indices, vuSmartMaps empowers users with intuitive tools and functionalities for streamlined data storage management, facilitating enhanced decision-making and productivity.

Different States of Data Indices

The data storage module within vuSmartMaps maintains data indices tailored to the specific type of data store being utilized, whether it’s the HyperScale Data Store or the NoSQL Data Store.

HyperScale Data Store

In the HyperScale Data Store, data is organized into three distinct tiers: Hot, Warm, and Cold Data Storage.

  1. Hot Data Storage: This tier is dedicated to storing recently accessed and critical data, providing high-speed access for immediate retrieval. Data in this state is maintained as per policy defined in data retention settings, ensuring efficient data management.
  2. Warm Data Storage: Intermediate storage for data accessed less frequently but remains relevant. It offers moderate-speed access to accommodate less frequent yet still pertinent data. Data is regularly archived from Hot/Warm to Cold state as per data retention policies.
  3. Cold Data Storage: Long-term archival and storage solution for historical or rarely accessed data. While access speed is lower compared to Hot and Warm Storage, Cold storage ensures the preservation of critical historical information. Data from the Cold state can be restored if required using the Data Storage module, providing a comprehensive data management solution.

NoSQL Data Store

For the NoSQL Data Store, indices in vuSmartMaps can be in OpenClosed, or Archived states:

  1. Open indices are live and used for active search and dashboard building.
  2. Closed indices consume minimal resources and can be reopened if needed.
  3. Archived indices free up resources entirely from the active data partition and can be retrieved when necessary.

💡Note: It should be noted that a closed index takes up space in the disk as the data is still residing in the system.

The detailed steps to manage NoSQL Data Store indices are discussed in the section NoSQL Data Store.

Managing Data Storage

The Data Storage page can be accessed from the platform left navigation menu by navigating to Data Management > Data Storage.

The landing page on clicking the Data Storage looks like the following:

Upon navigating to the landing page, you will find dedicated tabs for both the HyperScale Data Store and NoSQL Data Store.

Further Reading

FAQs

Critical and recently accessed data should be stored in the Hot Data Storage tier, which offers high-speed access for immediate retrieval. Ensure your data retention policies are configured to keep essential data in the Hot tier.

Use the Restore button in the Data Storage module to move data from Cold Storage to Warm Storage. Remember, restored data will remain in the Warm state for 7 days before being permanently deleted.

Check the available space in the Warm Storage before initiating a restore. Ensure that restoring the data will not reduce the free space in Warm Storage to less than 5%.

Configure data retention policies to automate the transition of data between Hot, Warm, and Cold Storage, i.e., Data Archival. With this approach, less frequently accessed data is archived, ensuring data is managed according to the organization’s requirements without manual intervention.

Verify that there is sufficient space in the Warm Storage tier before initiating restore operations. Check system logs for any errors related to data restoration and ensure that no other restore operations are currently in progress.

Review your data retention policies to ensure timely archiving of less frequently accessed data to Warm or Cold Storage. Additionally, manually check for and move any non-critical data from Hot to Warm or Cold Storage.

Check if there is sufficient space in the Warm Storage tier and verify that no other restore operations are currently in progress. Additionally, ensure the data you are trying to restore does not already exist in Hot or Warm Storage.

Use the Data Storage module to sort the data tables by last modified time or size in the Warm Storage tab. Identify and select the data tables that meet the criteria for archiving, and manually move them to Cold Storage if necessary.

If you are dealing with high volumes of financial transaction data and need to optimize storage to ensure efficient data management and retrieval. Implement data archiving and compression strategies. Archive older transaction data to reduce storage costs and use compression techniques to optimize storage space.

Resources

Browse through our resources to learn how you can accelerate digital transformation within your organisation.

Quick Links

VuNet Secures Rs. 60 Crore in Series B Funding