Delete Unused Time Series Data Dialog

Closed

This dialog allows users to delete historical (observed and forecast) data from time series data. This only applied to data that has not been used in simulations for the current database.

The dialog is displayed when Delete unused time series data is selected from the Open TSD view as dialog.

Delete unused time series data Dialog

Note

Deletion is immediate and occurs when you click OK. Use this dialog with care.

Dialog options

Option

Description

Only delete data with time stamps older than

Upper time limit. InfoAsset Manager will only delete values with time stamps older than the specified date.

Default is today's date.

Note

For forecasts, it is the time stamp of the forecast origin that is used, rather than the time stamped values of the forecast data. If a forecast origin is deleted all its values will be too.

Keep the latest version of each value even if it has not been used by a simulation

Check this option to keep the latest version of a value even if it has not been used in a simulation.

Let us take the example of a value with a timestamp 10/1/2013 17:00 that has been imported a week ago, then a value at the same timestamp that has been imported a few days ago, and then again today. There will be three versions of the value at this particular timestamp. So long as none of these values have been used by a run and the timestamp threshold is after 10/1/2013 17:00, they will all get deleted once you click OK. However, if this option is not checked, InfoAsset Manager will keep the last imported value (imported today) whereas it will delete the others. See illustrated example below.

OK

Close the dialog and commit the changes.

Cancel

Abort deletion and close the dialog.

Closed

If we imagine a time series data object containing a stream in which the following values are imported on the 06/05/13

Time Value

5/05/2013

1.10

4/05/2013

1.23

3/05/2013

0.92

2/05/2013

0.80

1/05/2013

0.88

30/04/2013

0.70

06/05/13 import

Then if the following values are imported into the same stream on the 07/05/13

Time Value

6/05/2013

1.32

5/05/2013

0.60

4/05/2013

0.70

3/05/2013

0.84

2/05/2013

0.98

1/05/2013

1.01

07/05/13 import

Finally let us suppose that the values below are imported into the same stream on the 08/05/13

Time Value

7/05/2013

0.67

6/05/2013

1.20

5/05/2013

1.22

4/05/2013

1.10

3/05/2013

0.99

2/05/2013

1.80

08/05/13 import

When the stream is open in InfoAsset Manager, the user can see the most recently imported value for each time stamp

Time Value

7/05/2013

0.67

6/05/2013

1.20

5/05/2013

1.22

4/05/2013

1.10

3/05/2013

0.99

2/05/2013

1.80

1/05/2013

1.01

30/04/2013

0.70

Viewing data

The values from 2/05/2013 to 7/05/2013 are the values imported on 08/05. The 1/05/2013 value is the value imported on the 07/05 and 30/05/2013 is the value imported on the 06/05. However all the values imported are still present in the time series data. These "old versions" can be viewed by using the Historical option of the Open TSD view as dialog. This dialog is displayed when the Open As context menu option is selected for a scalar or spatial time series data object.

For example if the user was to look at the time series data as if it was the 07/05/2013, the following values will be shown:

Time Value

6/05/2013

1.32

5/05/2013

0.60

4/05/2013

0.70

3/05/2013

0.84

2/05/2013

0.98

1/05/2013

1.01

30/04/2013

0.70

These values are all the values from the 07/05 import and the value for the 30/04/2013 from the 06/05 import.

Let us take a closer look at the delete behaviour now:

  1. If any of these values have been used in a simulation, and the simulation still exists in the database, they will never be deleted using the Delete unused time series data dialog.
  2. Also if a timestamp is NEWER than the date specified in the Only delete data with time stamps older than field of the dialog,it will not get deleted. If the Only delete data with time stamps older than field is set to 5/05/2013, only the values with a 4/05/2013, 3/05/2013, 2/05/2013, 1/05/2013 and 30/05/2013 time stamp will be deleted.
  3. If the Keep the latest version of each value even if it has not been used by a simulation option is left disabled, the data will look like this after deletion (every value with a timestamp before the threshold has been deleted):
  4. Time Value

    7/05/2013

    0.67

    6/05/2013

    1.20

    5/05/2013

    1.22

    Deleting Data (threshold 05/05)

  5. Now if the Keep the latest version of each value even if it has not been used by a simulation is enabled, the data will be like in the table below.
  6. Time Value

    7/05/2013

    0.67

    6/05/2013

    1.20

    5/05/2013

    1.22

    4/05/2013

    1.10

    3/05/2013

    0.99

    2/05/2013

    1.80

    1/05/2013

    1.01

    30/04/2013

    0.70

    Keeping the latest version of each value

If we compare the data in Keeping the latest version of each value table above with the data of the Viewing data table, it looks exactly the same. However this is not the case. In the Keeping the latest version of each value table old values have been removed, thus freeing up space. For example, the values imported for 4/05/2013, 3/05/2013, 2/05/2013 on the 06/05 and 07/05 have been deleted (because there are more recently imported values for each of these time stamps). Also the value at 1/05/2013 imported on 06/05 will have been deleted because the latest value at this time stamp is the one imported on the 07/05.

Time Series Data Objects

Scalar Time Series Data

Spatial Time Series Data