TapeTrack Documentation

Because there is more to tape management than you ever realized

User Tools

Site Tools

Trace: • restricting_volumeid_by_repository • set_slot_manually • hiding_volumeids • labelling_storage • function_scanning_in • function_send • http_proxy • tmsscsvnoheader • tmss10batchloader • windows_scheduler
cookbook:tsm

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
cookbook:tsm [2021/02/18 21:51] – [The dsmadmc command] Scott Cunliffecookbook:tsm [2025/01/21 22:07] (current) – external edit 127.0.0.1
Line 1: Line 1:
 ====== Tivoli Storage Manager Sync Cookbook ====== ====== Tivoli Storage Manager Sync Cookbook ======
  
-Tivoli Storage Manager (or TSM) is IBM's enterprise backup solution, and provides both a command line interface program that can be used to query the information required for synchronization, and ODBC driver that allows you to directly query data from the TSM database.+Tivoli Storage Manager (or TSM) is IBM's enterprise backup solution, and provides both a [[technote:commandline|Command Line]] interface program that can be used to query the information required for synchronization and ODBC driver that allows you to directly query data from the TSM database.
  
 TSM is designed around several database tables that must be queried to get a complete list of tapes.  TSM is designed around several database tables that must be queried to get a complete list of tapes. 
Line 7: Line 7:
 These tables are: These tables are:
    * **The DRM Table**. This table lists all tapes are considered critical for recovery purposes.    * **The DRM Table**. This table lists all tapes are considered critical for recovery purposes.
-   * **The Volume Table**. This table lists all tapes that contain active data for a given TSM system. Any Volume that become scratch and is no longer managed by the DRM subsystem will be dropped from this table. +   * **The Volume Table**. This table lists all tapes that contain active data for a given TSM system. Any [[object:volume|Volume]] that become scratch and is no longer managed by the DRM subsystem will be dropped from this table. 
-   * **The Library Table**. This table is only available on servers that are considered library masters and lists all Volumes that are in an ATL environment. This table will also include scratch tapes that are currently in an ATL.+   * **The Library Table**. This table is only available on servers that are considered library masters and lists all [[object:volume|Volumes]] that are in an ATL environment. This table will also include scratch tapes that are currently in an ATL.
  
-<note tip>The location field in the Volume and state field DRM tables do not represent the same value. The location field in the Volume table represents the perceived current location of a Volume, while the state field in the DRM table may represent the current location, but may also represent the destination location of a tape.+<note tip>The location field in the [[object:volume|Volume]] and state field DRM tables do not represent the same value. The location field in the [[object:volume|Volume]] table represents the perceived current location of a [[object:volume|Volume]] , while the state field in the DRM table may represent the current location, but may also represent the destination location of a tape.
 </note> </note>
  
-<note tip>TSM will drop Volumes from both the Volume and DRM tables when they become scratch. Although these Volumes may now be in an ATL and visible by querying the Library Master Server, they may also be elsewhere, including a scratch rack and not appear in any TSM table. To identify any scratch tapes that may have evaded being recalled from off-site, it is good practice to set the SCRATCH field during each synchronization and to periodically run the [[cli:tmss10movescratch|TMSS10MoveScratch]] command</note>+<note tip>TSM will drop [[object:volume|Volumes]] from both the [[object:volume|Volume]] and DRM tables when they become scratch. Although these [[object:volume|Volumes]] may now be in an ATL and visible by querying the Library Master Server, they may also be elsewhere, including a scratch rack and not appear in any TSM table. To identify any scratch tapes that may have evaded being recalled from off-site, it is good practice to set the SCRATCH field during each synchronization and to periodically run the [[cli:tmss10movescratch|TMSS10MoveScratch]] command</note>
  
 ===== Data Extraction From TSM ===== ===== Data Extraction From TSM =====
  
-The first step in synchronizing your TSM Library with TapeTrack is to extract the Volume data from your TSM instance.+The first step in synchronizing your TSM Library with TapeTrack is to extract the [[object:volume|Volume]] data from your TSM instance.
  
-Using the Tivoli Storage Manager administrative tool dsmadmc, the Volume data needs to be extracted from both the DRM and Volume tables and exported into csv file format.+Using the Tivoli Storage Manager administrative tool dsmadmc, the [[object:volume|Volume]] data needs to be extracted from both the DRM and [[object:volume|Volume]] tables and exported into csv file format.
  
 {{dsmadmc_extract.png}} {{dsmadmc_extract.png}}
Line 29: Line 29:
  
 From the DRM table, select the fields: From the DRM table, select the fields:
-  * volume_name: Used to determine the Volume-ID in TapeTrack. +  * volume_name: Used to determine the [[object:volume|Volume-ID]] in TapeTrack. 
-  * state: Used to determine the location the Volume should be. +  * state: Used to determine the location the [[object:volume|Volume]] should be. 
-  * stgpool_name: Used to set the Volume Description.+  * stgpool_name: Used to set the [[object:volume|Volume]] [[object:volume|Description]].
  
-<sxh>+<code>
 dsmadmc -dataonly=yes -id=userid -pa=password -tcpserveraddress=tsm01.gazillabyte.local \ dsmadmc -dataonly=yes -id=userid -pa=password -tcpserveraddress=tsm01.gazillabyte.local \
         -displaymode=table -outfile=TSM-DRM.csv -commadelimited "select volume_name,state,stgpool_name from drmedia"         -displaymode=table -outfile=TSM-DRM.csv -commadelimited "select volume_name,state,stgpool_name from drmedia"
-</sxh>+</code>
  
 === From the Volume table: === === From the Volume table: ===
  
-From the Volume table, select the fields: +From the [[object:volume|Volume]] table, select the fields: 
-  * volume_name: Used to determine the Volume-ID in TapeTrack +  * volume_name: Used to determine the [[object:volume|Volume-ID]] in TapeTrack 
-  * location: Used to determine the location the Volume is. +  * location: Used to determine the location the [[object:volume|Volume]] is. 
-  * stgpool_name: Used to set the Volume Description. +  * stgpool_name: Used to set the [[object:volume|Volume]] [[object:volume|Description]]. 
-<sxh>+<code>
 dsmadmc -dataonly=yes -id=userid -pa=password -tcpserveraddress=tsm01.gazillabyte.local \ dsmadmc -dataonly=yes -id=userid -pa=password -tcpserveraddress=tsm01.gazillabyte.local \
         -displaymode=table -outfile=TSM-VOL.csv -commadelimited "select volume_name,location,stgpool_name from volumes"         -displaymode=table -outfile=TSM-VOL.csv -commadelimited "select volume_name,location,stgpool_name from volumes"
-</sxh>+</code>
  
-Output csv files should be written to a directory where the TapeTrack Sync command can access them as input files for the Sync process.+Output CSV files should be written to a directory where the TapeTrack Sync command can access them as input files for the Sync process.
  
 ===== Synchronization ===== ===== Synchronization =====
Line 55: Line 55:
 <note important>You will need to install the [[cli:sync_suite|TapeTrack Sync software]] to complete these instructions.</note> <note important>You will need to install the [[cli:sync_suite|TapeTrack Sync software]] to complete these instructions.</note>
  
-Synchronization with TapeTrack is performed by calling the [[cli:TMSS10Sync|TMSS10Sync]] command line program, along with:+Synchronization with TapeTrack is performed by calling the [[cli:TMSS10Sync|TMSS10Sync]] command-line program, along with:
   * The CSV file produced from the DRM table   * The CSV file produced from the DRM table
   * The CSV file produced from the Volume table   * The CSV file produced from the Volume table
Line 62: Line 62:
 {{tsm_sync.png}} {{tsm_sync.png}}
  
-The [[cli:TMSS10Sync|TMSS10Sync]] is called individually for the DRM and Volumes output csv files.+The [[cli:TMSS10Sync|TMSS10Sync]] is called individually for the DRM and [[object:volume|Volumes]] output csv files.
  
 === Example Command Line Arguments === === Example Command Line Arguments ===
Line 68: Line 68:
 Sync command line using DRM output Sync command line using DRM output
  
-<sxh>+<code>
 TMSS10Sync -a -d TSM-DRM.ttidef -S user:-password@serveraddress < TSM-DRM.csv  TMSS10Sync -a -d TSM-DRM.ttidef -S user:-password@serveraddress < TSM-DRM.csv 
-</sxh>+</code>
  
 Where: Where:
-  * ''-a'' Add new Volumes if they are encountered.+  * ''-a'' Add new [[object:volume|Volumes]] if they are encountered.
   * ''-d'' Path to the Synchronization Definition File (.ttidef file).   * ''-d'' Path to the Synchronization Definition File (.ttidef file).
   * ''-S'' The Logon string argument sets the [[cli:server_argument|Server Logon Information]].   * ''-S'' The Logon string argument sets the [[cli:server_argument|Server Logon Information]].
Line 80: Line 80:
 Sync command line using Volume output Sync command line using Volume output
  
-<sxh> +<code> 
-TMSS10Sync -a -d TSM-DRM.ttidef -S user:-password@serveraddress < TSM-VOL.csv  +TMSS10Sync -a -d TSM-VOL.ttidef -S user:-password@serveraddress < TSM-VOL.csv  
-</sxh>+</code>
  
 Where: Where:
Line 92: Line 92:
 === Example batch file showing Sync process with dsmadmc extracted data and process output === === Example batch file showing Sync process with dsmadmc extracted data and process output ===
  
-<sxh>+<code>
 #!/bin/bash #!/bin/bash
  
Line 139: Line 139:
  echo TMSS10MoveScratch -S user:-$PW@tapetrack.gazillabyte.local -R "LIBR"  echo TMSS10MoveScratch -S user:-$PW@tapetrack.gazillabyte.local -R "LIBR"
  
-</sxh>+</code>
  
 === Example Synchronization Definition File (.ttidef file) === === Example Synchronization Definition File (.ttidef file) ===
Line 152: Line 152:
  
  
-The following definition file assumes default TSM locations and two Repositories (OFFS and LIBR) in TapeTrack+The following definition files assume default TSM locations and two Repositories (OFFS and LIBR) in TapeTrack
 </note> </note>
-<sxh> +===TSM-VOL TTIDEF File=== 
-# +<code> 
-# Set input file  +# Volume TTIDEF 
-# + 
-SetFile("TSM-Volume.csv"); +# Set CSV delimiter 
-# +SetCSVDelimiter(",");
-# Set the Customer and Media as literal values as they never change+
 # #
 +# Set Customer and Media values as they remain constant
 SetLiteral(CUSTOMER, "ACME"); SetLiteral(CUSTOMER, "ACME");
 SetLiteral(MEDIA, "LTO"); SetLiteral(MEDIA, "LTO");
-# + 
-# Set the delimiter to a CSV +# Extract Volume-ID
-# +
-SetCSVDelimiter(",") +
-# +
-# Set the Volume-ID +
-#+
 Extract(VOLUME, 1, 8, 0); Extract(VOLUME, 1, 8, 0);
-#  
-# Set the volume description from pool name 
 # #
 +# Extract Scratch value for comparison
 +Extract(SCRATCH, 2, 20, 0);
 +
 +# Extract Description
 Extract(DESCRIPTION, 3, 100, 0); Extract(DESCRIPTION, 3, 100, 0);
 +RemoveSpaces(DESCRIPTION);
 +
 +# If Scratch = Vault skip, anything else set SCRATCH to true
 +AddTranslation(SCRATCH, "VAULT", "!Bypass!");
 +AddTranslation(SCRATCH, "*", "true");
 +
 +# Exclude any lines starting with . or /
 +AddString(EXCLUSION, 0, ".*");
 +AddString(EXCLUSION, 0, "/*");
 +
 +</code>
 +
 +
 +===TSM-DRM TTIDEF File===
 +
 +<code>
 +# DRM TTIDEF
 +
 +# Set CSV delimiter
 +SetCSVDelimiter(",");
 # #
-# Get the repository value +# Set Customer and Media values as they remain constant 
-#+SetLiteral(CUSTOMER, "ACME"); 
 +SetLiteral(MEDIA, "LTO"); 
 + 
 +# Extract Volume-ID 
 +Extract(VOLUME, 1, 8, 0); 
 + 
 +# Extract Repository value
 Extract(REPOSITORY, 2, 20, 0); Extract(REPOSITORY, 2, 20, 0);
-# +RemoveSpaces(REPOSITORY); 
-# Translate repository value based off initial value + 
-# If Repository = Vault and Courier set Repository to OFFS +# Extract Scratch value 
-# If Repository = Anything else (Mountable, Vault Retrieve or Courier Retrieve) set Repository to LIBR +Extract(SCRATCH, 2, 20, 0); 
-# +RemoveSpaces(SCRATCH); 
-AddTranslation(REPOSITORY, "Vault", "OFFS"); + 
-AddTranslation(REPOSITORY, "Courier", "OFFS");+# Translate Scratch value 
 +AddTranslation(SCRATCH, "VAULTRETRIEVE", "true"); 
 +AddTranslation(SCRATCH, "*", "false"); 
 + 
 +# Translate Repository value 
 +AddTranslation(REPOSITORY, "VAULT", "OFFS");
 AddTranslation(REPOSITORY, "*", "LIBR"); AddTranslation(REPOSITORY, "*", "LIBR");
-# +AddSkipOnRepositoryChange("LIBR", "OFFS", "*"); 
-# Set all volumes to not scratch + 
-# +# Exclude any lines starting with . or / 
-SetLiteral(SCRATCH, "false");  +AddString(EXCLUSION, 0, ".*"); 
-</sxh>+AddString(EXCLUSION, 0, "/*"); 
 +</code>
  
 <- :cookbook:networker|NetWorker Sync Cookbook ^ :cookbook:introduction|Cookbook ^ :cookbook:veeam|VEEAM Sync Cookbook -> <- :cookbook:networker|NetWorker Sync Cookbook ^ :cookbook:introduction|Cookbook ^ :cookbook:veeam|VEEAM Sync Cookbook ->
  
 {{tag> cookbook}} {{tag> cookbook}}
cookbook/tsm.1613685093.txt.gz · Last modified: 2025/01/21 22:07 (external edit)