Buldoser User Guide v3.3

Crown Software BuldoserBuldoser User Guide Version 3.3 September, 2006 © Copyright 2003 - 2006 - Crown Partners, LLC Buldoser User Guide Table of Contents Introduction......................................................................................................................... 1 Purpose of this Manual ................................................................................................... 1 Intended Audience .......................................................................................................... 1 Document Conventions................................................................................................... 1 Getting Started .................................................................................................................... 2 Starting Buldoser ............................................................................................................ 2 Using the Docbase Browser............................................................................................ 3 Opening cabinets and folders.................................................................................. 4 Getting an object’s Object ID ................................................................................. 4 Unlocking objects ................................................................................................... 4 Deleting objects ...................................................................................................... 4 Refreshing the Browser........................................................................................... 4 Showing and Hiding User Cabinets........................................................................ 5 Logging into another Docbase ................................................................................ 5 Exiting the Docbase Browser.................................................................................. 5 Viewing the current version of Buldoser ................................................................ 5 Docbase to Docbase Overview ........................................................................................... 6 The Buldoser Methodology ............................................................................................ 6 Supported Object Types.................................................................................................. 8 ETL Process .................................................................................................................... 8 Check in content objects ....................................................................................... 10 Mandate a content freeze ...................................................................................... 10 Move supporting objects....................................................................................... 10 Create Batch Folder .............................................................................................. 10 Extract Content ..................................................................................................... 10 Finish Extract ........................................................................................................ 11 Switch Docbase..................................................................................................... 11 Transform.............................................................................................................. 11 Load Content......................................................................................................... 11 Finish Load ........................................................................................................... 11 Resolve Errors....................................................................................................... 12 Reprocess Errors ................................................................................................... 12 Load Relationships................................................................................................ 13 Finish Relationship Load ...................................................................................... 13 Resolve Relationship Errors ................................................................................. 14 Reprocess Relationship Errors.............................................................................. 14 Test Content .......................................................................................................... 14 Undo Load ............................................................................................................ 14 Extracting Content from a Docbase.................................................................................. 15 Starting an Extract......................................................................................................... 15 Finishing a Stopped Extract .......................................................................................... 21 Mapping Data Values ....................................................................................................... 22 © Copyright 2003 - 2006 - Crown Partners, LLC 2 Buldoser User Guide Mapping Attributes ....................................................................................................... 25 Creating ACLs and Accessing Groups ....................................................................... 25 Creating Folders............................................................................................................ 27 Preview Folder Creation ............................................................................................... 29 Loading Content into a Docbase....................................................................................... 31 Starting a New Load ..................................................................................................... 31 Finishing a Stopped Load ............................................................................................. 38 Reprocessing Load Errors............................................................................................. 39 Starting a Relationship Load......................................................................................... 40 Finishing a Stopped Relationship Load ........................................................................ 42 Reprocessing Relationship Load Errors........................................................................ 43 Undoing a Load............................................................................................................. 43 Scheduling an ETL Operation .......................................................................................... 46 Scheduling Overview.................................................................................................... 46 Extract Jobs........................................................................................................... 46 Load Jobs .............................................................................................................. 47 Scheduling an Extract Job............................................................................................. 47 Scheduling a Load Job .................................................................................................. 49 Editing an Existing Extract or Load Job ....................................................................... 51 Deleting an Extract or Load Job ................................................................................... 51 Database to Docbase Overview ........................................................................................ 53 Connecting to a Data Source......................................................................................... 53 Mapping a Data Source to Documentum’s Data Model............................................... 53 The Object View ................................................................................................... 54 Supporting Views.................................................................................................. 54 Object Configurations........................................................................................... 55 Inline Data Transformation................................................................................... 56 Attribute Configuration......................................................................................... 57 Content Configuration .......................................................................................... 57 Folder Configuration............................................................................................. 58 Security Configuration.......................................................................................... 58 Versioning Configuration ..................................................................................... 59 Pre- and Post-Processing....................................................................................... 59 Multi-threaded Loading Algorithm....................................................................... 60 Loading Content from a Database .................................................................................... 61 Creating a New Configuration or Configuring an Existing Configuration................... 61 Finishing a Stopped Database Load.............................................................................. 96 Undoing a Database Load............................................................................................. 97 Appendix – EDMS98 Operations ................................................................................... 100 Content View .............................................................................................................. 100 Defining Object View ................................................................................................. 100 © Copyright 2003 - 2006 - Crown Partners, LLC 3 Crown Partners.......... LLC 4 ..2006 ..Buldoser User Guide . 102 © Copyright 2003 .. . LLC 5 ...Crown Partners..2006 .Buldoser User Guide ...... 103 © Copyright 2003 . . 105 © Copyright 2003 .. LLC 6 .2006 .....Crown Partners....Buldoser User Guide . “This type is used” <<This type is used>> . To indicate keyboard keys. read the last chapter entitled. This guide provides instructions on how to use Buldoser for both Docbase to Docbase operations as well as Database to Docbase operations. “ETL Overview. To indicate a variable type of information. Groups. The double less than / greater than signs and the actual text is not typed. button names. see the Documentum Object Reference) Documentum security structures such as Users. or menu items that needed to press. or select. Purpose of this Manual The Buldoser User Guide provides instructions for performing Extract. and for text found in tables. For more general information on ETL operations. To indicate text needed in a field. The quotes are not typed.” Intended Audience Movement of content between Docbases requires knowledge of the Documentum repository and of the specific content being moved. The specific information represented by the variable within the double less than / greater than signs is typed. including: Documentum Query Language (DQL) (for more information. This manual is for administrators of Docbases and assumes the user is familiar with basic Documentum skills. click. see the Documentum DQL Reference) Documentum object model (for more information. and ACLs Using Documentum Administrator Documentum Cabinets and Folders Document Conventions Table 1-2. transform and load (ETL) operations in a Documentum environment using the Crown Partners Buldoser products. only the information within the quotes is typed. Conventions used in this Guide Convention Where used This type is used This type is used For emphasis.Introduction This section describes the purpose of this manual and its intended audience. for support documentation titles. Crown Partners. License keys are provided by installation machine to customers who have purchased a license. The first time Buldoser is run it will ask for a license key.bat or LaunchBuldoser. Click the Accept option followed by the “Ok” button to proceed. respectively). Starting Buldoser Buldoser can be run from the installed shortcuts (Windows only) or the supplied batch files (LaunchBuldoser. the new key must be entered in this file. To purchase a license or obtain a license key. It gives an overview of logging in and operating the Docbase Browser. Figure 1: Buldoser license key challenge dialog License keys can be obtained from Crown Partners.sh for Windows or UNIX. the End User License Agreement is presented.txt” in the installation directory. The login dialog will then be displayed. After the license key has been entered successfully. If an upgraded license is purchased. See Figure 1. LLC 2 .com. See Figure 2.2005 . The license key is stored in a file named “BuldoserLicense. contact productsales@crownpartners. Figure 2: Buldoser user login dialog © Copyright 2003 .Buldoser User Guide Getting Started This section provides instructions for getting Buldoser running the first time. Each feature is described in the following paragraphs with a description for use.ini file should be checked for correct connection information and that the Docbases are currently available. as well as an interface to view the results of a load. and then click Login. LLC 3 . It is suggested to use a Documentum super user to perform ETL operations. Buldoser will present an error message. Figure 3: Buldoser Docbase Browser Using the Docbase Browser The Docbase Browser provides an easy way to select items for Extract. © Copyright 2003 . The dmcl. See Figure 3.Buldoser User Guide If no Docbase is currently available. enter a valid username and password.2005 .Crown Partners. The Buldoser Docbase Browser will open. To start Buldoser. This can be useful for unlocking objects so that they may be deleted. To delete all versions of the selected objects. select the item. Deleting objects To delete objects. so items may be selected using Ctrl + click for individual items or Shift + click for a range of items. select the items then right-click and select Unlock.Crown Partners. If there are a large number of items in a cabinet or folder. or the table on the right. and then opened or closed using the +/. The Unlock menu item may also be reached from the File menu. Cabinets or folders may also be clicked again in the tree view to refresh their contents. double-click the cabinet or folder from either the tree view on the left. Multi-select is enabled. select Refresh from the File menu. IDQL. LLC 4 . The Delete menu items may also be reached from the File menu. Current Version. Refreshing the Browser To refresh the current view. This can be useful for pasting into IAPI. © Copyright 2003 . The Get Object ID menu item may also be reached from the File menu.Buldoser User Guide Opening cabinets and folders To open a cabinet or folder. Multi-select is enabled. or another administrator tool for doing further research on an object. The cabinet or folder may also be single-clicked.2005 . Buldoser will warn that opening may take a long time. Unlocking objects To unlock checked out objects. Getting an object’s Object ID To copy an item’s Object ID into the Clipboard. so items may be selected using Ctrl + click for individual items or Shift + click for a range of items. select the items then right-click and select Delete This will delete only the current version of the objects. then right-click and select Get Object ID.sign in the tree view. select Delete All Versions. This is useful for viewing new cabinets that are created during a load. select Exit from the File menu.Crown Partners.Buldoser User Guide Showing and Hiding User Cabinets By default Buldoser will only show the current user’s personal cabinet and all non-personal user cabinets. LLC 5 . To log into a different Docbase. select Show User Cabinets from the File menu. To exit the Docbase Browser and Buldoser.2005 . select About Buldoser… from the Help menu. The menu item will then toggle to Hide User Cabinets. which can be selected to hide other user’s personal cabinets. To show all users’ cabinets. To view the current version of Buldoser. Logging into another Docbase Exiting the Docbase Browser Viewing the current version of Buldoser © Copyright 2003 . select Switch Docbase from the File menu. The Login dialog will appear and a different Docbase may be selected. They must be moved separately before the Content Objects are moved. Figure 4: Content to Supporting Object Relationship When Buldoser moves Content Objects. The Buldoser Methodology When content is moved from one Docbase to another.2005 . This approach is different from other tools such as Dump & Load and DocApps.Crown Partners. that content relies on supporting and related objects to exist in the target Docbase for the operation to be successful. which will move any supporting or related objects in addition to the Content Objects to ensure success. it assumes all supporting and related objects already exist in the target Docbase. Figure 4 below illustrates these relationships. LLC 6 . © Copyright 2003 .Buldoser User Guide Docbase to Docbase Overview This section gives an overview of the features and high-level steps for performing ETL operations between two Documentum Docbases using Buldoser. making it unnecessary to move them. Figure 5 illustrates the mapping concept. LLC 7 . These objects usually already exist in a controlled implementation. With other tools. Other tools tend not to provide an exhaustive list of what was automatically moved.Crown Partners. the user who owns a particular document in the source Docbase should be changed in the target Docbase. and allowing the user to map supporting objects from the source to the target. which is not practical for very large volumes. For instance.2005 . The Buldoser methodology for ensuring success is to identify for the administrator what objects must exist in the target Docbase. Figure 5: Buldoser Mapping © Copyright 2003 . causing clutter and inefficiency in the target Docbase.Buldoser User Guide The following reasons support the Buldoser approach: Moving these supporting and related objects adds much more time to the Extract and load process. these supporting and related objects are frequently duplicated. the administrator does not wish to use the same supporting objects in the target that is used in the destination. making it difficult for administrators to determine what was moved in the batch. In some scenarios. . In addition to making ETL operations much more efficient. etc.2005 .Crown Partners. during ETL operations. To move other types such as lifecycles. workflows. Supported Object Types Buldoser was developed to handle the task of moving large volumes of content objects. alias sets. it is recommended to use DocApps with Documentum’s Application Builder and Application Installer.Buldoser User Guide The idea of mapping supporting and related objects is very powerful. folder structure. as well as guaranteeing there is no duplication of supporting objects. etc. The mapping feature also allows the administrator to “clean up” the data as it’s moved by streamlining the object model. object types. ETL Process Figure 6 below describes the overall process for moving content from Docbase to Docbase using Buldoser. it also gives the administrator complete control over what is moved. In the current version. Buldoser only moves objects of type dm_document and its subtypes. LLC 8 . security model. © Copyright 2003 . Crown Partners. LLC 9 .Buldoser User Guide Figure 6: Docbase to Docbase Process © Copyright 2003 .2005 . all users should be notified that an ETL operation is scheduled to take place. proceed to the Switch Docbase step. If the Extract is stopped. Supporting objects include. Any configuration objects that exist in the source Docbase should be moved to the destination Docbase before the content movement begins. Once the Extract is complete. To keep updates from being lost during the process. Buldoser allows Extract operations to be stopped and restarted from the stopping point at a later time. as content depends on these objects existing in the target. Extracting Content from a Docbase for more information. A calculation of content size should be made to ensure enough space exists in the batch folder before the Extract step. See the section. so every effort should be made to make these batches uniquely named.Crown Partners. but are not limited to: Object Types Users ACLs Alias Sets Lifecycles Folders XML Applications Formats Storage Locations Move supporting objects Create Batch Folder A batch folder is simply the location where content objects will be Extracted. Extract Content © Copyright 2003 . Extract the objects to be moved to the batch folder.2005 . any outstanding updates should be checked into the Docbase using the appropriate client application. proceed to the Finish Extract step.Buldoser User Guide Check in content objects Mandate a content freeze To ensure all content is moved. This location is remembered by Buldoser as the batch name. Buldoser will also Extract a list of the supporting objects that must exist in the target Docbase. and that updates should be postponed until after the operation is complete. LLC 10 . Using Buldoser. see the section. Extracting Content from a Docbase for more information. the administrator will Transform. Buldoser allows loads to be stopped and restarted from the stopping point at a later time. Switch Docbase After the Extract is finished. © Copyright 2003 . Loading Content into a Docbase for more information.Buldoser User Guide Finish Extract If the Extract was stopped. If the load is stopped. Once the Extract is complete.2005 . Transform Load Content Finish Load If the load was stopped. If the load completes but has errors. Buldoser may restart the load from the stopping point. Loading Content into a Docbase for more information. LLC 11 . See the section. proceed to the Resolve Errors step. See the section. Once logged into the target Docbase. The Buldoser Methodology. If the load is not stopped and has no errors. Using Buldoser. login to the target Docbase to map the supporting objects. If the load completes but has errors. Buldoser will proceed immediately to the Load Relationships step. For more information on performing data mapping.Crown Partners. At this step the ability also exists to create custom Folders and any ACLs and groups that correspond to that existing folder structure. See the section. proceed to the Switch Docbase step. proceed to the Resolve Errors step. Mapping Data Values. Buldoser may restart the Extract from the stopping point. Buldoser will proceed immediately to the Load Relationships step. See the section Using the Docbase Browser for more information. If the load is not stopped and has no errors. This concept is core to Buldoser’s ETL process. load the Extracted objects from the batch folder. proceed to the Finish Load step. Mapping data values identifies any potential issues due to supporting objects not existing in the target Docbase. and allows the administrator to resolve these issues before the load. it is described in more detail in the section. Buldoser will use the mappings stored in the batch folder to transform the content objects during the load. Loading Content into a Docbase for more information on reprocessing load errors. See the section.Buldoser User Guide Resolve Errors Should errors exist in the load. Once the issue is resolved. Once all errors are reprocessed. proceed to the Load Relationships step. LLC 12 .2005 . Buldoser will set aside the objects in an error log to be reprocessed once the issue is fixed. Buldoser allows for only the errors in a load to be reprocessed. proceed to the Reprocess Errors step. Reprocess Errors © Copyright 2003 . This way the administrator does not have to remove and reload successful objects to try the load again. Usually errors are due to Docbases being stopped or incorrect or incomplete mappings. Review the log file for the load to determine the problem.Crown Partners. Buldoser attempts to always move forward during the load process to be as efficient as possible. they can be resolved before relationships are created.2005 . If the load completes but has errors. Buldoser may restart the load Finish Relationship from the stopping point. If any errors exist in the initial phase. Buldoser allows relationship loads to be stopped and restarted from the stopping point at a later time. If the load is not stopped and has no errors. See the section. proceed to the Finish Relationship Load step. errors would be duplicated in both phases creating twice the number of issues for the administrator to resolve. Loading Content into a Docbase for more information. If the relationship load is stopped. If the load completes but has errors. If relationships were created at the same time as the content objects. relationships will automatically be started immediately after the first phase. proceed to the Test Content step. generically referred to as “relationships. use Buldoser to create the relationships. © Copyright 2003 .Buldoser User Guide Load Relationships This step refers to the process of loading dm_relations and virtual document links. If relationships exist but were not created immediately after the first phase. If relationships were loaded immediately after. proceed to the Resolve Relationship Errors step. If there are no errors during the initial load. Loading Content into a Load Docbase for more information.” Relationships are loaded in a separate phase from the core Content Objects for two reasons: Both the parent and child objects in a relationship must exist before the relationship can be created. If the load is not stopped and has no errors. LLC 13 . proceed to the Test Content step. proceed to the Resolve Relationship Errors step.Crown Partners. If the relationship load was stopped. it would force the administrator to load the content objects in separate batches and in a particular order. See the section. To resolve them. Buldoser will set aside the objects in an error log to be reprocessed once the issue is fixed. locate the child objects in the source Docbase and move them using Buldoser. proceed to the Reprocess Relationship Errors step. Usually it is sufficient to test the first 100 objects or so. incorrect mappings. Once all errors are reprocessed. If the testing succeeds. proceed to the Test Content step. This way the administrator does not have to remove and reload successful objects to try the load again. If the batch was executed incorrectly. Usually errors are due to child objects not existing in the target Docbase. proceed to the Undo Load step. If testing fails. Once the child objects are move. See the section.Crown Partners. Buldoser allows for only the errors in a relationship load to be reprocessed. Undo Load Buldoser provides the capability to remove any objects that are loaded. Loading Content into a Docbase for more information on reprocessing relationship load errors. © Copyright 2003 . the content should be tested in the target Docbase using the appropriate client application. the process is complete. re-examine the Extract and load logs for any errors. Reprocess Relationship Errors Test Content After any load operation. Loading Content into a Docbase for more information. See the section. LLC 14 . then randomly test 510% of the remaining population.2005 .Buldoser User Guide Resolve Relationship Errors Should errors exist in the relationship load. or incorrectly handled objects. Docbase to Docbase Overview for an important description of how Buldoser moves content objects. To complete a stopped Extract. follow these steps: 1. LLC 15 . Finishing a Stopped Extract. Make sure the location has enough space.Buldoser User Guide Extracting Content from a Docbase This section provides step-by-step instructions for Extracting content from a Docbase using Buldoser. Extracts may be stopped and completed at a later time from the stopping point. The Exract dialog will appear. 2. If this is the first time moving content using Buldoser. Starting an Extract This section describes starting a new Extract. To start Extracting content from a Docbase. see the section.Crown Partners. Create a location on the file system to contain the Extracted content and attributes. Select New Extract from the Docbase Extract menu.2005 . see the section. © Copyright 2003 . or document that is selected from the Docbase Browser.2005 . The DQL must be of the form dm_document where… Note that the DQL statement may not contain the (all) keyword. the DQL statement will “collect” object IDs as the Docbase is browsed. LLC 16 .Crown Partners. 4. © Copyright 2003 . folder. 5.Buldoser User Guide 3. Select the […] button to browse for the location. Select Threads to indicate the number of threads that will be used for this Extract operation. If documents are selected. To close the Extract dialog but save the values in the DQL. Create a DQL statement to identify the objects to Extract. Enter the location into the Extract Directory text box. click Save Settings. Buldoser can also automatically create a DQL statement based on a cabinet. Select Extract Audit Trail to Extract any dm_audittrail objects associated to the content within this batch. Select Extract Content to Extract all renditions along with the attributes. Click Cancel to close the dialog. Select Extract Virtual Docs to Extract virtual document relationships that refer to the objects being extracted as the parent in the relationship. 13. 14. For more information on content metadata refer to the Content Server Fundamentals Guide. Select Extract Renditions to indicate if the content has more than just page=0 renditions. a link relative to the content storage directory of the filestore will be saved in the xml metadata.Buldoser User Guide 6. Select Page 0 Renditions if all of the objects in the batch have associated dmr_content objects with page=0. 16. Groups and ACLs for the batch will be Extracted. The will also preserve content metadata. c. 7. No content will be Extracted as a result of this option. © Copyright 2003 . 10. First the Folders. b. LLC 17 . Select Extract Lifecycle Setting to Extract what Lifecycle is attached to the objects. Select Local Extract to indicate that the Metadata and any content and renditions will be stored locally in the Extract Directory indicated in Step 3. Know that this will impose an additional load on the docbase during both the Extract and load operations. Select Links from File Store to designate that all content and renditions will not be Extracted. This is referred to as Contentless Migration and can reduce the time of the overall operation if the Renditions are significantly large. 9. Click Extract Dependencies to create a dependency mapping file only. Note that moved audit trail will be associated to the same user as the existing system. Upon completion the following status dialog will appear. 8. Note: This does not Extract the Lifecycle itself. only the current version will be Extracted. Click the Extract button to start Extracting immediately. 11. b. 15.Crown Partners. If this option is not selected. however. a. 12. Choose the Metadata only option if content less objects are desired. a. Select Extract All Versions to extract the entire version tree for each object.2005 . It is recommended to verify that there are dmr_content objects with page=1 in the batch prior to selecting this option. Select All Renditions if any renditions in the batch have dmr_content objects associated with page=1. Select Extract Relationships to Extract any dm_relation objects that refer to the objects being Extracted as the parent in the relationship. Lifecycle movement should be performed using Documentum’s Application Builder. Click Save Settings to save the settings but not perform the Extract immediately. Buldoser User Guide The dialog is explained below: Item Description Title Bar Location Total Objects Indicates the operation being performed Current Batch Location Total number of objects anticipated to be processed with this operation. LLC 18 .Crown Partners. Additionally this progress bar is only update after the processing of an entire version tree.2005 . © Copyright 2003 . An important distinction to make here is that this number represents individual number of objects across a version tree. View Stats for Thread Number View Log Stop Will open the log file associated to the currently Selected Thread. 4. Note that for a multiple version load that this one object actually accounts for the entire version tree. Number Waiting – Number of objects that are waiting to be processed by this thread. Each Thread has a Docbase session and separate pool of resources used for processing objects. Number of objects/second being processed collectively by all of the worker threads. Number Failed – Number of objects that were failed to be processed.2005 . each individual threads statistics can be analyzed. Only when the “Stopped” message appears is the operation is in a © Copyright 2003 . Indicates the number of objects that can be allocated to be processed by a single thread at a given time. 3.Crown Partners. Average Processing Time – Average Processing Time for this thread. 1.Buldoser User Guide Total Threads Max Objects/Thread Progress Messages Total Throughput Number of threads being used. Using the “<” and “>” buttons. Number of objects that remain to be processed for the entire operation Status Messages for the operation. Will stop the dealing of objects to each of the threads. This includes multiple versions of objects. each of the threads will need to process their queue of objects. LLC 19 . 2. Note that this will not stop the operation. Number Processed – Number of objects processed by this thread. 2005 .Buldoser User Guide completed state. LLC 20 . Close Update Stats Closes the HUD Dialog. Will force the recalculation of the statistics on the currently displayed thread. © Copyright 2003 .Crown Partners. Enter the location of the Extract into the Extract Directory text box. The Finish Extract dialog will appear. To start a new Extract. To finish exracting content from a Docbase.Crown Partners. click Save Settings. The location may be browsed by clicking the […] button 4. see the section. Starting an Extract. click Cancel.2005 . 3. © Copyright 2003 . 6. Extracts may be stopped and completed at a later time from the stopping point. ACLs. To close the dialog and save the entries. 2.Buldoser User Guide Finishing a Stopped Extract This section describes finishing a stopped Extract. This operation can only be performed after the Folders. To close the dialog. 5. LLC 21 . click Finish Extract. follow these steps: 1. and Groups have been Extracted from the docbase. Identify the location on the file system that contains the previously Extracted content and attributes. To resume the Extract. Select Finish Extract from the Docbase Extract menu. Getting Started. For more information on connecting to a Docbase with Buldoser or switching Docbases.dep”) file is generated in the Extract location. If this is the first time moving content using Buldoser. The Transform Dialog will appear. Mapping Data Values is the action of mapping these supporting objects to values in the target Docbase. Buldoser provides an interface for mapping these values while connected to the target Docbase. Select Transform from the Docbase Load menu. Login or switch to the target Docbase. LLC 22 .2005 .Buldoser User Guide Mapping Data Values This section provides step-by-step instructions for mapping data values from a source Docbase to a target Docbase. follow these steps: 1. Object Types. see the section. see the section.Crown Partners. and Folders that must exist in the target Docbase for a load operation to be successful. This file identifies all the supporting objects such as ACLs. Docbase to Docbase Overview for an important description of the theory behind mapping data values. To Transform from the source to the target Docbase. 2. When Buldoser executes an Extract. a dependency mapping (“buldoser. © Copyright 2003 . Select Open from the File menu. LLC 23 . select the dependency mapping file. the Transform dialog will show Object Type mappings. and click Open. After the file is opened.Buldoser User Guide 3.Crown Partners. If an Extract was just performed. and the dependency type will display 2 exclamation points to make it easy to identify any potential errors during the load. the Transform dialog will evaluate each dependency and identify whether the supporting object exists in the target Docbase. Buldoser will present the option to open the dependency mapping file from the previous Extract. Navigate to the Extract directory. the value will display a red exclamation point. 4. © Copyright 2003 .2005 . A file browser will appear. For nonexistent mappings. Initially. Click the Clear button to remove mappings from selected rows. 9. 10. 11. 6. To change to another Dependency Type.Buldoser User Guide 5. If changes are not saved and the dialog is closed. To resolve a mapping for a missing dependency or to map a value from the source Docbase to a different value in the target Docbase. 12. Click the Map All button to map all rows to the selected target option. Select a value from the Target Options drop-down. © Copyright 2003 .2005 . Click the Map button to map the selected rows to the selected target option.Crown Partners. LLC 24 . 7. 8. Buldoser will warn the user before closing the file. The screen will update to show dependencies of the selected type. select the row or rows to be mapped. the changes can be saved by selected Save from the File menu. Click the Clear All button to remove mappings from all rows. After all mappings are completed. select the type from the drop-down. 3 and above. Once the object types are mapped select the button labeled “Map Attributes” In Buldoser version 3. If the User or Alias of the ACL does not exist. Any User accessors extracted from a repository will not be recreated. © Copyright 2003 . dm_owner.Crown Partners. At this point any number of ACLs can be selected from the table. Upon clicking the “Create Selected ACLs” button these ACLs will be created in the target docbase. This allows the dependency file to thereby be more portable across docbases by saving the step of mapping to docbase owner. The following should be taken into consideration when creating ACLs: • • • Upon creating ACLs. LLC 25 . Upon recreating a group any sub groups in the source repository will also be recreated in the target. An ACL can grant permission to either: • Groups (dm_group objects) • Users (dm_user objects) • Aliases ( dm_alias_set objects) It is important to know that because Buldoser does not import users.e the acl_domain) To create an ACL open the Transform dialog and select the “ACL” dependency type. Refer to the Transform section for more information. Creating ACLs and Accessing Groups It is important to know the basic theory of ACLs in order to understand how they are moved using Buldoser. For more information see the steps outlined in the section Transform. In order to map attributes first map object types to their desired target value. only dm_group accessors are granted permission to the ACL. only the accessor groups are recreated. This feature is especially useful when consolidating multiple custom types into a single custom type. and acl_domains are mapped using the dm_dbo alias if the owner_name attribute is the docbase owner. the dbo is used as the value for the owner_name (i.Buldoser User Guide Mapping Attributes Each object type included in the batch can have the value of the target attribute mapped from a different source prior to loading.2005 . 2005 .Buldoser User Guide © Copyright 2003 . LLC 26 .Crown Partners. The ACLs of this folder structure should be mapped as desired prior to performing this operation. To create a Folder. It is important to know that any ACL mapping will supersede any existing ACL value of a folder from the source repository.Crown Partners. © Copyright 2003 . For more information on how to map ACLs refer to the section Transform.e. Upon an Extract operation all of the folder objects for a given batch are Extracted to the specified load directory. It is important to know that this function will recreate an entire security structure of a repository. Upon clicking the “Create Selected Folders” button to these folder will then be created in the target docbase. At this point any number of Folders can be select from the table. Map any desired folder object type and attribute mapping prior to creating folders. dm_folder is the supertype) the custom Metadata associated to that folder will additionally be Extracted. ACLs to which a folder refers may be created if not already existing in the repository. Refer to the Transform section for more information. Specifically. Some things to keep in mind while Extracting folders: • • • Map any desired folder types in the Transform window prior to creating folders. If a custom folder type (i. LLC 27 . Additionally any groups those ACLs reference will be created if not already existing in the docbase.2005 .Buldoser User Guide Creating Folders The “Transform” screen is also used to recreate an existing folder structure in the target repository. open the Transform dialog and select the “Folder” dependency type. Map any desired folder ACL mapping prior to creating folders. © Copyright 2003 . LLC 28 .2005 .Buldoser User Guide Select the desired folder(s) and click the “Create Selected Folders” button.Crown Partners. All of the resultant created folders for this batch will be displayed in the table. Note: If a large number of folders were selected it may take some time to process. At this point Folders can be selected from the table. To preview folder creation first open the Transform dialog and select the “Folder” dependency type.Crown Partners.Buldoser User Guide Preview Folder Creation An additional option exists to see which Folders. © Copyright 2003 . and groups will be created prior to creating them. LLC 29 . Refer to the Transform section for more information. Upon clicking the “Show Folder Dependencies” button all of the folder dependencies will be displayed. ACLs.2005 . Buldoser User Guide . LLC 30 .2005 . © Copyright 2003 .Crown Partners. LLC 31 . The load dialog will appear: © Copyright 2003 . To complete a stopped load. Select New Load from the Docbase Load menu. see the section. Before loading content. Starting a New Load This section describes starting a new load. follow these steps: 1. Loads may be stopped and completed at a later time from the stopping point. It is recommended that the user is the Docbase Owner (dbo). If this is the first time moving content using Buldoser. see the section. Docbase to Docbase Overview for an important description of how Buldoser moves content objects. To load content into a target Docbase. see the section. Database to Docbase Overview for more information on the feature. Buldoser also provides the capability to load content from a database into Documentum. See the section. the Transform step should be performed. Mapping Data Values. Finishing a Stopped Load.2005 . For more information on this step.Crown Partners. The user who logs into the target Docbase must be a super user.Buldoser User Guide Loading Content into a Docbase This section provides step-by-step instructions for loading content that was Extracted from a source Docbase into a target Docbase using Buldoser. Select the Synchronization Setting to tell Buldoser how to react if the CURRENT version of an object being loaded matches a CURRENT object that already exists in the target system. If a ContentLess Extract is Specified. Optionally a Processing Class can be specified.2005 . the option will be presented to specify a Base Path. 3. By implementing the interface IBuldoserTransform gives the full power of Java and the DFC classes to implement any custom functionality that might be required. Enter the location of the Extract into the Load Directory textbox. First map a network driver to the existing filestore of the source docbase. An example of this location is: C:\Documentum\data\sbdev\content_storage_01\00002417.Crown Partners. Using this functionality will only save time only if the renditions are large. Note that in this case the source docbase is sbdev and the docbase id 2417(hex). © Copyright 2003 .Buldoser User Guide 2. 4. or browse using the […] button. LLC 32 . This is useful in Web Content Management Systems where the promotion through lifecycle states takes a great deal of time. If Previous Object Exists Append Version Tree to append the existing version tree with only the CURRENT version of the object. Note: Not all lifecycles have an r_current_state that starts at zero. this object is determined to be loaded. Select No Lifecycle Promotion to only attach the lifecycle and do no promotion. which will impose an additional load on the Content Server. LLC 33 . the number of times to promote any objects that are loaded with Lifecycles in the Promote Cycles drop-down. Select Lifecycle Promotion setting to indicate how many lifecycle promotions need to occur after the lifecycle is attached to this object. The object is never checked to be existing. The object_name and folder_path attributes are used to determine if this object has already been loaded. Select ALWAYS Create Version Tree to create objects regardess of existing objects (default). If so. d.Crown Partners. It is best to start with one or two • © Copyright 2003 . Select Promote Desired Number of Cycles to promote all content loaded with lifecycles a set number of times. In this case Simply run the Site Publishing Job after the load to take full advantage of this feature. b.Buldoser User Guide First the r_object_id is compared against the r_object_id of the object in the batch. i. Select Promote Content to Previous State to run the promote command on the content the same number of times as the value of the r_current_state attribute. c. Select Set Previous Lifecycle State to set the r_current_state attribute of the content after attaching the lifecycle. Selecting multiple threads helps the content to load faster. In other cases only the CURRENT version of the object will get loaded. 5. but it is dependant on the hardware. Select CREATE If Previous Object Does Not Exist to only load this version tree if the CURRENT version of the batch is not found. Select the number of threads to use for the load from the Threads drop-down. d. Select CURRENT versions only. Each thread will create an additional Docbase Session. • Lastly.2005 . a. Select REPLACE If Previous Object Exists to delete the existing version tree if the CURRENT version of the object is found. a. • Second the buldoser_audit_trail object is checked to determine if the source r_object_id of this object has been loaded. 6. b. Check the i_state_no and the state_name attributes of the dm_policy objects in the source and target docbase prior to running this operation. The Syncronization Setting is particularly useful for running scheduled jobs against a production docbase. This case would only occur if the extract and load occurred within the same docbase. c. On a nightly docbase this job can be used to Syncronize good content to a development system. then increase the number of threads for subsequent loads after monitoring network. 11. This option may be used for diagnostic purposes. Buldoser will create a format with the correct name only – an administrator must fill in the remaining attributes once the load is complete. This allows administrators to quickly map this attribute without using the Transform dialog. 9. Check the Auto Create Formats box to automatically create formats if they don’t exist in the destination Docbase. only errors will be written to the log file. a line graph may be created to display performance trends over the life of the load. It is highly recommended to move formats with a Documentumprovided tool or script outside of Buldoser before performing ETL operations. Additionally the default number of sessions a client can obtain is 10. Click Cancel to close the dialog. 10. This option can negatively impact performance for very large loads. If this option is not selected. © Copyright 2003 . An instance of the following status dialog will appear. For large loads this option may degrade performance.txt.Buldoser User Guide threads for initial loads.2005 . This option is provided as a fallback mechanism only.ini file of the client running Buldoser to modify this setting. Click Save Settings to save the settings but not perform the load immediately. LLC 34 . Set the MAX_SESSION_COUNT attribute in the dmcl. memory. 7. Check the Auto Set Owner box to automatically set the owner_name attribute of each object to the Docbase owner of the target Docbase. 8. and processor resources. Click the Load button to start loading immediately. Check the Trace box to have Buldoser write a DMCL-level trace for every 1000th object that is loaded.” By opening a chart file using Microsoft Excel. Check the Verbose box to create a very detailed log file to be created from the load. This option is typically used during a small trial load for diagnostic purposes. Having the Docbase owner own content is a standard convention. Check the Chart Performance box to create a tab-delimited data file containing relevant performance information on the load in milliseconds.Crown Partners. A file is created for each thread and is named “chart<thread number>. 2005 .Crown Partners. LLC 35 .Buldoser User Guide © Copyright 2003 . each individual threads statistics can be analyzed. Each Thread has a Docbase session and separate pool of resources used for processing objects. Number of objects that remain to be processed for the entire operation Status Messages for the operation. Number of objects/second being processed collectively by all of the worker threads. Indicates the number of objects that can be allocated to be processed by a single thread at a given time. Number of threads being used. LLC 36 . 6. This includes multiple versions Total Threads Max Objects/Thread Progress Messages Total Throughput View Stats for Thread Number © Copyright 2003 . Using the “<” and “>” buttons. An important distinction to make here is that this number represents individual number of objects across a version tree.2005 . Number Processed – Number of objects processed by this thread. 5. Number Waiting – Number of objects that are waiting to be processed by this thread.Crown Partners.Buldoser User Guide The above dialog is explained below: Item Description Title Bar Location Total Objects Indicates the operation being performed Current Batch Location Total number of objects anticipated to be processed with this operation. Note that for a multiple version load that this one object actually accounts for the entire version tree. Additionally this progress bar is only update after the processing of an entire version tree. 8.Buldoser User Guide of objects.2005 . 7. Will stop the dealing of objects to each of the threads. Will force the recalculation of the statistics on the currently displayed thread. Note that this will not stop the operation. each of the threads will need to process their queue of objects. View Log Stop Will open the log file associated to the currently Selected Thread. Number Failed – Number of objects that were failed to be processed. LLC 37 . Only when the “Stopped” message appears is the operation is in a completed state.Crown Partners. Average Processing Time – Average Processing Time for this thread. Closes the HUD Dialog. Close Update Stats © Copyright 2003 . verbose logging. To modify the values for promote cycles. auto Folder creation. click Cancel. The Finish Load from Docbase Extract dialog will appear. Starting a New Load. The dialog will change to display the above options. The same number of threads are launched in the finishing load as the original load. see the section. Loads may be stopped and completed at a later time from the stopping point. follow these steps: 1. 5. click Save Settings. 2. To finish loading content into a Docbase.Crown Partners. To close the dialog and save the entries. 6. Identify the location on the file system that contains the previously loaded content and attributes. tracing. 3. To start a new load. Each thread will have its own stopping point and will continue from there. © Copyright 2003 . auto ACL creation. or auto set owner.Buldoser User Guide Finishing a Stopped Load This section describes finishing a stopped load. Select Finish Stopped Load from the Docbase Load menu. The location may be browsed by clicking the […] button 4. To close the dialog. LLC 38 . 7. auto Format creation. click the Modify Load Settings button. click Finish Load.2005 . Enter the location of the load into the Load Directory text box. To resume the load. see their respective sections. the error file will eventually be empty. it will write any failed objects to an error file. LLC 39 . Each thread has its own error file named “load_errors_T<thread number>. Reprocessing can only occur after the initial load is completed. To start a new load or finish a stopped load. After all objects are loaded. Enter the location of the load into the Load Directory text box. The location may be browsed by clicking the […] button 4. Identify the location on the file system that contains the previously loaded content and attributes. The Reprocess Load Errors from Docbase Extract dialog will appear. click Save Settings. When Buldoser executes a load. Select Reprocess Load Errors from the Docbase Load menu.2005 . As these retries succeed. click Reprocess. gradually reducing the size of the error file.” To reprocess load errors. 3. The same number of threads is executed when reprocessing errors as the original load. Reprocessing uses this error file as its input to retry these failed objects. To close the dialog and save the entries. 6. 2. Starting a New Load and Finishing a Stopped Load. follow these steps: 1.txt. To close the dialog. the objects are removed from the error log. 5.Crown Partners.Buldoser User Guide Reprocessing Load Errors This section describes reprocessing the errors from a completed load. To resume the load. © Copyright 2003 . click Cancel. so only one instance of the following status dialog will appear. © Copyright 2003 . or auto set owner. To load relationships into a target Docbase. The dialog will change to display the above options. see the section. Relationship loads are the second phase of the load process and load any dm_relations and virtual document links that may exist. The location may be browsed by clicking the […] button 3. Select Create Relationships from the Docbase Load menu. auto ACL creation. click Cancel. tracing. LLC 40 . 4. click Create Relationships. the relationship phase will begin automatically. To complete a stopped relationship load. follow these steps: 1. To modify the values for promote cycles. auto Folder creation. The Create Relationships from Docbase Extract dialog will appear: 2. If the first phase completes successfully on the first try.2005 . Enter the location of the load into the Load Directory text box. Relationship loads may also be stopped and completed at a later time from the stopping point. If the initial phase is stopped or has errors.Buldoser User Guide 7. 5. To close the dialog and save the entries. click the Modify Load Settings button. the relationship phase must be kicked off manually. Relationship loads are single-threaded only. auto Format creation. To close the dialog. Finishing a Stopped Relationship Load. Starting a Relationship Load This section describes starting a new relationship load. To start the relationship load. verbose logging.Crown Partners. click Save Settings. For Relationship Load this is always BuldoserRelationshipLoad Indicates the Batch location where this operation is being performed. Timestamp for when the load began. Indicates the thread number (always zero for relationship loads). Indicates the operation type.Crown Partners. Indicates the running average time per relationship in milliseconds.2005 . LLC 41 . Indicates when the relationship load should complete calculated by © Copyright 2003 . Indicates the number completed. Indicates the number of failed relationships. Indicates the number of successful relationships.). Describes the current operation.Buldoser User Guide The dialog is explained below: Item Description Title Bar Operation Type Load Location Thread Number Progress Messages Successful Relationships Failed Relationships Begin Time Average Load Time Projected Completion Time Indicates the percent completion and thread number (which is always zero for Relationship loads. To finish loading relationships into a Docbase. click Save Settings. see the section. Only available after the load is complete or has been stopped. Starting a Relationship Load. View Log Stop Opens the log file. Select Finish Stopped Relationship Load from the Docbase Load menu. The Finish Relationships from Docbase Extract dialog will appear. Stops the load. click Finish Relationships. Identify the location on the file system that contains the previously loaded relationships. Relationship loads may be stopped and completed at a later time from the stopping point. follow these steps: 1.2005 . 3. To start a new relationship load. click Cancel. To close the dialog. Close Finishing a Stopped Relationship Load This section describes finishing a stopped relationship load. 6.Buldoser User Guide extrapolation. To close the dialog and save the entries. see the section. Finishing a Stopped Relationship Load. To restart the load. To resume the load.Crown Partners. Enter the location of the load into the Load Directory text box. 5. © Copyright 2003 . 2. The location may be browsed by clicking the […] button 4. LLC 42 . 2005 . 6. When Buldoser executes a relationship load. click Save Settings. it will write any failed relationship to an error file. follow these steps: 1. Starting a Relationship Load and Finishing a Stopped Relationship Load. To resume the load. The Reprocess Relationship Errors from Docbase Extract dialog will appear. Reprocessing can only occur after the relationship load is completed. LLC 43 . To start a new relationship load or finish a stopped relationship load. Undoing a Load Undo will completely eradicate the previous objects. 5. © Copyright 2003 . click Cancel. To close the dialog and save the entries.” To reprocess relationship errors. Identify the location on the file system that contains the previously loaded relationships. The location may be browsed by clicking the […] button 4. the error file will eventually be empty. relationships and the audit records that track the loading process. and Groups. 3. gradually reducing the size of the error file. 2.Crown Partners.txt. ACLs. see their respective sections. Select Reprocess Relationship Errors from the Docbase Load menu. To close the dialog. After all relationships are loaded. the relationships are removed from the error log. The error file is named “relationship_errors. Undo will not remove any automatically created formats. As these retries succeed. Enter the location of the load into the Load Directory text box. Undo will additionally remove any automatically created Folders.Buldoser User Guide Reprocessing Relationship Load Errors This section describes reprocessing the errors from a completed relationship load. click Reprocess Relationship Errors. Reprocessing uses this error file as its input to retry these failed objects. Buldoser User Guide To undo a load. Buldoser uses this location in its audit trail to identify objects loaded from the batch. Enter the location of the load into the Load Directory text box. Undo operations run single-threaded only. Identify the location on the file system that contained the loaded objects. The Undo dialog will appear.2005 . click Cancel. To close the dialog. To undo the load. 3. To close the dialog and save the entries. LLC 44 .Crown Partners. Select Undo Load from the Docbase Load menu. follow these steps: 1. 2. click Undo. click Save Settings. 5. An instance of the following status dialog will appear. The location may be browsed by clicking the […] button 4. The dialog is explained below: © Copyright 2003 . 6. Indicates the Batch location where this operation is being performed.Buldoser User Guide Item Description Title Bar Operation Type Load Location Thread Number Progress Messages Stop Close Indicates the percent completion and thread number (which is always zero for Undo.Crown Partners.2005 . Stops the undo. © Copyright 2003 . Indicates the number completed. Indicates that this is a BuldoserUndo. Describes the current operation. LLC 45 . Only available after the undo is complete or has been stopped.). Indicates the thread number (always zero for Undo). with the addition of a job name.” Objects will be Extracted to this location instead of the configured location. Docbase to Docbase Overview. LLC 46 . and. users should be familiar with its capabilities before working with scheduler. “Backup 2005-04-21 04:00:00.2005 . including: Scheduling Extracts or loads to be performed during off hours when users are not accessing the source or target Docbase. Buldoser will modify the Extract by: Creating a sub folder underneath the Extract location for the Extract. see the section. When Documentum runs an Extract Job. Normally Extracts will run the DQL statement and Extract the objects directly to the extract location. Scheduler is implemented as a Documentum job.Crown Partners. An example of a sub folder is. etc.g. Replicating content from a source to a target Docbase. run frequency. The name of the folder will follow the convention Backup yyyy-mm-dd hh-mm-ss. For more information on installation. Regularly monitoring a location for content that is generated by another system for import into a Docbase. hours. Scheduling Overview Buldoser Scheduler provides the capability to schedule Docbase Extracts and Docbase Loads. Creating a regular backup of selected files while the Docbase is running. There are a plethora of applications for Scheduler. days. Extract Jobs When Extract Jobs are scheduled. © Copyright 2003 . they are configured exactly the same as a normal Buldoser Docbase Extract. minutes. Scheduler uses the exact same installation procedure as normal Buldoser operation. For more information on Docbase to Docbase operations.). The operation of Buldoser Extract and Load Jobs are described in further detail in the following paragraphs.Buldoser User Guide Scheduling an ETL Operation This section provides an overview of Buldoser’s scheduling capabilities as well as stepby-step instructions for scheduling an Extract or Load between Docbases. and requires that Buldoser is loaded on the Content Server. Buldoser’s scheduler functionality is based on Docbase to Docbase operations. see the Buldoser Installation Guide and Release Notes.. and run mode (e. ” Creating an audit trail entry that records the date and time of the execution. follow these steps: 1. Creating an audit trail entry that records the name of the batch that was executed. run frequency. Normally Loads will load objects that are found in the configured load location. “select distinct r_object_id from dm_document where folder(‘/Demo’. minutes. These changes allow Buldoser to run incremental Extracts of objects that are identified by the DQL statement for the job.).2005 . with the addition of a job name. This audit entry is used for modifying the DQL above. etc. These changes allow Buldoser to poll a location for generated or Extracted content. The Create Extract Job dialog will appear: © Copyright 2003 . Select Extract Job from the Schedule menu.. LLC 47 . Scheduling Overview for general information on Scheduler applications and capabilities. hours.Buldoser User Guide Modifying the DQL statement to only Extract objects that have changed since the last execution of the job. An example of a sub folder is. refer to the section. Make sure the location has enough space.” Copying a master mapping dependency file to the sub folder if it exists. Backup yyyy-mm-dd hh-mm-ss. Create a location on the Content Server’s file system or a file system that is accessible from the Content Server to contain the Extracted content and attributes. 2. To create a new Extract Job. Buldoser will modify the load by: Looking for any new batches that have been created in the job’s load location since the last time the job ran.g.descend) and r_modify_date>Date(’04/21/2005’). as well as to keep from duplicating loaded batches. An example of a modified DQL statement is. Scheduling an Extract Job This section describes creating a new Extract job. Batches are sub folders with the naming convention. Load Jobs When Load Jobs are scheduled. When Documentum runs a Load Job.Crown Partners. days. “Backup 2005-04-21 04:00:00. they are configured exactly the same as a normal Buldoser Docbase Load. and run mode (e. If this is the first time creating an Extract job. LLC 48 . For more information on how to configure a Docbase Extract. For Extract Directory through Extract Audit Trail.Crown Partners. Starting an Extract. configure the dialog in the same way as a normal Docbase Extract. 4. © Copyright 2003 . see the section.Buldoser User Guide 3. Enter a name for the job in the Job Name text box.2005 . refer to the section. The value should be an integer. If this is the first time creating a load job. Enter how often the job should run in the Run Frequency text box. Scheduling a Load Job This section describes creating a new load job. Backup yyyy-mm-dd hh-mm-ss. The location should contain a sub folder with a name that follows the convention. To create a new Load Job. follow these steps: 1. 6.Buldoser User Guide 5. Identify the location on the Content Server’s file system or a file system that is accessible from the Content Server that contains the generated or Extracted content and attributes. The Create Load Job dialog will appear: © Copyright 2003 . 7. Click the Cancel button to close the dialog. Click the Create Extract Job button to create the job in the Docbase. 2. The job will be grouped under the Buldoser category. Scheduling Overview for general information on Scheduler applications and capabilities.2005 . LLC 49 . Select the units for the run frequency in the Run Mode drop-down.Crown Partners. Select Load Job from the Schedule menu. 8. Enter a name for the job in the Job Name text box. see the section. © Copyright 2003 . 8. Enter how often the job should run in the Run Frequency text box. 4.2005 . For Load Directory through Auto Set Owner. Select the units for the run frequency in the Run Mode drop-down.Buldoser User Guide 3. The value should be an integer. The job will be grouped under the Buldoser category. LLC 50 .Crown Partners. 5. For more information on how to configure a Docbase Load. 6. Click the Create Load Job button to create the job in the Docbase. Click the Cancel button to close the dialog. configure the dialog in the same way as a normal Docbase Load. Starting a New Load. 7. follow these steps: 1. 2.2005 . To edit an existing job. follow these steps: 1.Crown Partners. Follow the same instructions as creating an Extract or Load Job within the sections Scheduling an Extract Job and Scheduling a Load Job. Using Documentum Administrator can cause unpredictable results. Select Manage Jobs from the Schedule menu. or by using the Buldoser client. The following dialog will appear. 2. LLC 51 . Select the job to be deleted from the list. Click the Edit button. Deleting an Extract or Load Job Jobs may be deleted through Documentum Administrator. Select the job to be edited from the list. respectively.Buldoser User Guide Editing an Existing Extract or Load Job Existing Extract and Load Jobs should be configured only with the Buldoser client. To delete an existing job. The following dialog will appear. 3. 4. © Copyright 2003 . Select Manage Jobs from the Schedule menu. © Copyright 2003 .Crown Partners.Buldoser User Guide 3. LLC 52 .2005 . Click the Delete button. After acquiring the appropriate driver. and content file locations for the objects to be loaded into a Documentum Docbase.Crown Partners. and Java provides a JDBC driver that bridges a connection to these ODBC drivers. JDBC uses drivers to connect to the above data sources. locate information on the fully qualified class name of the driver and the correct format for connection URLs and SQL queries. Oracle. a mapping must be created from the nonDocumentum data model to Documentum’s data model. This mapping tells Buldoser how to turn the tables and columns from the database into Documentum objects. columns. For ODBC connections. logical folder location. JDBC provides the capability to connect to virtually any RDBMS or ODBC-supported data source. © Copyright 2003 . For products like Sybase. and rows. Connecting to a Data Source Buldoser uses Java Database Connectivity (JDBC) to connect to a database to retrieve the metadata. 2. LLC 53 . and. ODBC is usually used to provide a connection. . and DB2. Before starting an ETL operation. Windows provides drivers out-of-the-box for most data source types. Buldoser approaches mapping in three phases: 1. For filebased data sources.txt). and security. Microsoft SQL Server. Oracle. including: Microsoft Excel spreadsheets. SQL Server. Map source data to Documentum attributes. Sybase. Identify source tables. See Windows reference documentation for how to create an ODBC data source. security. and DB2.Buldoser User Guide Database to Docbase Overview This section gives an overview of the features and high-level steps to perform a load from a Database or 3rd Party System to a Documentum Docbase using Buldoser. content.2005 . JDBC drivers are usually provided with the software. Mapping a Data Source to Documentum’s Data Model When importing from a data source. make sure to acquire the correct and most current driver and driver documentation for the data source. Text files (. folders.csv. the order is not relevant. Test the mapping to see if it’s correct. Versioning order is defined as the oldest version to latest version.2005 . LLC 54 . Oftentimes these tables contain all the renditions of the object. there will be no supporting views. © Copyright 2003 . be sure to use the format supported by the selected driver. These views usually related to the Object View in 1:M relationship.Buldoser User Guide 3. This allows any other tables that are registered with Buldoser to link to the Object View. the first step in creating a load is to identify the objects to be moved. The Object View After connecting to the data source. a view must be created within the database that joins the two tables together. a primary key is required in the Object View. These views must have a foreign key that establishes a relationship to the Object View. For non-versioned objects. The Object View should result in a list of objects – 1 row per object – and be in versioning order. repeating attribute values. Usually this is the creation order of the objects. Buldoser accomplished this via an SQL statement that queries the primary table(s) that contains the objects. When creating an SQL statement. If the data source only has a single table.Crown Partners. See the diagram below for an example of a conceptual data model. This query statement is known as the Object View. Buldoser requires the order to be correct to make sure version trees are correctly re-created during the load. If the foreign key exists within the Object View. or folder links. The following paragraphs describe the process of creating a mapping. Supporting Views Supporting Views are other tables or views within the data source that contain information that is necessary to build Documentum objects. If the data source contains multiple tables. Since configurations may be similar and may take some effort © Copyright 2003 .Buldoser User Guide In the above scenario. These mappings are created by object type in Object Configurations. Reference should be made to the design documentation or product literature to determine which tables to use.Crown Partners. Object Configurations Once the source data model is understood and registered with Buldoser. a view could also be created for the Object View that joins data from the Customer table since the relationship is 1:1. and content renditions. folders.2005 . Buldoser allows for more than one Object Configuration for a particular load. the tables and columns can be mapped to Documentum object attributes. LLC 55 . Usually understanding which table represents the Object View and which tables represent Supporting Views requires some knowledge of the tables and relationships in the data source. the configuration to apply will be selected on an object-by-object basis by evaluating its “Applies When” criteria. security. Inline Data Transformation In addition to loading data from a database into Documentum. Folder Configuration. suppose a column contained a status of a particular document in the legacy system. Each topic is described in more detail below. Object Configurations consist of Attribute Configurations. Buldoser also provides the ability to transform data during the load. the administrator can use the Department to drive the ACL to be used. Buldoser allows for the copying of a configuration to speed the mapping process and reduce errors. Security Configuration. This example is illustrated in the table below. and Pre. but the administrator wishes to determine the ACL for a particular object based on a column called Department. When that column is moved to an attribute. Folder Configuration. Content Configuration (for formats). This example is illustrated in the table below. Department Column (old value) ACL (new value) © Copyright 2003 . and Security Configuration. For instance.Crown Partners.Buldoser User Guide to create. Status Column (old value) Work in Process Staged Approved Archived Status Attribute (new value) WIP Staging Active Expired Buldoser calls this process Inline Data Transformation. the user wishes to change the value of the status attribute to a new value that reflects a difference in business rules. For instance.and Post-Processing Configuration. LLC 56 . It is offered in Attribute Configuration.2005 . By mapping the Department column to the ACL Name in Security Configuration. Content Configuration. Version Configuration. Inline Data Transformation is also useful for deriving other configurations than attribute data. suppose a data source doesn’t have the concept of an Access Control List (ACL). Inline Data Transformation can be applied to change the value from the database before assignment to the attribute. values from the source must be in mm/dd/yyyy hh:mm:ss AM format.2005 . There are several options depending upon whether the attribute to be assigned is single-valued or repeating. plus: Map Multiple Columns – multiple columns are mapped to the attribute. To add a content rendition. Static Value – a literal value will be assigned to all objects to which the current configuration is applied. This option is usually used for single-table data sources where the administrator has created multiple columns to contain repeating attribute values. Buldoser needs the full physical location of the file and the Documentum format. the same options are available as single-valued attributes. The delimiter is used to parse out multiple values that are stored in the column. The physical location can be broken into a base file path and a © Copyright 2003 . The first value from each column will be assigned to the attribute. Content Configuration Content Configuration tells Buldoser how add content renditions to an object. For Date type attributes. For single-valued attributes. the options are: No Configuration – no values will be assigned to the object. If the data type of the source column is Date. Map Column – a column is mapped to the attribute.Crown Partners.Buldoser User Guide HR Legal Research and Development Sales Attribute Configuration HR ACL Legal ACL R&D ACL Sales ACL Attribute Configuration tells Buldoser how to assign values to the attributes of an Object Type for a specific Object Configuration. For repeating-valued attributes. This option is usually used for single-table data sources where the administrator has created a single column to contain repeating attribute values and has separated multiple values with a delimiter. LLC 57 . then the date will be formatted automatically. Map Column with Delimiter – a single column is mapped to the attribute with the addition of a delimiter. a column from the data source either contains an ACL or indicates an ACL. Security Configuration Security Configuration tells Buldoser which ACL will be applied to an object. If the folder doesn’t exist. Folder Configuration Folder Configuration tells Buldoser which folders will contain an object. For formats with the same file extension.2005 .Crown Partners. If a specific file extension is desired. A folder may be selected or typed in. If folders are not configured. Buldoser provides two options for configuring folders: Select a fixed folder for all objects – The simple option is to put all objects in the same folder location. all objects will be located in the personal cabinet of the currently logged-in user. Buldoser provides Inline Data Transformation to map column values to a particular Documentum folder path if there isn’t a direct mapping. Buldoser allows the administrator to configure which format to use. LLC 58 . Buldoser provides Inline Data Transformation to map formats from a column to Documentum formats. Buldoser will pull the file extension from the file and look up the Documentum format. Buldoser provides the option to create it on-the-fly.Buldoser User Guide relative file path. a column from the data source either contains a folder path or indicates a folder path. © Copyright 2003 . Buldoser provides Inline Data Transformation to map column values to a particular Documentum ACL if there isn’t a direct mapping. Identify a column that indicates the ACL – In this case. Identify a column that indicates folder location – In this case. Identify a column for location and a column for format and map formats This option is usually used for multi-table data sources where a separate view contains the physical location and format for the rendition. since most Content Management Systems – whether homegrown or purchased – store content relative from a base location. Buldoser provides two options for configuring physical location and format: Identify one-to-many columns that contain file locations and automatically determine format – This option is usually used for single-table data sources where the administrator has created multiple columns to contain file locations. Buldoser will use the last file extension. Buldoser provides two options for configuring security: Select a fixed ACL for all objects – The simple option is to assign the same ACL to all objects. LLC 59 . any time the Previous Version column’s value equals a literal string entered by the administrator. “IBuldoserTransform. Three options are available: o Previous version column = Primary Key – With this option. There are three items to configure for versioning: Previous version column – The column in the Object View that contains the value of the Primary key for the previous version must be identified. Buldoser recognizes the base of a version tree. These methods are executed from a provided Java Interface named. Buldoser recognizes the base of a version tree.2005 . and a handle to the IDfSysObject interface after the object is loaded. When Buldoser executes the method. Buldoser recognizes the base of a version tree. Version Label column – A column that contains version labels may be optionally identified. Full access is given the object in memory before the load. Configuring this item allows Buldoser to implement multi-threading. o Previous version column = Literal Value – With this option. any time the Previous Version column’s value equals the Primary Key. it will fail the object and write the message to the log file.and Post-Processing For those scenarios that require special processing or validation. o Previous version column = Null – With this option. © Copyright 2003 .html.” A set of JavaDocs is provided for use when implementing the interface. If one is found. Versioning Configuration Versioning configuration is a required step for data sources that implement versioning. it will check for a returned value. The custom class file must be identified within the class path so that Buldoser can use it at run-time. ACLs will be applied with the default configuration of the Content Server.Crown Partners. See the Documentum Content Server Administrator’s Manual for more information on Content Server configuration. Base of the version tree – A method must be selected that identifies for Buldoser how to identify the base of a version tree. Buldoser provides the capability to execute external Java processing methods before and after each object is loaded. otherwise it is optional. Pre.Buldoser User Guide If Security is not configured. and can be found at <Buldoser Install Location>\docs\apidocs\index. any time the Previous Version column’s value is Null. The dealer iterates through the Object View.Buldoser User Guide Multi-threaded Loading Algorithm Buldoser incorporates a multi-threaded load algorithm that is modeled after a card dealer dealing cards to players.2005 .Crown Partners. When all the queues are full. although this rarely happens. Each player monitors its own queue of objects to load. © Copyright 2003 . gathering all the data required to load a particular object and pushes it onto the queue of the player with the least number of objects. the dealer will wait until there is availability. Worker threads (players) are launched which make connections to the target Docbase. the players will wait on the dealer. A controlling (dealer) thread first makes the one and only connection to the source database. LLC 60 . When all the queues are empty. Select New Load from the Database Load menu. To complete a stopped load. 6. see the section. 4. 5. To load content into a target Docbase.Buldoser User Guide Loading Content from a Database This section provides step-by-step instructions for loading content from a database into a target Docbase using Buldoser. For more information on this step. © Copyright 2003 .and Post-Processing. Validate that the class path contains both the location of the processing class and the database driver. see the section. 2. Start Buldoser. See the section. Database to Docbase Overview for an important description of how Buldoser moves content objects.2005 . see the section Getting Started. Creating a New Configuration or Configuring an Existing Configuration This section describes configuring a new or existing load. Create a location on the file system to contain the configuration and log files. Loads may be stopped and completed at a later time from the stopping point. Download and install the driver that will be used to connect to the data source. Buldoser also provides the capability to load content from a Buldoser Extract into Buldoser.Crown Partners. Docbase to Docbase Overview for more information on the feature. Step 1 of the Database Load Wizard will appear. 3. follow these steps: 1. If this is the first time moving content using Buldoser. Finishing a Stopped Load. LLC 61 . Implement the IBuldoserTransform class for Pre. Click Next to continue. © Copyright 2003 . Click Cancel to close the Wizard and stop configuration without saving. Buldoser will update the Wizard with the existing settings.Buldoser User Guide 7. If a configuration already exists at this location.Crown Partners. Step 2 of the Wizard will appear. 8. Enter the log path location into the Log Path text box. 9. or browse for the location by clicking the […] button.2005 . LLC 62 . the Next button will be enabled.Crown Partners. Click the Test button to test the connection information. 11. If Buldoser is successful connecting. the value is formatted as jdbc:odbc:<name of the ODBC connection>. 14. LLC 63 . If not. For ODBC connections.2005 . Enter the connection URL for the data source in the Data Source text box. Buldoser will © Copyright 2003 . Enter a user name for the connection in the User Name text box. Enter a password for the connection in the Password text box. if applicable. 13. Enter or select the class name of the driver in the Driver drop-down. if applicable. Buldoser will not store the password in the configuration file so it must be entered every time. The value for the ODBC driver and the Oracle driver are provided. 12.Buldoser User Guide 10. 2005 . 19. 20. Enter the SQL statement that identifies the objects to be moved into the SQL text box. 17. This value is user-defined and can be anything that represents the data set. If Buldoser is successful executing the SQL. Click Previous to go back to Step 1. The SQL must be formatted correctly for the driver entered in Step 2.Buldoser User Guide return an error. Continue modifying the connection information until the test is successful. 18. Click Next to proceed to Step 3. Enter a name for the Object View in the Object View Name text box. LLC 64 . 15. Click the Test SQL button to validate the SQL statement. Click Cancel to stop configuring and close the Wizard without saving.Crown Partners. the Next button and Primary Key drop-down will be © Copyright 2003 . 16. click Next to proceed to Step 5. Click Cancel to stop configuring and close the Wizard without saving. 23.Buldoser User Guide enabled. Click Next to proceed to Step 4. © Copyright 2003 . LLC 65 . For single-table data sources such as Excel spreadsheets.Crown Partners. Step 4 only applies to multi-table data sources. Continue modifying the SQL statement until the test is successful. 25. 24. Click Previous to go back to Step 2. Buldoser will return an error. 22. If not.2005 . 21. Select the Primary Key column for the Object View in the Primary Key dropdown. Click Copy to copy a selected Object Configuration. 32. Click Edit to edit a selected Object Configuration.Buldoser User Guide For each Supporting View. 29. LLC 66 . Click Next to proceed to Step 5. Click Add to create a new Object Configuration. 33. 26. 30. then click Add. To remove a Supporting View that has been added. select the rows to remove and click Remove. Click Previous to go back to Step 3. Click Cancel to stop configuring and close the Wizard without saving. © Copyright 2003 . 27.Crown Partners. 28. select a View from the View Name drop-down and the column that links the view to the Object View from the Linking Column dropdown. 31.2005 . b. and enter a value for the Source Column in the Value text box. Click Add to create a new row. select an Object View column from the Source Column drop-down. a. select a comparison operator from the Is drop-down. Click Remove to remove a selected row. 35. Click Remove to remove a selected Object Configuration.Crown Partners.\ © Copyright 2003 . c. Create filters in the Configuration Applies When table to make the configuration apply to only certain rows in the Object View. 36. For each row. If Add or Edit was clicked the Object Configuration will appear.Buldoser User Guide 34.2005 . LLC 67 . If the Object Type for the configuration is changed after attributes have been configured. © Copyright 2003 . Click Configure Attributes. 39. select an attribute. 38. Select an Object Type from the Object Type drop-down. To map a single column to an attribute. 40.Buldoser User Guide 37.2005 . the attribute configuration will be lost. Select the attribute to be configured. The Attribute Configuration dialog will appear. and then select a Configuration Type from the Configuration Type drop-down. LLC 68 .Crown Partners. then “Map Column” from the Configuration Type drop-down. click Map Values. LLC 69 . To map values from the source column to attribute values. Select a view and column from the View and Column drop-downs.Buldoser User Guide 41. respectively. © Copyright 2003 . The Attribute Value Mapping dialog will appear.2005 . 42.Crown Partners. 44. the values will appear in a drop-down in the Maps To column. Click Save to save the mappings. If the attribute has value assistance. Click OK to save the mappings or Cancel to close the dialog without saving. To enter a static value for a single-valued attribute. 46. LLC 70 . © Copyright 2003 . select a single-valued attribute. Enter or select a value in the Maps To column for each Column Value from the data source. which will cause unique entries across case.Buldoser User Guide 43. If another attribute is selected before clicking Save.2005 .Crown Partners. the configuration will be lost. 45. The Attribute Configuration dialog will reappear. then “Enter Static Value” from the Configuration Type drop-down. Note: SQL Server 2000 has a case insensitive distinct query. To enter multiple static values for a repeating-valued attribute. © Copyright 2003 . Enter a value in the Value text box. Click Save to save the configuration. then “Enter Static Values” from the Configuration Type drop-down.Crown Partners.2005 . 48.Buldoser User Guide 47. LLC 71 . select a repeating-valued attribute. Click Remove to remove a value from the list. select a repeatingvalued attribute. then “Map Multiple Columns” from the Configuration Type dropdown. Enter a value in the Value text box.2005 . 50. LLC 72 .Crown Partners. © Copyright 2003 . To map multiple columns to a repeating-valued attribute. Click Save to save the configuration. and then click Add to add it to the list.Buldoser User Guide 49. Buldoser User Guide 51. Select a view and column from the View and Column drop-downs. then “Map Column with Delimiter” from the Configuration Type drop-down. Click Remove to remove an entry from the list.Crown Partners. 52. LLC 73 . select a repeating-valued attribute. To map a column with a delimiter to a repeating-valued attribute. and then click Add to add it to the list.2005 . © Copyright 2003 . Click Save to save the configuration. LLC 74 . © Copyright 2003 . Click Cancel to cancel all changes since the dialog was opened. Click Save to save the configuration.Crown Partners. 54. Once all attributes are configured. Select a view and column from the View and Column drop-downs and a delimiter in the Delimiter text box.2005 . click OK to save the configuration and return to the Object Configurator.Buldoser User Guide 53. The Security Configuration dialog will appear.Buldoser User Guide 55. © Copyright 2003 . Click Configure Security.2005 . LLC 75 .Crown Partners. click the Map ACL Values button.2005 . select an ACL and ACL Domain from the drop-down. LLC 76 . select the Use an ACL from a Column radio button.ACL Name. To map values from the selected columns to ACLs in the current Docbase. The ACL Mapping dialog will appear.Buldoser User Guide 56. © Copyright 2003 . ACL column. Next. To use a fixed ACL for all objects. select the Use a Fixed ACL and ACL Domain radio button. and ACL Domain column from the drop-downs.” To use a column from the data source to drive the ACL that is used. Select a view. 57. Entries are formatted as “ACL Domain.Crown Partners. ACL Name.” 59.2005 . Click Cancel to close without saving. The Security configuration dialog will reappear. The Object Configurator will reappear. For each row. ACLs are formatted as “ACL Domain. Click OK to save the configuration and close the dialog. © Copyright 2003 . Click OK to save the mappings and close the dialog.Buldoser User Guide 58. Click Cancel to close without saving.Crown Partners. 60. select the ACL in the Maps To drop-down that should be selected based on the value from the source column. LLC 77 . Crown Partners. LLC 78 . © Copyright 2003 . The Content Configuration dialog will appear. Click Configure Content.2005 .Buldoser User Guide 61. Buldoser User Guide 62. The Format Mapping dialog will appear. 65. click Map Duplicate Formats. Click Remove to remove a view and column. © Copyright 2003 . Select the radio button for the Configuration Type to use. To identify which format will be used in the case where multiple formats exist in the target Docbase for the same file extension. or click […] to browse for the location.2005 . LLC 79 . 63.Crown Partners. For content in column or columns. select each view and column and click Add. Enter the base path for all files in the Base Content Path text box. 64. 2005 . © Copyright 2003 . The Content Configuration dialog will reappear. To close without saving. LLC 80 . select the format to be used from the Maps To drop-down on the right. click Cancel.Buldoser User Guide 66. Click OK to close the dialog and save the mappings.Crown Partners. 67. For each file extension on the left. © Copyright 2003 . and format columns.2005 . For content in a separate view. select the view. check the Documentum Ticket checkbox to have Buldoser calculate the location.Buldoser User Guide 68. click the Map Formats button. 69.Crown Partners. If the formats identified in the Format column are not Documentum formats. If this is a Documentum Docbase and the data_ticket attribute is used for physical location. LLC 81 .. The Format Mapping dialog will appear. physical location. Buldoser User Guide 70. For each source format on the left, select a Documentum format to use instead in the Maps To drop-down. 71. Click OK to save the mappings and close the dialog. Click Cancel to close without saving. The Content Configuration dialog will reappear. 72. Click OK to save the configuration and close the dialog. Click Cancel to close without saving. The Object Configurator will reappear. © Copyright 2003 - 2005 - Crown Partners, LLC 82 Buldoser User Guide 73. Click the Configure Folders button. The Folder Configuration dialog will appear. © Copyright 2003 - 2005 - Crown Partners, LLC 83 Buldoser User Guide 74. To use a fixed folder path for all objects, select the Use a Fixed Folder Path radio button. Next, enter a folder path in the drop-down. To list folders in the target Docbase in the drop-down, click the List Folders button. 75. To use a column from the data source to drive the folder that is used, select the Use Folder Path from a Column radio button. Select a view and folder column from the drop-downs. Optionally enter a folder path prefix and suffix. To map values from the selected column to folders in the current Docbase, click the Map Folder Paths button. The Path Mapping dialog will appear. © Copyright 2003 - 2005 - Crown Partners, LLC 84 select the Folder in the Maps To drop-down that should be selected based on the value from the source column. The Folder configuration dialog will reappear. The Object Configurator will reappear. For each row. 77. © Copyright 2003 .Crown Partners.Buldoser User Guide 76. 78. LLC 85 .2005 . Click OK to save the mappings and close the dialog. Click OK to save the configuration and close the dialog. Click Cancel to close without saving. Click Cancel to close without saving. Click the Configure Versioning button.Buldoser User Guide 79.Crown Partners.2005 . © Copyright 2003 . The Version Configuration dialog will appear. LLC 86 . respectively.Buldoser User Guide 80. Select the view and column for the version labels from the Version Label View and Version Label Column drop-downs. © Copyright 2003 . 83. 82. LLC 87 .Crown Partners. Select the column that contains the primary key value of the previous version in the Previous Version Column drop-down. This must be configured correctly for multi-threading to function properly. 81.2005 . The Object Configurator will reappear. Click Cancel to close without saving. Click OK to save the configuration and close the dialog. Select the method for determining the base of a version tree from the three radio buttons. Click the Configure Pre. © Copyright 2003 .and Post-Processing button.2005 . The Processing Configuration dialog will appear.Buldoser User Guide 84. LLC 88 .Crown Partners. Crown Partners. After all configuration is complete. Enter the name of the class that implements IBuldoserTransform into the Processing Class textbox. Click Cancel to close without saving. Click Cancel to close without saving. Click OK to save the configuration and close the dialog. Click OK to save the Object Configuration and close the dialog. 86. The Object Configurator will reappear. 88.2005 . © Copyright 2003 . LLC 89 .Buldoser User Guide 85. 87. Leave the box blank for no processing. The class must exist within the classpath or Buldoser will return an error. Step 5 will reappear. © Copyright 2003 . Click Cancel to stop configuring and close the Wizard without saving. Click Next to proceed to Step 6. Click Previous to go back to Step 4. 90.Buldoser User Guide 89. LLC 90 .2005 .Crown Partners. 91. Crown Partners.2005 . Click Next to proceed to Step 7. When the end of the data set is reached. folders. Each object will display each configuration in sections. 93. Click Next Object to advance through the data set. Click Previous to go back to Step 5 and correct any errors in configuration. showing values for attribute. Step 6 provides the ability to preview objects as they will be built using the configurations created in Step 5. 94. and processing class. versioning.Buldoser User Guide 92. content. © Copyright 2003 . LLC 91 . Buldoser will start over from the beginning. security. This option may be used for diagnostic purposes. A file is created for each thread and is named “chart<thread number>. and processor resources.2005 . memory. Check the Trace box to have Buldoser write a DMCL-level trace for every 1000th object that is loaded.Buldoser User Guide 95. Selecting multiple threads helps the content to load faster. It is best to start with one or two threads for initial loads. only errors will be written to the log file. 98. Check the Verbose box to create a very detailed log file to be created from the load. LLC 92 . If this option is not selected.txt. Check the Chart Performance box to create a tab-delimited data file containing relevant performance information on the load in milliseconds. but it is dependent on the hardware that is being used.” By opening a chart © Copyright 2003 . Select the number of threads to use for the load from the Threads drop-down. 97. then increase the number of threads after monitoring network. 96.Crown Partners. This option can negatively impact performance for very large loads. LLC 93 . 105. file using Microsoft Excel. It is highly recommended to move folders with a Documentum-provided tool or script outside of Buldoser before performing ETL operations. This option indicates whether a bulk of the database operations will occur on the Controlling thread or on each of the worker threads. © Copyright 2003 .Crown Partners. Buldoser will create the entire folder path with the correct name only – an administrator must fill in the remaining attributes once the load is complete. Check the Auto Create Folders box to automatically create folders if they don’t exist in the destination Docbase. Buldoser will create a System ACL with the correct name only – an administrator must fill in the correct Users. Check the Auto Set Owner to DBO box to automatically set the owner_name attribute of each object to the Docbase owner of the target Docbase. 102. Check the Dealer-Side Database Load box to have the heavy Docbase operations executed on the Dealer side instead of at the thread level.Buldoser User Guide 99. This option is provided as a fallback mechanism only. 103. Check the Auto Create Formats box to automatically create formats if they don’t exist in the destination Docbase. This option is typically used during a small trial load for diagnostic purposes. If the loads are without content then it is best to leave this option unchecked. Groups. Click Next to proceed to Step 8.2005 . 100. 101. a line graph may be created to display performance trends over the life of the load. It is best to have this option checked when doing loads with content. and permission levels once the load is complete. Check the Auto Create ACLs box to automatically create ACLs if they don’t exist in the destination Docbase. It is highly recommended to move ACLs with a Documentum-provided tool or script outside of Buldoser before performing ETL operations. Buldoser will create a format with the correct name only – an administrator must fill in the remaining attributes once the load is complete. 104. Having the Docbase owner own content is a standard convention. This option is provided as a fallback mechanism only. For large loads this option may degrade performance. Click Previous to go back to Step 6. This option is provided as a fallback mechanism only. It is highly recommended to move formats with a Documentumprovided tool or script outside of Buldoser before performing ETL operations. 2005 . LLC 94 . Configuration is now complete and Buldoser is ready to load. 107. 108. Click Cancel to close the Wizard without saving. © Copyright 2003 .Buldoser User Guide 106. 109. Click Previous to return to Step 7. Click Save and Close to save the configuration and close without initiating the load. The Dealer Heads-Up Display (HUD) will appear.Crown Partners. Click Load Now to start the load. Indicates how many objects have been dealt by the Dealer thread. Max Objects/Thread: Dealing Progress: © Copyright 2003 . The number may be increased or decreased during the load by clicking the + and – buttons. Indicates the number of objects that each worker thread will cache. This number can be increased or decreased during the load by clicking the + and – buttons. Indicates the total number of objects for the batch.Buldoser User Guide The dialog is explained below: Item Location: Total Objects: Total Threads: Definition Indicates the name Log Path for the batch.2005 . Indicates the number of threads that was selected. LLC 95 .Crown Partners. Identify the location on the file system that contains the database configuration. follow these steps: 1. Database loads may be stopped and completed at a later time from the stopping point. Opens the load log for the selected thread. Note that each worker thread will finish the objects that are currently in its waiting queue. Indicates the average speed for dealing an object. Finishing a Stopped Database Load This section describes finishing a stopped database load. The thread number is indicated. Indicates the number of objects that have been processed by the selected thread. © Copyright 2003 . Indicates the number of objects that have failed for the selected thread. Once the load has been stopped or has completed. Allows the dealing to be stopped. Indicates the average load speed for the selected thread. the Close button allows the dialog to be closed. Use the < and > buttons to cycle through the threads to view each thread’s statistics. The Finish Load from Database dialog will appear. The load may be restarted from the stopping point by selecting Finish Load from the Database Load menu. Indicates how fast on average objects are being loaded across all threads.Crown Partners. Indicates how many objects are in the selected threads queue. LLC 96 . Updates the per thread statistics for the currently selected thread. To finish loading from a database into a Docbase. 2. Select Finish Load from the Database Load menu.2005 .Buldoser User Guide Messages: Dealing Speed: Total Throughput: View Stats: Number Waiting: Number Processed: Number Failed: Average Load Time: View Log: Stop: Close: Update Stats: Provides messages that indicate the current operation of the load. Indicates for which thread statistics are being displayed. © Copyright 2003 .Crown Partners. Enter the password to connect to the database in the Password text box. Select Undo Load from the Database Load menu. follow these steps: 1. The Undo dialog will appear. Identify the location on the file system that contained the database configuration. To close the dialog. click Cancel.Buldoser User Guide 3. 7. or Formats.2005 . To resume the load. Undoing a Database Load Undo will completely eradicate the previous objects and the audit records that track the loading process. Buldoser uses this location in its audit trail to identify objects loaded from the batch. To close the dialog and save the entries. To undo a database load. Enter the location of the database configuration into the Load Directory text box. LLC 97 . ACLs. Undo will not remove any automatically created Folders. 5. click Finish Load. 6. click Save Settings. 2. The location may be browsed by clicking the […] button 4. click Save Settings. 6.). click Undo. Enter the location of the load into the Load Directory text box. To undo the load. An instance of the following status dialog will appear. © Copyright 2003 . To close the dialog and save the entries. The dialog is explained below: Item Description Title Bar Operation Type Load Location Indicates the percent completion and thread number (which is always zero for Undo.Buldoser User Guide 3. click Cancel.2005 . Indicates that this is a BuldoserDbUndo. 5. To close the dialog. The location may be browsed by clicking the […] button 4.Crown Partners. Indicates the Batch location where this operation is being performed. Undo operations run single-threaded only. LLC 98 . Crown Partners. Only available after the undo is complete or has been stopped. © Copyright 2003 . LLC 99 . Indicates the number completed.Buldoser User Guide Thread Number Progress Messages Stop Close Indicates the thread number (always zero for Undo). Stops the undo. Describes the current operation.2005 . Buldoser User Guide Appendix – EDMS98 Operations Buldoser currently supports EDMS 98 Operations through the Database to Docbase functionality. Content View 1.r_object_id_i = b. For subtypes simply swap out dm_document for the type name. © Copyright 2003 .data_ticket. parent_id_i from dmr_content_s a.2005 . full_format. dmr_content_r b where a. A network drive will need to be mapped to the filestore directory on the source Docbase. LLC 100 .Crown Partners. In order for this to occur a JDBC driver to the underlying database on which the Docbase runs will need to be installed.r_object_id_i 2. A view in the database that runs the Docbase the following query: create view content_view as select c. In Windows this directory is typically c:\Documentum\Data\<Docbase> Defining Object View The following query can be used to Extract dm_document objects from the Docbase. LLC 101 .Buldoser User Guide Next.Crown Partners. link this query (in Step 3 of 8) with the Supporting View defined as “content_view” © Copyright 2003 .2005 . Buldoser User Guide © Copyright 2003 .2005 . LLC 102 .Crown Partners. 2005 .Crown Partners.Buldoser User Guide © Copyright 2003 . LLC 103 . LLC 104 .Crown Partners. *Note that the <Mapped Filestore Path> (within the “Base Content Path:” field) should actually be the Drive and path to where the filestore is mapped on the machine running Buldoser. © Copyright 2003 .2005 .Buldoser User Guide The Content and Versioning buttons are particularly important for this operation. Set them according to the below screenshots. Crown Partners. LLC 105 .Buldoser User Guide © Copyright 2003 .2005 .