ODI 12c - Repositories_getting_started1.pdf

ODI 12c - RepositoriesBefore You Begin. Purpose This tutorial walks you through the steps that are needed to create and connect to the Oracle Data Integrator (ODI) Master Repository and the ODI Work Repository using Repository Creation Utility (RCU) and ODI Studio. Time to Complete Approximately 1 hour. Introduction Repositories are schemas and tables in a database that hold information about ODI Designs, Topologies, and Security. There is a one-to-many relationship between Master and Work repositories. An example of why you might want to have multiple work repositories is for separating development and production designs. The repository schemas and tables can be created either manually using ODI Studio or automatically using Repository Creation Utility (RCU). RCU is the preferred method of maintaining the repositories. The database storing the repository can be Oracle Database 12c or several other supported databases. This is the first in a series of four OBEs in the Oracle Data Integrator 12c: Getting Started (https://apex.oracle.com/pls/apex/f? p=44785:24:15503233161396::::P24_CONTENT_ID,P24_PREV_PAGE:7952,24) series. Scenario Linda works as a database administrator for Example Enterprise Corp (http://www.example.com). In Example Enterprise, Linda is responsible for performing database management and integration tasks on the various resources within the organization. In particular, Linda is responsible for data loading, transformation, and validation. To begin working on her projects (such as exporting a flat file to a relational table), she needs to create the new Master repository and Work repository. This is her first task. Following this, she will make a flat file to relational table project. Following that, she will make an agent. These other tasks are covered in later OBEs. Hardware and Software Requirements The following is a list of software requirements: A supported operating system (the OS shown here is 64-bit Oracle Enterprise Linux release 6.7 (Santiago), other versions such as Windows are supported as well) Oracle Database (the version shown here is Enterprise Edition 12.1.0.2.0, other versions are supported as well) Oracle Data Integrator 12c (the version shown here is 12.2.1) The following is a list of OPTIONAL software: Oracle WebLogic Server (WLS) 12c (other versions are supported as well) Oracle SQL Developer 12c (included with Database 12c install) If WLS is present, it must be in the same Middleware HOME directories as ODI. Prerequisites Before starting this tutorial, you should have: Started Oracle Database services and components such as the Listener. A Database user with DBA role privileges such as the SYS or SYSTEM account. Installed the HR schema included in the Oracle Database. The Sample Schemas Installation Guide is part of the Oracle Database documentation set, and is also available online at: http://otn.oracle.com (http://otn.oracle.com). Already installed, but not configured, ODI. Mapped a plan for passwords. Best practices are MixedCase, at least eight characters in length, and contain a number. Examples: MyPasswd99 , Welcome1 . 1. Creating Repositories with RCU Throughout the screen captures, passwords you type will display as dots, for example . If you type Welcome1 , it will display as eight dots, but if you come back to view it later, it may display as a different number of dots (to hide the true password length.) For purposes of training, you may make all the passwords the same; but in a production environment, they might likely be different. Also in the screen captures, if you see items in red (red boxes or red arrows), they are not part of the product, but were added as part of the course to draw attention to things you need to change (enter or select or deselect). Also, the cursor is usually pointing to the last thing you need to do, for example, click OK. In the task instructions, field prompts will be bold, such as Hostname. Values you type in the fields or on copmmand lines will be bold blue Courier font, such as localhost . To do create the Master and Work repositories with Repository Creation Utility (RCU), perform the following steps: 1.1 Running RCU RCU can be used to create or to drop repositories. In this first step, you will create a repository. Installing ODI adds the RCU bits to the Middleware HOME. Navigate to the proper directory and launch RCU. OS Prompt [myuser@myhost ~]$  cd $FMW_HOME/oracle_common/bin  [myuser@myhost bin]$  pwd  /u01/app/oracle/Middleware/Oracle_Home/oracle_common/bin  [myuser@myhost bin]$  ./rcu                                                                                   You may find copies of RCU shell scripts elsewhere. This is the one you want. The Welcome page is displayed. There is nothing to select. Click Next to continue. On the Create Repository page, select Create Repository and System Load and Product Load (which is the default). This will require DBA privileges such as the user SYS or SYSTEM would have. Click Next to continue. On the Database Connection Details page, enter a Host Name such as localhost or an IP address, Database Listener Port such as 1521 , Database Service Name such as orcl.example.com (note this is not the instance name), Database Username such as sys , and the corresponding Password which will not display. The Role will change automatically as you type a Username. You may see the following warning. click Ignore to continue. If you are using Latin alphabets for languages such as English. . A progress bar displays. depending on your database configuration.Click Next to continue. . click OK to continue. Selecting that one line item will automatically select several other components as indicated by the black checks. Notice the DEV prefix on some of the schema names.When the progress bar reaches 100% and all the lines have green checks. You can change the default prefix. as will be needed if you ever add additional repositories. A progress bar displays. select Oracle Data Integrator. On the Select Components page. Click Next to continue. it is acceptable to use the same password for all schemas. On the Schema Passwords page. enter the same password twice. . but in a production environment. you would likely use different passwords. click OK to continue. In a training environment.When the progress bar reaches 100% and all the lines have green checks. Click Next to continue. enter a Work Repository Type of Name of D . The asterisks are not part of . and the Repository password is for the database user. Note that the Supervisor password is for ODI Studio. These eventually will be stored in Oracle Wallet. the defaults are fine. enter the same Password in four places. and a Work Repository workrep . DEV throughout. Click Next to continue. Note the prefix of the tablespace names. On the Map Tablespaces page.On the Custom Variables page. there is nothing to do. A Confirmation dialog box will pop up. A progress bar displays.Click Next Click OK to continue. . to continue. When the progress bar reaches 100% and all the lines have green checks. A progress bar displays. . click On the Summary page. just review. there is nothing to do. OK to continue. Click Create to continue. When the progress bar reaches 100% and all the lines have green checks. you have the option to view the various log files. Note that this phase on this machine took about 4 minutes to complete on a typical PC. . On the Completion Summary page. Click Close to continue. it will automatically go to the Completion Summary page. Perhaps you just want to start from a clean slate. you will need them later. Remember the passwords.2 Deleting Repositories with RCU (OPTIONAL) Suppose you have a repository that you need to delete. ./rcu                                                                                   You may find it convenient to define optional environment variables such as $FMW_HOME and $ODI_HOME to speed up this directory navigation. only this time you will drop repositories. Start RCU just the same way you did to create repositories. OS Prompt [myuser@myhost ~]$  cd /u01/app/oracle/Middleware/Oracle_Home/oracle_common/bin  [myuser@myhost bin]$  .In summary. 1. you have used RCU to create various schemas on an Oracle database to support ODI. Those would complement the required environment variables such as The Welcome page is displayed. Perhaps it was created by mistake. Before deleting any repositories. $ORACLE_HOME and $JAVA_HOME . make sure that all applications are disconnected from using those schemas and tables. There is nothing to select. The number of steps will change as well.) . (The page name on the top banner and left navigation will change from "Create" to "Drop" when you select Drop below. On the Create Repository page. select Drop Repository.Click Next to continue. Service orcl. enter a Host Name such as Name such as localhost or an IP address. On the Database Connection Details page. and the corresponding Password which will not display.com (note this is not the instance name). The Role will change automatically as you type a Username. .Click Next to continue. Port such as 1521 . Username such as sys .example. Note the prefixes of the components in the background reflect your choice.Click Next to continue. The example shows selecting JUNK. When the progress bar reaches 100% and all the lines have green checks. A progress bar displays. On the Select Components page. . click OK to continue. use the with prefix pulldown to select the schemas to drop. there is nothing to do. A progress bar displays. When the progress bar reaches 100% and all the lines have green checks. . just review.Click Next to continue. click On the Summary page. OK to continue. . A progress bar displays.Click Drop to continue. When the progress bar reaches 100% and all the lines have green checks. On the Completion Summary page. it will automatically go to the Completion Summary page. you have the option to view the various log files. do not modify anything in here.3 Verifying Schemas with SQL Developer (OPTIONAL) This is just to show you where some of the tables are stored. Just look. This example uses SQL Developer. 1. or from ODI Studio. or any similar tool. In summary. You can use TOAD. It is recommended to backup any repository data just in case.Click Close to continue. SQL*Plus. you used RCU to remove unwanted schemas from the database based on prefixes. a GUI which is included with Oracle Database 12c. . Generally speaking. You can do this either from the database using utilities such as RMAN. Start your favorite SQL editor. this is an unrecoverable action. There are multiple ways to create a connection. the Port such as 1521 and the SID such as orcl (note this is instance. . a DBA-authorized Username such as sys and the localhost .) Verify the appropriate Role. Right-click on Connections. any one of them is valid. not the service name. On the Database Connection page. Create a New Connection. Enter the database Hostname such as mydba . Click Test to continue. then click the + green plus.How you start SQL Developer is installation dependent. You may have a desktop icon to start it. sys requires SYSDBA. for example. enter a Connection Name such as corresponding Password. it will reply. Status: Success in the lower left corner. Click Connect to continue. Enter SELECT                                            * FROM schema_version_registry; in the Query Builder. .If the test is successful (that is. if a connection can be established and the credentials are correct). Query the registry table. You can use this connection for the rest of the tutorial. Query the count of tables in one of the objects. or you can do everything in one work repository. just look. In summary. These were created by RCU. Click the green arrow in the top menu bar to display the table count. Nothing to do here. and topologies. Connecting to Repositories with ODI Studio Oracle Data Integrator 12c Studio provides a graphical tool for manipulating the repository's designs. You can have several work repositories. over two hundred tables just for ODI. Enter SELECT count(*)                                            FROM all_tables WHERE                                           owner='DEV_ODI_REPO'; in the Query Builder. 2. you have used SQL to verify that RCU built the repositories correctly. . Nothing to do here. Wow. the DEV_ODI_REPO component. operators.Click the green arrow in the top menu bar to display the table. These were inserted by RCU. just look. such as DEV (development) and PROD (production). that is /u01/app/oracle/Middleware/Oracle_Home/odi/studio . . perform the following steps: 2./odi.1 Using Oracle Wallet to Manage User IDs and Passwords Navigate to $ODI_HOME/studio . Midway through the progress bar. Start ODI Studio by running script odi. In this example. If there is no previous installation. there is nothing to select.sh   Oracle Fusion Data Integrator Studio 12c  Copyright (c) 1997.                                                                                  A progress bar displays. OS Prompt [myuser@myhost ~]$  cd $ODI_HOME/studio  [myuser@myhost studio]$  pwd  /u01/app/oracle/Middleware/Oracle_Home/odi/studio  [myuser@myhost studio]$  . All rights reserved. and only the very first time. 2013.sh .To connect to a particular set of master and work repositories. Confirm Import Preferences dialog box will pop up and ask if you want to import preferences from a previous installation. Oracle and/or its affiliates. the yellow pencil (edit) and the red X (delete) should be greyed out since there is nothing to edit or delete yet. Strictly speaking.Click No to continue. to add a new login. click Connect To Repository. In the left panel. There are other places on the menu bar to do the same thing... . On the Login panel. The progress bar resumes. click the + green plus. This must match what you created using RCU and is case-sensitive.Fill in all of the Connection information. then edit Click on the magnifying glass <placeholders> ) to display a list of valid work repositories. Field Prompt: Value: Login Name:  DEV_ODI_REPO  ODI User:  SUPERVISOR  Password:  (not displayed)  Master User:  DEV_ODI_REPO  Master Password:  (not displayed)  Driver List: Driver Name: Url: Oracle JDBC Driver (pick from pull-down list)  oracle. .jdbc.OracleDriver  jdbc:oracle:thin:@ localhost:1521:orcl (pick template from list. OK . Select workrep and click Click Test to make sure that everything is correct. This populates the Work Repository field. .This was created as part of RCU. . If you ever deinstall ODI. When using a wallet to store the ODI credentials. Click OK to continue. This stores the wallet information (and other preferences) in the hidden directory in your home directory: ~/." then click OK . New Wallet Password asks you to define a password and an expiration time. Click OK to continue. the ODI Login page will be prepopulated with this information. the wallet is not removed automatically. ODI Studio will ask you for the Wallet password prior to logging in. you will have information under the three tabs in the left panel. Only on the very first time. You will not need to enter the ODI credentials again (User password). "Successful. You can view it with the GUI tool owm (Oracle Wallet Manager).If Information popup box replies.odi/oracledi/ewallet . From now on. If the connection was successful.  Advanced Analytics and Real Application Testing options SQL>  create user DEV_ODI_REPO3 identified by Welcome1;  User created. OS Prompt [myuser@myhost ~]$  sqlplus / as sysdba  SQL*Plus: Release 12. SQL>  grant dba to DEV_ODI_REPO3;  Grant succeeded.0. Oracle. That method will not be repeated at this point. In summary.2. SQL>  exit  Disconnected from Oracle Database 12c Enterprise Edition Release 12.2. The third (and recommended) way to create a second new repository and to keep the first one.0 ­ 64bit Produ With the Partitioning. or SQL Developer. is to create a new DB user such as DEV_ODI_REPO3 and then proceed with the steps below.0 ­ 64bit Production With the Partitioning. 2013. The second way is to reuse an existing ID such as DEV_ODI_REPO but that is not recommended since it will overlay (replace) the existing work repository. as shown in the previous steps.1. As a DBA. OLAP. OLAP.1. That information is stored in Oracle Wallet in your home directory. The first way is to use RCU.1. or the SQL tool of your choice to create a new DB user.2. 2.  All rights reserved.It is possible to store the login information without using Wallet as an alternative.2 Connecting to a New Work Repository (OPTIONAL) There are three ways to create another new work repository. use sqlplus .0.0. Connected to: Oracle Database 12c Enterprise Edition Release 12. you have defined the connection for ODI to use the repository you created with RCU. Advanced Analytics and Real Application Testing options [myuser@myhost ~]$  .0 Production on Fri Sep 20 05:21:08 2013 Copyright (c) 1982. Password:  (not displayed. You already have one work repository connected from RCU.OracleDriver (pick from list) Driver: JDBC Url: jdbc:oracle:thin:@ localhost:1521:orcl                                                   (pick template from User: list. If the DBA creates a new user in SQL*Plus as recommended. The panel opens on the right. for example DEV_ODI_REPO . then expand Repositories. the DBA role may be a bit excessive. then this step in ODI creates a second repository and leaves the first intact.jdbc. then this will replace the repository. in the left panel. then right-click Work Repositories.In real life. but                                                   matches the one just created                                                   in sqlplus)  . then edit edit <placeholders> )  DEV_ODI_REPO3  If you use the same User again as previously used. On the Specify ODI Work Repository connection properties panel. then click New Work Repository. you would probably use a lower set of permissions. enter the following information: Field Value: Prompt: Technology: Oracle (pick from pull-down list) JDBC oracle. click the Topology tab. To create another new work repository. Click Next to continue. but it is okay to use it for training purposes. enter the following information: Field Prompt: Value: Name:  WORKREP3  Password:  (not displayed)  Work Repository Type: Development (pick from pull-down list) Yes to continue. Click On the Specify ODI Work Repository properties panel. The warning about not using localhost is a good suggestion.You can click Test Connection if you wish. . . A progress bar displays. On the Confirmation dialog box. click Yes to continue. On the Create Login dialog box.Click Finish to continue. such as DEV_ODI_REPO3 . Click OK to continue. enter a login name. In summary. you can click Open to see information about it. it may have been necessary to back up (export) the previous one if you ever need it back. Since it is a replacement.On the Enter Wallet Password dialog box. you now have two work repositories. just look. Click OK to continue. enter a password (which will not display). To verify that the new work repository is fully populated. the old work repository is still good. but this created a new work repository. the original work repository was fine. You have now created a new work repository which is in addition to the old work repository. Nothing to do here. . Note that the old name workrep remains on the left. If the new repository already contains information. Select Import. In the Import Selection dialog box. To import both a master and/or work repository. you can choose to update or replace "duplicate" rows. Importing Previous Repositories (OPTIONAL) Over time you may develop repositories that would be useful to either move to other machines or clone on other machines.. The process of how to do the export is not covered in this OBE. click the Topology tab.1 Importing a Master Repository On the left panel. The zip file contains XML metadata that can be loaded on a new repository. select Import the Master Repository. . One way to do this is to export the repositories to a zip file. it is assumed that the zip files already exist.3.. then click the blue factory pulldown icon on the top right of the tab column. copy the zip files to the target machine and perform the following steps: 3. or . A progress bar displays.Click OK to continue. Click OK to continue. In the Import a Master Repository dialog box. magnifying glass. select Import From a Zip File. Either browse for the file using the type the name of the zip file. On the left panel. In summary. Nothing to do here. just look.2 Importing a Work Repository This is almost identical to the previous procedure. this can take several minutes to complete. 3. Click Close to continue. An Import Report displays. then click the red triangle pulldown icon on the top right of the tab column. . Select Import. you can import a previously saved Master Repository from a zip file.. click the Designer tab. except it is done in a different tab.Depending on the XML file size.. or . Click OK to continue. magnifying glass. select Import the Work Repository.In the Import Selection dialog box. Either browse for the file using the type the name of the zip file. In the Import a Work Repository dialog box. select Import From a Zip File. just look. this can take several minutes to complete. In summary. A progress bar displays. Click Close to continue. you can import a previously saved Work Repository from a zip file. Nothing to do here. An Import Report displays. Depending on the XML file size. .Click OK to continue. If at a later date you want to come back to either verify or modify the connection information.. To test the repository connections. perform the following steps: 4.. This presumes that you are already connected to an active repository. you can view (but not change) the parameters. then obviously your repository connections work just fine.1 Viewing Repository Configuration Information On the main menu bar. In the Repository Connection Information dialog box. you can re-test the connections. navigate to ODI > Repository Connection Information. .4. Testing Repository Connections If you have gotten this far in the OBE sequentially. 2 Editing Repository Configuration On the ODI main menu bar.Click OK to close the dialog box. Click the yellow pencil to edit the existing parameters. The wallet dialog box may appear. In the Repository Connection Information dialog box. In summary. select ODI > Disconnect then select ODI > Connect. . one way to view the active connection information is from the main menu under ODI. Then the ODI Login dialog box appears. 4. you can view and/or change the parameters. Note that even though the test appeared to be completely successful. a success message displays. to close the dialog box. there may still be problems. click Click OK Test to test the connection. If everything is correct. .Once you are satisfied with the values. or on the ODI Studio Start Page.oracle. refer to additional OBEs in the Oracle Learning Library (http://www.oracle. there are several ways to see. samples. If you see these.com/middleware/1221/odi/index.com/goto/odi) OTN Community Forums (https://forums. Credits Lead Curriculum Developer: Elio Bonazzi Other Contributors: Viktor Tchemodanov.oracle.com/corporate/index.com/technetwork/middleware/dataintegrator/documentation/index. In summary. and OLN URLs on OTN: Current version: here (http://docs. you should have learned how to: Store ODI user ID/passwords in Oracle Wallet Create Master and Work repositories using RCU Connect to Master and Work repositories using ODI Studio Import previous repository zip files Test repository connections Resources The following are conceptual or procedural Help topics relevant to the topic of this tutorial: Online documentation. edit.oracle.com/goto/odi (http://www. All rights reserved.html) Your Privacy Rights (http://www. you may be instructed to do something or contact someone. Julien Testut About Oracle (http://www.html) Terms of Use (http://www. Want to Learn More? In this tutorial.html) Contact Us (http://www.html) The following specific courses: D82167GC10 (http://placeholder) Oracle Data Integrator 12c: Integration and Administration (replaces D64974GC20 Oracle Data Integrator 11g: Integration and Administration Ed2) D82171GC10 (http://placeholder) Oracle Data Integrator 12c: New Features External Web sites for related information: www.html) Legal Notices (http://www.com/us/legal/privacy/index.com/community/developer/english/business_intelligence/system_management_and_integrat To learn more about Oracle Data Integrator 12c.Occasionally messages will display in the terminal session used to start ODI Studio (it may be behind the active Studio window). viewlets.oracle.oracle. Oracle and/or its affiliates.com/goto/oll).html) Older versions: here (http://www.com/us/corporate/contact/index.oracle.com/us/legal/index.oracle.oracle.com/us/legal/terms/index.oracle. .oracle. and test the connection information. Alex Kotopoulis.html) Copyright © 2015.