Bi Monitoring r5c3

How to work withBI Monitoring Disclaimer This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages were caused by SAP intentionally or grossly negligent. © 2011 SAP AG. All rights reserved. 2 Agenda This demo introduces the BI Monitoring application and shows how to work with the below mentioned BI Monitoring applications. oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. All rights reserved. 3 Integration of Business Intelligence specific alerts in Alert Inbox including Notification Management. Task Assignment and forwarding to 3rd party 4 . Incident Management.Monitoring for Business Intelligence SAP Solution Manager BI Overview Monitor System Monitor Central system status overview for all technical components involved in SAP Business Intelligence Solution Capability to monitor cross-system SAP BW process chains and single process chain steps Central monitoring of SAP BW queries and templates Central monitoring of Business Objects specific jobs and correlation to system specific metrics BI Detail Monitors © 2011 SAP AG.Introduction . All rights reserved. BI monitoring scenario © 2011 SAP AG. All rights reserved.g. queries. BO jobs) BO Web Application Server Systems SAP BI Platform Systems (BusinessObjects Enterprise) SAP Data Warehouse Systems (SAP BW) Backend Systems / Data Sources e. queries and templates in SAP BW system. BO server systems. jobs in BO system) Monitored systems in BI scenario – grouped by BI component type (BW systems. Two monitoring levels are provided: • System level monitoring for the involved technical systems • Monitoring of important BI objects (process chains.Introduction – Monitored BI scenario and objects This picture shows a typical BI scenario (between backend systems and end user). BO web app server systems). templates. 5 . SAP ERP Process Chains BO Jobs BOE Web Application Info objects Reports Queries / Templates End user Monitored BI objects (process chains. …….0 Architectural Overview (simplified) WEBI CRYS TAL XCelsi us Live Office Frontends HTTP …. WebI Services CMS BO Server Layer ODBO. SAP BW © 2011 SAP AG. All rights reserved. RFC. Web Crystal WEBI Pioneer Services Viewer Viewer Viewer SAP BusinessObjects Enterprise XI Web Application Java Platform SDKs BO Web App.. Data Sources 6 . Serv. MDX. Layer CORBA Others Crystal Services Multidim. Analy..SAP BusinessObjects Business Intelligence 4. Agenda oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. 7 . All rights reserved. All rights reserved.BI Overview Monitor – How to Start… © 2011 SAP AG. 8 . BI Overview Monitor – How to Start… 2. Start the BI Overview monitor by choosing „Start Embedded“ or „Start in New Window“ 1. 9 . Select a scenario... © 2011 SAP AG. All rights reserved. performance and exceptions) © 2011 SAP AG. BW process chains and queries and templates) 10 .BI Overview Monitor – Initial View The overview is grouped by the BI component types in your scenario Total number of alerts for the specific BI component type System Monitoring status (availability. Status of the monitored BI applications (BO jobs. All rights reserved. 11 .BI Overview Monitor The BI Overview Monitor shows at a glance the summary of the current status and the open alerts of all BI components that are included in your technical scenario. All rights reserved. Alert (summary) Technical instances status (worst case) BI monitored objects status (summary) System + host level status (worst case) Summary of alerts and status worst case of all systems in the same BI component type (web app. BO. BW) © 2011 SAP AG. technical instance Tomcat example © 2011 SAP AG.BI Overview Monitor – Detail View (BO Web App) Clicking on a component type in the BI overview monitor expands the underlying single systems and technical instances with their separate alert and status aggregation per system resp. 12 . All rights reserved. All rights reserved.BI Overview Monitor – Detail View (BO System) Technical instances of a BO system Two BO systems Tomcat example © 2011 SAP AG. 13 . BI Overview Monitor – Tabular View Switch between Graphical and Tabular View Allows comprehensive overview for large number of instances © 2011 SAP AG. 14 . All rights reserved. 15 .Agenda oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. All rights reserved. Technically the SAP BW systems may consist of a ABAP type system and a SAP J2EE type system • The system monitoring for each involved system has to be setup separately via the system monitoring setup • System monitoring for each system can be viewed via the system monitoring UI or as jump in from the BI monitoring UI BO Web Application Server Systems System type ATC (Tomcat) With enhancements for BO web application © 2011 SAP AG.System Monitoring for systems in BI monitoring scenario This picture shows a typical BI monitoring scenario and the monitored technical objects: • The involved technical systems in a full scope BI monitoring scenario include • BO Web Application Systems (with SP1 only Tomcat is supported for system monitoring). All rights reserved. For SP2 SAP J2EE and WebSphere are planned to follow • BOBJ server systems. SAP BI Platform Systems (BusinessObjects Enterprise) System type BOBJ Completely BO specific SAP Data Warehouse Systems (SAP BW) System type ABAP or JAVA (SAP J2EE) „classical“ ABAP / SAP J2EE system monitoring (no BW specifics) 16 . •SAP BW systems. 17 .Agenda oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. All rights reserved. All rights reserved. performance status and exception status.Example: BO Web Application Systems Monitor The BO Web Applications System Monitor shows the single BO Web components that are part of your technical scenario. availability status. A direct start of the system monitoring application for each BO Web instance is provided. Drill down to the system monitoring application system hierarchy by clicking on the icon of a System Monitoring category you are interested in Each single instance of a BO Web component is shown including details like number of alerts. © 2011 SAP AG. 18 . 19 . for example “Performance” © 2011 SAP AG. All rights reserved.Example: BO Web Application Systems Monitor Select a System Monitoring category you are interested in. Example: BO Web Application Systems Monitor The performance category and its subcategories are shown In the details section you can investigate now the single performancerelevant metrics © 2011 SAP AG. 20 . All rights reserved. 21 .Example: BO Web Application Systems Monitor By changing the view category you can directly switch between the single categories to Performance… … and examine the metric details… © 2011 SAP AG. All rights reserved. BI System Monitor – BO Web Application metrics Availability of BOE InfoView web application (HTTP ping from SMD agent) Introscope metric tree Avg. Response time of open session action Exceptions in BI launchpat = InfoView application or in Query As a Web Service QaaWS calls (Log file scanning via SMD agent) © 2011 SAP AG. All rights reserved. 22 System Monitoring for BO Web Application System •The system monitoring for the BO Web Application System provides all general system monitoring capabilities for the underlying web application system plus specific monitoring for BO web application metrics • Currently the following BO web application specific metrics are provided • Category Availability: regular http ping check for the BO InfoView web application (web UI for BOE). The URL is defined during managed system setup and stored in the Solution Manager URL framework. • Category Performance: average response time of BO web application frontend calls (Introscope metric) • Category Exceptions: any message of type ERROR in the BO web application log of the InfoView webapp. More specific ERROR patterns can be customized by the customer based on customer need / experience. Solution Manager Performance Introscope EM BO Web Application Server Systems Performance Metrics SMD Agent Asb jj dds ds dd Availability BOE Web URL ping Application Exceptions SMD Agent Asb jj dds ds dd Host Agent © 2011 SAP AG. All rights reserved. 23 Agenda oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. All rights reserved. 24 Different types correspond to different BO product instances © 2011 SAP AG.BO Enterprise System Model BOE Cluster BOE node BOE node BOE Server Process BOE Server Process BOE Server Process BOE Service BOE Service Technical system BOE Server Process BOE Service BOE Service B BOE Service BOE Service BOE Server BOE Service BOE Service Intelligence Agent BOE Server Intelligence Agent Softwarecomponent Technical instances Monitoring templates per software component defined on technical instance level (corresponds to BO server types) Many types of BO server processes exit. Currently no metrics on BO system level BOE nodes are not modelled but each server process name has the node name as prefix A complete list of BOE 4.0 services and their mapping to BO server types and SAP BO metric templates can be found here: 25 . All rights reserved. All rights reserved. 26 .Example: BO Server Systems Monitor BO system wide job metrics / alerts Technical BO instances = BO servers For scrolling through all BO instances page by page © 2011 SAP AG. … For BO systems each BO server represents a technical instance. © 2011 SAP AG. Each technical instance provides its own metrics and alerts.Example: BO Server Systems Monitor Choose the category that you are interested in – like Availability . 27 . All rights reserved. All rights reserved. 28 .BI System Monitor – BO Server Systems metrics Server Intelligence Agent (SIA) No BO specific metrics for performance or availability (SIA is the BO watchdog and not monitored itself) only receiving from Host level Exception for unexpected BO server restarts reported in SIA log For all other BO servers an inactive metric defintion exists that can be adapted by customers © 2011 SAP AG. BI System Monitor – BO Server Systems metrics Central Management Server Avg. All rights reserved. Response time of CMS queries and Logons © 2011 SAP AG. 29 . BI System Monitor – BO Server Systems metrics File Repository Server Avg. Read and Write response times © 2011 SAP AG. 30 . All rights reserved. BI System Monitor – BO Server Systems metrics Web Intelligence Processing Server WebI server memory usage © 2011 SAP AG. 31 . All rights reserved. All rights reserved. 32 . An inactive metric entry is available for BO server type in the SAP template Solution Manager Performance BO Server Systems Introscope EM SMD Agent Performance + Availability Metrics BO Server BO Server Asb jj dds ds dd Availability BO Monitoring Server JMX Exceptions SMD Agent Asb Asb jj dds jj dds ds dd ds dd Host Agent © 2011 SAP AG.System Monitoring for BO Server System •The system monitoring for the BO ServerSystem provides all general system monitoring capabilities for the underlying operating system plus specific monitoring for BO metrics • Currently the following BO Server specific metrics are provided • Category Availability: BOE Server availability metric from Introscope (collected by BO monitoring service and offered via JMX) • Category Performance: average response time of BO Server Introscope metric • Category Exceptions: unexpected server stops logged in the SIA (Server Intelligence Agent) log (BO watchdog server) More specific ERROR patterns can be customized by the customer based on customer need / experience. Agenda oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. 33 . All rights reserved. All rights reserved. 34 .Agenda This demo shows how to work with the following BI Monitoring applications: oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. All rights reserved.Starting In the BI Overview Monitor choose the BO Server Systems box… … and click then on the traffic light section jobs © 2011 SAP AG. 35 .BO Job Monitor . Not Started on Time . For each job you can see the status of each monitored metric: .Out of Time Window .Status 36 .Duration . All rights reserved.BO Job Monitor The BO Job Monitor opens in a separate tab Monitored jobs are grouped by the BO system they belong to © 2011 SAP AG. Duration of last finished or currently running job run in minutes Status of the last finished job run (= job instance) Green if successful Red if failed 37 . © 2011 SAP AG. All rights reserved. current time for running job is < window end time. See details on next slide.BO Job Monitor – metrics details Delay in minutes of the last finished or currently running job run to the specified threshold timestamp (today if the timestamp is already reached or yesterday otherwise) Maximum distance in minutes of the last finished or currently running job run to the specified threshold time window on the day where the window start timestamp has the closest distance to the job start time. 0 if the job start time is > window start time and job end resp. 38 .BO Job Monitor – out of time window calculation examples now 0 J3 yesterday W1 today tomorrow W3 W2 J1 time J4 J2 J5 J 6 Daily time window Job runs Closest window Reported metric value © 2011 SAP AG. All rights reserved. Choose your technical scenario and go to the step Configure BO Job Monitor 39 . All rights reserved. How to check the thresholds of your technical scenario? Go to the SAP Solution Manager Configuration .BO Job Monitor – Checking Configured Thresholds Choose the job that you are interested in and check the thresholds… © 2011 SAP AG.BI Monitoring. 40 . All rights reserved.BO Job Monitor – check job details in BO system Select Navigate to and then Central Management Console (CMC) For detailed analyis of a job in the BOE system … and log on © 2011 SAP AG. All rights reserved.BO Job Monitor – check job details in BO system Start the Instance Manager… Enter the selection criteria for your job of interest and click the Find button © 2011 SAP AG. 41 . 42 . © 2011 SAP AG.BO Job Monitor – check job details in BO system Right click the job you are interested in and select “Instance Details” to see more details of this instance. All rights reserved. © 2011 SAP AG.BO Job Monitor – check job details in BO system Check the corresponding detail information for the alert you are investigating. 43 . In our case: check the error message to find the reason for the failed status. All rights reserved. 44 .bobj“ External Name= „BOBJMonServiceVi_ Document“ Type= „Consumer Proxy“ Script ‚List Jobs„ „bobjnormal. All rights reserved.BI Monitoring for BO Jobs •The BI Monitoring for BO Jobs provides the following metrics for the execution of process chains in the Business Objects system: •Performance: •Duration •Not Started on Time •Availability: •Out of Time Window •Exceptions: •Status Solution Manager (ABAP stack) Solution Manager (JAVA stack) BO Server system SMD Agent Extractor Web-Service „BOBJMonService” Agelet „remoteos“ Name = „DPC PUSH CORE“ SystemID=<SOLMAN-SID> Extended Content=<BO server host name> Agelet „e2emai.jar“ BO Server © 2011 SAP AG. All rights reserved. 45 .Agenda oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. BW Process Chain Monitor .Starting In the BI Overview Monitor choose the BW Server Systems box… … and click then on the traffic light in the section Process Chains © 2011 SAP AG. All rights reserved. 46 . Out of Time Window .Duration .Status . For each job you can see the status of each monitored metric: .Data Packages Processed 47 .Records Processed .Not Started on Time .BW Process Chain Monitor Monitored process chains/steps are grouped by the BW system they belong to Monitoring of complete process chains as well as single process chain steps is supported. As of Solman 7. © 2011 SAP AG. As of SP3 each single run may raise an alert. All rights reserved.1 SP1 metrics are calculated from all process chain / step runs within the last 24h worst case values are reported. BW Process Chain Monitor – Starting the Analysis Transaction 2. Start the BW Analysis Transaction by choosing Navigate to -> Analysis Transaction 1. 48 . All rights reserved. Mark the BW process chain you want to investigate… © 2011 SAP AG. . 49 . All rights reserved.BW Process Chain Monitor – Analysis with Transaction RSPC The analysis transaction RSPC is started by default showing the previously chosen process chain.. © 2011 SAP AG. BW Process Chain Monitor – Analysis with Service Tool ST13 Enter transaction here… You can use the SAP WebGUI session also for calling other analysis tools like ST13 (BW-TOOLS)… © 2011 SAP AG. All rights reserved. 50 . All rights reserved. 51 .BW Process Chain Monitor – Analysis with Workload Monitor ST03N … or ST03N © 2011 SAP AG. 52 . All rights reserved.BW Process Chain Monitor – Starting the Alert Inbox Open the alert inbox by clicking on the number of alerts or the traffic light of the BW process chain that you are interested in © 2011 SAP AG. for example BW Process Chain Records/Data Packages 3. Choose the Show Details button © 2011 SAP AG.BW Process Chain Monitor – Alert Inbox for BI 2. Select the alert group that you want to investigate in greater detail 1. Select the alert that you are interested in . 53 . All rights reserved. BW Process Chain Monitor – Alert Inbox for BI Check the details of the specific alert . All rights reserved. maximum and last measured value of the metric © 2011 SAP AG.like minimum. 54 . 55 .BI Monitoring for BW Process Chains •The BI Monitoring for Process Chains provides the following metrics for the execution of process chains in the BW system: •Performance: •Duration •Not Started on Time •Availability: •Out of Time Window •Exceptions: •Status •Records •Data Processed Packages Processed Solution Manager (ABAP stack) BW system (ABAP stack) RFC Extractor ST-PI: /SDF/E2E_BW_PROCESSCHAINS Name = „DPC PULL CORE“ SystemID = <BW-SID> Extended Content = „ST_PI“ ST-A/PI: BCC_BW_PC_MONITORING BW © 2011 SAP AG. All rights reserved. Agenda oIntroduction oBI Overview Monitor oSystem Monitor o BO WebApp Systems o BO Server Systems o BW ABAP/Java Systems oBI Detail Monitors o BO Job Monitor o BW Process Chain Monitor o BW Report Monitor © 2011 SAP AG. 56 . All rights reserved. All rights reserved.Starting In the BI Overview Monitor choose the BW Server Systems box… … and click then on the traffic light in the section Reporting © 2011 SAP AG. 57 .BW Reporting Monitor . BW Reporting Monitor Monitored queries / templates are grouped by the BW system they belong to For each BW Query or Template you can see Average Response Time in seconds and the alerts © 2011 SAP AG. All rights reserved. 58 . Start the BW Analysis Transaction by choosing Navigate to -> Analysis Transaction 59 . Mark the BW Query or Template you want to investigate… © 2011 SAP AG. All rights reserved. 2.BW Reporting Monitor – Analysis with Workload Monitor ST03N 1. BW Reporting Monitor – Analysis with Workload Monitor ST03N 1. All rights reserved. 60 . Check the details of the query you want to investigate © 2011 SAP AG. Transaction ST03N opens in a SAPGui for HTML session 2. Choose section Queries: Bex Web (ABAP) 3. 61 .BI Monitoring for BW Queries & Templates •The BI Monitoring for Queries & Templates provides the following metrics for the execution of queries and templates in the BW system: •Performance: •Average response time of queries •Average response time of templates Solution Manager (ABAP stack) BW system (ABAP stack) ST-PI: Extractor /SDF/E2E_BW_QUERY_TEMPLATES RFC Name = „DPC PULL CORE“ SystemID = <BW-SID> Extended Content = „ST_PI“ ST-A/PI: BCC_BW_QT_MONITORING BW © 2011 SAP AG. All rights reserved. System Storage. iSeries. System p. z/VM. IBM. This limitation shall not apply in cases of intent or gross negligence. Windows. either express or implied. Business Objects and the Business Objects logo. PartnerEdge. WebSphere. POWER5. graphics. OS/2. PostScript. and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business. Netfinity. System z. Crystal Reports. Microsoft. BladeCenter. Java is a registered trademark of Sun Microsystems. System z9. DB2 Connect. The information contained herein may be changed without prior notice. All rights reserved No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. PowerVM. System z10. Acrobat. Redbooks. DB2 Universal Database. text. iAnywhere. HACMP. or transmitted in any form or for any purpose without the express prior written permission of SAP AG. zSeries. ByDesign. SAP shall have no liability for damages of any kind including without limitation direct. VideoFrame. used under license for technology invented and implemented by Netscape. indirect. PowerPC. special. copied. X/Open. HTML. Sybase 365. MetaFrame. i5/OS. the Adobe logo. Parallel Sysplex. Duet. RACF. OS/390. This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. Massachusetts Institute of Technology. Intelligent Miner. Data contained in this document serves informational purposes only. Oracle is a registered trademark of Oracle Corporation. SAP. and other countries. Adobe. XHTML and W3C are trademarks or registered trademarks of W3C®. Inc. or consequential damages that may result from the use of these materials. Inc. POWER. BatchPipes. System i. Sybase and Adaptive Server. SAP has no control over the information that you may access through the use of hot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages. Tivoli and Informix are trademarks or registered trademarks of IBM Corporation. Power Architecture. Xcelsius. including but not limited to the implied warranties of merchantability. Citrix. SAP NetWeaver. z/OS. AIX. Business Objects is an SAP company. OSF/1. No part of this document may be reproduced. POWER6+. links. product strategy. Program Neighborhood. POWER5+. and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase. or other items contained within this material. and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. developments. Inc. Please note that this document is subject to change and may be changed by SAP at any time without notice. Web Intelligence. SAP assumes no responsibility for errors or omissions in this document. Sybase is an SAP company. Linux is the registered trademark of Linus Torvalds in the U. WinFrame.S. SQL Anywhere. UNIX. SAP does not warrant the accuracy or completeness of the information. Excel. StreamWork. National product specifications may vary. XML. MVS/ESA. AS/400. Crystal Decisions. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. POWER6. All other product and service names mentioned are the trademarks of their respective companies. pSeries. fitness for a particular purpose. This document contains only intended strategies. All rights reserved. Inc.© 2011 SAP AG. SAP BusinessObjects Explorer. BusinessObjects. and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries. and MultiWin are trademarks or registered trademarks of Citrix Systems.. RETAIN. DB2. and PowerPoint are registered trademarks of Microsoft Corporation. S/390. System x. z9. System i5. and/or development. xSeries. © 2011 SAP AG. World Wide Web Consortium. 62 . ICA. OpenPower. R/3. JavaScript is a registered trademark of Sun Microsystems. OS/400. This document is provided without a warranty of any kind. S/390 Parallel Enterprise Server. The statutory liability for personal injury and defective products is not affected. GPFS. and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. Outlook. The information in this document is proprietary to SAP. or non-infringement. and Motif are registered trademarks of the Open Group. z10. eServer. System p5.