An Overview of Appraisal AssistantA tool to support process assessment / appraisal Software Quality Institute Griffith University Software Quality Institute Griffith UNIVERSITY Outline • • • • Background Tool description Mini team management BETA testing Software Quality Institute Griffith UNIVERSITY SPICE • Generate ISO15504 and ISO9001:2000 profile Software Quality Institute Griffith UNIVERSITY .Background • Goal: An easy to use program help keep track of appraisal artifacts • Evidence based • Customizable standard model items and rating schemes • Supports CMMI staged/continuous representation and ISO/IEC 15504-5 • Supports SCAMPI A/B/C. Background • • • • • Metrics for tracking appraisal progress Generate reports Mini-team collaboration OS: Windows 98/SE/ME/2000/XP/ViSTA Used by SQI personnel in 3 CMMI and 2 SPICE assessments Software Quality Institute Griffith UNIVERSITY . Tool description • Setup the appraisal project – Process scope • Highest capability level • Add/Remove practices – Organization scope • Add/Remove instantiations • Relate instantiations to model practices – Appraisal team • Separate login for each team member Software Quality Institute Griffith UNIVERSITY . Tool description • Evidence based appraisal – Collect evidence • Using spreadsheet • Importing evidence from older projects • Using evidence registry of the tool – Directly open evidence document/URL – Map evidence to model practices – For SCAMPI A Appraisals: • Calculate affirmation coverage in real-time using the 50% rule Software Quality Institute Griffith UNIVERSITY . Bug report is mapped to 2 practices Software Quality Institute Griffith UNIVERSITY . Software Quality Institute Griffith UNIVERSITY . SURAC is mapped to 2 practices Software Quality Institute Griffith UNIVERSITY . Tool description • Characterize practice implementation – Evidences are grouped by instantiations – Characterize the practice implementation on instantiation and organization unit level – Support all characterization options defined in SCAMPI v1.1 MDD – Rating scale customizable through rating scheme editor Griffith UNIVERSITY Software Quality Institute . Software Quality Institute Griffith UNIVERSITY .1 MDD – Rating scales customizable through rating scheme editor – Automatic aggregate lower level findings and ratings – Organization Unit ML Rating • Staged equivalent table for continuous rep.Tool description • Ratings and findings – Support all rating options defined in SCAMPI v1. • Process area sorted by ML for staged rep. Software Quality Institute Griffith UNIVERSITY . Software Quality Institute Griffith UNIVERSITY . Software Quality Institute Griffith UNIVERSITY . Software Quality Institute Griffith UNIVERSITY . ratings and findings are NOT converted – Evidences are grouped by process outcomes – Automatic calculate process capability level – Generate ISO15504 process profile summary report • Generate ISO9001:2000 profile – Group evidences by quality requirements – Rate quality ISO9001 clauses/requirements satisfaction – Document non-conformity – Auditing reports Software Quality Institute Griffith UNIVERSITY .Tool description • Generate ISO15504 process profile – CMMI Practice characterizations. Tool description • Export (almost) all user entered data to documents – ADS report – Strength/weakness summary – Detail finding report + charts – Goal rating profile – PIID Software Quality Institute Griffith UNIVERSITY . Mini team management • Evidence can be recorded and characterised using mini-teams – Add more evidence and interviews – Associate evidence to practice (add PII) – Disassociate parent evidence from practice (delete PII) – Change characterization/comment PIIs • Practice implementation can be characterised and changed by the mini-team Software Quality Institute Griffith UNIVERSITY . Mini team management • Things can NOT be done with mini team – Can not delete evidence unless parent project also deletes it – Can not change appraisal scope (both organization and process scope) – Can not generate mini-teams from a mini-team – Can not import ISO9001/ISO15504 profiles from a mini-team Software Quality Institute Griffith UNIVERSITY . Mini team management • Export mini team databases – Avoid scope overlaps – Save the configuration for reuse • Import mini team – Database record conflicts and work around – Batch import options Software Quality Institute Griffith UNIVERSITY . 1 – One standard model supports continuous and staged representation appraisals – Mapping tables relate CMMI model elements to ISO12207/ISO15504-2 and ISO9001:2000 – All model elements are customizable Griffith UNIVERSITY Software Quality Institute .Tool description • CMMI standard appraisal model items – Consists of all items of CMMISE/SW/IPPD/SS v1. gu.au/AppraisalAssistant • What will be available – The Appraisal Assistant Setup package • Includes a full User Manual – Slides for preparing the appraisal team • What do we want to hear from you – Defect reports. etc) Software Quality Institute Griffith UNIVERSITY . suggestions – The tool usage pattern survey (appraisal project workload.edu. subject to provision of feedback data – Plan is for a beta release period of two years – Tool updates every six – eight months • BETA site: www.BETA testing • Cost: Distributed free.sqi.