Frequently Asked Questions (FAQs)
Don’t see the exact information that you’re searching for? Contact us and we’ll be happy to answer your questions about Program & Project Assessment (P&PA), CPPA™ certification, or our exclusive PROJECTRx® products and services.
- What is Program & Project Assessment (P&PA)?
- Why is P&PA needed?
- How do Organizational Assessments compare to P&PA?
- Which SME frameworks support P&PA?
- Does PMBOK® support P&PA?
- Does PRINCE2® support P&PA?
- Does COBIT® support P&PA?
- How does PROJECTRx® support P&PA?
- What is the PROJECTRx® Framework?
- What are Assessment Life Cycles?
- What are Assessment Milestones?
- What is a Basis of Assessment (BOA)?
- What is a Rating Methodology?
- What is a Balanced Scorecard?
- How is Earned Value Management (EVM) leveraged?
- How are Best Practices facilitated?
- What is Framework Integration?
- What are Assessment Mechanics?
- Is P&PA only for IT Projects?
- What are ProjectRx’s P&PA Services?
- What Training Does ProjectRx offer?
- What is P&PA Certification?
- Why is the CPPA™ important?
- What are the Requirements for the CPPA™?
- Why is CPPA™ Certification not offered by PMI, OGC, or ITGI?
- What are ProjectRx’s P&PA Products?
- How can I stay informed about P&PA?
1. What is Program & Project Assessment (P&PA)?
Program & Project Assessment (P&PA) is a risk mitigation strategy used to proactively manage delivery performance. It features the structured evaluation of one or more subject matter areas where progress is measured and assessed against established baselines. P&PA provides an organization with effective oversight and tracking of its large, business critical, and high risk programs and projects, and is complementary to portfolio management.
2. Why is P&PA needed?
Research and surveys from leading subject matter experts (SMEs) in the field of program and project management report that approximately fifty percent (50%) of projects fail to meet their objectives. The strategic, financial, and value based impact that delivery issues may impose on a program or project can be staggering. While there continue to be positive trends such as the ongoing evolution of project management standards, the number of organizations viewing project management as a required competency, and the number of experienced and certified project management professionals, the delivery gap has still not closed beyond that of a "coin flip". P&PA provides an effective oversight approach resulting in improved program and project performance.
In 2007, a Robbins-Gioia survey found that more than seventy percent (70%) valued the concept of an independent, separate group of people designated to assist them in overseeing large-scale initiatives, as opposed to the oversight being performed by the same people doing the implementation1. A November 2008 survey by ProjectRx identified that sixty-nine percent (69%) of participant organizations currently perform formal assessments or audits, or would like to. Sixty-five percent (65%) would like to see the development of a practice standard.
Project Management frameworks provide the processes and standards for managing projects. Organizational assessments assist with the assessment and improvement of organizational processes and best practices. However, in order to determine whether specific programs or projects will meet their delivery objectives (i.e. what management really wants to know), a project delivery approach is needed.
1 = Results of the 2007 Independent Project Oversight Support Survey conducted at a Gartner CIO-level project portfolio conference in Boston.
3. How do Organizational Assessments compare to P&PA?
Organizational assessments, while helpful in assessing and improving the maturity level of organizations with respect to project management processes and best practices, are not accurate predictors of success for specific programs or projects.
Many organizations are made up of multiple divisions, business units, and/or teams that may operate at different maturity levels. Additionally, the programs and projects being managed by those divisions, business units, and/or teams are not necessarily at the same level as an organizational assessment. Organizations tend to have a mix of projects that are 1) doing well, 2) just getting by, and/or 3) experiencing issues. There are many factors beyond project management processes and best practices that can have a significant impact on project delivery. Nearly every program or project has risk associated with it becoming OBE (i.e. Overcome by Events).
4. Which SME frameworks support P&PA?
Project Management frameworks such as PMBOK® (i.e. Project Management Body of Knowledge) from the Project Management Institute, Inc. and PRINCE2® (i.e. Projects in a Controlled Environment) from the Office of Government Commerce (UK) provide the processes, tools, and knowledge for managing projects. Assessment frameworks such as COBIT® (i.e. Control Objectives for Information and related Technology) from the IT Governance Institute provide assessment capabilities.
In order to effectively perform P&PA, the solution should include assessment integration, a well defined assessment framework, detailed assessment (i.e. project management and product development) content, and leverage assessment tools and automation. The framework should contain a basis of assessment (BOA), balanced scorecard, assessment process flow, earned value management (EVM), best practice facilitation, framework integration, and assessment mechanics.
The PROJECTRx® framework from ProjectRx, LLC was specifically designed to bridge the gap between project management and assessment frameworks, and mitigate the P&PA gaps found in leading SME frameworks.
5. Does PMBOK® support P&PA?
PMBOK® (i.e. Project Management Body of Knowledge) from the Project Management Institute, Inc. is probably the most widely recognized and utilized project management standard. However, when it comes to P&PA it finishes well behind the other leading SME frameworks. PMBOK® 4th Edition can be used to identify whether the forty-two (42) processes exist, and if a rating methodology were developed, it could be used to assess the effectiveness of the processes. It is important to note that this process-based assessment is not the same as determining whether delivery objectives will be met.
PMBOK® contains detailed project management process information that can be used as assessment content, earned value management (EVM), and best practices. Its process groups and knowledge areas may be used as project management (PMLC) and assessment area (AALC) life cycles.
PMBOK® lacks assessment integration, an assessment framework, basis of assessment (BOA), balanced scorecard, assessment process flow, assessment milestones, framework integration, a rating methodology, assessment mechanics, and assessment tools/automation.
With respect to P&PA, PMBOK® finishes a distant 4th behind the PRINCE2®, COBIT®, and PROJECTRx® frameworks. A November, 2008 survey by ProjectRx identified that seventy-seven (77%) of participants thought that PMBOK® did not adequately address project assessment, and sixty-five percent (65%) would like to see a practice standard developed.
6. Does PRINCE2® support P&PA?
PRINCE2® (i.e. Projects in a Controlled Environment) from the Office of Government Commerce is a government standard in the UK and is widely recognized in Europe.
PRINCE2® 2009 contains assessment integration, detailed project management process content, a balanced scorecard (i.e. delivery perspective, benefit management, business case), assessment milestones (i.e. project assurance, end stage and exception assessments), best practices, and portions of an assessment framework, assessment mechanics, and basis of assessment (BOA).
PRINCE2® recognizes but lacks earned value management (EVM), an assessment process flow, framework integration, a rating methodology, and assessment tools/automation.
With respect to P&PA, PRINCE2® represents a significant improvement over PMBOK®. However, because it was developed by the OGC to be used as an overall framework, it lacks a few features and prescriptive detail.
7. Does COBIT® support P&PA?
COBIT® (i.e. Control Objectives for Information and related Technology) from the IT Governance Institute is a well designed assessment framework. It was developed to help with the understanding and management of risks and benefits associated with information and related IT.
COBIT® 4.1 contains assessment integration, an assessment framework, assessment mechanics, best practices, a rating methodology, and portions of a basis of assessment (BOA) and balanced scorecard (i.e. delivery perspective).
COBIT® lacks detailed project management process content, assessment process flow, earned value management (EVM), assessment tools/automation, and portions of a balanced scorecard (i.e. PDLC perspective).
With respect to P&PA, COBIT® is a slight improvement over PMBOK®, but not to the degree of PRINCE2®. Because it was developed by the ITGI as an IT governance framework, it lacks project management detail. Only one (1) of the thirty-four (34) COBIT® processes speaks to project management (i.e. at a macro level).
8. How does PROJECTRx® support P&PA?
PROJECTRx® was designed specifically to bridge the gap between project management and assessment frameworks. It features assessment integration, an assessment framework, detailed assessment (i.e. project management process) content, basis of assessment (BOA), balanced scorecard, earned value management (EVM), assessment process flow, assessment milestones, framework integration, rating methodology, best practices, assessment mechanics, and assessment tools/automation.
With respect to P&PA, PROJECTRx® represents an optimal solution. It is like being able to leverage the best features found in various SME project management and assessment frameworks, and more. ProjectRx® can be used on its own or in combination with other SME or Client developed frameworks to mitigate P&PA gaps and significantly enhance assessment capabilities.
9. What is the PROJECTRx® Framework?
PROJECTRx® is an innovative and exclusive oversight solution developed for P&PA. It effectively integrates proven assessment processes, state-of-the-art tools, and people. PROJECTRx® features a three dimensional life cycle approach (i.e. project management (PMLC), product development (PDLC), and assessment area (AALC) life cycles). This approach takes into consideration not only how the project is managed, but how the product is developed.
PROJECTRx® also features a three-pronged milestone approach (i.e. strategically placed toll gate reviews, ongoing performance feedback, and periodic validation of processes and/or delivery results and expectations).
While the framework is directionally aligned to PMBOK® 4th Edition, it extends significantly beyond the limitations of a process based approach. PROJECTRx® incorporates aspects of product development, delivery performance, benefit management, assessment life cycles and milestones, and rating methodology.
The framework is extremely flexible in its use of work and organization breakdown structures, life cycles, milestones, etc. PROJECTRx® can be used “stand-alone” (i.e. with its own project management processes) or can be used to enhance other frameworks such as PMBOK®, PRINCE2®, and COBIT®, or Client-developed frameworks.
10. What are Assessment Life Cycles?
A life cycle is a series of related stages (usually with a beginning and an end) that represents a specific view of a program or project. PROJECTRx® uses Work Breakdown Structures (WBS) consisting of phases, assessment areas, activities, and IOTTs (i.e. inputs, outputs, tools & techniques) for a logical sub-division of project life cycles. WBS Life Cycles are used to maintain assessment content and are the basis for creating assessment milestones.
PROJECTRx® uses a three dimensional life cycle approach (i.e. PROJECTRx® activities vs. project management (PMLC), product development (PDLC), and assessment area (AALC) life cycles).
PMBOK® does not contain assessment life cycles. However, its framework can be used as a two dimensional life cycle approach (i.e. PMBOK® processes vs. Process Groups and Knowledge Areas).
PRINCE2® and COBIT® utilize a one dimensional life cycle approach (i.e. PRINCE2® activities vs. PMLC, and COBIT® processes vs. AALC, respectively).
It is important to note when comparing the SME frameworks that the processes within the corresponding life cycles vary by level and description - all processes are not the same!
11. What are Assessment Milestones?
A milestone is an event held to review the status and assess the performance of a program or project. PROJECTRx® uses Work Breakdown Structures (WBSs) consisting of phases, assessment areas, activities, and IOTTs (i.e. inputs, outputs, tools & techniques) for a logical sub-division of project milestones. WBS Milestones and Assessment Milestones are created based upon WBS Life Cycle components, and offer significant flexibility relative to scope and content.
WBS Milestones are the basis for defining assessment scope. PROJECTRx® utilizes an integrated three-pronged milestone approach (i.e. tollgate reviews, ongoing progress, and periodic validation). Validation is a process by which the effectiveness of the project’s procedures and controls are periodically evaluated along with delivery results and expectations. This process can be formal (i.e. like Sarbanes-Oxley) or be informal.
Milestones are used to collect, analyze, and report assessment findings and results. Earned value management (EVM) is integrated into each milestone to validate scope, schedule, and cost performance against baselined objectives, and for trend analysis.
12. What is a Basis of Assessment (BOA)?
A Basis of Assessment or BOA documents the methodology and core assumptions for how assessments are to be planned and executed. The BOA contains elements such as the scope of effort, corresponding assessment content, milestone strategy, project and milestone components, assessment outcomes, and rating methodology.
13. What is a Rating Methodology?
A Rating Methodology is used to measure elements of the assessment. The methodology should include components such as multiple rating levels, dimensions, metrics, criteria, and exception thresholds. It should also provide for the rollup or summarization of metrics in order to facilitate the analysis process, and provide flexibility for configuration to the client’s environment.
14. What is a Balanced Scorecard?
While having effective processes is certainly a plus, it does not guarantee success or provide a balanced picture of the project’s health. In order to obtain a meaningful assessment of the project, the framework should include a project management vs. product development perspective, process vs. delivery perspective, and benefit management (i.e. identification, validation, and business case).
PROJECTRx® features the use of five delivery elements in conjunction with processes to provide answers that most senior executives and stakeholders are looking for: Will the scope be delivered? Will the schedule be met? Will the budget be met? Will the product meet quality standards and customer expectations? Will the project benefits be realized?
Most programs and projects are required to identify benefits for the business case. In many instances, however, benefits are provided to meet an imposed acceptance threshold, and are often not realistic. They are frequently ignored once the program or project begins.
PROJECTRx® views benefits as the most important delivery element because it is why projects are done. In fact, it is negligent to evaluate changes to delivery objectives without determining the impact to benefits. PROJECTRx® utilizes elements such as benefit management plans, benefit delivery plans, and benefit validation.
15. How is Earned Value Management (EVM) leveraged?
PROJECTRx® utilizes the four core elements of Earned Value Management (EVM) in order to calculate EVM variances, performance, and forecasts. Budget at Completion, Planned Value (i.e. Budgeted Cost of Work Scheduled), Earned Value (i.e. Budgeted Cost of Work Performed), and Actual Costs (i.e. Actual Costs of Work Performed) are used to validate results from the project team relative to scope, cost, and schedule. EVM information is available with each milestone in order to provide trending of the results. The PROJECTRx® tools utilize EVM Wizards in order to standardize how EVM information is presented and eliminate some of the mystery and confusion with interpreting EVM results.
16. How are Best Practices facilitated?
PROJECTRx® facilitates the identification and documentation of best practices such that they can be leveraged across the enterprise on future programs and projects. Lessons learned, templates, examples, and critical success factors are identified during the individual milestones and documented at the appropriate WBS or project level.
17. What is Framework Integration?
Framework Integration identifies how the assessment solution will integrate process, tools and people. The PROJECTRx® framework contains proven assessment processes, state-of-the-art tools, and corresponding experience, education, training, and mentoring.
18. What are Assessment Mechanics?
Assessment frameworks should contain the mechanics required to support P&PA. In addition to the items identified in FAQ #9 for the PROJECTRx® framework, elements such as the guiding principles, oversight/governance, component flow, assessment reporting, and deployment strategies should be defined.
19. Is P&PA only for IT Projects?
No. While many clients will use PROJECTRx® for IT projects, the framework and products can handle a variety of uses and methodologies. In addition to the Project Management Life Cycle (PMLC), other methodologies such as Product Development (PDLC), Six Sigma, Sarbanes-Oxley (SOX), IT Governance, Quality Management (QMLC), Integrated Baseline Review (IBR), and Client-specific are supported. PROJECTRx® features flexible assessment life cycles, assessment milestones, and rating methodology.
20. What are ProjectRx’s P&PA Services?
ProjectRx assists clients with the development and deployment of effective project oversight solutions. We also perform project assessments, health checks, audits; PROJECTRx® process deployments; PROJECTRx® product deployments; and provide the corresponding education, training, and mentoring.
Ted Williams, founder of ProjectRx, has over 30+ years of subject matter expertise with the management, recovery, and oversight of large, strategic, and high-risk IT projects, including 10+ years audit and assessment. He was responsible for developing and deploying the highly successful project audit framework at Cendant Corporation, which was recognized as best practice.
ProjectRx leverages Ted’s background and experience to bring you innovative P&PA solutions to measure and assess the health of your programs and projects.
21. What Training Does ProjectRx offer?
ProjectRx’s specialty is Program & Project Assessment (P&PA) and Risk Management. Our P&PA course options include a ˝ day Executive Overview, 2 day P&PA Training, and 3 day P&PA Certification.
ProjectRx offers a full suite of program management, project management and business analysis training in partnership with a global education provider, as well as Six Sigma training and Organizational Development through our partner, MoZen, Inc.
22. What is P&PA Certification?
P&PA Certification is awarded to individuals who meet ProjectRx’s stringent criteria for performing Program & Project Assessments. The CPPA™ designation recognizes that you have the knowledge, experience, and ability to effectively measure and assess project performance based upon a rigorous assessment framework. It acknowledges that your capabilities are not limited to one (1) particular SME framework, but that you leverage the best from multiple leading SME frameworks.
23. Why is the CPPA™ important?
The CPPA™ offers a way for you to differentiate yourself from the rest of the crowd. The PMP® and PRINCE2® certifications recognize individuals who meet rigorous standards for managing projects. The CPPA™ distinguishes you as being able to effectively measure and assess program and project performance utilizing tools and techniques not found in leading SME frameworks.
The CPPA™ helps to ensure that you are able to effectively communicate project performance with project team members, Project Management Offices (PMOs), and Senior Management in a clear, concise, and objective manner in business terms. You will be better able to proactively mitigate delivery risks and avoid troubled projects.
24.What are the Requirements for the CPPA™?
Candidates for CPPA™ certification must have active PMP® or PRINCE2® certification. They are also required to complete a three (3) day P&PA certification class, pass the P&PA certification exam, and submit an Assessment Management Plan (AMP).
The CPPA™ is not affiliated with the Project Management Institute, Inc. or the Office of Government Commerce (UK).
25. Why is CPPA™ Certification not offered by PMI, OGC, or ITGI?
The project management (i.e. PMBOK® and PRINCE2®) and assessment (i.e. COBIT®) frameworks available from PMI, OGC, and ITGI do not offer comprehensive P&PA solutions. They would therefore not provide assessment training capabilities based upon a robust P&PA framework like the one available with PROJECTRx®.
With respect to P&PA, PMI’s PMBOK® trails the other SME frameworks by a significant margin. PRINCE2® offers a significant improvement over PMBOK®, however, the OGC does not intend to provide prescriptive detail. COBIT® provides a solid assessment framework. However, its focus in not on project management and the ITGI does not plan to offer additional project management detail.
With its comprehensive framework, PROJECTRx® is uniquely positioned to provide effective P&PA, and thereby CPPA™ certification. Refer to FAQs #5, #6, and #7 for more information about the PMBOK®, PRINCE2®, and COBIT® frameworks.
26. What are ProjectRx’s P&PA Products?
In addition to educational and consulting services, ProjectRx offers web based tools to perform assessments, health checks, and audits. These products are used internally by ProjectRx to perform program and project assessments and are available to clients as a web hosted solution through our partnership with DataPipe, Inc.
It should be noted that the PROJECTRx® products are not a scheduling tool like Microsoft® Project which is used to define and track activity and resource related information associated with a project plan/schedule.
PROJECTRx® Pro and Ekg are populated with content similar to what is available from leading subject matter experts in the areas of project management, product development, quality management, IT governance, etc. The content is used within the P&PA framework to measure and assess project performance relative to scope, schedule, budget, quality, and benefit delivery, as well as against process related objectives such as risk, communication, organization, acquisition, and project administration. The result is a balanced scorecard assessing the critical elements of a program or project.
27. How can I stay informed about P&PA?
The best way to stay informed of developments regarding Program & Project Assessment (P&PA) is to sign up for the free newsletter at http://www.projectrx.com/contact.php.
Additionally, our Links Page provides links to the PMI Troubled Projects Specific Interest Group (TPSIG) and the PMI College of Performance Management (PMI-CPM) as additional resources for topics related to P&PA and Earned Value Management (EVM).
©2010 ProjectRx. All rights reserved.
Long Valley, NJ 07853-4010
Phone: 908-520-2283 Fax: 908-292-1060