2018 SYMPOSIUM

22nd ANNUAL PPX SYMPOSIUM

Ottawa Event and Conference Centre
200 Coventry Road
Ottawa. ON

PPX Symposium Agenda

7:30 am – 8:30 am– Atrium
Registration and Breakfast

8:30 am – 8:45 am – Room 118DE
Welcome Remarks
Katie Brown, Chair, PPX Symposium Planning Committee

8:45 am – 9:45 am – Room 118DE
Keynote Speaker
The Treasury Board of Canada’s Policy on Results – Progress and Prospects

Description:
This presentation will summarize progress-to-date on the implementation of the Policy on Results (2016). It will identify the Policy’s structural elements, discuss their degree of implementation, as well as delve into how these elements are contributing to a strengthened culture of performance measurement, evaluation and innovation in program and policy design and delivery. Finally, it will examine challenges and how these are being addressed to maintain the results momentum and the alignment of resources with priorities.

9:45 am – 10:15 am – Room 118DE
Peter Green Memorial
Tom Wileman, Retired, Office of the Auditor General of Canada, and Treasurer of PPX
Steve Montague, Partner, Performance Management Network Inc. and PPX Vice-President

Academic Collaborations
Eric Champagne, Associate Professor of Public Administration at the University of Ottawa’s School of Political Studies , and Board Member of PPX

10:15 am – 10:45 am – Room 118C
Break in the Tradeshow Area

Concurrent Sessions

10:45 am – 11:45 am

Session 1 – Room 106H
Deriving Value by Asking the Tough Questions

Description
This presentation will detail the importance of knowing what you do and why, what you care about and where you are trying to go as you design a performance measurement system that adds true value for your organization. The presentation will also cover some tools and mechanisms to help answer those big questions.

Session 2 – Room 118A
Positioning Internal Audit to Contribute to More Strategic Organizational Outcomes

Description
This presentation will show participants how to identify better ways they can make more strategic contributions to their organization in their professional activities by showing how the delivery of internal audit can be designed to deliver better outcomes for their organization. By focusing on the innovative implementation of established audit standards, the presentation will show how the strategic implementation of audit requirements in the following areas can achieve better outcomes:

  • More strategic risk-based internal audit planning;
  • More strategic audit planning;
  • More strategic audit examination: and
  • More strategic audit reporting.

The presentation will be delivered in a way to make the learnings transferable to other areas of internal oversight as well as to program managers.

Session 3 – Room 118B
Resource Alignment Reviews – The Role of Business Modeling and Technology Enablement

Description
The TBS Policy on Results has signalled the importance of aligning resource management with performance reporting. Resource Alignment Reviews are considered one of the three pillars of the Government of Canada’s new expenditure management regime. The challenge however is how to effectively demonstrate and operationalize the linkages between inputs (aka resources), outputs (aka programs and services), and outcomes (aka desired results).

While logic modeling is a useful high-level approach, it is typically only a visual representation of often more theoretical causal relationships. To truly understand and manage resource allocations, many organizations are now considering more advanced business modeling and/or operational planning techniques, both of which are closely aligned to solid performance reporting frameworks.

This presentation will examine a variety of business modeling and planning strategies in play at a number of Federal Departments such as Health Canada, Veterans Affairs, and Treasury Board Secretariat. It will also demonstrate how technologies such as SAP (Business Planning and Consolidation (BPC), Business Intelligence (BI) and Strategy Management (SSM)), Qualiware (Government of Canada’s Enterprise Architecture technology standard), and the advanced use of Excel-based modeling, are intrinsic parts of this new evidence-informed decision-making environment.

11:45 am – 1:15 pm – Room 118DE
Lunch & Keynote
To Be Advised

1:15 pm – 1:30 pm – Room 118C
Break in the Tradeshow Area

Concurrent Sessions

1:30 pm – 2:30 pm

Session 4 – Room 106H
Approaches and Methods for Assessing the Relevance of Canadian Government Programs
This session will be delivered in French only.

Description
The Policy on Evaluation (2009) was evaluated in 2013-2014. This evaluation highlighted the difficulties associated to the assessment of program relevance and called for an increased flexibility on the requirements related to its systematic assessment. The objective of this session is to describe in an empirical manner, how relevance is measured in federal evaluations under the Policy on Evaluation in order to better understand the implications of this recommendation. The presented approach is exploratory, as program relevance has not been significantly addressed in previous research. The proposed study covers the first six years of the Policy on Evaluation (2009 – 2014) and uses a qualitative analysis of federal evaluation reports, followed by key informant interviews.

Session 5 – Room 118A
Emerging Promising Practices on Integrating Gender-based Analysis in Evaluation

Description
This session presents early findings on emerging promising practices from Jane’s case study line of evidence on integrating gender-based analysis in the federal government evaluation function. Given the federal government’s recent emphasis on gender equality, and subsequently gender-based analysis, research efforts in this area were expanded from a small sample (3) to include organizations focussing on building related capacities amongst results units, including those gender-based analysis in specific evaluation efforts, and an organization considering and electing not to include gender-based analysis in a specific evaluation. Drawing on related international evaluation practitioner guidance materials (UNEG 2014; UNICEF, 2011; UNWomen, 2015) specific discussion areas will highlight organizational leadership, organizational supports, stakeholder engagement, capacities amongst evaluation and results personnel, and evaluation experience on integrating gender-based analysis. These, and other findings lend themselves to the development of a high-level competency framework related to integrating gender-based analysis in evaluation.

Session 6 – Room 118B
Developing A Consistent Rating Tool for Knowledge Uptake + Use

Description
This session will be a summary presentation from work on this special project conducted through the 2017-18 FY year involving research on, development and refinement of a knowledge uptake and use rating tool (KUUT) for use in various public sector contexts and conditions. The session will focus on research conducted and work under the direction of Dr. Kelly Skinner and overseen by PPX champion Steve Montague. The presentation will include the following:

  • The results of a literature review on the subject including consideration of various models and approaches and their relative advantages and disadvantages
  • An examination of face validity through feedback from CoP members about the trial version of the KUUT
  • evidence on how the KUUT has been used, and a synthesis of this information
  • A synthesis of past/current use of the KUUT, along with input from CoP members, to suggests refinements

The session will include specific table questions related to pressing questions regarding the KUUT and its refinement. The session can be considered part of the ‘open commons’ approach to this research project – and participant’s part of the refinement process.

2:30 pm – 2:45 pm – Room 118C
Break in the Tradeshow Area

2:45 pm – 3:45 pm – Room 118DE
Keynote

Public Infrastructure: Best Practices in Measurement and Performance Frameworks

Description
The Institute of Fiscal Studies and Democracy (IFSD) has a strong applied research program on infrastructure management and funding. Mr. Page’s topic highlights the difficulty of measuring the impact of infrastructure, an area of continuing interest to the PPX community that links to an earlier PPX symposium presentation. Mr. Page is part of a research team that is looking at this issue, and plans to present some results in 2019.

3:45 pm – 4:00 pm
Closing Remarks
Katie Brown, Chair, PPX Symposium Planning Committee

4:00 pm – 6:00 pm – Room 118C
Welcome Reception

7:30 am – 8:30 am – Atrium
Registration and Breakfast

8:30 am – 8:45 am – Room 118DE
Welcome Remarks
Katie Brown, Chair, PPX Symposium Planning Committee

8:45 am – 9:45 am – Room 118DE
Opening Keynote
Everything is Connected: Environment, Economy, Foreign Policy, Sustainability, Human Rights and Leadership in the 21st Century

Description:
“We must now speak environment, economy, foreign policy, health and human rights in the same breath,” says Sheila Watt-Cloutier.

In this truly globe-spanning talk, Watt-Cloutier provides a clear, meaningful, and comprehensive understanding of the way these issues are interconnected, and what it means for the future of our planet.

Speaking on leadership, she shows how your organization fits into the grand scheme of things, and organizations can fulfill their mandate by understanding how the local connects to the global, and vice versa.

With a focus on solutions, Watt-Cloutier brings the realities of the Arctic―where Inuit today face profound challenges to their environment, their economy, their health and their cultural well-being―to light. The challenges they face are clearly connected to the industries we support, the disposable world we have become, and the non-sustaining policies we create. Because her Inuit culture faces the most extreme challenges of globalization, Watt-Cloutier speaks from firsthand experience, and couples that with her extensive experiences as a global leader.

Drawing upon her ancient culture, and speaking from a position of strength, not victimhood, she helps audiences find common ground. Her Arctic voice–not as far away as we might imagine–enlightens and inspires. With inclusive good will, it bridges some extremely divided gaps around the world.

9:45 am – 10:00 am – Room 118DE
Membership Draw
Walter Zubrycky, PPX Director
Tweet of the Day
Mike Haley, Landmark Decisions Inc. and PPX Director

10:00 am – 10:15 – Room 118C
Break in the Tradeshow Area

Concurrent Sessions

10:15 am – 11:45 am

Session 7 – Room 106H
Transforming a Department to Focus on Results

Description
Delivering results is a central focus and core mandate of every Department of the Canadian Government. It applies to all Departments and reflects the current emphasis on the Results and Delivery Approach. In this context, Employment and Social Development Canada created an innovative model with 4 Phases intended both to complete quality performance indicators for all of its 40 programs, and to build towards development of an integrated department-wide system. The model being implemented provides the scaffolding for which results, ultimately delivered to Canadians, are based on evidence that will be understood by a wide audience. Each phase builds on the preceding one and includes provision for operational tactical change which matches intended organizational culture change. This describes how employees have been mobilized in the early stages of this process. It also suggests to implement improved and better integrated performance measures and to promote culture change.

Session 8 – Room 118A
Integrated Planning : a Deliverology and Continuous Improvement Tool!
This session will be delivered in French only.

Description
The presentation describes Canada Economic Development’s renewed process of integrated planning and our innovative and technological platform. Including: resources allocation in regard to priorities and results (projects, processes, services); quarterly follow-ups and realignment and communication to employees. The presentation will focus on how Canada Economic Development cultivate a results and performance organizational culture.

Session 9 – Room 118B
Informing Decision-Making: Lessons Learned From Implementing the Policy on Results

Description
Come hear from multiple large and small departments on the lessons learned from implementing the Policy on Results and how this is impacting decision-making. New challenges have emerged since receiving approval from TBS and by sharing best practices, the Community of Practice for Science-based Organizations has been able to find innovative approaches and learn from each other. The session will consist of 4 short panel presentations followed by in-depth question and answer period.

The session will include specific table questions related main issues identified and some of the methodology challenges.

11:45 pm – 1:15 pm – Room 118DE
Lunch Keynote
How to Measure the Success of Canada’s Olympic Games Effort – Beyond Just Medal Count

Description
The journey of an athlete en route to an Olympic performance is measured by a number of markers, milestones, and moments. This athlete journey exists within a team and sport system structure that is complex and involves many stakeholders along the way.

This presentation will shed light on the journey, including an understanding of the Canadian Olympic Committee’s approach towards process measures to achieve ultimate outcomes; while embracing Team Canada’s performance management philosophy of whole athlete wellness. You will gain insight into how Canada prepares for Games and how we optimize our unique environment to foster a united team performance culture across the sport system.

So how does this approach translate into concrete plans? We will dig deeper on how the COC plans and aligns strategies for performance including the allocation of resources. Our ultimate goal is not just about medals, but extends into creating a winning environment that supports optimal performance at all levels.

1:15 pm – 1:30 pm – Room 118C
Break in the tradeshow area

Concurrent Sessions

1:30 pm – 2:30 pm

Session 10 – Room 106H
Health Canada’s Approach to Target Setting: Lessons Learned From Past Departmental Performance Reports

Description
Since the implementation of the Policy on Results in July 2016, Treasury Board Secretariat (TBS) has been strengthening reporting on performance and results to Parliament and Canadians through the development of a new, simplified reporting framework. In order to set new targets for the upcoming fiscal year against the Departmental Results Framework (DRF), an analysis was conducted on past Departmental Performance Reports (DPRs). A target setting approach was then developed. The presentation provides lessons learned from the target analysis and the target setting approach.

Session 11 – Room 118A
Results Framework and Management System: The Perfect Match for Regulatory and Management Excellence in Delivering Services and Results to Canadians

Description
As a first wave adopter of 2016 Policy on Results, the presentation will highlight steps the National Energy Board took in implementing the Departmental Results Framework, the challenges encountered on the journey toward compliance with the policy, and the successes to date. The presentation will also discuss how the combination of the results framework and management system best practices facilitated the development and implementation of robust structures and mechanisms required to efficiently and effectively deliver results. The presentation will also provide examples of how implementing the Policy and the subsequent changes NEB made to improved their management processes.

Session 12 – Room 118B

Plotting the Way Forward: Lessons Learned From Data Integration

Mohammed Frendi, Innovation, Science and Economic Development, CIO

Stéphan Ringuette, Lixar IT, Business Development Manager

Mike Sisk, Lixar LT, Division Manager

Description
In an age of convergence, government is at last waking up to the necessity of exploring its own data alongside that of other organizations. With the help of Lixar (private sector) and Simon Fraser University, Innovation, Science and Economic Development’s Results and Delivery Unit led a merge of CMC Microsystems data with existing data from across its portfolio. The project has raised more questions than it has answered, and the lessons learned are charting a path forward for better measurement and understanding of what is really going on in the nation’s economy, as well as the importance of data in motivating a community of practice.

2:30 pm – 2:45 pm – Room 118C
Break in the tradeshow area

2:45 pm – 3:45 pm – Room 118DE
Closing Keynote

The Management Accountability Framework: Past, Present + Future

Description
The Management Accountability Framework (MAF), a tool designed to monitor the performance of departments and agencies across the Government of Canada, was evaluated for the third time in 2017. The authors of the recent evaluation study will present their findings as part of this session – followed by a commentary by Dr. Evert Lindquist the Editor of Canadian Public Administration who will contemplate the future use of the MAF. These presentations and panel discussion will be of high interest to anyone interested in public sector management assessment – especially those who may have been part of the process over the past 15 years. Whether you are a veteran analyst or a new public servant, this session promises to be rich with information, provocative and engaging.

Reference: MAF evaluation: https://www.canada.ca/en/treasury-board-secretariat/corporate/reports/evaluation-management-accountability-framework.html#toc06

Reference : How Ottawa Spends 2017-18: Canada @15: https://carleton.ca/hos/wp-content/uploads/How-Ottawa-Spends-2017-2018-Ottawa-@150.pdf see Chapter 11

3:45 pm – 4:00 pm – Room 118DE
Closing Remarks
Katie Brown, Chair, PPX Symposium Planning Committee

2018 TWENTY-SECOND ANNUAL PPX SYMPOSIUM PRESENTATIONS

The Treasury Board of Canada’s Policy on Results – Progress and Prospects
Politique sur les résultats du Conseil du Trésor du Canada – Progrès et perspectives

Derek Armstrong, CFA Executive Director, Results Division, Treasury Board of Canada Secretariat / CFA, Directeur exécutif, Division des résultats Secrétariat du Conseil du Trésor du Canada

Public Infrastructure: Best Practices in Measurement and Performance Frameworks
Infrastructure publique : Pratiques exemplaires dans les cadres de mesure et de rendement

Kevin Page, President and CEO of the Institute of Fiscal Studies and Democracy / président et PDG, Institut des finances publiques et de la démocratie

The Management Accountability Framework: Past, Present + Future
Le cadre de responsabilisation de gestion : le passé, le présent et l’avenir
Presentation 1
Presentation 2

Dr. Evert Lindquist, Professor, University of Victoria / professeur, Université de Victoria
Bicki Westerheide, Acting Director of the Internal Audit and Evaluation Branch of TBS / directeur par intérim de la Direction générale de la vérification interne et de l’évaluation au SCT
Sandy Moir, Managing Partner of the Ottawa office of Goss / partenaire de gestion du bureau d’Ottawa de Goss Gilroy
Janice Remai, Partner at Goss Gilroy and a Credentialed Evaluator / partenaire chez Goss Gilroy et un évaluateur accrédité possédant

Session #9
Informing Decision-Making: Lessons Learned From Implementing the Policy on Results
Pour éclairer la prise de décisions : leçons tirées de la mise en œuvre de la Politique sur les résultats
FIND OUT MORE ABOUT US AND WHAT WE DO