May 14 -16, 2019

The 23rd Annual PPX Symposium is scheduled for May 14 to 16, 2019, this year’s PPX theme is Managing Planning and Performance: Getting the Right Information at the Right Time. The PPX annual Symposium provides an opportunity for participants to discover valuable information on best practices and solutions in performance and planning and to share experience, expertise and knowledge with hundreds of public and private professionals from across Canada and abroad.

Ottawa Conference and Event Centre
200 Coventry Rd, Ottawa, ON K1K 4S3

PPX Symposium Agenda

Wednesday, May 15, 2019

7:30 am – 8:30 am – Atrium
Registration and Breakfast

8:30 am – 8:50 am – Room 118DE
Welcome Remarks

Katie Brown, PPX President

9:00 am – 10:00 am – Room 118DE
Keynote Speaker

10:00 am – 10:45 am – Room 118C
Break in the Tradeshow Area

Concurrent Sessions

10:45 am – 11:45 am
Session 1 – Room 118A
Linking Results and Financial Information to Build a Culture of Results at Fisheries and Oceans Canada

Fisheries and Oceans Canada (DFO) was an early adopter of the Policy on Results and successfully transitioned to the requirements of the Policy. This presentation will outline what the department is doing to further strengthen its culture of results and the use of results information. The presentation will focus in particular on how the department is seeking to enhance understanding of the resources used to achieve results (an objective of the Policy on Results). It will describe how DFO’s Results Division and its Budget Planning & Financial Management directorate are working together to link financial and results information, and to explore innovative ways to make use of this cross-pollination of information.

Session 2 – Room 106H
Honest Results Reporting, Inappropriate Pressure, and Public Service Ethics

The purpose of this panel and case study presentation is to raise awareness of ethical issues that arise in results reporting; Public Service ethical values and principles; and principles of organizational ethics.

Session 3 – Room 118B
Auditing Gender Equality: Bringing it to the Next Level

The UN has recognized achieving gender equality and empowering women and girls as one of its 17 sustainable development goals (SDG).  It also makes a sound economic proposition, as it increases the access to a qualified workforce that would be otherwise excluded or under-utilized. In fact, a 2015 report from the McKinsey Global Institute found that advancing women’s equality could add US$12 trillion to global GDP by 2025.
Auditors in the public sector can be a useful source of intelligence to public sector leaders, organizations and citizens to enable the monitoring of progress towards the achievement of gender equality.
The presentation will explore issues related to auditing government’s preparedness, such as policy framework, planning and funding. Also, challenges associated with auditing gender equality such as lack of appropriate benchmarks and availability of specialized expertise will be outlined as well as good practices that overcame them successfully.

11:45 am – 1:15 pm – Room 118DE
Lunch & Keynote

1:15 pm – 1:30 pm – Room 118C
Break in the Tradeshow Area

Concurrent Sessions

1:30 pm – 2:30 pm
Session 4 – Room 106H
Deep Dive: An Approach to Get More Out of an Indicator

The Centre of Expertise in Performance Measurement for the Canadian Food Inspection Agency (CFIA) is in the early stages of exploring a new way to look at the data behind an indicator result to better support decision making. We view the indicator result as the tip of the iceberg and are taking a “deep dive” to look at the supporting data below the water  level. Our goal is to have the CFIA analyze indicator results and tell a performance story in a consistent and meaningful way. We will explain the theory behind this approach and how we are putting it into practice by focusing on the work we have done to define and measure industry compliance with regulations. The participants will have a chance to experience the value of this approach with a hands-on exercise and to discuss with us the possibilities for their organization.

Session 5 – Room 118A
Using Risk Information to Improve Decisions

The presentation will explore and provide examples where large complex organizations have gone beyond assessing current conditions and have explored and leveraged the uncertainties surrounding risks to make better decisions that are resilient to a spectrum of risk conditions. Real world examples from the public sector will be included.

Session 6 –  Room 118B
Trials and Tribulations of Developing an Effective Horizontal Results Framework (HRF)

Monitoring the results of Horizontal Initiatives can be time consuming and fraught with difficulties. This presentation will focus on how best to develop Horizontal Results Frameworks (HRF) including making linkages between results and financial information. The presentation will examine best practices and examples, looking at where to start, who should be involved, what results information should be included in HRFs, and different steps to achieve an effective document.
The session will also encourage attendees to share their own trials and tribulations, and lessons learned, in developing HRFs.

2:30 pm – 2:45 pm – Room 118C
Break in the Tradeshow Area

2:45 pm – 3:45 pm
UN Results Based Management Plenary



This panel will discuss the emerging principles of Results Based Management (RBM) as outlined by recent UN review work ( see https://www.unjiu.org/sites/www.unjiu.org/files/rbm_full_report_english.pdf ). The panel will examine how one agency of the UN has taken steps over the past year and a half to implement these principles in an integrated results and planning framework directly linked to Sustainable Development Goals. This presentation will be made by Mr Giuseppe De Simone – a senior strategic planner with UNIDO. The panel discussion will include a commentary by Mr Nick Kowbel of the United Nations Evaluation Group (UNEG) who will discuss how the principles have been embodied in his work and the work he has been reviewing over the last several years since he left his position as a senior evaluator in the Government of Canada to work at the UN. Dr. John Mayne will then act as a discussant on the panel – his work having been an inspiration to the UN Joint Inspection unit report as well as to several UN and other international agencies attempting to implement RBM over the years. Dr Mayne will speak to the key principles and what he sees as key elements of their implementation. The session will be moderated by Steve Montague, a PPX co-founder, executive member and career practitioner. This session will be of interest to planners, performance measurement specialists, evaluators, managers and practitioners at all levels and across functions.

3:45 pm – 4:00 pm
Closing Remarks

4:00 pm – 6:00 pm – Room 118C
Welcome Reception

Thursday, May 16, 2019

7:30 am – 8:30 am – Atrium
Registration and Breakfast

8:30 am – 8:45 am – Room 118DE
Welcome Remarks

8:45 am – 9:45 am – Room 118DE
Opening Keynote

As Canada embarks on the NASA-led Deep Space Gateway and will shortly launch the RADARSAT Constellation Mission, the opportunity and need to demonstrate the impacts of these investments are always in the spotlight. Whether it’s answering the question of why Canada chose to invest in space or clearly demonstrating how space inspires young Canadians to choose careers in Science, Technology, Engineering and Mathematics fields –being able to demonstrate the socio and economic benefits of space is evolving. Sylvain will outline how the new era of space gives Canada an amazing opportunity to not only change how Canada looks at results and demonstrates the impacts of fundamental science but leads the world into a new performance measurement universe.

9:45 am – 10:15 – Room 118C
Break in the Tradeshow Area

Concurrent Sessions

10:15 am – 11:45 am
Session 7 – Room 118B
Applications of Big Data Analytics in the Public Sector: Potentialities and Challenges
This session will be held in French only

Big-data analytics is becoming a tool that can potentially improve governance, productivity, and security in the public sector. However, these new opportunities entail potential costs and significant risks to society. This presentation aims to analyze the use of the technological tools associated with big data analytics in the public sector. We will discuss the need for integrating new technologies in public sector practices along with privacy and security issues to citizens and governments. Case studies from different levels of governments will be presented to illustrate the potentials and challenges of big data analytics in the public sector.

Session 8 – Room 118A
Moving the Dial Toward Digital – # Digital Performance

The Chief Information Officer of Canada has laid out the vision for digital in the Government of Canada (GC): The GC is an open and service-oriented organization that operates and delivers programs and services to people and businesses in simple, modern and effective ways that are optimized for digital and available anytime, anywhere and from any device.  What does this mean for government organizations? Are we achieving this vision? What does “good” digital government look like? The Office of the Chief Information Officer wants to measure the progress of GC Departments and Agencies in support of this vision. The team will present the work to-date on a Digital Maturity model which is one piece of a broader digital government performance measurement framework. Working in the open, the team will conduct an on-site user-focused design session where the PPX community will be invited to test and iterate upon the latest version

Session 9 – Room 106H
Addressing Policy Requirements in Performance Measurement for Science-based Organizations – a Forum to Share Solutions to Common Challenges

This session will be a summary presentation from work of the Community of Practice in Performance Measurement and Evaluation in Science-Based Organizations conducted through the end of the 2017-18 and beginning of the 2018-19 fiscal year. At this point three sessions are planned for February, March and April 2019 which build on sessions held through since 2016, under the direction of Nadine Cyr and overseen by PPX champion Melanie Winzer. The work to be presented will include the following:

  • How to assess the state of performance measurement in large and small departments, approaches taken and lessons learned
  • Improving decision making and results-based management in projects and investments
  • Overcoming data challenges to better inform decisions and understand GBA+ aspects of programs

The session will include specific table questions related to main issues identified and some of the methodology challenges.

11:45 pm – 1:15 pm – Room 118DE
Lunch Keynote
Demystifying Analytics

Many public sector organizations collect reams of performance data but most of it is used for reporting. In this presentation, Greg will describe an Analytics Strategy that is based on 10+ years of work with organizations spanning his tenure at Cognos Incorporated, as Director of the IBM Centre for Business Analytics and Performance at the University of Ottawa, and his current position as Vice-President of Research at the IOG. He will also provide examples of how this strategy can be implemented with performance data currently available in organizations and explore the challenges faced by departments seeking to make better use of data.

1:15 pm – 1:30 pm – Room 118C
Break in the Tradeshow area

Concurrent Sessions

1:30 pm – 2:30 pm
Session 10 – Room 118A
How Positive Auditing Enhances the Strategic Contributions of Internal Audit

The presentation shows how internal audit can innovate by expanding its assurance coverage to include positive findings on subjects critical to organizational success.  The movement toward the inclusion of some positive findings needs to become more systematic and disciplined to more completely meet stakeholder expectations. A case will be put forward that defines and promotes the addition of “positive auditing” to the standard deficiency-focused assurance audit coverage.  The presenters will show how the concepts of risk, risk management, and professional practice can be enhanced by the addition of “positive auditing”. Internal Audit`s focus on organizational deficiencies continues to be important, however, professional practices can and should expand its orientation and coverage to include the examination, validation and reporting on positive performances that are deemed critical to organizational success.

Session 11 – Room 106H
Development and Evaluation of a Consistent Rating Tool for Knowledge Uptake and Use

Jasmin Bhawra, PhD Candidate, University of Waterloo

This presentation will provide a background on measurement and evaluation of knowledge translation — a fundamental process for virtually all public programs and policy — as well as the Knowledge Uptake and Utilization Tool (KUUT). A brief overview of knowledge uptake/use/transfer will be provided, followed by a brief introduction to the KUUT developed by Skinner (2007). Examples of KUUT adoption over the past decade will be presented alongside recent adaptations and results from validity testing of the tool. The session will conclude with an interactive session to obtain participants’ insights on their experiences with knowledge uptake/use/transfer, current needs, challenges, and feedback on the tool.

Session 12 – Room 118B

Integration of GBA+ in Evaluation: Testing the “Null Hypothesis”

Evaluation is an important tool for assessing to what extent gender and intersectional factors were taken into consideration in a program, policy, or initiative. This presentation will give an overview of Natural Resource Canada’s approach to integrating GBA+ into its evaluation practice. A core component of GBA+ is examining and challenging assumptions to ensure that inequalities are not inadvertently perpetuated. With the focus on a specific forestry program, it will also describe the results of a case study in the use of evaluation to test the assumption that inequities that need to be addressed are beyond the scope of the program.

2:30 pm – 2:45 pm – Room 118C
Break in the tradeshow area
2:45 pm – 3:45 pm – Room 118DE
Closing Keynote
Emerging Practices of Federal Evaluation and Its Influence on Decision-Making



Given the implementation of the federal Policy on Results, 2016, program evaluation has had to find innovative ways of supporting the results agenda of Cabinet and other senior decision-makers. Evaluators are being asked to demonstrate the value of their contribution both to improving the management of programs and showing how such improvements can influence policy.

The panel will address two key questions:

1) What are the key changes in the practice of federal evaluation?
2) How are these practices affecting the function’s ability to better influence federal policy and management decision-making?

3:45 pm – 4:00 pm – Room 118DE
Closing Remarks

Katie Brown, PPX President
Steve Montague, PPX Vice President


Session 1 – Linking Results and Financial Information to Build a Culture of Results at Fisheries and Oceans Canada / Lier les résultats et l’information financière pour édifier une culture des résultats à Pêches et Océans Canada

Chris Boughton, A/Director of Results, Fisheries and Oceans Canada
Carl Boisvert, Director, Financial Management, Fisheries and Oceans Canada

Session 2 – Honest Results Reporting, Inappropriate Pressure, and Public Service Ethics / Rapports de résultats honnêtes, pressions inappropriées et éthique de la fonction publique

Robert Czerny, Ethics Practitioners’ Association of Canada Past President
Ben Po, Senior Values and Ethics Advisor
Art Stewart, Retired Senior Advisor to the Comptroller General of Canada

Session 3 – Auditing Gender Equality: Bringing it to the Next Level / Vérification de l’égalité entre les sexes : Pour passer au palier suivant

Yves Genest, Vice-President, Canadian Audit & Accountability Foundation

Session 4 – Deep Dive: An Approach to Get More Out of an Indicator / En eaux profondes : une approche permettant de tirer plus de résultats d’un indicateur

Jennifer Armour, Senior Program Officer, Canadian Food Inspection Agency
Vanlang Nguyen, Analyst, Canadian Food Inspection Agency

Session 5 – Using Risk Information to Improve Decisions / Utiliser l’information sur les risques pour améliorer les décisions

John Lark, Risk Management Specialist, Risk Sciences International
Greg Paoli, C.O.O., Risk Sciences International

Session 6 – Trials and Tribulations of Developing an Effective Horizontal Results Framework (HRF) / Épreuves et difficultés liées à l’élaboration d’un cadre de résultats horizontal (CRH) efficace

Melanie Dubuc, Senior Evaluator,Department of Fisheries and Oceans
Michael Paquet, Results Division Analyst, Department of Fisheries and Oceans

Session 7 – Applications of Big Data Analytics in the Public Sector: Potentialities and Challenges / Applications de l’analyse des mégadonnées dans le secteur public : possibilités et difficultés – Cette session se déroulera en français seulement

Eric Champagne, Associate Professor in Public Administration School of Political Studies, University of Ottawa
Francis Gaudreault, PhD candidate in Public Administration, Associate Researcher, Centre on Governane University of Ottawa

Session 8 – Moving the Dial Toward Digital – # Digital Performance / Transition vers le numérique – # Performance du numérique

Robert Trottier, Director, Digital Policy Oversight and Reporting, Treasury Board of Canada Secretariat

Session 9 – Addressing Policy Requirements in Performance Measurement for Science-based Organizations – a Forum to Share Solutions to Common Challenges / Répondre aux exigences des politiques en matière de mesure du rendement pour les organismes à vocation scientifique – Un forum pour échanger des solutions à des épreuves ( part 1) – (part 2) – (part 3)

Nadine Cyr, Manager of Performance Measurement & Accountability Reporting, National Research Council
John Walsh, Chief Data and Results and Delivery Officer Environment and Climate Change Canada
Melanie Winzer, Executive Direction of Programs and Integrated Planning Branch, Canadian Space Agency
Gregory Bridgett, Acting Director, Central Performance & Impact Assessment Unit Treasury Board of Canada Secretaria

Session 10 – How Positive Auditing Enhances the Strategic Contributions of Internal Audit / Comment la vérification positive améliore les contributions stratégiques de la vérification interne

Internal Auditor Magazine – Upside of Risk
(link will be available until June 7th)

Basil Orsini, CIA, CRMA, CGAP, CCAP, CFE,Retired
Katie Brown, PPX President, Office of the Superintendent of Financial Institutions

Session 11 – Development and Evaluation of a Consistent Rating Tool for Knowledge Uptake and Use / Élaboration et évaluation d’un outil d’évaluation uniforme pour l’intégration et l’utilisation des connaissances

Kelly Skinner, Assistant Professor, University of Waterloo
Jasmin Bhawra, PhD Candidate, University of Waterloo
Steve Montague, Performance and Planning Exchange

Session 12 – Integration of GBA+ in Evaluation: Testing the “Null Hypothesis” / Intégration de l’ACS+ dans l’évaluation : Mise à l’essai de « l’hypothèse zéro »

Stephanie Kalt, Evaluation Manager, Natural Resources Canada
Chloe Elias, Policy Analyst, Natural Resources Canada

Opening Keynote Day 1
Rodney Ghali, Assistant Secretary to the Cabinet, Impact and Innovation Unit, Privy Council Office / Secrétaire adjoint du Cabinet, Unité de l’impact et de l’innovation, Bureau du Conseil privé

Closing Keynote, Day 1
UN Results Based Management Plenary / Séance plénière sur la gestion axée sur les résultats à l’ONU

Opening Keynote, Day 2 ENG
Sylvain Laporte, President, Canadian Space Agency / Président, Agence spatiale canadienne

Luncheon Keynote, Day 2
Demystifying Analytics / Démystifier la fonction analytique
Greg Richards, Vice-President of Research and Business Development at the Institute on Governance and an Adjunct Professor at the University of Ottawa / Vice-président de la recherche et du développement d’entreprises au Centre d’études en gouvernance et professeur adjoint à l’Université d’Ottawa