Thursday, May 16, 2019
7:30 am – 8:30 am – Atrium
Registration and Breakfast
8:30 am – 8:45 am – Room 118DE
Melanie Winzer, PPX Board Member
8:45 am – 9:45 am – Room 118DE
Sylvain Laporte, President, Canadian Space Agency
Sylvain Laporte became President of the Canadian Space Agency in March 2015. He is committed to advancing Canada’s presence in space through satellite, exploration and astronaut missions in the service of science and innovation. From 2011 to 2015 Sylvain was Chief Executive Officer of the Canadian Intellectual Property Office. Prior to that, he held the position of Executive Director, Industrial Technologies Office at Industry Canada, where he was responsible for managing financial contribution programs in research and development for the aerospace, defence, security and space industries. Sylvain first joined Industry Canada in March 2007 as the Chief Informatics Officer.Before entering the public service, Sylvain held several positions at the Canada Post Corporation in the marketing, retail, logistics and information technology sectors. Sylvain earned a bachelor’s degree in computer science and a master’s degree in computer engineering from the Royal Military College of Canada. He served with the Canadian Armed Forces for over 20 years, gaining experience as an aerospace engineer in diverse areas, from engineering and maintenance to human resource management. The President is passionate about leveraging space to inspire Canadian youth to pursue careers in science, technology, engineering and mathematics.
As Canada embarks on the NASA-led Deep Space Gateway and will shortly launch the RADARSAT Constellation Mission, the opportunity and need to demonstrate the impacts of these investments are always in the spotlight. Whether it’s answering the question of why Canada chose to invest in space or clearly demonstrating how space inspires young Canadians to choose careers in Science, Technology, Engineering and Mathematics fields –being able to demonstrate the socio and economic benefits of space is evolving. Sylvain will outline how the new era of space gives Canada an amazing opportunity to not only change how Canada looks at results and demonstrates the impacts of fundamental science but leads the world into a new performance measurement universe.
9:45 am – 10:15 – Room 118C
Break in the Tradeshow Area
10:15 am – 11:45 am
Session 7 – Room 118B
Applications of Big Data Analytics in the Public Sector: Potentialities and Challenges
This session will be held in French only
Eric Champagne, Associate Professor in Public Administration School of Political Studies, University of Ottawa
Francis Gaudreault, PhD candidate in Public Administration, Associate Researcher, Centre on Governane University of Ottawa
Big-data analytics is becoming a tool that can potentially improve governance, productivity, and security in the public sector. However, these new opportunities entail potential costs and significant risks to society. This presentation aims to analyze the use of the technological tools associated with big data analytics in the public sector. We will discuss the need for integrating new technologies in public sector practices along with privacy and security issues to citizens and governments. Case studies from different levels of governments will be presented to illustrate the potentials and challenges of big data analytics in the public sector.
Session 8 – Room 118A
Moving the Dial Toward Digital – # Digital Performance
Robert Trottier, Director, Digital Policy Oversight and Reporting, Treasury Board of Canada Secretariat
Robert graduated from the Government of Canada’s IM/IT Management Development Program in 2012. He currently occupies the position of Director, Digital Policy Oversight and Reporting in the Office of the Chief Information Officer at Treasury Board of Canada Secretariat (TBS). Before joining TBS, Robert was a Director of Information Management at Correctional Services Canada (CSC) where he where he performed a functional review of the IM division and secured funding for the GCDOCS implementation.
With over 20 years in IM/IT, providing client support, defining business requirements and building strong horizontal partnerships, Robert is excited to share his experience of making performance meaningful.
One of his favorite quotes is: If everything seems under control, you’re not going fast enough – Mario Andretti (Formula 1 racer)”
The Chief Information Officer of Canada has laid out the vision for digital in the Government of Canada (GC): The GC is an open and service-oriented organization that operates and delivers programs and services to people and businesses in simple, modern and effective ways that are optimized for digital and available anytime, anywhere and from any device. What does this mean for government organizations? Are we achieving this vision? What does “good” digital government look like? The Office of the Chief Information Officer wants to measure the progress of GC Departments and Agencies in support of this vision. The team will present the work to-date on a Digital Maturity model which is one piece of a broader digital government performance measurement framework. Working in the open, the team will conduct an on-site user-focused design session where the PPX community will be invited to test and iterate upon the latest version
Session 9 – Room 106H
Addressing Policy Requirements in Performance Measurement for Science-based Organizations – a Forum to Share Solutions to Common Challenges
Nadine Cyr, Manager of Performance Measurement & Accountability Reporting, National Research Council
Nadine Cyr is the Manager (Acting) of Performance Measurement and Accountability Reporting at the National Research Council with more than 15 years of performance measurement experience in the public sector. She holds a Bachelor of Science in Civil Engineering from the University of Alberta and currently chairs the PPX Community of Practice for Science-based Organizations. Over the past 8 years at NRC, Nadine has played a key role in developing and implementing performance measures and reports that meet senior management needs as well as central agency requirements. She presented progress made in building a comprehensive NRC performance measurement framework at previous PPX Community of Practice Learning Events and PPX Annual Symposiums. Nadine joined the PPX Board of Directors in late 2018.
John Walsh, Chief Data and Results and Delivery Officer Environment and Climate Change Canada
Melanie Winzer, Executive Direction of Programs and Integrated Planning Branch, Canadian Space Agency
Melanie is the Executive Director of Programs and Integrated Planning Branch at the Canadian Space Agency. In this role, she leads the development and implementation of the Policy on Results. Previously she was the Manager of Planning, Reporting, Measurement and Data and the Canadian Institutes of Health Research leading the development and implantation of CIHR’s Performance Measurement (PM) Regime Toolbox, which is heavily based on the CAHS Impact Framework. She has presented at 3 national symposiums, 8 regional events and founded the Community of Practice on Performance Measurement and Evaluation in Science-based Organizations. As a member of the PPX Board of Directors, she chairs the Learning Committee. Melanie has spent close to 20 years in the Federal Public Service in the areas of Planning, Performance Measurement, Project Management and Reporting. Over this time, she has led various departments to be deemed “Leader and Department of Example” in the areas of integrated planning, performance measurement, project management and parliamentary reporting. She has a Bachelor of Commerce from the University of Ottawa and completed a Master of Arts in Political Science in June 2018.
Gregory Bridgett, Acting Director, Central Performance & Impact Assessment Unit Treasury Board of Canada Secretaria
This session will be a summary presentation from work of the Community of Practice in Performance Measurement and Evaluation in Science-Based Organizations conducted through the end of the 2017-18 and beginning of the 2018-19 fiscal year. At this point three sessions are planned for February, March and April 2019 which build on sessions held through since 2016, under the direction of Nadine Cyr and overseen by PPX champion Melanie Winzer. The work to be presented will include the following:
- How to assess the state of performance measurement in large and small departments, approaches taken and lessons learned
- Improving decision making and results-based management in projects and investments
- Overcoming data challenges to better inform decisions and understand GBA+ aspects of programs
The session will include specific table questions related to main issues identified and some of the methodology challenges.
11:45 pm – 1:15 pm – Room 118DE
Greg Richards, Vice-President of Research and Business Development at the Institute on Governance and an Adjunct Professor at the University of Ottawa
Gregory Richards, MBA, Ph.D, FCMC, is currently Vice-President of Research and Business Development at the Institute on Government and an Adjunct Professor at the University of Ottawa. He was previously Director of the MBA program at the University of Ottawa, a visiting professor at the Western Management Development Centre in Denver, Colorado and a member of Peter Senge’s Society for Organizational Learning based at MIT. At the IOG, he manages the research team exploring all things digital. At the University of Ottawa, he managed the public sector performance management research cluster and continues to manage the IBM Centre for Business Analytics and Performance. His publications appear in the Journal of Public Administration and Research, the International Journal of Productivity and Performance Management, and the Journal of Computer Information Systems. He has also published an edited book on Big Data and Analytics in government and has delivered 50+ conference presentations on the topic of performance measurement and management in the public sector. Prior to his academic appointment, he was a consultant working with several Departments including Finance, the House of Commons, Treasury Board Secretariat, Public Service Commission, Western Diversification and the Canadian Coast Guard. Early in his career, he worked as a public servant at Transport Canada and Consulting and Audit Canada
Many public sector organizations collect reams of performance data but most of it is used for reporting. In this presentation, Greg will describe an Analytics Strategy that is based on 10+ years of work with organizations spanning his tenure at Cognos Incorporated, as Director of the IBM Centre for Business Analytics and Performance at the University of Ottawa, and his current position as Vice-President of Research at the IOG. He will also provide examples of how this strategy can be implemented with performance data currently available in organizations and explore the challenges faced by departments seeking to make better use of data.
1:15 pm – 1:30 pm – Room 118C
Break in the Tradeshow area
1:30 pm – 2:30 pm
Session 10 – Room 118A
How Positive Auditing Enhances the Strategic Contributions of Internal Audit
Basil Orsini, CIA, CRMA, CGAP, CCAP, CFE,Retired
Basil Orsini has presented at four PPX Symposiums, as well as numerous internal audit and some evaluation venues over the past 30 years.
Katie Brown, PPX President, Office of the Superintendent of Financial Institutions
Katie Brown has presented at multiple conferences, has worked in performance measurement and audit within the Federal Public Service for 10 years, and is the current President of the PPX.
The presentation shows how internal audit can innovate by expanding its assurance coverage to include positive findings on subjects critical to organizational success. The movement toward the inclusion of some positive findings needs to become more systematic and disciplined to more completely meet stakeholder expectations. A case will be put forward that defines and promotes the addition of “positive auditing” to the standard deficiency-focused assurance audit coverage. The presenters will show how the concepts of risk, risk management, and professional practice can be enhanced by the addition of “positive auditing”. Internal Audit`s focus on organizational deficiencies continues to be important, however, professional practices can and should expand its orientation and coverage to include the examination, validation and reporting on positive performances that are deemed critical to organizational success.
Session 11 – Room 106H
Development and Evaluation of a Consistent Rating Tool for Knowledge Uptake and Use
Kelly Skinner, Assistant Professor, University of Waterloo
Kelly Skinner is an Assistant Professor in the School of Public Health and Health Systems at the University of Waterloo where she leads the new online Master of Health Evaluation program. Kelly’s research and evaluation interests focus in two areas: (1) the health and well-being of First Nations populations and northern communities including the evaluation of health programs and food systems approaches; and (2) using evaluation theory and conceptual approaches to operationalize and build evaluation systems, with a continued interest in measuring knowledge uptake and utilization. Kelly has experience with stakeholder engagement, working with communities as an evaluation consultant, and currently teaches several courses she developed to online graduate students on Kelly Skinner is an Assistant Professor in the School of Public Health and Health Systems at the University of Waterloo where she leads the new online Master of Health Evaluation program. Kelly’s research and evaluation interests focus in two areas: (1) the health and well-being of First Nations populations and northern communities including the evaluation of health programs and food systems approaches; and (2) using evaluation theory and conceptual approaches to operationalize and build evaluation systems, with a continued interest in measuring knowledge uptake and utilization. Kelly has experience with stakeholder engagement, working with communities as an evaluation consultant, and currently teaches several courses she developed to online graduate students on evaluation theory, applications, practice, and management.
Jasmin Bhawra, PhD Candidate, University of Waterloo
Jasmin Bhawra is a PhD Candidate whose research focuses on food and nutrition policy. She is an independent evaluation consultant working with non-profit organizations, and co-founder of Active Healthy Kids India.
Steve Montague, Performance and Planning Exchange
Steve Montague, partner of Performance Management Network Inc. is a credentialed evaluator, a Fellow of the Canadian Evaluation Society and has 35 years of experience as a practitioner in performance measurement and program evaluation as a management consultant, an adjunct professor and as an evaluation manager in a major Canadian federal government department. Mr. Montague has managed major and minor projects analyzing a wide variety of programs for Canadian federal, provincial, United States, Scottish and Australian governments, as well as conducting work for the OECD, the World Bank, the European Union and the United Nations. He has published articles on measurement and evaluation in journals in Canada, the US and Europe and facilitated numerous presentations, panels and workshops on evaluation, performance management and information management. Steve is also a founding member and three times president of the Performance and Planning Exchange.
This presentation will provide a background on measurement and evaluation of knowledge translation — a fundamental process for virtually all public programs and policy — as well as the Knowledge Uptake and Utilization Tool (KUUT). A brief overview of knowledge uptake/use/transfer will be provided, followed by a brief introduction to the KUUT developed by Skinner (2007). Examples of KUUT adoption over the past decade will be presented alongside recent adaptations and results from validity testing of the tool. The session will conclude with an interactive session to obtain participants’ insights on their experiences with knowledge uptake/use/transfer, current needs, challenges, and feedback on the tool.
Session 12 – Room 118B
Integration of GBA+ in Evaluation: Testing the “Null Hypothesis”
Stephanie Kalt, Evaluation Manager, Natural Resources Canada
Stephanie Kalt is an Evaluation Manager with the Audit and Evaluation Branch at Natural Resources Canada. She has close to 17 years of experience in evaluation and performance audit with the Government of Canada. She has a Master’s of Environmental Applied Science and Management (MASc) and a Bachelor’s in Environmental Studies and Geography. Her current role includes providing functional leadership to the Audit and Evaluation Branch on gender based analysis plus.
Chloe Elias, Policy Analyst, Natural Resources Canada
Chloe Elias joined Natural Resources Canada as a Policy Analyst in August 2018. She has a Master’s in Public Policy and Administration and a Bachelor’s in Environmental and Women’s Studies. She is currently working in evaluation with the AEB and supporting the integration of gender based analysis plus into the Department’s evaluation practice.
Evaluation is an important tool for assessing to what extent gender and intersectional factors were taken into consideration in a program, policy, or initiative. This presentation will give an overview of Natural Resource Canada’s approach to integrating GBA+ into its evaluation practice. A core component of GBA+ is examining and challenging assumptions to ensure that inequalities are not inadvertently perpetuated. With the focus on a specific forestry program, it will also describe the results of a case study in the use of evaluation to test the assumption that inequities that need to be addressed are beyond the scope of the program.
2:30 pm – 2:45 pm – Room 118C
Break in the tradeshow area
2:45 pm – 3:45 pm – Room 118DE
Emerging Practices of Federal Evaluation and Its Influence on Decision-Making
Dr. Rob Shepherd, Associate Professor, School of Public Policy and Administration, Carleton University
Robert Shepherd is Associate Professor in the School of Public Policy & Administration at Carleton University. He is Supervisor of the Graduate Diploma in Public Policy & Program Evaluation, Past Chair of the Consortium of Universities for Evaluation Education, and Past President of the Canadian Association of Programs in Public Administration (CAPPA). He is currently working on two SSHRC Partnership grants aimed at evaluating youth program practice on reserves in Northwest Ontario, and examining options for replacement of the Indian Act.
Dr. Isabelle Bourgeois, associate professor at École nationale d’administration publique and Canada Research Chair in Program and Policy Evaluation
Isabelle Bourgeois, Ph.D., is an associate professor at l’École nationale d’administration publique (ENAP), University of Quebec, and holder of the Canada Research Chair in Program and Policy Evaluation. Her research work focuses on the role of program evaluation in improving government decision-making and resource allocation; she is specifically interested in organizational evaluation capacity and evaluation utilization. Before starting her academic career, Dr. Bourgeois was an evaluation manager in two federal government organizations. She was the 2017 recipient of the CES-NCC Karl Boudreault Award and was the Vice-Chair of the Consortium of Universities for Evaluation Education from 2015-2017. She is currently the Editor-in-Chief of the Canadian Journal of Program Evaluation.
Christine Minas, Director, Results Division, Expenditure Management Sector, Treasury Board of Canada Secretariat
Christine Minas is a Director in the Results Division at Treasury Board Secretariat and the Champion for the Federal Evaluation Community. She has worked in several federal departments, including many years at Employment and Social Development Canada where she held positions in evaluation, research
and policy. Christine is an expert in socio-economic issues across the policy-program-delivery continuum. In the past three years Christine served on the ESDC Mental Health Framework Implementation Committee providing leadership on progress measurement. Recognized for her leadership, Christine actively builds partnerships to achieve results. As a sociologist of work Christine holds degrees from the Universities of Toronto, Alberta and Cambridge (UK).
Shelley Borys, Director General, Evaluation, and Chief Audit Executive in the Office of Audit and Evaluation, a shared service for the Public Health Agency of Canada and Health Canada.
Shelley Borys is the Director General, Evaluation, and Chief Audit Executive in the Office of Audit and Evaluation, a shared service for the Public Health Agency of Canada and Health Canada. She holds a PhD in Social Psychology from the University of Waterloo. Shelley is a Credentialed Evaluator, and has received several awards from the Canadian Evaluation Society (CES). She is a member of the CES Credentialing Board and was inducted as a Fellow of the CES in 2014. Shelley worked for over 10 years as a consultant in evaluation, joining government in 2005, and led the evaluation functions at Environment Canada and Citizenship and Immigration Canada before joining the Public Health Agency in 2011 as the Director General of Audit and Evaluation.
Isabelle Trépanier, Chief Audit and Evaluation Executive, Infrastructure Canada
Isabelle Trépanier is the Chief Audit and Evaluation Executive at Infrastructure Canada, a position she’s held since March 2016.Recruited to the federal public service in 1991, the first 10 years of her career were spent in the field of financial management.
Part of Transport Canada’s Policy Group from 2001 to 2011, she worked on various files in all modes, including the design of the transportation element of the first Building Canada infrastructure Plan. Her last posting in Policy Group was as Director, National Air Services Policy, where she led the development of economic policy frameworks and legislation affecting Canadian air carriers, domestic air services, passenger rights and the environment.
From 2011-2014, Isabelle was the Executive Director, Corporate Planning and Reporting at Transport Canada, a position which supported the alignment of business activities, financial resources, performance and risk management.
She holds a Masters in Business Administration from the University of Ottawa and a Bachelor’s degree in Commerce.
Alexandra Dagger, Director General of Audit and Evaluation, National Research Council Canada.
Alexandra Dagger is the Director General of Audit and Evaluation at the National Research Council Canada. She has extensive experience in evaluation, performance measurement, and internal audit in both the public and private sectors. Her focus in recent years has been on leveraging evaluation and audit capabilities and products to provide evidence and strategic advice for decision making. She is a past board member of the local Canadian Evaluation Society chapter. In recognition of her contributions to the local evaluation community, Alex received the Karl Boudreault Award for Leadership in Evaluation in 2014
Fatima Barros, VP Audit and Evaluation, Canada Mortgage & Housing Corporation
With more than 30 years of diverse experience at CMHC, Fatima Barros knows how important housing is to Canadians – and how important it is to get it right. This makes her ideally suited for her role as Vice-President of Audit and Evaluation: she understands the complex and broad risks facing the corporation, as well as how Internal Audit contributes to ensuring CMHC is
positioned to help Canadians meet their housing need.“The Internal Audit and Evaluation function has matured at CMHC over the past few years;
we’ve adopted leading practices that are not often seen at organizations of our size. I believe we are a real leader among our peers. We look at business lines as our clients. We’re here to help them do their work well, to provide real-time support and advice as processes are being developed, not just after the fact.”
Fatima reports to the Audit Committee of the Board of Directors, giving her team the independence to offer objective assurance, credible assessments on the management of key risks to the corporation, and evidence-based evaluations of the relevance and performance of housing programs. Sitting on CMHC’s Executive Committee and attending Board meetings help her understand CMHC’s strategic priorities and direction, allowing her to focus her team’s efforts on areas of greatest risk and importance to the corporation.
“CMHC’s mission and mandate really resonate with me, which is why I have spent my entire career here. I’m proud of the work we do and the positive impact it has on so many Canadians. I see how employees live CMHC’s values every day.” Fatima holds Chartered Professional Accountant and Certified General Accountant designations. An avid reader and mother of two adult children, she lives with her husband in Ottawa.
Nima Ghomeshi, Evaluator
After 8 years with the Canadian Foreign Service, Nima is now redirecting his public service career towards Program Evaluation. Over the past year, he has worked as an Evaluator with Elections Canada and the National Research Council of Canada, while completing a Graduate Diploma in Program Evaluation (Carleton). He also holds a BSc in Psychology (McGill) and an MA in International Affairs (Carleton). In his spare time, he enjoys acting and spending time in nature.
Given the implementation of the federal Policy on Results, 2016, program evaluation has had to find innovative ways of supporting the results agenda of Cabinet and other senior decision-makers. Evaluators are being asked to demonstrate the value of their contribution both to improving the management of programs and showing how such improvements can influence policy.
The panel will address two key questions:
1) What are the key changes in the practice of federal evaluation?
2) How are these practices affecting the function’s ability to better influence federal policy and management decision-making?
3:45 pm – 4:00 pm – Room 118DE
Katie Brown, PPX President
Steve Montague, PPX Vice President