Skip to main content
p
                                                                                       Earn u
                                                                                              PE
                                                                                      to 28 C
                                                                                               !
                                                                                        Credits




AUDITING & EVALUATING
GOVERNMENT PROGRAM PERFORMANCE

                                                                                September 27-30, 2010
Use Performance Information to Drive Decision Making
                                                                                Arlington, VA


FEATURING TWO INTERACTIVE COURSES:                                              Capture and
                                                                                Utilize Accurate
PERFORMANCE AUDITING:
Achieving Maximum Impact                                                        Data to Prove
• Create successful strategies to improve performance auditing
                                                                                that Government
• Develop relevant program measures to better improve program objectives
                                                                                Programs are
PROGRAM EVALUATION:
Developing and Performing High-Priority Evaluation Activities
                                                                                Achieving their
• Learn to determine if a program is accomplishing its intended outcomes        Intended Outcomes
• Understand key steps to build an evaluation system within your organization

In Association with:


                                                    www.PerformanceInstitute.org/Audit
Day 1                              PERFORMANCE AUDITING: ACHIEVING MAXIMUM IMPACT

                                   Monday, September 27, 2010
 AUDIT PERFORMANCE INFORMATION —




                                   8:30                                                              12:00
                                   Conference Registration and Continental Breakfast                 Lunch Break


                                   9:00                                                              1:00
                                   Understand Definitions and Phases of a                             Discuss and Understand How Vulnerability is Assessed
                                   Performance Audit                                                 • Obtain an understanding of the program: Inputs,
                                   • Define financial and performance audits under                       processes, outputs and outcomes
                                     auditing standards                                              • Assess vulnerability (the COSO/ERM and TX State
                                   • Understand the phases and outputs of a performance audit          Auditor models)
                                   • Learn the importance of the planning phase in order to          • Review audit-ability of high risk/high vulnerability programs
                                     receive high impact auditing results
                                   • Identify terms associated with risk and                         Case Study: Conduct a Risk and Vulnerability Assessment
                                     vulnerability assessment                                        • Identify high risk/high vulnerability issues
                                                                                                     • Report out and reach consensus on selecting issues
                                   Identify Risks Associated with Government Programs and              for audit
                                   Use Conceptual Models to Interpret and Assess the Risks           • Summarize risk and vulnerability assessment
                                   • Discover the inherent risk model and relationship to
                                     program performance expectations or goals                       4:00
                                   • Identify and evaluate sources of program performance            Adjourn
                                     expectations or goals
                                   • Review types of performance measures and understand
                                     how inherent risks, performance expectations/goals and
                                     performance measures are interrelated
                                                                                                               “There is solid evidence
                                   Examine How Inherent Risks Are Assessed
                                                                                                             that each dollar spent on
                                   • Review principles of risk
                                   • Develop methods for evaluating and ranking risk using
                                                                                                            program integrity…yields
                                     risk factors                                                        $1.60 in savings and reduced
                                   • Determine sources of risk information
                                   • Learn how to document and report on risk assessment results                 erroneous payments.”
                                                                                                                                 — Peter Orszag, Director,
                                                                                                                         Office of Management and Budget




                                   WHO SHOULD ATTEND?
                                        • Government Auditors                     • Project Managers                   • Division Managers
                                        • Inspectors General                      • Program Analysts                   • Program Planners
                                        • Program Managers                        • Strategic Planners                 • City and County Executives




     2                             www.PerformanceInstitute.org/Audit
PERFORMANCE AUDITING: ACHIEVING MAXIMUM IMPACT




                                                                                                                                     Day 2
Tuesday, September 28, 2010




                                                                                                                                      AUDIT PERFORMANCE INFORMATION —
8:30                                                                                     Become a
Conference Registration and Continental Breakfast
                                                                                         Certified Government
                                                                                         Performance Manager
9:00
                                                                  To ensure professional success, you must continually expand
Formulate Performance Audit Objectives and
                                                                  your skills and education. The bar has been raised in
Sub-Objectives Based on Risks and Vulnerabilities
                                                                  government agencies and organizations and managers
• Understand the importance of asking the right question          want to hire, promote and work with the most skilled
• Examine the relationship between audit objectives and           individuals possible.
  performance aspects
• Apply steps for defining audit objectives and sub-objectives     To address this need, The Institute offers a Certificate in
• Review relationships between audit objectives                   Government Performance Management. Completing a
  and methodologies                                               certification program is easy. Just attend the three “core”
                                                                  courses and an additional three “elective” courses based
Case Study: Develop High Impact Audit Objectives and              on the topics that meet your agency’s unique needs. The
Sub-Objectives Based On Risk and Vulnerability Assessment         skills you acquire will then be used to complete a “capstone
                                                                  project” on a particular issue that you and your department
• Select high risk/high vulnerability issues
                                                                  are facing, which will then be evaluated by an expert
• Develop high impact objectives and sub-objectives
                                                                  member of our staff.
• Report out and assess potential impacts


12:00                                                             Customize a Program to Fit Your Needs
Lunch Break                                                       Working with Institute training managers, you can select courses
                                                                  that will have direct application and impact to your work.

1:00                                                              For more information about certification, please contact
Review and Understand How to Select Data                          Chris Hicks at 202-739-9548 or email him at
Collection/Analysis Methodologies                                 Chris.Hicks@PerformanceInstitute.org
• Relate audit methodologies to appropriate and
  sufficient evidence
• Review quantitative analysis (ratio analysis, trend and        5 REASONS TO ATTEND:
  time-series analysis, regression analysis, cost-benefit,
  cost-effectiveness and others)
• Examine qualitative analysis (survey/interview/focus groups,
                                                                  1   USE data and evaluation to drive continuous
                                                                      program performance

  observation--participant observation, trained observer)
• Understand relationship of methodology selection to             2   EXAMINE the different types of program
                                                                      evaluation and how to use them
  audit-ability and audit project budgets


Discover Best Practices in Risk and Measurement Based
                                                                  3   DETERMINE program relevancy to the
                                                                      agency’s mission

Performance Auditing

• Learn to create a checklist which identifies successful
                                                                  4   USE evaluation methods to discover program
                                                                      strengths and weaknesses

  strategies related to performance auditing
                                                                  5   UNDERSTAND the relationships between
                                                                      performance auditing, performance measurement,
                                                                      program evaluation and organizational learning
4:00
Adjourn




                                                                                    www.PerformanceInstitute.org/Audit                3
Day 3                   DEVELOPING & PERFORMING HIGH-PRIORITY EVALUATION ACTIVITIES

                        Wednesday, September 29, 2010
 PROGRAM EVALUATION —




                        8:30
                        Conference Registration and Continental Breakfast
                                                                                      About the Trainers:
                        9:00                                                           Stephen L. Morgan, CIA, CGAP,
                        Setting the Stage: A Federal Perspective on the Current        CGFM, CFE, is the former city auditor of Austin, Texas,
                        State of Program Evaluation within Government Agencies         who directed a full scope audit office that conducts
                        • Examine the Obama Administration’s “increased                performance audits, fraud investigations, and
                          emphasis on program evaluation” and what new                 consulting engagements. Mr. Morgan played a key
                          processes may await Federal evaluators                       leadership role in helping the City of Austin evolve its
                        • Understand the relationship between evaluation and           performance measurement and management system
                          performance auditing, performance measurement,               into a model for other government organizations.
                          program evaluation and organizational learning               Before joining the City Auditor’s Office, Mr.
                        • Review what key agencies have done to better improve         Morgan was an evaluator in the U.S. Government
                          their evaluation practices                                   Accountability Office’s National Productivity Group.
                        • Discuss what challenges await as new management              His Institute of Internal Auditors’ offices have included
                          requirements are presented                                   president and governor, Austin Chapter, chair of
                                                                                       the International Government Relations Committee,
                        TED KNIKER, Executive Consultant, Federal Consulting Group,
                                                                                       North American Director on the Global Board,
                        National Business Center, U.S. Department of the Interior
                                                                                       chair of the North American Board, and chair of the
                                                                                       North American Nominating Committee. In January
                        10:30                                                          2001 Mr. Morgan was appointed (reappointed
                        Phase One of Learning Approach to Evaluation:                  in 2005) by the Comptroller General of the United
                        Focus the Inquiry                                              States to the Advisory Council on Government
                        •   Establish a common framework on basic evaluation terms     Auditing Standards. He co-authored three textbooks:
                        •   Review the impetus for evaluation                          Performance Auditing: A Measurement Approach (first
                        •   Understand the organization’s context                      and second editions) and Auditor Roles in Government
                        •   Develop the logic model                                    Performance Measurement: A Guide to Exemplary
                                                                                       Practices at the Local, State, and Provincial Levels. In
                        12:00                                                          May 2009, Mr. Morgan received the Victor Z. Brink
                        Lunch Break                                                    Memorial Award for Distinguished Service, the IIA’s
                                                                                       highest global audit leadership award. In May 2007,
                                                                                       Mr. Morgan accepted the National Intergovernmental
                        1:00
                        Phase One of Learning Approach to Evaluation:                  Audit Forum’s Excellence in Government Performance
                        Focus the Inquiry (continued)                                  and Accountability Award from the Comptroller
                                                                                       General of the United States. Also, in March 2002,
                        • Clarify the purpose of the evaluation
                                                                                       Mr. Morgan became the fourth annual recipient of the
                        • Develop the evaluation’s key questions
                                                                                       Harry Hatry Distinguished Performance Measurement
                        • Think explicitly about the use of findings
                                                                                       Practice Award from the American Society of Public
                                                                                       Administration honoring his lifetime of contributions to
                        Phase Two of Learning Approach to Evaluation:
                                                                                       public service. Mr. Morgan holds a Bachelor of Arts
                        Carry out the Inquiry
                                                                                       degree in government (with honors) from the University
                        • Develop and implement the evaluation plan
                                                                                       of Texas at Austin; he was elected to Phi Beta Kappa.
                                                                                       He also holds an MPA from the Lyndon B. Johnson
                        4:00                                                           School of Public Affairs of the University of Texas.
                        Adjourn
   4
DEVELOPING & PERFORMING HIGH-PRIORITY EVALUATION ACTIVITIES




                                                                                                                    Day 4
Thursday, September 30, 2010




                                                                                                                     PROGRAM EVALUATION —
                                                          8:30
                                                          Conference Registration and Continental Breakfast
Rosalie Torres is a recent past board
member of the American Evaluation Association,
                                                          9:00
serves on the editorial boards of major evaluation        Phase Three of Learning Approach to
journals and served as the staff director for the1994     Evaluation: Apply Learning
revision of the Joint Committee’s Program Evaluation
                                                          • Interpret the data and develop communications
Standards. With over 30 years experience conducting
                                                            and reports
program evaluation in human service settings, she
                                                          • Support the action plan based on evaluation findings
has taught graduate level research and evaluation
                                                          • Monitor and provide feedback on actions taken
courses at several universities, and routinely conducts
workshops on various topics related to evaluation
                                                          Build and Evaluation System Within
practice. She has authored/co-authored numerous
                                                          Your Organization
books and articles articulating practice-based
                                                          • Gather and review information about
theories of evaluation use; the relationship between
                                                            organization’s mission, purpose, strategic plan,
evaluation and individual, team and organizational
                                                            structure and staffing
learning; and effective strategies for communicating
                                                          • Diagnose status of organization’s infrastructure
and reporting evaluation findings. Among them
                                                            critical to organizational learning and design of
are: Evaluation Strategies for Communicating and
                                                            evaluation system
Reporting: Enhancing Learning in Organizations,
                                                          • Reach shared understanding on the organization’s
2nd edition (Sage, 2005), and Evaluative Inquiry
                                                            overall theory of change
for Learning in Organizations (Sage, 1999). Her
organization was recently awarded a National
Science Foundation grant to conduct research on
                                                          12:00
                                                          Lunch Break
logic model use in the design, implementation and
evaluation of complex, multi-year educational reform
systems. She earned her Ph.D. in research and             1:00
evaluation in 1989 from the University of Illinois.       Build an Evaluation System Within Your Organization
                                                          (Continued)
                                                          • Use theory of change and logic models to identify
                                                            inquiry questions for informing organizational

    “The instructor has an                                  improvement and success
                                                          • Identify additional measures needed and complete
   in-depth knowledge of                                    plan for data collection, analysis, reporting and use
                                                          • Implement and evaluate the evaluation system
the subject matter as well
  as a keen knowledge of                                  4:00
                                                          Training Adjourns
    other resources useful
              for my job.”
                           — MC, Program Analyst,
                           Internal Revenue Service

                                                                               www.PerformanceInstitute.org/Audit    5
AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE

In-House Training & Customization

One of the more popular vehicles for accessing the Institute’s educational offerings is the delivery of on-site trainings
and management facilitations. Bringing a training or facilitation in-house gives you the opportunity to customize a
program that addresses your exact challenges and provides a more personal learning experience, while virtually
eliminating travel expenses. Whether you require training for your department or for an organization-wide initiative,
the advanced learning methods employed by The Performance Institute will create an intimate training atmosphere that
maximizes knowledge transfer to enhance the talent within your organization.

Customization:
We realize that not all obstacles can be overcome by applying an “off-the-shelf” solution. While many training
providers will offer you some variation of their standard training, The Performance Institute’s subject matter experts will
work with you and your team to examine your programs and determine your exact areas of need. The identification of
real life examples will create a learning atmosphere that resonates with participants while at the same time providing
immediate return on your training investment. Using interactive exercises that employ actual projects or scenarios
from your organization, instructors can address specific challenges and align the curriculum of each session to your
objectives. While the majority of on-site trainings are focused on smaller groups, The Performance Institute also has the
ability to accommodate organization-wide training initiatives. Utilizing multiple instructors, the Institute has the capacity
to deliver courses to groups of up to 300 participants per day.

Areas of Expertise:
On-site delivery of single courses, certification programs and entire packages of specialized courses are available in
the following areas:

•   Strategic Planning                  •   Performance-Based Contracting
•   Performance Measurement             •   Performance Reporting
•   Project Management                  •   Program Evaluation
•   Lean Six Sigma                      •   Administrative Management
•   Workforce Management                •   Leadership and Change
•   Performance-Based Budgeting

For more information about in-house training and certification options, please contact Jennifer Mueller at 202-739-9619 or
email her at Jennifer.Mueller@performanceinstitute.org.


Sponsorship Opportunities:
As a conference and training provider, The Performance Institute is an expert in bringing together leaders to share and discuss best
practices and innovations. We connect decision-makers with respected solutions providers.

The Institute offers four different pre-designed sponsorship packages:
• Event Co-Sponsor                      • Session Sponsor
• Luncheon Sponsor                      • Exhibit Booth Sponsor

For more information on sponsorships or to get started, contact Meredith Mason at 202-739-9707 or email her at
Meredith.Mason@PerformanceInstitute.org


6                www.PerformanceInstitute.org/Audit
AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE

Venue & Hotel

Venue & Hotel:                                                                          CPE Credits: 7 per day, 28 total
Audit and Evaluate Program Performance will be held at The                              Delivery Method: Group-live Level: Beginner
Performance Institute in Arlington, VA, just one block east of the                      Advanced Preparation/Prerequisites: None
Courthouse Metro stop on the Orange Line. A public parking           The Performance Institute is registered with the National
garage is located just inside of the building.                       Association of State Boards of Accountancy (NASBA) as a
                                                                     sponsor of continuing professional education on the National
        The Performance Institute Conference Center                  Registry of CPE Sponsors. State boards of accountancy have
        1515 N. Courthouse Rd., Suite 600                            final authority on the acceptance of individual courses for CPE
        Arlington, VA 22201                                          credit. Complaints regarding sponsors may be addressed to the
        877-992-9521                                                 National Registry of CPE Sponsors, 150 Fourth Avenue North,
                                                                     Nashville, TN 37219-2417. Website: www.nasba.org.
A limited number of rooms have been reserved at the
Arlington Rosslyn Courtyard by Marriott at the prevailing
rate of $229. This rate is based on the Government Per Diem          Quality Assurance:
and is subject to change. Please call the hotel directly and         The Performance Institute strives to provide you with the most productive
reference code “Audit and Evaluate Program Performance”              and effective educational experience possible. If after completing the
                                                                     course you feel there is some way we can improve, please write your
when making reservations to get the discounted rate. The
                                                                     comments on the evaluation form provided upon your arrival. Should you
hotel is conveniently located three blocks from the Rosslyn          feel dissatisfied with your learning experience and wish to request a credit
Metro station. Please ask the hotel about a complimentary            or refund, please submit it in writing no later than 10 business days after
shuttle that is also available for your convenience.                 the end of the training to:

                                                                     The Performance Institute: Quality Assurance
        Arlington Rosslyn Courtyard by Marriott                      805 15th Street, NW, 3rd Floor
        1533 Clarendon Blvd.                                         Washington, DC 20005
        Arlington, VA 22209
                                                                     Note: As speakers are confirmed six months before the event, some
        Phone: 703-528-2222 / 1-800-321-2211                         speaker changes or topic changes may occur in the program. The
        www.courtyardarlingtonrosslyn.com                            Performance Institute is not responsible for speaker changes, but will work
                                                                     to ensure a comparable speaker is located to participate in the program.

Tuition & Group Discounts:                                           If for any reason The Performance Institute decides to cancel this
                                                                     conference, The Performance Institute accepts no responsibility for
The tuition rate for attending Audit and Evaluate Program            covering airfare, hotel or other costs incurred by registrants, including
Performance is as follows:                                           delegates, sponsors and guests.


 Offerings                           Early Bird      Regular Rate
                                                                     Discounts:
 Individual Course                   $769*           $869
                                                                     • All ‘Early Bird’ Discounts must require payment at time of registration
 Attend Both and Save!               $1499*          $1599             and before the cut-off date in order to receive any discount.
                                                                     • Any discounts offered whether by The Performance Institute (including
* For the Early Bird rate, register before: August 2, 2010.            team discounts) must also require payment at the time of registration.
                                                                     • All discount offers cannot be combined with any other offer.
For more information on group discounts for Audit and
                                                                     • Discounts cannot be applied retroactively
Evaluate Program Performance please contact:
Chris Hicks at 202-739-9548 or email him at                          Payment must be secured prior to the conference. If payment is not
Chris.Hicks@PerformanceInstitute.org                                 received by the conference start date, a method of payment must
                                                                     be presented at the time of registration in order to guarantee your
                                                                     participation at the event.


                                                                                www.PerformanceInstitute.org/Audit                               7
AUDITING & EVALUATING GOVERNMENT PROGRAM PERFORMANCE

Registration Form

           CALL                                      FAX THIS FORM TO                                   VISIT
           877-992-9521                              866-234-0680                                       www.PerformanceInstitute.org/Audit


 Registration Form
        Yes! Register me for Audit and Evaluate Program Performance
        Yes! Register me for Auditing Performance Information
        Yes! Register me for Program Evaluation
        Please call me. I am interested in a special group discount for my team


 Delegate Information

 Name                                                                                                                                  Title


 Organization                                                                                                                          Dept.


 Address


 City                                                               State                                                              Zip


 Telephone                                                                                                                  Fax


 Email



 Payment Information
    Check           Purchase Order/Training Form          Credit Card


 Credit Card Number                                                 Expiration Date                                                     Verification no.


 Name on Card


 Billing Address

 Please make checks payable to: The Performance Institute


 CANCELLATION POLICY: The Performance Institute will provide a full refund less a $399 administration fee for cancellations requested four weeks prior to
 the event start date unless cancellation occurs within two weeks prior to the event start date. If a cancellation is requested less than two weeks prior to the
 event start date, no refund will be issued. Registrants who fail to attend and do not cancel prior to the event will be charged the entire registration fee. All
 cancellations must be requested through the cancellation link found in your attendance confirmation email. Please note that cancellation is not final until
 you receive a cancellation confirmation email.

    I have read and accepted the Cancellation Policy above.

 ACKNOWLEDGED AND AGREED

 By: ______________________________________________________________________________________________ Date: _______________________________________

                                                                                                                                  Priority Code: P765-WEB