Policy Engagement Project Management Plan

Policy Engagement Project Management Plan

 

The APHL Informatics Project Management Plan (PMP) identifies what the project will do, when, by whom and describes how major aspects of the project will be managed. 

Only Section 2: Scope of the PMP should be updated after Project Startup. The APHL Project Lead approves scope changes.

Project Name

Policy Education

APHL Project Lead

Brooke

Project Manager

TBD

Sponsor

Brooke Beaulieu

Target Audience

Management, PHAs, PHLs, CSTE, ASTHO, other national partners

Created By

Crystal and Brooke

When Created

2/2023 (Word)

Document Date

Mar 15, 2023

Document Status

In Development
In Review
Final

Template Version # and Date

(v. 1) Mar 14, 2023

Approved By and Date

Approved by ---, APHL Project Lead, on Mar 7, 2023 (enter date once approved)
Approved by ---, <role>, on Mar 7, 2023 (enter date once approved)
Approved by ---, PMO, on Mar 7, 2023 (enter date once approved) (initially)

 

Sections with “*” are optional for small projects. PMs need to mark unused sections with “N/A due to <reason>.” An example reason might be “small project” or “not a factor.”

 

1 PROJECT OVERVIEW

Provide a brief description of the project and its associated product. Also, briefly state the business need for the project, its public health/business impact, and how the project goals align with the goals of APHL, CDC (if applicable), and other Public Health Agencies. It is strongly recommended that you include a technical diagram, if feasible.  Suggestions would be a high-level conceptual data flow diagram, technical architecture, current/future state, or something similar.

This project will work with CSTE and other partners to track federal public health-impacting policy publications for commenting opportunities, develop draft comments, develop policy summaries, perform policy education, and support public health agencies (PHAs) and labs (PHLs) who want to submit personal or organizational comments to policymakers. APHL will work with partners, PHAs, PHLs, and other parties as identified others to perform this work on an ongoing basis, after the initial pilot iteration to establish and test processes.

1.1 Project Goals and Objectives

A brief summary of the end result of the project.  (For Example: Facilitate labs sending ELR messages using HL7 format from labs to state PHAs and to the CDC.)

• Inventory and decision log of policies evaluated.
• Policy summaries, as prioritized and approved by APHL.
• Draft comment letters (for NPRM/RFI responses), as prioritized and approved by APHL.
• Repository of final comments submitted on behalf of APHL and/or in collaboration with partners.
• Confluence project space that fosters information sharing, facilitates collaborative development of comments, and serves as a repository for project documents.

1.2 Background * (optional for small projects)

Briefly describe prior / current experiences of Clients that identify the need for the project.

N/A: Small project, beginning with a pilot

1.3 Business Need

Describe the Problem or opportunity addressed, Justification, Customer’s needs, primary use cases.

PHA/Ls are under-resourced and PHA/L SME implementers don’t have time to read federal policies that will have large impacts to their work, operations, and critical data quality and availability.

In the past CSTE, APHL, and others (JPHIT1.0) have reviewed various federal policies and have occasionally presented draft comments to PHA/Ls, submitting a comment letter with various signatories as the association. As policy analysis has not previously received dedicated funding, these reviews and information sharing only ever occurred at the last second for PHA?Ls, though national leaders, within-association, and association leaders were aware somewhat sooner. This “scramble” did not allow PHA/Ls to work through agency internal review procedures that would allow them to submit a letter as the organization, and education about the potential to submit comments as an individual was not available. Finally, agencies, associations, and national leaders may not have realized the degree to which numbers of letters are weighted differently from letters with several or many signatories, which still only counts as one letter. These, as well as chronic under-resourcing, have contributed to low awareness of and participation of STLTs PHA/Ls in federal rule-making input procedures.

 

?may be too much detail about why submitting individual PHA/L letters is needed??

In addition, when there are conflicts in perspective between PHAs, due to the nature of submitting one letter, letters do not reflect full spectrum of impact to different PHA/L operations, and may not reflect differences in different types of public health reporting (immunization, syndromic, and ELR all have different structures and needs). In addition, PHLs and their unique perspectives have not been well reflected in submitted Association (CSTE, APHL) group comment letters. (is that true? I don't' recall any lab participation in CSTE’s discussions…)

 

The needs the policy education project plans to address, and our resulting goals, are threefold:

  1. Efficiently review and identify predicted impacts of high-priority proposed policies and requests for information and identify potential impacts on PHA/Ls.

    1. Share findings and rapidly-developed draft comments our public health community, especially PHA/Ls themselves in a way that allows them to contribute directly to the draft comments to allow all to see the variety of impacts depending on the agency, lab, public health reporting standard and other environmental (or is operational a better word?) differences.

    2. With these draft comments, PHA/Ls and agency staff will be empowered to submit their own comment letters as well as meeting their agency’s internal review processes so that their letters will reflect their priority concerns, and include specific impacts, especially if those are unique (for example; AK v NYC, unique challenges faced by territories and the differences in operations among different tribal nations. With timely drafts to work from, these letters will be easier and faster for time-constrained SMEs to write.

    3. This efficient method of developing and sharing draft comments will empower PHA/Ls to comment on federal policies that will impact their work intimately as well as meeting agency and laboratory review procedures in a timely manner. They will be empowered to voice the diversity of their STLTs PHA/L needs directly, rather than being spoken for.

    4. Federal partners will receive a greater number of letters from STLTs PHAs including staff and agencies who have not otherwise been able or comfortable to comment previously.

  2. Provide education about federal policy-making processes, timelines, comment review procedures, including understanding what makes more and less useful comment letters from the perspective of policy-writers and reviewers. This education will assist PHA/L staff in understanding of policy-making, and develop their confidence and skillsets in this area, ideally contributing their perspectives and input to leaders directly, though submission of their own letters. If we are lucky, they’ll share with colleagues and friends, and we will begin to develop a robust policy-contributing core of STLTs practitioners, with critical operational and implementation knowledge to share with policymakers and leadership.

  3. To increase ambient awareness of PHA/Ls staff of the various proposed policies and published rules federal partners are working on, develop clear and readable summaries of policies for those federal publications that are not of large enough impact to develop comments, but may still interest PHAs, PHLs, or our partners. These summaries will increase awareness among PHA/Ls about policies relevant to their work and contribute to their engagement.

    1. Encourage PHAs to share impacts they identify from summaries or comments they were inspired to develop and submit, encourage conversation and other interactions.

    2. Develop and grow member knowledge and confidence with the goal of growing the (nascent?) STLTs policy community and increasing the space that STLTs perspectives take up in national discussions and policy-making. Encourage relationship-building that will improve awareness of STLTs perspectives and that could move STLTs towards putting their needs and goals on the federal agenda.

    3. To encourage interaction, we will remove barriers, lower the stakes of interaction and discussion, facilitate and encourage to provide a supportive and responsive space for discussion and learning.

      1. This is what I’m imagining, and yes, I realize it’s pretty pie in the sky (for example, perhaps a rule only affects STLTS STI data collection in some way, is not high-priority for APHL resources to develop draft comments and gather input, but for staff working in STIs, it may be important enough to develop their own comments. We hope PHA/Ls will feel comfortable enough sharing those too, so others can benefit and are inspired to take opportunities to practice and grow their policy analysis and commenting skillsets.) However, if we get three people who do this in a year, we’ve just identified STLTs policy leaders - and can start introducing them to feds and leaders who will benefit from talking to them. This is like identifying a future Nancy, Karla, or Annie - I’d consider that an incredible win, even if it’s only one person, because they will set direction and become a pillar of the community.

2 SCOPE

2.1 Scope of Work

Describe what the project is intended to achieve in business and technical terms. Use bulleted lists.

Items in Scope:

  • Review of federal Notice of Proposed Rule-making (NPRMs), Requests for Information (RFIs), and federal policy priorities for relevance to public health.

  • Development of policy summaries, as prioritized and approved by APHL.

  • Development of draft comment letters to be submitted under the APHL organizational banner, as prioritized and approved by APHL. As applicable, draft comments letters will be developed in joint collaboration with partners.

  • Engaging with and collecting input from PHAs, PHLs and partners on policy implications.

  • Development of materials, tools, templates, or educational products of various sorts to assist PHAs and PHLs in writing agency or lab-specific comments.

  • For released policies (past the stage for providing comments), sharing of information and updates as identified to PHAs and PHLs.

  • Collaboration with others in the public health policy space to streamline efforts and expedite development of draft comments by implementing a strategic and coordinated approach.

  • Convening forums in which “on the ground” staff at PHAs and PHLs can communicate about their needs to inform national policy making.

  • Initial project scope will be focused policies that impact public health informatics, information systems, and data exchange. However, this scope may expand in the future (as approved by APHL Project Owner) depending on evolving needs and priorities of PHAs, PHLs, and partners.

2.2 Out of Scope

List the items that are out of bounds for this project.

Items out of Scope

  • Writing jurisdiction-specific responses to policies for PHAs and PHLs. Instead, the project will provide education, templates, draft language (as applicable), and opportunities for discussion that enable PHAs and PHLs to write and submit their own feedback to national policy making.

  • Lobbying.

  • Submitting comments claiming to speak on behalf of all PHAs and PHLs.

2.3 Critical Success Factors  

Key business goals that must be achieved in order for the system to be a success for the Client or Organization. These factors help a team or organization decide what they should focus on and compare progress to the goals that are set.

  1. Subject matter expertise covering broad public health scope that can provide the project team with reasonable insight into jurisdiction’s interest in engaging with NPRMs, RFIs, and other policy opportunities.

  2. Timely identification of priority policies for engagement and allowance of ample time to develop materials and comments by the submission deadline.

  3. Efficient, transparent, and simultaneous development of draft comments (likely in a centralized location) that allows for timely incorporation and reconciliation of proposed content.

  4. Partner support of and agreement to policy project parameters, especially access to and use of a collaborative space for developing draft comments.

  5. Availability and interest of PHAs, PHLs, and partners to engage with the APHL project team on policy initiatives. The project is well socialized in relevant forums.

  6. Policymakers and other regulators welcome and value submitted comments and feedback from PHAs and PHLs.

  7. Buy-in from APHL and partner leadership to approve and provide signature on comments letters, as necessary.

  8. The project team can accurately assess and deliver the type of engagement that is most valuable to PHAs, PHLs, and partners.

  9. PHAs, PHLs, and partners perceive there is value and progress stemming from the comments/feedback submitted in response to policy making.

2.4 High-Level Requirements (* optional for small projects)

Describe the functions that must be in place when the project is complete.  The level of detail in this section will vary based on the complexity of the project and the persons involved in the development of the Project Management Plan. 

N/A: small project beginning with a pilot that will finalize deliverables and processes using stakeholder engagement

2.5 Major Deliverables  

Include both product deliverables and those items needed to manage the project.

Deliverable Name

Description & Value

Responsible Party

Target Due Date / Milestone

Deliverable Name

Description & Value

Responsible Party

Target Due Date / Milestone

List of potential policies

Smart-sheet ‘policy tracker’, allows single location for at a glance policy awareness

PM

N/A, has been created

Policy summaries

Summaries of policies APHL decides (using some criteria) are worth summarizing for PHA/Ls, but that don’t rise to the level of development of draft policy comment letters

PM

? ongoing?

Draft policy comments

Draft comments developed for policies APHL decide meet sufficient PHA/L impact criteria (?) and are likely to be worth effort to rapidly read and develop draft comments including PHA/L policy impacts to justify resourcing required produce draft comments for PHA/L announcement, feedback, and use.

PM

? ongoing?

Confluence space and orientation to PHA/Ls

Location for PHAs, PHLs, and partners such as CSTE, ASTHO, and JPHIT2.0(??) members to collaborate on draft comments, read and comment on policy summaries, and find and discuss policy education documents and support materials.

Confluence space is created, needs to be built out

PM

Space created, orientation and details of commenting and summaries needed, TBD when decided

2.5.1 Work Breakdown Structure

PMI defines a WBS as a "hierarchical decomposition of the total scope of work to be carried out by the project team to accomplish the project objectives and create the required deliverables."  Identify all product and project deliverables. (Initial only – not maintained).

See initial plan image: (TBD)

 

2.6 Approach (* optional for small projects)

Identifies the primary approach to the project. If using Agile, describe an initial breakdown of the sprints and releases, if applicable.

  • 1) Identification, 2) prioritization, and 3) approval of opportunities for comment to policies that have not yet been released

    • Identification:

      • PM or BA reviews Fed Reg and curates list for PH Policy Engagement Workgroup review (known as Workgroup)

      • Regular meetings of Workgroup to review short-list of flagged policies (short 7-10 sentence description)

      • APHL Leadership identification and priority (source of decision to comment)

    • Prioritization:

    • Approval:

  • Development summary materials of Workgroup-approved policies (~3 per quarter) and post on External Engagement Confluence page

    • Identifying most helpful level of detail

  • Socialization of information

  • Collection of feedback and comments, for the purpose of APHL Comment submission

    • Internally Comment Letter development on Internal Confluence Space

  • Finalization of APHL Comment Letter

  • Posting APHL Comment Letter on External Confluence Space

  • **Note about focus of policy engagement to develop feedback on policies that have not yet been officially published. Future efforts may expand scope to developing summaries for policies that have already been published for increasing awareness in PHAs and PHLs.

2.7 Relationship to Other Systems / Projects

Lists other systems or projects that might be impacted by this project – needed for coordination. (If none, delete this section.)

  • TBD - Brooke, I’m unsure what goes here, but could imagine listing federal partners who develop policy, partner organizations working on policy (all of them…), AIMS (b/c data exchange affected by policy, especially TEFCA), etc.

  • Should this include resourcing, PHA/L availability and competing priorities, other items in that vein?

3 ASSUMPTIONS, CONSTRAINTS, AND RISKS

3.1 Assumptions

A factor that, for planning purposes, will be taken to be true, real, or certain but is outside the project team's total control. These are recorded to gain agreement with the Client and to take swift action during the project if they do not hold true.  These are potential risks! Include external assumptions such as a product’s availability, suitability and reliability, legislative changes, relative importance of scope vs. cost or time.  Each assumption should spell out the consequence.

  1. Dedicated availability of APHL resources and project team. Without resourcing, the policy summaries will be uninteresting and generic (rather than tightly relevant to PHA/L operations and impacts) and review and comment development timelines will be lengthy, discouraging PHA/L involvement and participation in federal commenting processes.

  2. The project team consists of the relevant policy expertise, skills, and experience.

  3. PHA and PHL staff (notably those with the relevant expertise and experience) have sustained availability and interest in engaging with the project team.

  4. Partners have dedicated staff, and sustained availability and interest in engaging with the project team.

  5. Barriers to PHA and PHL access, participation, interest, are identified and removed.

  6. The relevant subject matter expertise breadth is identified, recruited, and retained.

  7. The project team can demonstrate sustained project value to APHL Management and the project is adequately funded to support necessary resources.

  8. In the case of resource changes: project knowledge, processes, and relationships can be readily transferred and maintained.

  9. The project team can socialize and emphasize the importance of project engagement with partners in the relevant arenas (e.g., Joint Public Health Informatics Task Force (JPHIT 2.0).

  10. The project team and partners agree on the process and tools to collaboratively develop and review comments.

  11. Federal policy makers appreciate or benefit from this work.

3.2 Constraints  

A constraint is anything that might restrict, limit, or regulate the project (i.e., time, scope, cost, resource, or equipment) restrictions known in advance that will affect the project's performance.  Generally, constraints are outside the control of the project team. List any constraints that must be taken into consideration before the startup of the project.  Violating one of these in project planning usually causes a project to fail in some way.

• The project team inadvertently makes or maintains barriers to participation, or does not execute on the value that PHAs and PHLs hoped to receive from the project. If this occurs, engagement in the project – and therefore project success - will falter.
• PHAs and PHLs do not feel informed enough about policy content to participate meaningfully in the project.
• Political nuances and sensitivities may arise when providing public comment, which may deter the perceived ability and willingness of PHAs, PHLs, and partners to contribute.
• Disagreement on an approach, tools, and expectations to collaboratively develop comments.
• Opportunities to provide feedback to NPRMs, RFIs, and other policy initiatives may be identified “late in the game,” significantly reducing the time available to convene and collaborate with PHAs, PHLs, and partners.

3.3 Risks

(FUTURE) A risk is any uncertain factor that may occur during the project, which could negatively impact the project's Objectives (scope, cost, schedule, or quality). These are listed to identify mitigation approaches to be considered within the initial project workplan. Subsequent Risk changes would be tracked via a Project Risk Log.

(This is an initial list only; to be maintained in a Risk Log at <URL>)

Risk

Mitigation(s)

Risk

Mitigation(s)

The project team inadvertently makes or maintains barriers to participation, or does not execute on the value that PHAs and PHLs hoped to receive from the project. If this occurs, engagement in the project – and therefore project success - will falter.

 

PHAs and PHLs do not feel informed enough about policy content to participate meaningfully in the project.

 

Political nuances and sensitivities may arise when providing public comment, which may deter the perceived ability and willingness of PHAs, PHLs, and partners to contribute.

Anon comments are possible and common, I planned to educate about that

I do think this is an unmitigated risk for PHA/Ls though, b/c org comments aren’t anon, only individuals.

Disagreement on an approach, tools, and expectations to collaboratively develop comments

 

Opportunities to provide feedback to NPRMs, RFIs, and other policy initiatives may be identified “late in the game,” significantly reducing the time available to convene and collaborate with PHAs, PHLs, and partners.

 

 

 

 

 

 

 

4 SCHEDULE

4.1 Major External Dependencies

A task or deliverable performed by non-project staff that is required by certain times in the project workplan so as not to adversely affect the schedule and/or costs.  These usually are critical to the success of the project.

  • CSTE agreement on approach, trial, location of draft comments

  • PHA/L advisors (resources)

  • Sufficient resources with wide SME brought to post-pilot project ??

4.2 Timeline / Gantt Chart / Schedule

Provide the high-level project schedule or a link or reference to the schedule. This schedule or summary Gantt chart would be a point-in-time schedule, and it would not be maintained in the PMP but maintained separately.

(This is an initial timeline only; to be maintained at <URL>)

Flagging for development - my suspicion is that we’ll need to do the pilot to develop a Gantt, but I’d like feedback on that if I’m wrong! @Brooke Beaulieu

4.3 Executive Milestones (* optional for small projects)

A significant, verifiable event in the life of a project.  These indicate to management whether the project is on track or not. Milestones should be defined here; this document should include the current link to tracking milestones.

Executive Milestone

Estimated Completion Timeframe

Project Phase (Planning, Execution, Monitoring/Control, Closing

Executive Milestone

Estimated Completion Timeframe

Project Phase (Planning, Execution, Monitoring/Control, Closing

Planning and Process Development:

  • Completion and approval of start-up documentation, with input from internal and external partners.

  • Identification of PHA and PHL advisors with time and interest to participate in the Steering Committee.

  • Confirm workflow for content development and approval, with input from internal and external partners,

  • Confluence space set up for review.

  • Official project approval by APHL Management

  • Project kick-off, further socialization with PHAs, PHLs, and partners

  • Confluence access granted for APHL, PHAs, PHLs, partners, CSTE, etc. and security model approved (at minimum so that we can test it and then re-evaluate if it’s provisional.

 

Planning, approval, and preparation:

Planning:

  • coordination with partners, shared decision-making, confluence development and access policies

Approval:

  • leadership, partners

Prepare:

  • Confluence acct setup

 

@Brooke Beaulieu how do these look to you? I pulled out what I thought identified what step these were but am not sure if that’s the intent/need here or not…?

Pilot Project Processes/Workflow:
• Pilot policy review conducted with Steering Committee, identification of pilot policy for comment/engagement.
• Engage with PHAs, PHLs, and partners on Launch (public)
• Develop pilot summary and materials, and work collaboratively to develop comments.
o ID low-stakes trial policy with a long deadline
o Develop draft comments
o Group editing
o Trial notifications
o Trial call interactions
o Trial call summary post-comment submission (both how many folks submitted, main points of comments, dual role as educational and recruitment)
• First official APHL comments submitted under pilot process
• Modifications to processes based on pilot feedback

 

Pilot

Test processes, revise based on feedback and findings, final approval of modified and ready-to execute project

 

Ongoing Project Operations:

  • Production process begins with established and tested procedures, agreed-upon review and security models, and APHL and CSTE support and informed and engaged PHA and PHL advisors

 

Execute

5 PROJECT ORGANIZATION

5.1 Interested Parties, Roles, and Responsibilities

This section describes the persons and roles supporting the project. This list includes internal and external project stakeholders to the project team. 

Name & Organization

Role

Primary Project Responsibilities

Name & Organization

Role

Primary Project Responsibilities

CSTE

Partner

Council of State and Territorial Epidemiologists (CSTE), including mechanisms to build and document PHA consensus on policy, surveillance, and the data modernization initiative (DMI).

Joint Public Health Informatics Taskforce (JPHIT 2.0)

Partner?

 

DMI initiative work

Various

 

APHL Public Policy Program

 

 

ASTHO, NACCHO, PHII, CDC

Additional interested parties that should be informed

Association of State and Territorial Health Officials (ASTHO)

National Association of County and City Health Officials (NACCHO)

Public Health Informatics Institute (PHII), through DMI work

CDC (funding, through DMI, through relationships with CMS, ONC, policymakers)

Steering committee

?

 

?

Crystal

Pilot…. person (PM)

Do the thing

??

Editor

Makes everyone’s life easier

Brooke

 

Approve the thing

Vanessa

 

Review the thing? Promote and publicize with PHAs and PHLs?

Michelle

 

Aware of the thing?

Tom and Mel

PMO

Very tolerant explanations and hand-holding - thank you!

CSTE - Annie

 

Aware of the thing? (I hope/suspect she’ll contribute comments, which would be awesome)

CSTE - Meredith?

 

Aware of the thing?

CSTE - Becky?

 

Promoting and publicizing with PHAs?

CSTE - Gillian, others?

 

Aware?