Public servants provide support for decision makers through synthesis documents such as briefing notes. To develop recommendations for dealing with the problem, they use a variety of sources for research and analysis. This current research seeks to assess opportunities and challenges regarding the use of artificial intelligence (AI) in public sector administration and policy development, focusing on whether AI can serve as a supplement and potential replacement for human policy analysts. The research questions focus on whether AI can plausibly ‘do’ policy analysis, support what human policy analysts currently do, and—based on those assessments—whether academia and governments need to reconsider what it means to teach and undertake policy analysis. This research tests these questions empirically by first creating briefing notes in three categories: AI generated; AI supported; and human created. Two panels of experts made up of retired senior public servants were then asked to judge the briefing notes from the perspective of a senior public sector decision maker (e.g., Deputy Minister) using a heuristic evaluation rubric to grade each note. I report on their evaluations as a basis for assessing whether current NLP technology is capable of generating plausible, persuasive, and useful policy analysis.