NOVEMBER 2025 9GOVERNMENT CIO OUTLOOKareas of the organization. A policy builds the foundation for organizations to reduce the risks and realize the benefits of generative AI. Getting Started with a Use CaseA small pilot project may be the best starting point to familiarize IT teams and operational users with implementing generative AI and realizing the benefits for a narrow internal use case. There are many opportunities to identify beneficial use cases across functions that require significant amounts of time to research documents, manual compilation or summarization of multiple data sources, call center knowledgebases, language translation, streamlining top document or content searches on an intranet site, or creating a generative AI workflow for multiple step processes that are currently disconnected and slow due to users having to look up information for each step. Training Tech TeamsIt will take time to get technical teams proficient in developing generative AI solutions and get familiar with best practices to train the model. Many vendor partners will assist organizations in getting off of the ground and a small pilot can build the necessary skills and experience to scale a solution once it is developed. A small pilot will provide perspective to evaluate the effectiveness, technology requirements, security, costs, ease-of-use, support needs, maintenance requirements, and scalability of a solution. One of the first things many organizations realize when they do a pilot is that their training data needs to be improved. Stale data, poorly written documents, and poor data quality can result in a generative AI solution that delivers biased, inaccurate, or poor responses. Testing and User TrainingGenerative AI requires a different approach for user testing and training. Traditional IT test scripts usually have clear success criteria and defect reporting. Traditional user training usually follows workflows across specific screens and functions. Training for the use of generative AI is different and is best accomplished through best practices for prompt engineering and familiarizing users with good approaches to get the information that they are looking for. Users also need to know how to validate the information that they receive from the generative AI prompt, usually through hyperlinks to cited sources. When testing a generative AI model there will likely be a diverse approach to how users interact with the prompt even though they are requesting the same information. A feedback mechanism is critical to capture user sentiment when the prompt returns information so that issues can be identified and corrected through iterative testing. Even with consistent user feedback on the effectiveness and performance of a solution there may be situations where multiple users receive the same response, but one will rate it as performing well and another may rate it as performing poorly.Scaling Up and Operational SupportLike any new technology implementation, introducing a new generative AI solution will require ongoing maintenance and support resources to keep the solution current, effective, secure, and supported. An effective pilot project may generate additional demand for similar use cases from other business functions. The information from the pilot project on the effectiveness, technology requirements, security, costs, ease-of-use, support needs, and maintenance requirements will be important in scaling up the solution further with the appropriate resources and budget to support it. It is likely that generative AI technology will continue to evolve rapidly, but one thing that we can be sure of is that it is here to stay and will likely introduce significant benefits and disruption to traditional public sector services in the future. Like any new technology implementation, introducing a new generative AI solution will require ongoing maintenance and support resources to keep the solution current, effective, secure, and supported.
< Page 8 | Page 10 >