DSD Closed Large Language Model

The City of Austin is seeking a vendor to provide a closed large language model (LLM) solution to support staff and the broader community in accessing accurate information related to development regulations and processes. The solution should utilize specific data sources, such as land development codes and city ordinances, to provide efficient and accurate responses to inquiries. The contract will be for an initial term of 12 months, with the option to extend for up to two additional 12-month periods. The vendor will be required to provide a high-level solution design, training and testing, role-based access control, and reporting. The City will provide source grounding source data and resources, and participate in testing and implementation. • The solution should be able to access, accurately interpret, and synthesize data from various resources. • The solution should be able to perform natural language processing and provide accurate and reliable responses. • The solution should be secure and protect personally identifiable information (PII). • The solution should be accessible and provide a quality user experience. • The vendor should have experience in delivering enterprise AI/LLM systems for government or regulated entities. • The vendor should provide a documented information security program and incident response plan.