Sources Sought: Evaluation-Driven Artificial Intelligence (AI) Development and Delivery Support for Mission-Critical Data Workflows

The Office of Naval Intelligence (ONI) is seeking sources capable of providing support and expertise for the development and delivery of evaluation-driven artificial intelligence (AI) applications and systems. The AI systems should accelerate analyst workflows in areas critical to national security. The contractor will be responsible for providing a phased AI delivery program, including production and delivery, support, and maintenance. The program will involve data collection, model training, and preliminary validation steps to ensure the model's foundational performance is aligned with ONI requirements. Some key aspects of the project include: • Production and delivery of AI systems • Support for the AI delivery program, including integration and testing, training, technical data, and repair and maintenance • Mission-aligned data ingestion, including design and build of data pipelines and data source vetting • Compliance with relevant data security and privacy regulations • Alignment with state-of-the-art methodologies and mission goals The contractor will be expected to provide comprehensive support to the AI delivery program, including establishing a model evaluation score, developing cold-start evaluators, and extending the model to additional mission threads.