informatics-isi-edu / deriva-mcp-ui / 24873832899

90%

push

github

Add per-turn chat_turn audit events with diagnostic mode

  Emit a turn_summary internal SSE event at the end of every chat turn
  (both LLM and RAG-only paths) that server.py intercepts and converts
  into a structured chat_turn audit log entry.

  Always-on fields: session_id, turn, user_id, tools_invoked, rag_triggered,
  rag_document_count, rag_documents, rag_scores, model, response_latency_ms,
  cost_usd. Error key is omitted on success to avoid log-shipper ERROR
  misclassification.

  Diagnostic mode (audit_diagnostic=True) adds: user_query, response_text,
  response_compressed (gzip+base64), tool_inputs, tool_outputs,
  lifetime_cost_usd.

  Add session_id (stable UUID per conversation) and turn_count to Session.
  Surface turn_count in /session-info. Gate response chunk accumulation on
  audit_diagnostic to avoid per-chunk list appends in normal operation.

  Add audit_diagnostic, audit_diagnostic_response_max_chars,
  audit_diagnostic_tool_output_max_chars, and audit_use_syslog config vars.
  Use audit_use_syslog (not app_use_syslog) to initialize the audit logger
  so audit events get a dedicated syslog ident in Docker.

55 of 69 new or added lines in 4 files covered. (79.71%)

1482 of 1631 relevant lines covered (90.86%)

0.91 hits per line