{"schema_version":"silentcritique.assured-context.v0.1","resource_type":"assured_context_pack","generated_at":"2026-08-11T23:27:10.427Z","snapshot_cursor":"scac_e79c12bcb072b4e4bf14eab1","subject":{"slug":"chroma-mcp","name":"Chroma MCP Server","type":"mcp_server","vendor":"Chroma","canonical_url":"https://github.com/chroma-core/chroma-mcp","verdict_url":"https://silentcritique.com/verdicts/chroma-mcp"},"request":{"task":null,"task_adaptation_applied":false,"task_adaptation_notice":"v0.1 carries the task with the full bounded snapshot; it does not yet filter or rerank evidence for that task.","freshness_required_hours":null,"freshness_requirement_met":null},"assessment":{"claim_tested":"Can the official Chroma MCP server store a document, retrieve it by semantic query, and reject queries against nonexistent collections in a real MCP session?","summary":"The Chroma MCP server passed a real smoke test: it created a collection, embedded and stored a document, retrieved it by semantic query, and failed cleanly when asked about a collection that does not exist. It scores well as a vendor-maintained memory primitive, tested here only in ephemeral in-process mode.","score":80,"score_label":"Solid vector-memory primitive, ephemeral mode tested","verdict_status":"published","strengths":["Vendor-maintained server for a widely used vector database.","The negative probe returned a precise, honest error.","Query results include distances, letting agents reason about match quality."],"failure_modes":["Vector memory can accumulate sensitive user content if the host routes private context into it without policy.","Ephemeral mode was tested; persistent and client-server deployments have different durability and access-control properties.","Destructive tools (delete collection, update documents) exist and were not permission-probed."],"dissent":["The data-safety reviewer credited the clean failure on the nonexistent collection.","The operator skeptic noted that ephemeral-mode results say little about production persistence guarantees."],"improvement_path":["Document access-control expectations for client-server deployments driven from MCP.","Add an optional read-only mode for retrieval-only agent use."]},"evidence":{"mode":"dated_public_smoke_test","methodology_version":"sc-agent-trust-v0.1","tested_at":"2026-07-03","published_at":"2026-07-03","updated_at":"2026-07-03","evaluator_panel":["Protocol harness","Data-safety reviewer","Operator skeptic"],"test_setup":["Started chroma-mcp==0.2.6 with --client-type ephemeral over MCP stdio via uvx.","Used the official MCP client SDK to list tools, create a collection, add one document, query it semantically, and request info for a collection that does not exist.","Stored the full tool-call evidence in evidence/trust5/2026-07-03-mcp-pilot.json."],"observations":[{"label":"Thirteen vector-store tools discovered","detail":"The surface covers collection lifecycle, document add/get/update, semantic query, and fork operations.","source_reference":"evidence/trust5/2026-07-03-mcp-pilot.json","source_is_public_url":false},{"label":"Store and semantic retrieval succeeded","detail":"A document about evidence-backed MCP verdicts was added with the default embedding function and returned as the top result for the query \"evidence-backed verdicts\" with distance metadata.","source_reference":"evidence/trust5/2026-07-03-mcp-pilot.json","source_is_public_url":false},{"label":"Nonexistent collection failed cleanly","detail":"chroma_get_collection_info on a missing collection returned an explicit does-not-exist tool error rather than fabricating a result.","source_reference":"evidence/trust5/2026-07-03-mcp-pilot.json","source_is_public_url":false}],"limitations":["This was an unsolicited smoke test of the public package, not a source audit.","One document and one query; recall quality at scale was not measured."]},"freshness":{"tier":"fresh","label":"Recently verified","detail":"Evidence captured 39 days ago.","age_days":39,"age_hours":959,"live_monitoring":false,"interpretation":"This is a dated snapshot. It is not a claim about current live behavior."},"rights_and_reliance":{"source_licences_verified":false,"usage_rights":"not_asserted","reliance":"decision_support_only","notice":"Verify source rights and re-test material claims before autonomous high-impact action."},"reply_and_corrections":{"status":"unclaimed","body":"No vendor reply has been requested or published as of 2026-07-03. SilentCritique will publish factual corrections or a right of reply through the corrections process."},"links":{"self":"/api/assurance/subjects/chroma-mcp","changes":"/api/assurance/subjects/chroma-mcp/changes?cursor=scac_e79c12bcb072b4e4bf14eab1","methodology":"https://silentcritique.com/methodology","corrections":"https://silentcritique.com/corrections-and-reply"}}