PII canary tests across repository traces and agent memory
Engineering teams using coding agents to investigate customer incidents should test durable workflow artifacts as well as model inputs. Custodian Labs places PII handling before the model call, while Sepo writes exchanges into issues, pull requests, comments, and an agent/memory branch. The Qwen pilot also found clearer implementations when privacy requirements distinguished received, stored, logged, and disclosed fields. Together, these sources indicate that a model gateway can protect the call while raw data remains in the repository record or transformed data is later copied into memory.
Add stable synthetic canaries to a test issue, run the answer–implementation–review workflow, and scan the issue thread, progress comments, pull-request diff, logs, model request, and memory branch. The transformation map should remain outside the repository, and the report should identify the first surface on which each canary was masked or replaced. This inexpensive end-to-end check would show whether the control covers the actual workflow rather than only the provider boundary.