Suppose a team is deciding whether to add query rewriting to an internal search system. Record the decision, baseline, and due date on one page. Define observations such as whether short queries retrieve the right document and whether rewriting adds irrelevant results.
Separate three kinds of material
Collect implementation notes, public evaluations, and local observations. Implementation notes explain prerequisites, public evaluations suggest promising conditions, and local evidence shows whether the method fits your data. Record dates, scope, and reading status for each item.
Write a decision record after close reading
Choose two sources whose tasks are closest to yours. Record their inputs, baseline, and evaluation method. Create a decision card with the current recommendation, evidence, reservations, and next experiment. Use Notion Research Documentation to connect the card to the source notes.
Close a gap with local examples
Take a de-identified sample of existing queries and compare results with and without rewriting. Attach the sample scope and observations to the card. Mark questions that need more data and use them to direct the next search.