Livia Sannaro

Back to all sessions

Lecture 15

Run the monthly visibility repair routine

EvidenceRepair

Prerequisites: Lectures 1, 2, 4, 5, 7, 9, 10, 13, and 14. You should already know what a large language model does, where public evidence may come from, how to sketch a studio view, why memory and live search answers differ, how names and language variants create confusion, and how source weight, recommendation omission, update lag, and control boundaries shape practical repair work. This final lecture turns those pieces into a routine a small studio can actually repeat.

At the end of a payroll-heavy week, the partner of a small studio opens a plain document called “AI checks.” It is not elegant. There are six rows, two old screenshots, one note about a directory that still refuses to update, and a half-written service sentence copied from the website draft. The partner runs the first query, waits for the answer, and sighs because the model names the studio correctly but still describes it as mostly payroll.

That sigh is where this course ends, because this is the real place where many studios will work. Not with a dashboard full of perfect graphs. Not with secret access to model internals. Just with public evidence, dated checks, a few recurring questions, and enough restraint not to rewrite half the website after one odd answer. The routine has to be small enough to survive invoices, client calls, and the ordinary fatigue of a professional office.

Start with a narrow monthly question set

Monitoring routine is a repeated check recording query, date, engine, answer, source context, issue, correction, and follow-up. The definition is deliberately unglamorous. A routine that sounds clever but takes three hours will be abandoned by a studio that still has deadlines to meet.

Begin with a narrow question set. I usually suggest one branded query, one service query, one local recommendation query, and, where language matters, one Italian-English pair. A branded query might use the studio name and town. A service query might ask for help with recurring accounting or payroll for a small company. A local recommendation query asks for providers in the area without naming the studio. The bilingual pair checks whether Italian and English pull the studio into different frames.

For Composite Object A, the monthly set might include the full studio name, the shortened name that appears in one directory, a query about payroll and accounting in the town, and a broader recommendation query for small companies. For Composite Object B, the set can include an Italian service phrase and an English phrase, because its public evidence appears in both languages. The point is not to cover every possible customer question. The point is to keep the same few doorways visible.

There is a temptation to add more queries every time a strange answer appears. Resist it at first. A routine becomes useful when the studio can compare like with like. If the query keeps changing, the log becomes a drawer full of unrelated receipts. It may contain evidence, but reconciliation becomes painful.

A good monthly set should feel almost too small. That is how it keeps its shape.

Record before interpreting

The first action is not repair. It is recording. Write the date, query, engine, and mode if the mode is visible. Copy the answer or save the answer text. Note whether visible sources were shown. If there are sources, write the ones that seem relevant. If there are no sources, say so instead of inventing a source trail.

Then mark the visible issue in plain language. Wrong address. Narrowed service. Old category. Name split. Borrowed evidence. Omission. Vague but not wrong. This small label prevents a common mistake: treating every uncomfortable answer as the same kind of failure.

A teaching example: the query asks, “commercialista for small company payroll and accounting near Object A’s town.” The answer names Object A, gives the correct address, but says the studio is best known for payslips. The studio could panic and rewrite every page around payroll. A calmer log entry says: “Named correctly; address correct; service narrowed to payroll; visible source mentions payslips twice; website first paragraph mentions accounting later.” That entry points toward a specific repair.

Screenshots may sit beside the text, but they should not replace it. As we saw in Lecture 14, a screenshot without date, query, engine, mode, and source context is a record with most of the bookkeeping torn away. It proves that an answer appeared. It does not explain the answer.

The recording step also protects the studio from mood. Some months the answer looks better. Some months it looks worse. Generated answers have movement in them. A written log slows the office down enough to ask: did the public evidence change, did the query change, did the engine change, or did the same situation merely feel more irritating because the week was already long?

Repair public evidence, not the answer itself

Evidence repair is correcting public facts, wording, and listings so studio evidence becomes clearer and less contradictory. This is the practical center of the course, because the studio has more influence over the public trail than over a generated sentence.

Repair begins with facts. If the address is wrong on a directory, request the edit and record the date. If the website hides the town in a footer image, put the town in ordinary text. If the service page says “administrative and fiscal support” in a way that can cover almost anything, write the actual service scope near the top: recurring accounting, payroll coordination, invoice records, ordinary deadlines for small companies. The sentence does not need to sound grand. It needs edges.

Then repair wording that invites a wrong service frame. Composite Object B shows the risk. Its English page once made the studio sound useful for people starting a business in Italy, while the Italian pages were more focused on recurring accounting after registration. If the monthly check keeps producing “business setup” language, the repair is not to scold the model. The repair is to make the English page say what the studio actually does, and to remove loose phrases that point toward work it does not want to claim.

Directory contradictions deserve their own line in the log. Do not mentally count a directory as repaired because someone sent a request. Until the public source changes, the contradiction still exists. That sounds severe, but it is just clean bookkeeping. A requested correction is an action. A corrected source is evidence.

Review language is slower. The studio should not script clients or ask for confidential details. It can, however, make future review requests more honest and concrete: clients may describe the public kind of help they received, in their own words. Over time, that may make the review signal less lopsided. It is indirect influence, not direct edit.

The repair test is simple: would a careful outsider have an easier time describing the studio accurately after this change? If yes, the repair is probably worthwhile. If the change only tries to trap or flatter AI systems, leave it alone.

Recheck with patience and compare the pattern

After repairs, return to the same query path. Do not expect every answer to change at once. Lecture 13 matters here: update lag can make a real correction look useless before the public trail has caught up. A monthly routine gives the correction time to travel without letting the studio forget what was changed.

The recheck should compare patterns, not isolated moments. Did the old address disappear from branded queries but remain in local recommendations? Did Italian answers improve while English answers still borrow wording from an old public page? Did one engine begin to name the studio while another still omits it? None of these movements is a final verdict. They are signals about where the trail is becoming clearer and where it remains mixed.

A recurrent pattern in small professional-service checks is partial improvement. Object A may move from “omitted” to “named but narrowed.” Object B may move from “merged with a nearby source” to “named correctly in Italian, vague in English.” These are not perfect outcomes, but they are better diagnostic positions. The studio now knows where the remaining work sits.

Here the course anchor earns its keep. Instead of asking whether AI visibility is “good” or “bad,” classify the answer. Does it name the practice? Does it narrow the service? Does it borrow nearby evidence? Does it leave the firm unmentioned? The same classification, repeated monthly, shows movement better than a dramatic screenshot folder.

Patience does not mean waiting forever. If the same wrong directory remains unchanged for months, keep it in the requested edit zone and reduce its influence where possible by strengthening owned evidence. If the same unsupported branch office appears once and then vanishes, do not build a defensive page about a town where the studio has never worked. The routine should make the studio steadier, not more reactive.

Keep the routine small enough to survive

A monthly routine should fit the studio’s real work. I would rather see ten careful minutes repeated than a heroic audit performed once and never opened again. The office habit matters more than the elegance of the document.

One person should own the log, but the whole studio can benefit from the findings. A partner may notice that the service page sounds too broad. A colleague who handles intake may recognize the phrase clients actually use. Someone who manages directory profiles may know which correction request is stuck. The routine becomes a shared evidence conversation, not a private obsession with AI answers.

Keep a modest archive. Save the monthly log, the corrected wording, the request dates, and the visible source changes. Keep private client material out of the archive, because this routine is about public evidence. The studio should not paste private files into AI tools to prove a point. Public visibility work should stay public.

There is also a softer boundary: do not let the routine turn into reputation anxiety. AI answers matter because business owners may use them during first discovery, but they are not the whole relationship. A studio still earns trust through calls, documents, deadlines, and plain explanation. The visibility routine exists to make the public surface less misleading before that relationship begins.

The final habit can be said in one sentence: record the answer, inspect the evidence, repair the public trail, and recheck later with the same question. It sounds almost disappointingly ordinary. That is why I trust it. Ordinary routines are the ones small offices can keep.

What the final routine looks like in practice

Imagine the month closes. Composite Object A runs four checks. The branded query names the studio correctly. The service query still overemphasizes payroll. The local recommendation query names two larger firms and omits Object A. The shortened-name query pulls in the old directory. The log marks three issues: narrowed service, recommendation omission, and directory contradiction.

The studio does not try to fix all of AI. It rewrites the first paragraph of the service page so accounting and payroll sit together. It sends one more directory correction request, with the full name and address. It adds a note to the log that the recommendation omission remains observable, not directly editable. Next month, the same queries will run again.

Composite Object B runs an Italian-English pair. The Italian query describes recurring accounting fairly well. The English query still says business setup help. The repair is focused: the English page receives clearer wording about post-registration accounting support, and an old tourism-facing phrase is removed. The check uses only public wording, not client files. No guarantee is written. The next check will show whether the English path begins to move.

This is the course in miniature. Start from a concrete answer. Build the source trail where possible. Separate fact from inference. Respect language variants. Watch source weight. Accept update lag. Mark the control boundary. Repair what belongs to the studio’s public evidence. Leave the rest documented.

That may not feel dramatic enough for a subject surrounded by dramatic claims. Good. A local accounting studio does not need theater. It needs a way to keep its public evidence readable while doing the work clients already trust it to do.

What matters to remember

Monitoring routine is a repeated check recording query, date, engine, answer, source context, issue, correction, and follow-up.

Evidence repair means improving the public trail: correct facts, clearer wording, consistent names, cleaner listings, and fewer contradictions across sources.

A small repeated query set is more useful than a large unstable one, because comparison needs the same doorways each month.

The repeated classification remains the course anchor: four ways an AI answer reshapes a small accounting studio — names the practice, narrows the service, borrows nearby evidence, or leaves the firm unmentioned.

The routine is not a promise of output control. It is a professional habit for making public evidence easier to read, then watching how answers respond over time.

Check yourself

Describe in your own words what a monthly monitoring routine should record and why each part matters.

A monthly monitoring routine should record the query, date, engine, answer, visible source context, issue, correction, and follow-up. Each part prevents a different kind of confusion. The query shows what was actually asked. The date matters because public evidence and answers can change. The engine and mode help explain variation. The answer text preserves what appeared without relying only on a screenshot. Source context gives clues about where the wording may come from. The issue label turns a vague complaint into a specific problem. The correction and follow-up show whether the studio acted and what should be checked next.

Give an example of a small query set for a local accounting studio and explain why you would keep it limited.

A small query set might include the studio’s full name with the town, a service query such as accounting and payroll support for small companies in the area, a local recommendation query that does not name the studio, and one English version if the studio serves international clients. I would keep it limited because the value comes from comparing the same paths over time. If the studio adds ten new queries every month, it becomes harder to know whether the evidence improved or whether the question simply changed. A small set is less impressive, but more repeatable.

How would you distinguish evidence repair from simply chasing a model output?

Evidence repair improves public facts and wording whether or not one model changes immediately. For example, correcting an old directory address, making the service page clearer, or aligning the Italian and English studio names helps human readers and machine systems at the same time. Chasing a model output is more reactive. It might mean rewriting a page because of one odd answer, adding awkward negative statements, or trying to force phrasing that does not serve clients. The test is whether the change makes the studio’s public evidence more accurate and readable. If it only tries to manipulate one answer, it is probably chasing.

In what situation would the monthly routine give weak guidance, and what should the studio do then?

The routine gives weak guidance when the checks are too inconsistent or the source trail is too hidden to compare. For instance, if the studio changes the query every month, switches engines without noting it, and saves only screenshots, the log will not explain much. It may also be weak when an unsupported claim appears once with no visible source and never repeats. In that case, the studio should avoid a large repair. The better response is to stabilize the query set, improve the recording fields, check visible evidence for obvious confusion, and wait for repeated signals before acting heavily.

How would you explain this final routine to a studio partner who wants faster results?

I would say the routine is slow because the problem is partly documentary, not just technical. AI answers may draw from websites, directories, reviews, copied listings, old snippets, and different language paths. A fast reaction can fix the wrong thing or create stranger wording for human readers. The monthly routine gives the studio a way to act without panic: record the answer, inspect the visible evidence, repair what is public and controllable, and recheck the same query later. It does not promise instant correction, but it does reduce avoidable confusion and gives the studio a clearer record of movement.