Start by defining what the assistant will not do
The first requirement is not choosing a model, but defining an operational boundary. The assistant can explain approved internal policies, locate rules by topic, summarize procedures, and identify the responsible channel. It should not evaluate candidates, recommend hiring, classify performance, interpret an individual situation as a final decision, or determine disciplinary, pay-related, or employment measures.
That boundary needs to appear in the experience, system instructions, and tests. Questions about vacation, benefits, leave, travel, or reimbursements can receive an informational answer when an applicable rule exists. Questions such as “Can I dismiss this person?” or “What punishment should I apply?” should instead produce clear escalation, without suggesting a decision disguised as a summary.
- Define one list of permitted topics and another list of topics that always require escalation.
- Treat advice about people, exceptions, and conflicts between documents as cases outside the scope.
- Separate policy lookup, request registration, and administrative decision-making into different components.
Sources and references: [2]
Build a governed knowledge base
Answer quality depends more on the document base than on a generic instruction for the model. Gather current policies, manuals, frequently asked questions, and official procedures, but remove drafts, conflicting copies, and materials without a clearly assigned owner. Each document should carry metadata such as owning department, country or region, audience, effective date, version, and access level.
A semantic search approach can locate relevant passages even when the question uses different words from those found in the policy. In a document retrieval implementation, files are split, indexed, and consulted before the answer is synthesized. Filters for region, effective date, and audience are recommended to prevent a rule valid in one context from appearing in another. The practical recommendation is to have the assistant show the policy name, version or date, and passage that supports each answer.
- Maintain one official source for each policy and an explicit process for archiving older versions.
- Use attributes to restrict results by region, effective date, audience, and confidentiality.
- Define behavior when no source exists: state the limitation and escalate, without filling gaps through assumption.
Sources and references: [1]
Design answers that inform without deciding
A useful HR answer should follow a predictable structure. First, restate the question in plain language. Then present the rule found, the relevant conditions, and the permitted next step. Finally, list the source with enough identification for the person to locate the document. This structure reduces vague answers and helps distinguish policy text from any operational guidance.
Avoid requesting unnecessary personal data. For a question about leave, for example, the system can explain the documented criteria and identify the support channel without requesting a diagnosis, medical history, or details about the employment relationship. If a question combines a general lookup with an individual decision, answer only the informational part and mark the second part for escalation.
Escalation should not be a generic message such as “contact HR.” It should identify the question category, responsible channel or team, minimum information required, and what the assistant cannot conclude. Even so, the system should not open an employment action, change a record, or send an external instruction without a separate, authorized action.
- Use output states such as source-based answer, insufficient source, prohibited scope, and escalation.
- Require structured fields for category, sources, operational confidence level, and escalation destination.
- Do not turn an internal relevance score into authorization to make a decision about a person.
Sources and references: [2]
Test behavior before releasing it company-wide
Tests should evaluate the complete flow, not just whether the answer sounds natural. Build cases with direct questions, typing errors, multiple intents, regional policies, conflicting documents, expired versions, requests to ignore rules, and attempts to obtain private data. For each case, define the expected answer, acceptable source, scope classification, and escalation destination.
An evaluation suite should measure retrieval of the correct source, fidelity to the document, clarity of the boundary, choice of escalation, and resistance to instructions inserted into consulted content. Structured comparisons and objective criteria make results more consistent than evaluation based only on impression. Record unanswered questions and retrieval failures to update the knowledge base and tests, without treating each correction as proof that the system will be correct in future situations.
Start with a single flow for search, answer, and escalation. Divide it into multiple agents or add tools only when tests demonstrate a concrete need. More components mean more points to test, especially when an incorrect classification could lead to an improper action.
- Create a collection of cases approved by HR specialists and expand it with anonymized real cases.
- Test sourced answers, refusals, escalations, and attempts to access restricted content separately.
- Monitor documentation changes and repeat evaluations when a policy is replaced.
Sources and references: [3]
Implement with minimum access and clear responsibilities
The assistant should begin as a consultation layer, not as an operator of HR processes. Give each audience access only to the documents it needs, and avoid connecting, in the first version, systems that can change salaries, statuses, evaluations, benefits, or disciplinary records. If support request creation is integrated, limit it to creating a draft or informational request, with controlled fields and no automated decision.
Assign owners for content, product, security, support, and metrics. The owner of each policy should be responsible for its validity and meaning; the technical team should be responsible for retrieval, technical logs, and access controls. It is also important to create a routine for disabling old documents, investigating answers without sources, and reviewing escalation categories.
A hypothetical example: a company has different policies for offices in Brazil and Portugal. Someone asks about the deadline for reporting an absence and adds that they want to know whether a colleague should be warned. The assistant consults the policy for the relevant region, answers only about the documented procedure, cites the version found, and escalates the question about a warning to the responsible team. It does not compare the colleague, recommend punishment, or record an employment decision.
- Choose an initial launch limited to informational questions and escalation channels.
- Define retention, access, and anonymization for conversations that may contain employee data.
- Track metrics for source found, correct escalation, unanswered questions, and out-of-scope requests.
Put it into practice
- Define in writing the permitted topics, prohibited topics, and conditions that require escalation.
- Organize official documents with version, effective date, region, audience, owner, and access level.
- Design an answer containing the rule, conditions, source, boundary, and next step, without deciding about people.
- Create tests for ambiguous questions, conflicting policies, injection attempts, and requests for private data.
- Launch informational lookup first, monitor failures, and update the knowledge base and tests after every relevant change.
Common questions
Can the assistant recommend a dismissal or warning?
No. It can locate and explain an applicable policy, but decisions about employment measures should remain outside the automated flow and be escalated to the responsible channel.
Does every answer need to present a source?
For an internal policy assistant, that should be the operational rule. When no suitable source exists, the system should state the limitation and escalate the question without inventing an answer.
Is it necessary to start with several specialized agents?
No. A simple flow for search, cited answer, and escalation is easier to test. Agent separation should be considered only when evaluations show a concrete need for that separation.
Sources and references
- OpenAI: Retrieval ↗Accessed on September 25, 2026
- OpenAI: Safety in building agents ↗Accessed on September 25, 2026
- OpenAI: Evaluation best practices ↗Accessed on September 25, 2026



