Server Quality Checklist

Tool Scores

• buscar_documentosA
  3.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden. It only says 'searches' without disclosing return format, matching behavior, side effects, or whether it is read-only. This is insufficient for a tool with no annotation coverage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence that directly conveys the tool's purpose without unnecessary words. It is well-structured and front-loads the action.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has a simple parameter set, an output schema exists, and the description captures the core search intent. It lacks explicit usage guidance and behavioral details, but given the low complexity and presence of an output schema, it is reasonably complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It does by clarifying that 'consulta' is a topic or keyword ('por tópico/palavra-chave'), adding meaning beyond the generic parameter title. However, it does not provide syntax or formatting details.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Busca documentos de referência do FastAPI por tópico/palavra-chave' clearly states the action (search), the resource (FastAPI reference documents), and the method (by topic/keyword). It distinguishes from sibling tools (listar_documentos for listing, obter_documento for retrieval) by focusing on search functionality.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies use when a topic/keyword is available, but it does not explicitly mention when to avoid this tool or suggest alternatives. Sibling tool names hint at alternatives, but the description itself provides no comparative guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• obter_documentoA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the burden of behavioral disclosure. The verb 'Obtém' implies a read-only operation, but the description does not mention potential errors, permissions, or side effects. However, for a simple retrieval tool, this basic transparency is adequate, though it could add more context about failure modes.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence that immediately states the action and object, front-loading the key information without any redundant words. It earns its place with zero waste.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity (one required parameter), the presence of an output schema, and the clear purpose statement, the description is nearly complete. It covers what the tool does and the parameter's role; the output schema handles return values. The only minor gap is lack of explicit guidance on when to prefer this over siblings, already partially addressed in usage guidelines.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate, but it only says 'pelo seu id' which simply restates the parameter name 'id_documento' without adding new meaning. It does not clarify format, constraints, or behavior for invalid ids; the sole parameter's purpose is already evident from its name.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'Obtém' (gets) and the resource 'conteúdo completo de um documento de referência' (complete content of a reference document), clearly distinguishing it from sibling tools like 'buscar_documentos' and 'listar_documentos' which involve searching or listing. The 'pelo seu id' (by its id) further specifies the exact retrieval method.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when you have a specific document id ('pelo seu id'), which clearly differentiates it from searching or listing. It does not explicitly mention alternatives or exclusion criteria, but the id-based retrieval context is clear, meeting the 'clear context, no exclusions' criteria.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• listar_documentosA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. The verb 'list' implies a read-only operation, and 'disponíveis' adds a scoping detail, but the description does not explicitly disclose safety, side effects, or output behavior beyond the inherent meaning of 'list'. It is minimally adequate but not rich.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, clear sentence without any wasted words. It directly states the action and the object.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the zero-parameter complexity and the presence of an output schema, the description is largely complete. It could explicitly mention alternative tools, but that is covered under usage guidelines. The description sufficiently covers the tool's purpose for a simple list operation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and the schema is empty with 100% coverage. Per the baseline rule for 0-parameter tools, a score of 4 is appropriate; the description does not need to elaborate on parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'Lista' (lists) with the resource 'documentos de referência do FastAPI' and the scope 'todos...disponíveis' (all available). This clearly distinguishes it from sibling tools 'buscar_documentos' (search) and 'obter_documento' (get a single document).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage (when you want all available documents), but it does not explicitly state when to use this tool over alternatives. There is no mention of exclusions or when to use 'buscar_documentos' or 'obter_documento' instead.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.