Server Quality Checklist

Tool Scores

• get_2fa_codeC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the tool retrieves a 2FA code, implying a read operation, but lacks details on security implications, rate limits, authentication requirements, or response format. This is a significant gap for a tool handling sensitive data.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's purpose without unnecessary words. It is appropriately sized and front-loaded, making it easy to understand quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool handling sensitive 2FA codes with no annotations and no output schema, the description is incomplete. It lacks critical details like security constraints, error handling, or return value format, leaving gaps in understanding how to use it effectively in context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema fully documents both parameters (username and website). The description adds minimal value beyond the schema, as it only implies the parameters are used for login context without providing additional syntax or format details.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Retrieve') and resource ('current 2FA code for a username'), specifying the context ('when logging into a website'). It distinguishes from sibling tools like get_account_list (lists accounts) and get_password (retrieves passwords), though it doesn't explicitly name them for comparison.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description mentions 'when logging into a website,' which provides some context, but it doesn't offer explicit guidance on when to use this tool versus alternatives like get_password for non-2FA logins or prerequisites. No exclusions or detailed scenarios are provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_account_listC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It states the tool retrieves accounts, implying a read-only operation, but doesn't clarify aspects like authentication requirements, rate limits, data sensitivity, or what 'accounts' entails (e.g., usernames, emails). This leaves key behavioral traits unspecified for a tool handling login-related data.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, straightforward sentence that efficiently conveys the core purpose without unnecessary words. It's appropriately sized for a simple tool, though it could be slightly more structured by front-loading key details more explicitly. There's minimal waste, earning a high score for conciseness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity (1 parameter, no output schema, no annotations), the description is adequate but incomplete. It covers the basic purpose but lacks details on behavioral aspects like security or usage guidelines. Without annotations or output schema, the description should do more to compensate, but it provides a minimal viable explanation, scoring at the threshold of adequacy.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage, with the 'website' parameter fully documented as 'The domain name of the website you need to login, e.g. "github.com".' The description adds no additional parameter semantics beyond this, so it meets the baseline of 3 where the schema does the heavy lifting without compensating for gaps.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Retrieve the accounts can be used when logging into a website.' It specifies the action ('retrieve') and resource ('accounts'), and the context ('when logging into a website') is clear. However, it doesn't explicitly differentiate from sibling tools like get_2fa_code or get_password, which prevents a score of 5.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides minimal guidance by mentioning 'when logging into a website,' which implies usage context but lacks explicit when-to-use rules or alternatives. There's no mention of when to use this tool versus get_2fa_code or get_password, or any prerequisites or exclusions, leaving significant gaps in usage direction.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_passwordC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the tool retrieves a password, implying a read operation, but doesn't cover critical aspects such as authentication requirements, security implications (e.g., if it's stored securely), rate limits, or what happens on failure (e.g., if the password isn't found). This leaves significant gaps for a tool handling sensitive data.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's purpose without unnecessary words. It's front-loaded and wastes no space, making it easy to parse quickly while conveying the essential action.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of handling passwords (sensitive data) and the lack of annotations and output schema, the description is incomplete. It doesn't address security behaviors, error handling, or return values, which are crucial for such a tool. The description alone is insufficient for safe and effective use by an AI agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage, with clear documentation for both parameters ('username' and 'website'), including examples. The description adds no additional parameter semantics beyond what the schema provides, such as format details or constraints. Given the high schema coverage, a baseline score of 3 is appropriate as the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with a specific verb ('Retrieve') and resource ('password for a username'), making it understandable. However, it doesn't explicitly differentiate from sibling tools like 'get_2fa_code' or 'get_account_list', which would require mentioning it's specifically for password retrieval rather than other authentication data or account listings.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a basic context ('when logging into a website'), but it lacks explicit guidance on when to use this tool versus alternatives like 'get_2fa_code' for two-factor codes or 'get_account_list' for listing accounts. There's no mention of prerequisites, exclusions, or specific scenarios, leaving usage unclear relative to siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.