Skip to content

dimagi-internal/ace / skills/solicitation-google-form-qa

solicitation-google-form-qa

Verified

Pass/fail check of a solicitation's public Google Form against the live call.

Solicitation Google Form QA

Structural checks on the form solicitation-google-form made. Binary verdict: pass / fail / incomplete. 8 static checks, run by scripts/qa-run.ts over checks.ts.

It checks the LIVE form and an anonymous fetch, not just the record, because the record says what the producer meant to make and only the live reads say what a respondent meets. A form is public, so a defect here is already in front of people. There is no -eval: the form is a mirror of the solicitation, whose quality solicitation-create-eval grades. See skills/_qa-template.md for the shared QA contract.

Inputs

ParameterUsed forResolver
recordsolicitation-google-form_record.md frontmatterexplicit file id; default: the run's 8-solicitation-management/ folder
solicitationlive get_solicitation (is_public, questions)read live from record.solicitation_id
formlive get_google_form_definition({formId})read live from record.form_id
anonymous_http_statuscurl -s -o /dev/null -w '%{http_code}' '<responder_url>', no cookiesmeasured at QA time
deny_listthe opp's deny list (inputs/confidentiality.yaml llo_facing_deny_list: plus brief/PDD instructions)same resolver as the producer; [] when none is declared
run_products_google_formrun_state phases.solicitation-management.products.solicitation.google_formrun_state when a run is bound; null when none is

Products

  • 8-solicitation-management/solicitation-google-form-qa_result.yaml, the QA result per lib/qa-types.ts. Outside a run, return it inline.

Checks

#idtypedescriptionauto-fix on fail
1record_completestaticRecord carries form_id, edit_url, responder_url, solicitation_id and a non-empty question_maprewrite the record from the create result
2every_question_mirroredstaticquestion_map covers exactly the live solicitation's question ids plus the three identity itemsrebuild the form (new name) from the current call
3form_items_carry_refsstaticThe live form's items carry unique [ref: …] lines that match question_maprestore the edited item, or rebuild
4banner_when_privatestaticA private call's form description starts with the demonstration bannerrestore the banner
5no_deny_listed_partystaticNo respondent-facing text on the live form names a deny-listed partyedit the form now, then the call
6responder_link_openstaticAn anonymous fetch of the responder link returns 200, unless the form is closedforms_set_publish_settings with anyoneWithLinkCanRespond: true
7products_recordedstaticrun_state google_form matches the record (skipped when no run is bound)rewrite the products block
8imports_uniquestaticNo form response or labs response appears twice in importeddelete the duplicate labs response, fix the record

Process

  1. Read the record frontmatter, then get_solicitation, get_google_form_definition and the anonymous fetch (§ Inputs). Inside a run, read the products block; outside one, use null.

  2. Write the six inputs as one JSON evidence bundle (shape documented at the top of checks.ts) to a local file.

  3. Run the checks:

    ACE_ROOT="${CLAUDE_PLUGIN_ROOT:-$(python3 -c "import json,os; d=json.load(open(os.path.expanduser('~/.claude/plugins/installed_plugins.json'))); print(d['plugins']['ace@ace'][0]['installPath'])")}"
    node "$ACE_ROOT/node_modules/tsx/dist/cli.mjs" "$ACE_ROOT/scripts/qa-run.ts" \
      --skill solicitation-google-form-qa --artifact <bundle.json> \
      --target <opp>/<run-id> \
      --capture-path 8-solicitation-management/solicitation-google-form_record.md
    
  4. Write the result through the shared writer, never by hand. Put one outcome per check ({check, type: "static", result: {pass, detail, auto_fix_hint}}) in a local outcomes.json, then:

    node "$ACE_ROOT/node_modules/tsx/dist/cli.mjs" "$ACE_ROOT/scripts/qa-result.ts" write \
      --skill solicitation-google-form-qa --target <opp>/<run-id> \
      --capture-path 8-solicitation-management/solicitation-google-form_record.md \
      --outcomes outcomes.json --out <local result.yaml>
    

    Upload that file to § Products. A hand-written shape is refused by the ace-gdrive write guard (skills/_qa-template.md § QA result YAML contract).

  5. On fail, a check 5 or check 6 failure is urgent: the form is public. Fix it before anything else.

  6. A record that does not exist is incomplete, not fail: there is no form to check.

MCP Tools Used

  • ace-gdrive: drive_read_file, get_google_form_definition, drive_create_file
  • connect-labs: get_solicitation

Mode Behavior

Same in every mode: read, check, write the result. It never changes the form.

Change Log

DateChangeAuthor
2026-10-18Initial version (optional-track PR5b): 8 checks over the live form, an anonymous fetch and the recordACE (optional labs E2E)
finishing-a-development-branchobra/superpowersUse when implementation is complete, all tests pass, and you need to decide how to integrate the workStars: 319kUpdated Claude CodeCodexVerifiedInstall
systematic-debuggingobra/superpowersUse when encountering any bug, test failure, or unexpected behavior, before proposing fixesStars: 319kUpdated Claude CodeCodexVerifiedInstall
test-driven-developmentobra/superpowersUse when implementing any feature or bugfix, before writing implementation codeStars: 319kUpdated Claude CodeCodexVerifiedInstall
skill-creatoranthropics/skillsCreate new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.Stars: 196kUpdated Claude CodeCodexVerifiedInstall