Audit AB Tasty feature tests and web campaigns

AB Tasty splits its tests between feature tests that have an MCP server and web campaigns reachable through the API, and this guide covers both paths.

How it works

  1. Connect AB Tasty's MCP server to your AI assistant or coding agent following the @abtasty/mcp-server setup, or paste a web campaign plan into the chat.
  2. Install the ExpLint MCP at https://explint.com/mcp to enable your agent to audit tests.
  3. Run the prompt below to audit these plans before the work starts.

How the check runs

  1. It collects the plan from the MCP server, the API, or your paste, names the path it used, then shapes the text into hypothesis, versions, audience, traffic split, main goal, and guardrails.
  2. It sends that text to ExpLint with explint__lint, which returns errors, warnings, and passes, each finding naming the rule behind it.
  3. You update the test in AB Tasty, bring the plan back the same way, and ask for a second lint that ties any remaining finding to the setup step behind it.

Copy and paste this prompt

Change the words in square brackets to name your own project, board, or test.

Prompt for your assistant
Here is a test plan from AB Tasty, from its MCP server, its API, or pasted below. Repeat it back headed hypothesis, versions and what each changes, audience, traffic split, main goal, guardrail goals, and run time, and say which headings are empty. Lint it with explint.com against [your ExpLint project name]. Show each error and warning and the words that caused it. Do not launch anything or invent numbers. Suggest fixes and lint again on my updated plan. Plan: [paste or name the AB Tasty test]

What ExpLint looks for

ExpLint ships over 24 rules, and a project switches each one on or off or rewrites it in plain English. These are the rules the plans this guide reads break most often. An error means the test cannot answer its question as written, and a warning means the result will be hard to judge when it comes in.

RuleLevelIn plain words
hypothesis/names-metric-and-directionerrorThe test has to name its main goal and the direction it expects, since AB Tasty records the goal as a setting and the plan is where the expectation goes.
variants/control-is-describederrorThe plan should say what visitors see today before it describes the variation, or a reader cannot tell what the test is measuring against.
randomization/states-the-spliterrorA traffic split set in the campaign still belongs in the plan text, because the reader judging the run length needs to see the share.
decision/has-criteria-before-launcherrorThe plan should record what result would ship the variation and what result would send it back, before the campaign collects its first visitor.

Read more

Portrait of Kameron Tanseli

Kameron Tanseli

Founder, ExpLint

Kameron Tanseli is the founder of ExpLint and a growth engineer who has run more than 1,500 experiments across a nine-year career. As the founding growth hire at Fyxer he launched 540 experiments in a year while the company grew from $1M to $35M in annual revenue, and he now runs growth engineering at FLORA, where a one-person team ships six to eight experiments a week.

Don’t let a bad test make it to production

Install the MCP and start flagging ticket slop before it reaches your users