How to Vet an Agency's Creator Network
How to evaluate a TikTok Shop agency's creator-network claims: the definitions to pin down, the funnel metrics that matter, and the red flags to watch for.
Every TikTok Shop agency pitch contains a creator network claim. The numbers are large, the logos are impressive, and the claim is almost impossible to falsify from the outside — which is precisely why it is the most inflated statement in the category. A roster is an input. What you are buying is creators who post for your brand, on brief, more than once.
- Network size is an input metric and tells you almost nothing on its own.
- Ask what "in our network" actually means — the definitions vary enormously.
- The metrics that matter are sample-to-post rate and repeat-post rate.
- Category and audience relevance beat raw follower counts every time.
- Ask how they re-engage creators who took a sample and went quiet.
This guide gives you the questions that turn an unfalsifiable claim into something you can actually assess.
Why the number is close to meaningless
Start by asking what membership in the network means. In practice, agencies use the phrase to describe wildly different things:
- Creators in a scraped or licensed database that anyone can buy access to.
- Creators who have ever been contacted, regardless of whether they replied.
- Creators who replied once, at any point, to any campaign.
- Creators who have completed at least one paid or seeded campaign.
- Creators with an active, current relationship and a track record of posting.
Only the last two are worth anything to you, and the difference between the first and the last can be two orders of magnitude. So the first question is never "how many?" — it is "define network." Then: how many meet the strictest version of that definition, and how many of those have posted in the last ninety days?
A capable operator answers precisely and without defensiveness, because they track it. A vague answer is the answer.
The metrics that actually matter
Ask for these four, defined the same way across every agency you are comparing, so the numbers are comparable rather than rhetorical.
1. Acceptance rate
Of creators contacted for a campaign, what share agree to participate? This measures targeting quality and offer strength together. A low rate usually means the outreach is untargeted, the offer is weak, or both. Ask how it is calculated — contacted-to-accepted is a very different denominator from replied-to-accepted.
2. Sample-to-post rate
Of creators who received product, what share actually posted? This is the single most revealing number in creator marketing, because every gap between sample and post is landed product cost you will never recover. It is also the number weak operators are least eager to quote.
Ask what window they measure it over, and what they do about the creators who fall outside it. The answer to the second question — the re-engagement motion — separates a program from a mailing list.
3. Repeat post rate
Of creators who posted once, what share posted again? This is where the economics of creator marketing actually live. Recruiting is the expensive part; the second and third post are where the acquisition cost amortizes. An agency whose model is a continuous stream of first-time creators is running a treadmill and charging you for the running.
4. Content-to-conversion
Of the content produced, what share drove meaningful attributable sales? Expect a skewed distribution — that is normal and honest. What you want to hear is how they identify winners early and what they do with them: more content in that direction, more spend behind that asset, more creators of that archetype.
Relevance beats reach
A network of a hundred thousand creators is worthless if none of them are credible talking about your category. Probe for fit rather than scale:
- Category depth. How many creators in your specific category have they worked with, and how recently? "Beauty" is not a category when your product is a clinical skincare device.
- Audience alignment. Do the audiences match your buyer, or just your general demographic? Ask how they verify this rather than assume it.
- Shop-native behavior. Does the creator actually sell? Some excellent creators have never driven a purchase, because their audience does not come to them to buy.
- Tier mix. A healthy program usually spans sizes. Ask how they decide the mix and what each tier is for — reach, credibility, volume, or conversion.
- Compliance track record. In regulated categories, ask what happens when a creator makes an off-limits claim. There should be a process, not a shrug.
The creator selection scoring framework is a useful reference for what a rigorous qualification process contains — and a good agency should have something structurally similar of their own.
Questions that surface the truth
- Define "in our network." Then ask how many meet the strictest definition.
- How many of those have posted in the last ninety days? Currency matters more than accumulation.
- How do you source creators for a category like ours? Listen for a repeatable method, not a database name.
- What is your sample-to-post rate, and how is it calculated?
- What is your repeat-post rate, and what drives it?
- What do you do when a creator takes a sample and goes quiet? There should be a sequence with steps and timing — the waterfall seeding method is one example of what structured follow-through looks like.
- Who owns the creator relationship? Ask for the contractual answer.
- How do you handle exclusivity and competitor conflicts? Especially relevant if they serve brands adjacent to yours.
- Show me a creator cohort report from a live account. Redacted is fine. You want to see the funnel, including the drop-offs.
- What percentage of creators are recruited fresh for each campaign versus re-activated? A very high fresh-recruit share means the network claim is doing little work.
Red flags
- The headline is roster size. Real operators lead with posting and repeat rates, because those are the numbers that took work.
- They cannot produce a cohort funnel. If sample-to-post is not tracked, it is not managed.
- Every creator is a first-timer. Ask what share of last quarter's posts came from creators who had worked with them before.
- No re-engagement process. Sending samples and hoping is not a program.
- Fit answered with follower counts. Reach is not relevance.
- Vague on relationship ownership. If it is unclear now, it will be a dispute later.
- No compliance answer for your category. Their unpriced risk becomes your brand's exposure.
- Named creators as proof. A creator once posting for a client is not a relationship. Ask how many times, and how recently.
Network claims in regulated categories
If you sell supplements, skincare with active ingredients, medical devices, or anything else with claim restrictions, network size matters even less and process matters far more. A creator who is happy to say whatever converts is a liability, not an asset — one video making a disease claim about a supplement is a brand and compliance problem that outlives the campaign.
What to ask specifically:
- What may a creator not say about a product in our category? You want an immediate, specific answer. For supplements, that means structure-and-function language only, and no claims about treating, preventing, or curing any condition.
- How is that enforced? A brief that lists prohibited claims, a review step before posting where the platform and agreement allow it, and a documented process for taking down or correcting a post that crosses the line.
- What happens on a repeat offense? A partner with volume has had this happen and has a rule. A partner without one will improvise using your brand.
- Are required disclosures handled? Paid-partnership and affiliate disclosure obligations sit with you as much as with the creator.
An agency that recruits well in a regulated category is often slower and narrower than one that does not, because qualification includes willingness to work inside constraints. That is a feature, and it should be visible in how they describe their network.
Verify independently
You do not have to take any of it on faith. Three cheap checks:
- Look at their clients' shops. Public creator content associated with a brand is visible. Is there a steady stream, or a burst followed by silence?
- Ask a reference the right question. Not "were you happy" — ask how many creators posted a second time, and whether the agency ever recommended pausing recruitment to focus on retention.
- Ask for a small paid pilot with defined funnel reporting. One cohort, one category, with acceptance, sample-to-post, and first-week performance reported. It is a fraction of the cost of a bad annual contract, and every honest operator will take it.
What good actually sounds like
A strong answer to "tell me about your creator network" does not begin with a number. It sounds like: here is how we source for your category, here is how we qualify, here is our funnel from contacted to posted to posted-again, here is what we do with the creators who go quiet, here is how we decide who gets a second sample, and here is what we would expect for a brand at your stage — including the parts that usually go wrong.
That answer is harder to give and much more useful to hear. If you want to see how we structure sourcing, seeding, and re-engagement, our affiliate outreach and management page lays out the motion, and the product seeding guide covers the mechanics.
Evaluating a shortlist and want help pressure-testing their creator claims? Talk to a MomentIQ strategist — bring the numbers you have been quoted and we will help you work out what they actually mean. The broader agency selection guide covers the rest of the evaluation.
