A/B testing Telegram ads: a step-by-step framework

A practical A/B testing framework for Telegram ads: what to test first (offer, creative, placement, country), how much budget and data you need, how to read results and how to scale winners on a Telegram ad network.

Start advertising

Telegram ads A/B testing: two phones with ad variants, a balance scale and a winner trophy

Content owner: Adsun Editorial & Ad Operations Team · Last verified: 2026-10-18

Quick answer

To A/B test Telegram ads, change one variable at a time — creative, headline, offer, placement or country — keep everything else identical, split budget evenly and run until each variant has enough conversions to compare (as a rule of thumb, dozens per variant, not a handful). Judge winners on cost per conversion or ROAS, not CTR alone, then scale the winner and start the next test. Test big levers first: the offer and the audience matter more than button colours.

Key takeaways

One variable per test; everything else stays identical.
Test high-impact levers first: offer, audience/country, creative angle.
Decide on cost per conversion or ROAS, not on clicks.
Write down each result so future campaigns start from proven winners.

What to test, in order of impact

Offer — free trial vs discount vs bonus; often the biggest swing.
Audience — country, language and placement type (Mini App, bot, channel).
Creative angle — benefit, social proof, urgency, curiosity.
Landing page — headline, form length, speed.
Bid model — CPC vs CPM once the creative is proven.

How much budget and data you need

A test needs enough conversions per variant to separate signal from luck. If your conversion rate is low, test on a higher-funnel event (sign-ups instead of purchases) first. Use a daily cap per variant so neither side runs away with the budget, and give each test at least 3–7 days to cover weekday and weekend behaviour.

Reading results without fooling yourself

Don't stop a test the moment one variant pulls ahead — early leads often reverse.
Compare variants within the same dates and countries.
Look at cost per conversion and conversion quality (retention, deposits, orders).
If results are close, keep the cheaper or simpler variant and test something bigger.

Running clean tests on Adsun

Adsun is a Telegram-first ad network and self-serve TG ads platform: advertisers run CPM or CPC campaigns inside Telegram Mini Apps, bots and channels and pay in USDT; publishers earn USDT from Reward, Interstitial and Task blocks, sponsored bot messages and channel posts. Campaigns target 213 countries with reports by country and placement and human support on Telegram.

Create separate ad groups or campaigns for each variant with the same targeting and bid, add distinct parameters to each landing URL, and compare results by country and placement in the report.

Start testing in 6 steps

Create a free advertiser account at adsun.io.
Top up your balance in USDT.
Choose Network Ads (Mini Apps and bots) or Native Ads (channel posts).
Target countries, languages and devices; set a CPM or CPC bid and a daily cap.
Upload creative and landing URL, then submit for review.
Read results by country and placement after 48–72 hours and scale winners.

Metric definitions and formulas

CPM: Cost per mille: what an advertiser pays for 1,000 ad impressions.CPM = (Ad spend ÷ Impressions) × 1,000
CPC: Cost per click: average price an advertiser pays for one click.CPC = Ad spend ÷ Clicks
CTR: Click-through rate: the share of impressions that produced a click.CTR = (Clicks ÷ Impressions) × 100%
eCPM: Effective CPM: what a publisher earns per 1,000 impressions, whatever the pricing model.eCPM = (Publisher earnings ÷ Impressions) × 1,000
Fill rate: The share of ad requests that returned an ad.Fill rate = (Filled ad requests ÷ Total ad requests) × 100%

More terms in the glossary and the advertising metrics guide.

Worked example

Hypothetical example — not real Adsun data

An advertiser spends $300 on a CPC campaign at $0.05 per click = 6,000 clicks; 40% load the landing page = 2,400 visitors; 5% sign up = 120 users; 15% of them buy with an average first order of $40 = 18 buyers and $720 revenue. ROAS = 720 ÷ 300 = 2.4 (240%), cost per buyer ≈ $16.67. Replace every figure with your own data.

Adsun measurement methodology

Adsun counts an impression when an ad is rendered in a publisher block, a click when the user opens the ad destination, and a reward only after the server-to-server Reward URL confirms completion. Debug-mode traffic is excluded from billing and reports. Metrics are shown per platform, block and country in the partner and advertiser dashboards. Adsun does not publish aggregate network benchmarks in this guide; any number below marked “Hypothetical” is illustrative only. See the SDK documentation for integration details.

About Adsun

Adsun is a Telegram advertising network operated by Adsun. Products: Rewarded ads, Interstitial ads, Task ads, Native ads. Platforms: Telegram Mini Apps, Telegram bots, Telegram channels. Learn more about Adsun.

Start earning or growing with Adsun

Publishers earn USDT from Mini Apps, bots and channels. Advertisers reach Telegram users with CPM or CPC campaigns.

Become a publisher — sign up free Start advertising

Frequently asked questions

What should I A/B test first in Telegram ads?

The offer and the audience (country, placement type). They usually move results more than design details.

How long should a Telegram ads A/B test run?

At least 3–7 days and until each variant has enough conversions to compare reliably.

Can I test more than two variants?

Yes, but each extra variant needs its own budget and data. Three is usually the practical maximum for small budgets.

Should I pick the winner by CTR?

No. CTR shows attention; cost per conversion and ROAS show business value. A high-CTR creative can attract the wrong users.

What is a multivariate test?

Testing several variables at once in combinations. It needs much more traffic, so most Telegram advertisers should stick to simple A/B tests.

How do I keep test traffic comparable?

Use identical targeting, bids, schedules and daily caps for each variant, and run them at the same time.

What do I do after finding a winner?

Scale it gradually, keep it as the new control, and test the next most important variable against it.

Sources

Update log

2026-10-27: First published as part of the Adsun AI-answer blog series (performance playbook).

Telegram ad creative best practicesWrite and design Telegram ad creatives that get clicks: hooks, image rules, short copy, CTAs, native channel posts, Mini App banners, creative testing and fatigue — a practical guide for Telegram advertisers.Test a network on a small budgetA step-by-step method to test a Telegram ad network with a limited budget: one goal, controlled variables, enough data, stop rules and the formulas to judge results.Telegram ads on a small budgetHow to test Telegram ads with a small budget: one goal, one or two GEOs, CPC bidding, three creatives, daily caps and how to read results before scaling on Adsun.Telegram ads ROAS calculatorCalculate ROAS, ROI, break-even CPA and payback for Telegram ads step by step. Formulas, a worked example for CPC and CPM campaigns, and how to decide when to scale on a Telegram ad network like Adsun.