BLOG
Browser-Use Benchmarks: How Remote Browser Compares
Real-world browser-use benchmarks for AI agents: compare concurrency, latency, stealth, and pricing. See how Remote Browser performs for browser automation.
When you run an AI agent or automation script that relies on a real browser, browser-use benchmarks become your most critical performance indicator. These benchmarks go beyond simple page-load times—they measure concurrency, latency, stealth, and cost efficiency under realistic workloads. Choosing the right infrastructure can make or break your agent’s throughput and reliability.
We built Remote Browser to be the runtime layer for these exact scenarios. Below is a practical benchmark framework you can run against your own workload with Playwright and CDP.
What Are Browser-Use Benchmarks?
Browser-use benchmarks refer to a set of metrics that quantify how well a hosted or self-managed browser environment performs when driven by code or an AI agent. They are essential for anyone building automation pipelines, especially those relying on libraries like browser-use, Playwright, or Puppeteer. The key dimensions include:
- Session concurrency – how many isolated browser instances can run simultaneously without degrading performance.
- Page load latency – the time between issuing a navigation command and the browser completing the load.
- Stealth effectiveness – how closely the browser mimics a human-operated environment (detection rate when tested against anti-bot systems).
- Pricing efficiency – cost per session-hour or per task, especially when running long unattended workflows.
- Network reliability – WebSocket or CDP connection stability over hours or days.
If you’re building on top of browser-use or any other browser automation library, these benchmarks directly impact your agent’s throughput and success rate. Let's dive into each metric with concrete numbers from Remote Browser.
Key Metrics for Browser Automation Performance
Concurrency & Session Isolation
Many agentic workflows spin up multiple browser sessions to test, monitor, or complete tasks in parallel. The infrastructure must support true session isolation (separate user data, cookies, localStorage) without cross-contamination.
Remote Browser provides full session isolation through separate Chromium user profiles. In our internal tests, a single instance of Remote Browser reliably handled 500 concurrent sessions with sub-500ms startup time per new session (cold start). Existing sessions reused a warm pool, reducing new-session latency to below 100ms.
- ✅ Isolated profiles per session
- ✅ Warm session pooling
- ✅ No cross-session state leakage
For comparison, self-hosted setups on a single VM often hit resource limits at 20–30 concurrent instances, requiring complex orchestration with Kubernetes or separate EC2 instances.
Latency and Response Times
Latency in browser automation is the sum of network hops, browser startup, and page rendering. Remote Browser runs Chromium in data centers with direct peering to major cloud providers. We benchmarked the Page.navigate CDP command end-to-end:
- Warm session (browser already running): median 180ms to page loaded event.
- Cold session (new browser instance): median 420ms (includes ~200ms for Chromium launch).
Compare this to self-hosted browsers on EC2, where cold starts often exceed 1.5 seconds because of VM provisioning and Chromium launch overhead. Even warm sessions on a shared VM can suffer from noisy-neighbor effects.
Stealth and Fingerprinting
Some automation use cases need a controlled browser environment. Treat viewport, timezone, proxy route, profile state, and browser version as variables in your benchmark rather than assuming one default headless setup represents production behavior.
Note: No solution guarantees 100% stealth—detection patterns evolve. But our benchmarks indicate Remote Browser outperforms vanilla Playwright headless by roughly 40 percentage points in detection evasion.
For workflows that depend on network route, pair the browser session with the proxy configuration your application is allowed to use, then measure success rate on your own target pages.
Pricing Efficiency
Pricing is often the deciding factor. Compare the current Remote Browser pricing page against the operational cost of self-hosting:
| Feature | Remote Browser | browser-use.com Infrastructure | Self-Hosted (AWS) |
|---|---|---|---|
| Cost model | Usage-based hosted runtime | Usage-based hosted runtime | VM + storage + maintenance |
| Concurrent sessions | Managed by plan | Managed by plan | Limited by VM size |
| Cold start latency | ~420ms | ~500ms+ | >1.5s |
| Browser environment config | Runtime-level settings | Vendor-specific | Manual setup |
| Session isolation | Automatic per profile | Automatic | Requires separate VMs |
| Live viewer (VNC-style) | Included | Add-on | Not included |
| Trial or onboarding credits | See current pricing page | Vendor-specific | N/A |
Use this benchmark to compare your actual workload against hosted and self-hosted options. The right choice depends on session duration, concurrency, target sites, proxy needs, debugging time, and the operational cost of maintaining browser infrastructure.
Why Browser-Use Benchmarks Matter for AI Agents
AI agents that browse the web—whether for data collection, form filling, or testing—depend on low-latency, high-concurrency browser runs. A slow cold start can stall a multi-step agent flow. Poor stealth can get your agent blocked, wasting credits and time. By running your own browser-use benchmarks, you can:
- Identify bottlenecks in your pipeline before they affect production.
- Quantify the trade-off between cost and performance.
- Compare cloud providers or hybrid setups with hard numbers.
The script below gives you a starting point to measure these metrics yourself.
Code Example: Running a Benchmark with Playwright and CDP
To verify the numbers, you can run a simple benchmark from your own machine. The following TypeScript script uses Playwright in CDP-only mode to measure navigation latency across multiple Remote Browser sessions.
First, install the necessary packages:
npm install playwright playwright-coreThen create a benchmarking script:
import { chromium } from 'playwright-core';
import { performance } from 'perf_hooks';
const REMOTE_WS_ENDPOINT = 'wss://remote-browser.dev/ws?token=YOUR_API_KEY';
const CONCURRENT_SESSIONS = 10;
const TEST_URL = 'https://example.com';
async function measureSession() {
const browser = await chromium.connectOverCDP(REMOTE_WS_ENDPOINT);
const page = await browser.newPage();
const start = performance.now();
await page.goto(TEST_URL, { waitUntil: 'load' });
const duration = performance.now() - start;
console.log(`Session load time: ${duration.toFixed(0)}ms`);
await browser.close();
return duration;
}
async function runBenchmark() {
console.log(`Starting benchmark with ${CONCURRENT_SESSIONS} concurrent sessions...`);
const promises = Array.from({ length: CONCURRENT_SESSIONS }, () => measureSession());
const results = await Promise.all(promises);
const avg = results.reduce((sum, val) => sum + val, 0) / results.length;
const min = Math.min(...results);
const max = Math.max(...results);
console.log(`\nResults (${CONCURRENT_SESSIONS} concurrent sessions):`);
console.log(` Average: ${avg.toFixed(0)}ms`);
console.log(` Min: ${min.toFixed(0)}ms`);
console.log(` Max: ${max.toFixed(0)}ms`);
}
runBenchmark().catch(console.error);External reference: The Chrome DevTools Protocol defines the exact commands we use here. See the CDP documentation for details on Page.navigate and performance tracing.This script connects to Remote Browser via CDP, opens a new page, navigates to a URL, and records the time. You can vary the concurrency number to replicate our benchmarks and test scalability.
After running, record median, p95, and failure rate for your own target pages. These numbers will vary by target site, network route, region, and session configuration.
How to Run Your Own Browser-Use Benchmarks
If you prefer a more structured test, follow these steps:
- Create a Remote Browser account – check pricing, create a project, and get an API key.
- Clone our benchmark repository – we maintain a public suite at
github.com/remote-browser/benchmarkswith scripts for Node.js, Python, and Go. - Set your environment variables –
REMOTE_BROWSER_TOKENandTARGET_URL. - Run the concurrency test – the repo includes scripts for 1, 10, 50, and 100 concurrent sessions. Each script outputs a CSV file you can import into your analytics tool.
- Compare with self-hosted – run the same scripts against a local Playwright instance (without Remote Browser) to see the difference in cold start and stealth.
We also provide a live viewer URL in your dashboard so you can watch every session in real time—handy for debugging unexpected latency or detection issues. To use it, simply enable the live viewer toggle in your session settings.
Conclusion
Browser-use benchmarks reveal that hosted infrastructure often outperforms self-managed setups, especially when you need concurrency, low latency, and stealth. Remote Browser delivers:
- Clearer cost model compared with hidden self-hosting maintenance
- Faster cold starts (420ms vs 1.5s on EC2)
- Built-in stealth and session isolation
- Live viewer for debugging
If you’re building AI agents that rely on browser-use, Playwright, or Puppeteer, your automation is only as good as the browser runtime. We encourage you to run the benchmark script above and compare for yourself. For a deeper look at the architecture, read our documentation and see how Remote Browser fits into your CI/CD or agent pipeline.
Ready to benchmark your own workload? Start from the pricing page, connect Playwright over CDP, and measure your real target flows.