Questions we get asked. Real answers.
Most of these come up on demo calls. We've collected the patterns here so you can scan before you book. If we missed yours, drop us a line.
What it is
What is Evaluat?
Evaluat is a real-browser performance testing platform. Every virtual user runs in its own isolated browser instance, so you capture Core Web Vitals and Navigation Timing under load, plus full session video, network logs, and console logs for every user.
Is Evaluat open source?
No. Evaluat is a hosted commercial platform. Over time we may open-source individual tools, like a Core Web Vitals exporter or the scenario format spec, but the core platform stays closed.
What does it cost?
Plans are sized by virtual user-minutes. Tell us roughly on a demo call, and we'll point you at the right tier. See the pricing page for the plan structure.
Versus other tools
How does Evaluat differ from k6?
k6 sends HTTP requests and measures how fast your server responds. Evaluat runs real browsers and measures what users actually see: LCP, INP, CLS, plus the full network and console for every session. Use k6 for API load tests. Use Evaluat for the customer-facing parts of your app. Full comparison.
How does it compare to JMeter?
JMeter is a Java GUI-driven HTTP and multi-protocol load tester. It can't render a page. Evaluat runs real browsers and captures Web Vitals. Use JMeter for protocol-level testing (JDBC, JMS, SOAP, FTP). Use Evaluat for the browser-side of your testing. Full comparison.
Does Evaluat do API testing?
No. Evaluat tests user-facing applications. If you need to load test a REST or gRPC endpoint, k6 or JMeter is the right tool.
Can it replace my existing load testing tool?
For the customer-facing parts of your app, yes. For pure API and protocol-level testing, no. Keep k6 or JMeter for those and run Evaluat alongside them. Most customers do exactly that.
The product
What browsers does Evaluat use?
Chromium-based browsers, the same engine your customers run as Chrome and Edge. Tell us on the demo call if you have a specific Firefox or WebKit requirement.
Which regions can I run tests from?
EU-West (London) and EU-Central (Frankfurt) are live today. Tell us what region you need on the demo call. We add regions when customers ask.
Can I emulate mobile devices?
Mobile viewport sizing is configurable today. Full device emulation (touch events, device pixel ratio, user agent spoofing) is on the roadmap. Ask on the demo call.
Can I run tests from CI?
CI integration is the headline feature of Testing Suite, which is coming soon. Today, Performance Tests run from the UI. Join the Testing Suite waitlist if CI is critical for you.
The reports
What's in a test report?
Five views: Overview (aggregate Web Vitals, time-series), URL performance (every URL with its own metrics), Sessions (every virtual user, individually addressable, with video), Console logs (deduplicated and counted), Network logs (every HTTP request, searchable across millions). More on reports.
Can I share a report with someone outside my team?
Yes. Every report has a shareable read-only URL. No login required to view it. Useful for sharing with customers, contractors, or stakeholders.
How long are reports retained?
30 days on Starter, 12 months on Growth, 3 years on Scale. Configurable on request.
Can I export the raw data?
Yes. Aggregated metrics export as CSV from every report view. Raw HAR network logs and console logs are downloadable per session.
Architecture
How many concurrent users can a test run?
Plan-dependent. Higher concurrency targets are available on Growth and Scale. Tell us your peak concurrency on the demo call and we will size the right plan.
What does "isolated browser" mean?
Each virtual user runs in its own browser instance. Its own memory, CPU, cache, cookies, and network stack. Nothing crosses between users. The contention you measure is real, not what a shared-browser model approximates.
How is that different from headless testing?
Headless browsers (puppeteer, playwright in headless mode) skip the rendering pipeline. Great for end-to-end test automation. Useless for accurate paint timings. Evaluat runs full browsers with the rendering pipeline so Web Vitals match what users actually see.
Does Evaluat work for SPAs?
Yes. Because each virtual user is a real browser, single-page apps render and execute exactly as they would for real users: client-side routing, hydration, lazy-loaded chunks, the lot. Web Vitals come out matching production.
Pricing & access
How is pricing calculated?
Plans are sized by virtual user-minutes: one virtual user running for one minute equals one VU-minute. A 1,000-user test for an hour consumes 60,000 VU-minutes. Each plan has a monthly VU-minute allowance plus features.
Is there a free trial?
We don't run a self-serve trial. Every onboarding includes a 30-minute demo on your real site, with a small test run live. The report from that demo is yours to keep, whether you go ahead or not.
Do you offer annual contracts?
Yes. Every plan can be billed monthly or annually. Annual contracts get a meaningful discount versus monthly. Speak to us about specifics.
What happens if I go over my VU-minute allowance?
We alert you when you approach the cap and soft-stop at 100% by default. Top-up packs and metered overage are available on request. We do not auto-bill overages without your say-so.
Where is my data stored?
In the region your test ran in. EU-only data residency is available in writing for European customers; UK-only for UK customers. Talk to us about specific compliance requirements.