Browserstack vs. CrossBrowserTesting

Originally Posted on February 7, 2013 Last Updated on December 30, 2014

This post is outdated. You can read all about why I’ve switched back to Crossbrowsertesting.

I’ve been a big fan of CrossBrowserTesting.com for nearly three years. At the time I began using them, they were heads above older, clunkier VPN type services that allowed web designers to test our creations in browsers unavailable to us (that is, the growing number of us who build on a Mac but still need to support IE).

The service has been more or less wonderful, I fully admit and would easily and happily endorse the product to anyone who asked. Not that it’s been without it’s shortfalls. Every now and then this or that would quit working, or I’d need to change my VPN or they’d switch something around. Their support staff is absolutely amazing, and would get back to me immediately when I had any issues, as well as check back in with me over time. They’ve got a really useful bookmarklet which allows you to test any webpage you’re on in a click. Plus, though they’re a time-based system (ie, you pay for X number of minutes / month, similar to a cell phone plan), they added roll over minutes at one point, which meant I always had plenty of minutes to use. Prior to roll over minutes, though, I would regularly need to pay extra to keep the service going for a month. My plan cost $19.95 / month.

More recently I discovered Browserstack. I’m the type of gent who loves loyalty. I’ve been using tools like Harvest for years and never even think about switching. When someone is first on the scene with a brilliant product, I like to hang around. That said, the idea of “minutes” with any service–whether it be mobile phones, Internet access or browser testing–has always irked me. Who wants to be afraid of testing a few extra things because they might run out of time?

But that wasn’t even the main crux of my decision. Browserstack’s interface is simply awesome.

I don’t need to do much to switch from testing in IE6 on a Windows XP machine to testing in Firefox on a Mac or an Android-powered Samsung Galaxy III. Change a few settings, and the whole things updates for me. With my super wide retina type Macbook Pro, this is a perfect system for me. Take a gander at the quick screenshot walk through below, and give ’em a try when you’re ready to actually make this whole Internet Explorer / Firefox thing a breeze instead of the current pain in the ass it likely is for you.

Up Next: Vector Twitter Tweet Button Photoshop File (.PSD)

Discussion

Ron 18 Aug 2013

Hi Nathan,

So have you moved over to browserstack from crossbrowsertesting?

And were you referring to crossbrowsertesting as a “pain in the ass” for IE and firefox switching / testing.

Why I ask is I’m deciding which one to commit my $$ to.

Thanks,
Ron

Reply
nathan 18 Aug 2013

Ron,

Both services are good. Browserstack, for me, is perfect though. And no I wasn’t referring to CBT as the pain in the ass, but rather more traditional means of working on a Mac and testing ie, be it via a second Windows machine or VPN or something.

Reply
mia 26 Aug 2013

Hi

We are into website development and mobile browser applications. Most the development involves HTML, Javascripting. We need a cross browser testing tool, which one do you suggest; crossbrowsertesting or browserstack?

Thanks,
Mia.

Reply
1. nathan 26 Aug 2013
  
  Browserstack, Mia.
  
  Feel free to do your own testing and see which one fits you, but I’m Browserstack all the way these days. Definitely responsive and quick so you can test your Javascript out.
  
  Reply
BaileyWhaley 4 Feb 2014

I recently tried using browserstack.com. However I did find browserstack to be very slow and clumsy. Videos could not be loaded – no continuous motion as opposed to testing directly on native browser, speed was slow, screenshots did not appear on all devices/browsers selected. I haven’t yet tried crossbrowsertesting.com because it needs credit card information. But i did find it has many more os/browser combinations to offer. Why would you still recommend browserstack?

Reply
1. nathan 5 Feb 2014
  
  There hasn’t been an OS/browser combo that I’ve needed that Browserstack doesn’t provide, BaileyWhaley. As for videos / animations / movement not working smoothly, you’ll find that with just about any service like this, including CrossBrowserTesting.
  
  Feel free to try both services before making a decision, but how well things respond largely depends on your connection vs. the service itself.
  
  Best of luck to you!
  
  Reply
James Devlin 31 Mar 2014

Hi Nathan,

thanks for the post. It gives a bit more insight into the service beyond the BrowserStack website.

Does the “Automate” service include all the features that the “Live” service does?

Cheers,
James

Reply
1. nathan 1 Apr 2014
  
  Not sure what the Automate service does or doesn’t include, James, I only use the main Live service.
  
  Reply
Ira 8 May 2014

I’ve been using BrowserStack for about two months. I want to love this. I have found that having access to all the platforms and browsers to be invaluable, and that to me justified the price, but yes it is so slow at times you can’t even get anything done. This is of course dependent upon which platform/browser you’re on.

My main issue however is connecting to Android devices. I always have issues connecting to Android devices; be it local or live sites. iOS works ALL the time. I’ve tried both Chrome and FF and rarely get success with the Android devices regardless of OS version.

Again, iOS always works (and works well) but in real life I’m less concerned with iPhones, etc due to my developments working so well with them anyway. So, it’s the Android platform I have special interest in especially due to the array of products and OS versions. That is the major issue here; the one thing I need, I cannot seem to ever do.

For $40 a month this is not acceptable.

Any experience with connecting to Android devices?

Reply
1. nathan 8 May 2014
  
  I feel your frustration Ira. Why are you paying $40 / month though? I’m on the individual plan at $19 / month.
  
  I haven’t had much experience using the Android interface, though I probably should look into that more I just typically neglect to test on Android as I find the results are often identical to what Chrome on my iPhone looks like.
  
  Reply
nathan 8 May 2014

Just went over to Browserstack and saw that indeed they are now charging $35 / month for their “Solo” plan, for 1-2 people. I think that’s pretty steep.

They also have a “Lite” plan for $19 / month, which is different from my (I guess grandfathered in plan) called “Individual” (which is also $19 / mo). The Lite plan doesn’t give you access to mobile devices though.

Reply
Ira 8 May 2014

Yeah, it’s actually $39/mo billed monthly.

I can deal with the sluggishness of some of the browsers, and it’s to be expected in a regard. However, connecting to Android devices has been a disaster. It seems to be worse with local setups yet I achieved the local connection correctly with their tool and I always connect to iOS no problem (for the most part, sometimes the screen freezes).

I’m mainly concerned with Gingerbread as some jQuery stuff, stacking order and PNG fallback for SVG, etc are all potential issues with that version. Usage is rapidly declining* though so that’s cool. It depends on the project/user base but I’m in the process of completing/testing a site for a large company so I don’t see excluding it, and there are some basic and easily implemented fixes needed for Gingerbread. Things that I could identify and fix within minutes has turned into HOURS trying to connect to the devices. I’ve contacted support twice and await response.

*https://developer.android.com/about/dashboards

The entire reason I went with the $39/mo plan was to connect to mobile. Awesome.

Reply
Luke Swenson 24 Sep 2014

I’ve used both services extensively in testing projects. I’ve used both of their VPN services and pretty much every device configuration.

Browserstack’s UI is nice, but for me it doesn’t preform as well as Crossbrowsertesting.com. Primarily in speed. Browserstack would lag when dealing with highly interactive websites.

If you are developing large projects with complex javascript, video, audio and new technologies, I would highly recommend going with Crossbrowsertesting.com. If you choose Browserstack you’re going to get frustrated quickly. I did.

Also, a lot of people tend to rave about Browserstacks UI design, but aesthetically I think it gets in the way and feels dated. It might be the beige.

Crossbrowsertesting has a nice white minimal design that doesn’t get in the way.

I did have an issue setting up the VPN on Crossbrowsertesting.com at first, but their customer support (phone) helped me get it set up quickly. Browserstack’s VPN service worked first try.

I hope that helps.

Reply
Amit 15 Oct 2015

Hi Nathan,
Does Browserstack support real device automated testing for ios?

Reply
1. nathan 15 Oct 2015
  
  Honestly I don’t know for sure, haven’t used them in awhile. Crossbrowsertesting does though, for sure.
  
  Reply
AJ Clarke 27 Jul 2017

Hey Nathan,

I create WordPress themes for a living and I use Crossbrowsertesting to make sure the themes work well in IE (mostly for checking IE). I’ve noticed a lot lag when browsing a site (scrolling, inspecting…etc). Do you experience the same thing? Sometimes I just want to scroll down a page and it takes like 4 seconds. Thanks for the feedback! I’ll probably just switch back to using Parallels for Mac which works really well, have you it that before? If not maybe check it out.

ps: Great looking site by the way – the typography is perfect over here!

Reply
1. nathan 28 Jul 2017
  
  Hey thanks AJ!
  
  I haven’t seen a lag like that, and that’s largely what I use CBT for too. No doubt using Parallels would be more “real” and probably even efficient though. 😛
  
  Best of luck with those WP themes!
  
  Nathan
  
  Reply
Sam Smith 24 Oct 2018

I personally tried using both the tools and I must say they both are very good. Only one thing is that they offer very less free time to test and that’s why I moved to https://www.lambdatest.com/ its a pretty good tool as well.

Reply