Taranker.Com Logo
Theme Scientist A/B Testing logo

Customer reviews: Theme Scientist A/B Testing

Develop by PreviewX

Reviews (17)

Overall rating
4.5

What Merchants Think

Overall, merchants find "Theme Scientist A/B Testing" to be a valuable tool for enhancing their online store experiences. While it's praised for its user-friendly interface and effectiveness in conducting A/B tests to improve revenue and conversion rates, there are some concerns about customer support and the app's technical limitations in certain aspects.

Key Strengths

  • Intuitive and user-friendly interface.
  • Significant positive impact on revenue and conversion rates.
  • Robust features for running split tests, including theme alternation and statistical tracking.
  • Highly flexible customization options for testing various elements.
  • Helpful and responsive development team.
  • Effective even with the app's free features.

Common Concerns

  • Delayed or inadequate customer support response times.
  • Data discrepancies during tests that require clarification.
  • Inability to split audiences live due to platform restrictions.
  • Lack of ability to set uneven time intervals for swapping themes.
  • App malfunctions not understood by at least one customer.

Final Thoughts

"Theme Scientist A/B Testing" is largely well-received by its users due to its powerful capabilities and ease of use, which significantly benefit merchants in optimizing their online stores. However, improvements in customer support and the addition of certain features could enhance user satisfaction and usability.

Print Your Places

Jun 05, 2023  on Shopify

Customer support is really bad at responding to this app. Our data had discrepencies that don't make sense/ need explanation on almost every test and their team does not get back to you for at least 5 days when you have a question, sometimes never.

Ministry of Scent

Aug 22, 2022  on Shopify

This app is easily one of our favorites and most used tools. We've used it to test multiple growth ideas and increase our revenue by over $50k a year so far. Developers are responsive, kind and very helpful. They've even introduced me to other products and people that could have been a better option for us. We want to test store-wide features so we create 2 versions of the same theme, and every 24 hours the theme switches. It's obviously more ideal to split visitors live, but Shopify seems to restrict developers from creating this experience. Everyone on our team is always really excited about our tests and results. My 2 requests would be to add slightly more robust insights on the results table and to be able to split audiences live (fingers crossed one day shopify will let it be built!)

Tree Tribe

Feb 08, 2022  on Shopify

Great app! Our team has been using this app for over a year to run A/B tests on products and website features - always testing something. We use a set it and forget it style: create a test, wait a few weeks or so, analyze the results, then start another test. The best for us has been testing product prices. Finding a better product price is golden!

Haltungshelfer

Jan 31, 2022  on Shopify

I really like the interface and i am nearly fully happy! BUT i would like to set the swapping times to something uneven, like 1/3/5/7/9 hours in order to really give every option the same time frames during a day. If i put my A/B test to swap every 4 hours for example, A would get 8-12 and 16-20 o clock every single day, which would mix up by swapping them every 3 hours. I would love, that you update this feature in the near future and ill happily give you 5 stars Great job guys! Love the update! Cheers :)

Le Monde au Naturel

Nov 09, 2021  on Shopify

We use the app free features to schedule theme change (for our sales, flyer, etc.) it is really easy to use and effective. The changes are done at the time scheduled. The support team is really nice too!

Soin Amalthée, le savon au lait de chèvre naturel et fait en France

Sep 16, 2021  on Shopify

It's the perfect tool to run AB Test on the Theme, simple and efficient. Unfortunately, at the moment I start an AB Test, I have visitors from the US, tons of visitors and all my KPIS are skewed. That's very sad.

Rings By Lux

Apr 06, 2021  on Shopify

Don't let the lack of reviews for Theme Scientist scare you away. We actually tried them all, and were ready to give up when we took a shot on TS with no reviews. Wow, intuitive, exactly the type of tests we were looking for, and unlike some of the others, it never broke themes while testing. We are actually in the ABT mode (Always Be Testing) now for life now, and this App has already given us the insights to double, yes double our conversion rates in 3 months. Word of wisdom, small tests, and keep variables isolated, so you know what is moving the needle. Last but not least, Joe, the man behind the curtain is an absolute Rockstar. Like us, always putting the customer first, and genuinely concerned about us maximizing our value from the app. Fantastic product, fantastic company, fantastic customer service!

Chef's Vision

Jun 16, 2020  on Shopify

Super clean, powerful app that lets you alternate between themes for split testing. Being able to customize an entirely separate theme gives you almost unlimited flexibility to tweak and test. It tracks the views, add to carts, conversion rates, and provides statistical significance levels so you know when to choose the winning version. The team behind the app are great, I hired them in the past to speed up my site and add lazy loading to images. They're very responsive, always improving and building new features and products based on suggestions.

Scroll to Top