How to Actually Evaluate a Shopify App Before You Install It

The average Shopify merchant has installed and uninstalled more apps than they can remember. A few stuck. Most didn’t. The ones that didn’t were usually spotted too late: after the install, after the store slowed down, after the support ticket that went nowhere for a week. The signals were there before the install. Most merchants just don’t know what to look for — so they look at the star rating, which is the least useful signal of all.

Why star ratings are the least useful signal

A 4.8 is table stakes. Almost every app in the Shopify App Store with more than a few hundred installs sits between 4.5 and 4.9. The range is so compressed that it stops being informative. What got an app to 4.8 matters. When it got there matters. Whether it is still earning that rating or coasting on it matters. The number alone tells you none of that.

Review farms are real. Clusters of five-star reviews posted within days of each other, all using similar language, with no specifics about what the app actually does — these are not organic. Templated reviews that read like they were written from a brief (“easy to use, great support, highly recommend”) are noise. What you are looking for is specificity: a review that names the problem, describes what changed, and mentions something concrete about the experience.

The negative reviews are more useful than the positive ones. Not because they tell you the app is bad, but because they tell you how the developer behaves when something goes wrong. A developer who responds to criticism with blame, deflection, or silence is telling you something important about what support will look like when you need it.

What actually tells you an app is worth installing

Review recency. A 4.8 average with the most recent review fourteen months ago is a different signal than a 4.8 with reviews from last week. An app that has stopped earning new positive reviews has either stopped growing or stopped being good. Check the date on the most recent handful before you read anything else.

How the developer responds to negative reviews. Read every response to a one or two-star review. Are they acknowledging the problem and explaining what changed? Are they defensive? Do they respond at all? This is the clearest window into what working with this developer actually looks like.

Active changelog. An app with a visible, recent changelog is being maintained. Someone is paying attention, shipping improvements, and fixing things that break. An app with no changelog or one that hasn’t been updated in a year is one Shopify update away from breaking silently.

“

An app with no changelog or one that hasn’t been updated in a year is one Shopify update away from breaking silently.

Named humans. A listing with a real company name, an About page, and identifiable people behind it carries more accountability than one with an anonymous developer handle and a stock photo. You are giving this app access to your store. Know who you are giving it to.

Reachable before you install. Email or message support with a pre-install question before you commit. The response time and quality of that interaction tells you more than any review. If nobody answers before you are a paying customer, they are certainly not going to prioritize you after.

Pricing that makes business sense. A full-featured app at $1.99 a month is either a loss leader, about to raise prices significantly, or not long for this world. Sustainable pricing means the developer can afford to maintain and improve the product. Unsustainably cheap pricing is a risk you are taking on when you build workflows around the app.

Permissions that match what the app does. Read the permission request screen when you install. A discount app that wants access to customer accounts is asking for more than it needs. Permissions beyond the obvious scope of the app’s function are worth questioning before you approve them.

Red flags you can spot without any technical knowledge

• Five-star reviews posted in clusters on the same dates, all with similar generic language
• Feature claims in the listing with no screenshots or video actually showing the feature working
• Pricing structure that requires you to install before the real cost becomes clear
• No stated support response time, or a support channel that is only a contact form
• Last app update more than a year ago
• Broken or generic English throughout the listing combined with stock imagery
• No privacy policy, or one that is clearly a template not written for this app
• App store listing that describes what the app does without showing how it does it

The performance check nobody does before installing

Shopify’s Online Store speed report shows you which apps are contributing to your page load time. Check your speed score before you install anything and again after. If a new app drops your score meaningfully, that is a cost you are paying on every page load, on every visit, across your entire store.

The other thing worth Googling before you install: “[app name] uninstall cleanup.” Some apps inject code directly into your theme files. When you uninstall them, that code stays behind unless you manually remove it — and if you do not know it is there, it just sits in your theme doing nothing useful and occasionally breaking things when you update. Newer apps built on Shopify’s Theme App Extension model do not have this problem. Older ones often do. Support can tell you which model they use before you install.

When a low review count is actually fine

Review count is a function of time and install base, not quality. An app that launched six months ago from a developer with a clear track record and 200 installs is not the same risk as an anonymous app with 200 installs and no other signals to evaluate.

The question is not how many reviews the app has. The question is what surrounds the number. A new app is worth a closer look if the developer built it because they ran into the problem themselves, has their name and reputation on it, is reachable before you install, has priced it honestly, and can explain exactly what the app does and does not do. That is a different thing from a new app that just hasn’t had time to disappoint anyone yet.

Early adopters of a well-built new app also get something that users of a larger, established app rarely have: direct access to the person who built it. That access gets harder to maintain as an app scales. Getting in early, when the developer is still talking to every user personally, is a genuinely different support experience.

Why solo-built apps deserve a different standard

A solo developer with their name on an app is accountable for everything in a way that a larger team simply is not. There is no support tier between you and the person who wrote the code. When something breaks, the person who can actually fix it is the person responding to your message.

Solo developers ship fixes faster. There is no sprint planning, no ticket queue, no committee deciding whether your bug is a priority this quarter. A real problem reported on a Tuesday is often resolved by Thursday, because the developer’s entire incentive structure points at keeping users working and happy.

The roadmap of a solo-built app reflects what merchants are actually asking for. A product team at a larger company is making educated guesses about what users need and running them through prioritization frameworks. A solo developer who talks to every user personally knows exactly what is broken and what would make the biggest difference, because they hear it directly.

Solo developers also do not let apps quietly die. A larger company has a portfolio. Apps fall out of priority rotation. A solo developer whose income and reputation depend on the app has every reason to keep it sharp. The pricing is honest because it has to be — no sales team to support, no investor expectations to meet. The price reflects what it costs to build and maintain, and what the value is actually worth.

This is the bar we hold ourselves to with Variant Discounts and Wholesale MarketFlow. Both were built because we ran into the problems they solve — not because we spotted a gap in a market report. One developer, accountable for everything, reachable directly. If you email before you install, you will hear back from the person who built it.

Before you install the next app

Skip the star rating first. Read the negative reviews and watch how the developer responds. Find out who built it and whether you can reach them. Check your store speed before and after. Ask what happens if you uninstall.

The apps worth installing are findable if you know what to look for. The ones that aren’t tend to reveal themselves before they ever get access to your store.