Keyword research used to feel suspiciously simple. Find a keyword, check the search volume, look at the difficulty score, and pick something with a big number in one column and a small number in the other. Congratulations, you have a spreadsheet. Whether you have a strategy is another question.
A keyword with 10,000 searches and a low difficulty score can be nearly useless if the people searching it have no reason to become customers. Meanwhile, a keyword with 200 searches and considerably tougher competition might be one of the most valuable opportunities on your website if it reaches the right buyer at exactly the right moment. That is why modern keyword research needs to look beyond keyword difficulty and evaluate the larger opportunity behind a search.
A worthwhile keyword usually sits somewhere at the intersection of difficulty, search intent, business value, SERP competition, and increasingly, AI competition. Search volume still matters, and keyword difficulty is still useful, but neither metric should make the decision on its own.
That broader view is central to modern Search Marketing, where the goal is not simply to collect rankings. It is to understand how an audience searches, where a brand can realistically compete, what visibility is actually available, and which opportunities have enough business value to justify the investment.
What Is Keyword Difficulty?
Keyword difficulty, usually abbreviated as KD, is a metric used by SEO platforms to estimate how challenging it may be to rank prominently for a particular search query. Most tools express it on a scale from 0 to 100, with lower scores generally indicating less competition and higher scores suggesting that the existing search results will be harder to displace.
The important thing to remember is that keyword difficulty is not a Google metric. It is an estimate created by whichever platform you happen to be using, and those platforms do not all calculate it the same way. Ahrefs explains that its Keyword Difficulty score is based primarily on the number of referring domains linking to pages already ranking in Google’s top 10, and It specifically notes that the score does not account for every on-page factor that could influence rankings. Other platforms use their own formulas and competitive signals.
That means a KD of 42 on one platform does not necessarily reflect the same competitive environment as a 42 on another platform. More importantly, even a well-calculated score cannot fully account for your site’s topical authority, the quality of your page, the searcher’s intent, the format of the results, or the value of winning the search.
Keyword difficulty is, therefore, best treated as a screening tool. It can help narrow thousands of possibilities into a more manageable set of opportunities, but once a keyword becomes a serious candidate, the number needs to give way to actual analysis.
What Is a Good Keyword Difficulty Score?
There is no universally good keyword difficulty score, which is less satisfying than saying “anything under 30,” but considerably more useful.
A keyword with a difficulty score of 15 could still be a poor target if it has weak business relevance, mismatched intent, or a results page that leaves almost no reason for someone to visit your website. On the other hand, a keyword with a score of 65 could be an excellent opportunity if it represents an important buying decision and your website already has the content, authority, expertise, and supporting pages needed to compete.
This is why rigid rules such as “new websites should only target keywords below 20” tend to fall apart in practice. An established website with years of relevant content, strong backlinks, recognized expertise, and existing visibility around a subject enters a competitive SERP from a very different position than a new domain publishing its first handful of pages.
Your real question is not whether a keyword is objectively easy or hard. It is whether the opportunity is valuable enough and whether your website is realistically positioned to pursue it.
That is where keyword research starts becoming opportunity research.
Keyword Opportunity Starts With More Than Difficulty
When we approach keyword research, the difficulty score is only one part of the evaluation. A stronger analysis looks at five connected questions: Can we realistically compete? What does the searcher actually want? Does reaching that person matter to the business? What else occupies the search results? And is AI changing how the answer is delivered?
Those questions often produce very different priorities from a traditional volume-and-difficulty export. A keyword may appear attractive because it has strong search demand and modest competition, but become far less interesting once you discover that the intent is irrelevant to your services. Another may initially look difficult, yet become a priority because the people searching it are highly qualified and the SERP contains weaknesses your business is well-positioned to exploit.
The point is not to invent another magical score. It is to understand what the numbers are actually describing.
Start With the Competition You Can See
Keyword difficulty gives you a rough estimate of competition. The actual search results tell you what that competition looks like.
Open the SERP and examine the pages that are already winning. Are the results dominated by major publishers, government organizations, household-name brands, and companies with enormous authority? Or are you seeing smaller websites, dated articles, shallow explanations, generic service pages, and resources that clearly leave room for something better?
Then compare those pages with your own position. Does your site already demonstrate authority around the subject? Do you have supporting content that strengthens the topic? Are relevant pages connected through useful internal links? Are outside websites referencing your work? Do you already rank for closely related searches?
Those signals can change how difficult a keyword really is for your business. Two websites can look at the same keyword and face completely different levels of difficulty because one is already established within the topic, and the other is starting from scratch.
In that sense, the KD number gives you the neighborhood. The SERP tells you what you would actually have to beat once you move in.
Search Intent Determines Whether the Keyword Fits
A keyword is only useful if you understand why someone is searching for it. Search intent is commonly divided into informational, navigational, commercial, and transactional categories, but real searches are rarely polite enough to fit neatly into a single box.
Consider a query such as “best CRM for small construction companies.” The person behind that search may be researching products, comparing features, reviewing pricing, reading reviews, narrowing down a shortlist, and preparing to make a purchasing decision. Calling the query “commercial intent” is technically correct, but it does not indicate what kind of page should be created or where the searcher is in the buying process.
A better approach is to ask what the person needs from the result. Are they looking for an explanation, comparison, price, product, service provider, calculator, review, tutorial, or firsthand experience? Then look at what the search engine is rewarding.
Semrush’s explanation of keyword intent notes that intent can be inferred from signals such as the query language, branded terms, and the types of features appearing in the results. That is useful because the SERP itself often provides one of the clearest clues about what search engines believe will satisfy the user.
If most of the results are product comparisons and category pages, publishing a 4,000-word informational article probably will not solve the problem. The goal is not simply to use the keyword. It is to create the type of resource the searcher actually needs.
Business Value Changes the Math
Search volume receives tremendous attention because it is easy to understand. A keyword with 8,000 searches appears more attractive than one with 250, but that comparison becomes much less useful once you ask who those searchers are and what they might do next.
The broader keyword might attract students, researchers, job seekers, DIYers, and people with almost no reason to buy from you. The smaller keyword could be used primarily by companies actively comparing the exact product or service your business provides. Suddenly, the 250-search keyword starts looking a lot more interesting.
There is no award for attracting the largest possible collection of irrelevant visitors.
Business value asks what could reasonably happen if you win visibility for a search. That could mean direct leads or revenue, but it can also include product discovery, assisted conversions, sales enablement, brand introduction, customer education, remarketing audiences, or influence earlier in a complicated buying journey.
This is particularly important in B2B markets, where a relatively small number of qualified searches may be tied to extremely valuable purchasing decisions. A search associated with a high-value contract does not need tens of thousands of monthly searches to deserve attention.
That is one reason our keyword research process looks at customer fit and strategic value alongside search demand. Traffic potential tells you how many people might arrive. Business value tells you whether you should care that they arrived.
The SERP Can Make a Good Keyword Look Bad
One of the biggest limitations of keyword difficulty is that it tries to compress a complicated search landscape into a single number. Actual search results are rarely that cooperative.
Depending on the query, a traditional organic page may be competing for attention with paid advertisements, shopping results, local packs, featured snippets, video carousels, discussion forums, image results, People Also Ask sections, news features, knowledge panels, and AI-generated answers. All of those elements affect how much meaningful visibility is available.
Imagine finding a keyword with 5,000 monthly searches, strong buying intent, and a manageable difficulty score. On paper, it looks excellent. Then you search it and discover four ads at the top, an AI Overview, a local pack, a video section, forum results, and several other features before conventional organic listings receive much visual attention.
That 5,000-search opportunity no longer looks quite as impressive.
Another keyword may have lower volume and somewhat higher difficulty, but a much cleaner results page where a strong organic result commands considerably more attention. Ranking third might be worth more than ranking first for a SERP where the traditional results have been pushed halfway down the page.
That is why keyword analysis should always include a manual look at the results. The question is not simply “Can we rank?” It is also “If we rank, how much does that visibility actually give us?”
AI Competition Is Changing the Value of Some Searches
Keyword research now has another competitor to consider: the answer itself.
Google’s documentation for AI features in Search explains that AI Overviews and AI Mode can surface links to supporting web content, while many of the same technical and content fundamentals that apply to traditional search remain relevant. That means good crawlability, useful content, internal linking, clear page structure, and strong topical relevance still matter, but the way users interact with search results is changing.
For some informational queries, an AI-generated response may satisfy a significant portion of the user’s need directly within the search experience. When that happens, the old assumption that a number-one ranking automatically translates into a predictable level of traffic becomes much weaker.
Research from Ahrefs examining AI Overviews and click-through rates found a substantial reduction in average click-through rate for top-ranking pages when AI Overviews were present. That does not mean every query behaves the same way, nor does it mean informational content has suddenly lost its value. It means marketers need to evaluate the nature of the opportunity rather than assuming every ranking will produce traffic as it once did.
The opportunity can also expand beyond the traditional click. Instead of asking only whether a page can rank, marketers increasingly need to consider whether the brand or its content could become a source used to support AI-generated answers.
That requires looking at which sites are referenced, what kinds of information AI systems appear to favor, whether original research or expert commentary is present, and whether the query naturally leads to deeper follow-up questions. Microsoft has taken steps to make this more measurable through AI Performance reporting in Bing Webmaster Tools, which includes information related to citations and AI-driven visibility.
This is where traditional keyword research increasingly overlaps with AI Search Optimization and LLM SEO. The competition is no longer limited to winning the first blue link. For some queries, the opportunity may also involve becoming one of the sources that shape the answer.
Search Volume Still Matters, but Context Matters More
None of this means search volume should be ignored. Volume remains useful for understanding demand, comparing related topics, spotting patterns, and estimating the potential size of an audience. The problem arises when marketers assume that the keyword with the highest count automatically represents the largest opportunity.
Highly specific long-tail searches often have lower reported volume but much clearer intent. Emerging subjects may not yet have enough historical data to produce impressive volume estimates. Niche B2B searches can look tiny in keyword tools while influencing purchasing decisions worth tens or hundreds of thousands of dollars.
There is also the broader topic surrounding a keyword to consider. A strong page rarely earns visibility for one exact search phrase and nothing else. It can rank across a collection of closely related terms and questions that reflect the same underlying need, which means the opportunity surrounding the page can be much larger than the volume assigned to one keyword.
That is a healthier way to think about modern content strategy: build around the need, then use keywords to understand how people express that need.
Easy Keywords Are Not Automatically Good Keywords
One of the quickest ways to produce a weak content strategy is to open a keyword tool, filter everything below a certain difficulty threshold, and turn whatever remains into the editorial calendar. This is how the internet ends up with an astonishing number of articles that technically target keywords but do not serve much business purpose.
Low difficulty can absolutely reveal overlooked opportunities. Maybe competitors have ignored a useful long-tail query, or perhaps there is a highly relevant search that aligns closely with one of your products or services. Those are exactly the kinds of opportunities worth finding.
But sometimes a keyword is easy because nobody seriously wants it. It may have weak commercial relevance, little demand, a mismatched intent, or a search results page that already answers the question without requiring a visit to another website.
The right response to a low KD score is not “publish immediately.” It is “why is this easy, and does winning it help us?”
Difficult Keywords Are Not Automatically Bad Keywords
The opposite mistake is avoiding anything competitive. Some keywords are difficult precisely because they represent important services, products, or buying decisions.
If a search sits at the center of your market, refusing to pursue it forever because the difficulty score looks intimidating is not much of a long-term strategy. A more useful question is what competing for that search would actually require.
The answer may involve stronger supporting content, better internal architecture, original research, stronger digital PR, expert contributions, authoritative references, or improved on-page execution. Your broader on-page search strategy matters because competitive visibility is rarely won by placing a target phrase in a title and calling it a day. Search intent, page purpose, content quality, internal relationships, user experience, and conversion paths all play a role.
Some opportunities may require months or even years of sustained work. That does not make them bad targets. It simply means the value of the opportunity has to justify the resources required to earn it.
A keyword with a difficulty score of 70 tied directly to your most profitable service may deserve far more attention than a KD 8 keyword that produces almost no commercial value.
A Better Way to Prioritize Keywords
A useful keyword strategy does not need another complicated proprietary score. It needs a consistent way of comparing opportunities.
For each important keyword or topic, consider the same five questions:
- How difficult is it for your website to compete?
- How well does the search intent match what you can provide?
- How much business value could the visibility create?
- How much usable space is available within the SERP?
- And how is AI changing the click, citation, or discovery opportunity?
Once those factors are considered together, prioritization becomes much clearer. A keyword with moderate difficulty, excellent intent, strong business value, a favorable search results environment, and good potential for broader AI visibility may deserve immediate investment. Another keyword may have enormous search volume and almost no meaningful relationship to the business.
The spreadsheet may love that second keyword. Your sales team probably will not.
Keyword Research Is Really Opportunity Research Now
Keywords are not dead. Marketers have been announcing that funeral every few years, and keywords continue showing up for work on Monday morning.
What has changed is the amount of context required to evaluate them properly.
Modern Search Marketing needs to understand the language people use, the needs behind their searches, the commercial value of reaching them, the strength of the existing competition, the composition of the results page, and the growing role AI systems play in mediating discovery.
That means the best keyword is rarely just the one with the most search volume, and it is not automatically the one with the lowest difficulty. The strongest opportunities are where real audience demand, business relevance, competitive feasibility, and meaningful visibility overlap.
That is harder to represent with a single colorful metric on an SEO platform. It is also a considerably better way to decide where to allocate your time, content, and marketing budget.
Find the Search Opportunities Worth Chasing
Good keyword research should make priorities clearer, not leave you staring at a 14,000-row spreadsheet wondering what to do next.
At Cadence Search, our keyword research services connect search behavior with intent, business value, competitive reality, website authority, SERP composition, content strategy, and AI-assisted discovery. The goal is not to chase every keyword you could possibly rank for. It is to identify the searches that are actually worth winning.