Chapter 3. SEO and the Research You Already Do

You can optimize everything and still fail, because you have to optimize for the right things. That’s where reflection and qualitative approaches come in. By asking why, we can see the opportunity for something better beyond the bounds of the current best.

Erika Hall, Just Enough Research

Whether you’re a designer, writer, developer, or marketer, you are a person with a goal: you want to make sure your website is findable. You want the digital experience you’re creating to actually meet people’s search intent—to give them what they’re looking for.

Including an SEO lens in the research process is one of the most important steps you can take toward achieving your goal. As we’ve seen, Google is a database of human psychology. Once you start leveraging this database to account for user search behavior, you won’t be able to stop seeing how search ties into everything. You’ll naturally find ways to use search data to build a clearer picture of your audience and their needs, and notice gaps in the experience where you’re not meeting search intent. 

A caveat: we’re going to discuss flexible strategies for adding a search lens to common user research tactics, not how to approach research practices as a whole. If you’re just getting started with research and aren’t yet familiar with the methods we discuss here, we highly recommend checking out Erika Hall’s invaluable Just Enough Research. It’ll give you a solid foundation around how to approach research more holistically. 

While you could certainly add a search lens to nearly any form of research you’re already doing, we recommend integrating search considerations into these four key activities: 

  • Stakeholder analysis. Asking the right questions of senior leadership or any other folks who are critically invested (but not always directly involved) in your project will help you uncover any organizational reasons behind current SEO challenges, determine goals and opportunities for SEO, and shine a light on culture or process problems that impede search visibility. This is critical for SEO success, so we’re going to spend a good deal of time on this activity. 
  • User interviews. There’s no substitute for hearing what real users say about how and why they use your site. Unearthing users’ search habits can provide surprising and helpful insights. Depending on how complex or specialized your subject matter is, you may want to talk to users prior to search intent analysis to begin building your list of root keywords. If you’ve already analyzed keywords, interviews can help you fill in the blanks around the data and better understand how search fits into the user’s journey.
  • Content audits. If you’re embarking on a redesign or doing any kind of iterative design work, taking a closer look at the content you already have is especially important for SEO. You can use search-relevant metrics to help shape your audit criteria, and then use the results to uncover gaps in search intent.
  • Competitive analysis. With a little sleuthing and help from a few inexpensive competitive-research tools, you can see how your site stacks up, SEO-wise, against competitors. This can help you pinpoint gaps in performance, see how links and authority play into your site’s visibility, and learn what topics your competitors are (and aren’t) covering.

In this chapter, we’ll walk through strategies for conducting research activities with SEO in mind. 

SEO and Stakeholder Interviews

We once worked on a project with a company that had moved its entire blog off their main site and onto a subdomain, not realizing the negative impact such a move would have on search visibility. Microsites can’t leverage the authority and links of the main domain, so they generally don’t perform as well in organic search.

Many internal constraints led up to the microsite decision. The marketing department wanted the blog to use plain language, but the legal department imposed restrictions on terminology used on the main site. The UX department wanted the blog to have a different look and feel, but the IT department lacked the developer resources to build out new page templates and navigation. Faced with these roadblocks, the blog team decided a microsite was their only option. 

We talked to team leads and higher-up stakeholders to dig deeper and learn more. It turned out that leadership didn’t realize that the legal team was being so inflexible, or that the IT department was so underresourced. They definitely didn’t know that building content on a microsite would have negative implications for SEO—and once they did know, they were determined to remove the roadblocks that had kept the content off the main site in the first place. That’s real progress that would never have happened if we hadn’t asked about search considerations in our stakeholder interviews.

Choose people to interview

As in any stakeholder interview process, the first step is to identify whom you need to talk to. Who are your SEO stakeholders? The biggest challenge there is that most people won’t realize that they are, in fact, SEO stakeholders. They might not see the connection between their goals and the role search plays in reaching those goals. Asking the right questions can help them see those connections. 

Start by making a list of all of your project stakeholders, noting the roles they play, as well as their actual names and titles. Then categorize your list to help identify gaps and overlaps. We use the seven stakeholder categories created by content strategist Meghan Casey (http://bkaprt.com/seo38/03-01):

  • Sponsors, like VPs or directors of digital or omnichannel, get the recognition or take the fall for organic search visibility. There’s often only one sponsor, but not always. Sponsors are usually responsible for the strategy and success of the company website and typically determine the role SEO will play in achieving that success.
  • Financial decision-makers, like VPs of marketing who lead a company redesign, decide whether SEO and search intent analysis get funded. Again, there’s usually only one of these, but there could be more. They’re ultimately responsible for funding SEO efforts, but might not understand SEO’s value or anticipate the investment it requires.
  • Strategic decision-makers, like UX directors whose performance is partially measured on the website’s alignment to user goals, have a problem that SEO can or should solve. They will likely be vocal about findability, and may be concerned that “optimizing for machines” could impede usability.
  • Champions are people you can count on to evangelize the importance of search and its role in design and content. A champion could be anyone influential and well-regarded in your organization who understands the value of human-centered SEO (and is willing to help you socialize research and win support for SEO integration).
  • Derailers don’t have official veto power, but they typically feel that SEO is a threat to their goals. Depending on their influence, derailers can (intentionally or unintentionally) stop a user-centered search strategy in its tracks. They’re often outside the obvious pool of project stakeholders but are impacted by the project outcomes, like creative directors who think “off-brand keywords” will undermine voice and tone.
  • Influencers have opinions and insights worth considering, but they don’t have veto power. They could be subject-matter experts, product managers, or even customer-service managers who can help you understand how people search for your content and the topics you should be ranking for.
  • Implementers are responsible for putting search strategy into action and bringing SEO to life. They often make content and design decisions that have a direct impact on search visibility. An implementer could be someone a lot like you—a web writer, designer, search professional, or developer.

While having stakeholders in these different roles will go a long way toward making your endeavor successful, it’s also important to ensure you have balanced departmental representation involved in the website strategy, from marketing to technology to paid search.

Questions to ask

Once your list of stakeholders includes the right mix of people to move your search-friendly agenda forward, it’s time to add an SEO lens to your interview questions. The questions we ask aren’t set in stone, but we typically start with an interview script that will uncover anything that could have a major impact on our work and help us neutralize politics, understand priorities, set expectations, and identify opportunities.

In addition to asking people for their name and title—and any other research questions you might have—here are some basic questions to draw out SEO-relevant insights.

To learn about expectations, ask:

  • What role does organic search play in our strategy? 
  • What does a successful SEO strategy look like to you?
  • What changes in organic search rankings would you like to see in a redesign? Why? 
  • What do you wish you knew about our users and the way they search?
  • Where does organic search fit into the redesign process?
  • Who’s responsible for organic search outcomes? 

To identify opportunities, ask:

  • How does paid search fit into our strategy right now? (Sometimes overreliance on paid search can stem from an issue with organic SEO and signal that there is an opportunity to get more of that traffic for free.)
  • For paid search:
  • What search terms topics do you typically bid on?
  • What types of keywords typically convert best?
  • What’s the monthly budget? (Monthly budgets can help you understand where your organization is spending the most money. You may want to prioritize SEO efforts there first, in terms of business priorities and cost savings.)
  • What’s the return on investment? (This can help you understand underperforming areas that might need better alignment with search intent.)
  • Do we have separate digital properties or websites? How many? (SEO challenges can emerge when similar content competes against itself or lacks the domain authority necessary to achieve high rankings.)
  • What roles do these other sites play? How did we decide on this domain strategy?

To understand priorities, ask:

  • How does your team define success?
  • What is the role of the website in achieving that success?
  • What factors impact your team’s raises, promotions, hires, and resourcing?
  • How will we measure success for the website? 
  • What areas of the website are most important to you and your team? Why?
  • What areas of the website are most important to your customers? Why? 
  • What user segments are a priority for you right now?
  • What products or services are a priority for you right now?

To neutralize politics, ask:

  • Is there anyone else we should be talking to about this?
  • If you’ve tried to implement SEO in the past unsuccessfully, where did it go wrong?
  • Are you aware of any negative perceptions or concerns around SEO? What would it take to change that perspective or resolve those concerns?

What to watch out for 

Inevitably in your interviews, you’ll come across workflow red flags, conflicting priorities, or unhealthy expectations that could derail your SEO efforts. Make note of those and plan out action items to mitigate them.

Workflow risks and concerns

As you talk to managers and implementers, you will very likely discover that content, design, and development teams have no idea how intertwined their work really is with SEO outcomes. You might discover that people are wary of SEO in general, and thus actively avoid serious efforts to include it. Even if people are open to it, you might see challenges in workflow, timing, or coordination that you’ll need to get ahead of. 

Instead of avoiding troublemakers, invite any potential derailers (especially influential ones) to the initial strategy and project-planning work sessions. (If that’s too much involvement, at least share your project goals and plans with them. Invite them to discuss where their work might intersect, any key areas where they need to provide feedback, or other ways they could participate.) You want them to take as much ownership of the process as they can, so they feel heard and invested in success. If you get stuck, lean on sponsors and champions to help soften attitudes or change perspectives to set the stage for process and workflow changes when necessary.

Competing priorities

“Doing SEO” might involve conducting search intent research, making changes to site navigation, writing new content, optimizing meta descriptions and titles, and taking on a whole range of technical tasks that we aren’t even covering in this book. Because it’s usually not feasible to do everything at once, focus your SEO efforts on high-priority areas of your site—but note that this only works if those areas have already been clearly established and prioritized. If stakeholders are unable to agree upon which areas of the site are most important in terms of earning organic visibility, it will be difficult to focus your SEO efforts.

High-priority areas of the site are usually those tied to real business outcomes like generating leads, selling a product or service, or even just drumming up awareness around specific information. Business outcomes are not site-performance metrics, like increasing traffic or reducing the bounce rate. If you hear metrics like that stated as business goals during interviews, dig deeper to get to the desired business outcomes those metrics are meant to drive, and then map them to areas of the website that most clearly support those outcomes.

After your interviews, you might find that different people have different ideas about which areas of the site are most important in terms of SEO. To clarify competing priorities, hold a working session with key stakeholders:

  1. Display a list of all of the different areas of the site with organic search concerns, based on what you heard during the interviews. Ask if anything’s missing that should be added to the list.
  2. Have participants rank those areas of the site in order from most to least important in terms of organic visibility. If you’re working with a smaller group (no more than eight people), you can simply have folks talk through the prioritization. When working with larger groups, dot voting can be a good way to assess priorities democratically: give participants a limited number of dot stickers to vote on which areas of the site are the most important to them. How many stickers you give each participant will depend on how many priority areas you need to narrow your list down to. Have everyone vote quietly, without discussion or lobbying. In the end, tally up the dots. Areas of the site with a higher concentration of dots are higher in priority.
  3. Assess the outcomes of this working session against the search data and insights from your search intent analysis.
  4. Create a rolling optimization task list that aligns SEO efforts to high-priority areas of the site. Then use that to determine what pages or sections you’re going to focus on first.

Unrealistic expectations

Knowing what people expect SEO to do can help you communicate appropriate expectations early on. Here are some of the most common holdups we see:

  • Getting hung up on the visibility of a single keyword or specific search phrase. If you do organic search right, there should be myriad ways someone can find your content, and many different points of entry too. Don’t let the idea of The One Perfect Keyword create tunnel vision—you want to be looking at a bigger, more nuanced picture of visibility across many different search terms in a category.
  • Expecting specific SERP features. As you may recall from Chapter 2, SERP features are nontraditional organic search listings like knowledge panels or “People also ask” boxes. You can optimize for these and hope for the best, but there’s never any way to make sure Google will include your website in their structured search result components.
  • Expecting content on microsites and subdomains to gain significant search visibility. Like we discussed earlier, content on microsites and subdomains can’t benefit from the main site’s link authority—the quality and quantity of links a page has that give it more value to search engines. Search engines treat microsites as entirely separate; regardless of any connection to a parent site, they’ll have to be indexed from scratch. With subdomains, it’s not impossible for them to earn visibility, but it is typically challenging.
  • Expecting traffic for products or services that nobody is actually searching for. If there’s no search demand for the information your content is providing, you can’t reasonably expect that if you optimize that content, the traffic will come. In such cases, a public relations campaign or paid advertising would be better tools than organic search.

To address unrealistic expectations, it’s helpful to demonstrate how your site is doing in organic search right now. This could happen by way of an informal presentation where you teach stakeholders how modern search works and highlight any current organic search performance issues. You can use this opportunity to dispel SEO myths, clarify misconceptions, and set more realistic shared expectations. See Chapter 6 for more ideas about sharing search considerations with your team.

SEO and User Interviews

We once worked with a hotel client that was redesigning its website. The client wanted to use SEO to encourage people to book rooms directly on its site, rather than on third-party travel aggregators (like Travelocity). They saw organic traffic as a zero-sum game: users either went directly to their site (good for the client) or booked on third-party sites (not good for the client).

But as we conducted user interviews, we learned that both the hotel website and the third-party sites were an important part of the user journey. Most users we talked to started their hotel-booking process on a third-party travel site to get an idea of their options and costs. But once they identified a hotel that seemed like a fit, they almost always visited the hotel site directly to see more details about the rooms or to look at pictures.

This meant we didn’t have to try to outrank the third-party travel sites for the most popular keyword terms (which is nearly impossible to do anyway). Instead, we focused on improving the user booking journey on the site itself by optimizing the local visitors-guide content and map results to show up earlier, improving key messaging on the homepage, and elevating direct booking deals in other areas of the site. 

Talking to real users about the reasons behind their searches helped us fill in the gaps from the search intent analysis and make smarter design decisions that aligned with what people actually wanted to know about the hotel. Search intent analysis and user interviews complement each other quite well, because together they provide the whole picture of search behavior. The data tells you what people are searching for; the interviews tell you why they are searching for it—and the combination can be pretty empowering.

You might be thinking, “Hey, now…user interviews are about way more than just understanding how and why people search!” And you’d be absolutely right. Keep on doing what you do in user interviews—just add in a few SEO-related questions to learn about search behavior, too. 

Depending on your specific project needs, you might choose to conduct user interviews before researching search intent, or vice versa. If you research search intent first, you can use interviews as a way to close knowledge gaps around the data. But if you’re doing research for an industry that is technical, niche, or just very unfamiliar, doing the interviews with real users first can help break down complex search paths and expose insider lingo and potential root terms and keywords to research.

Selecting people to interview

The nice thing about adding a search lens to user interviews is you don’t have to add any new groups of people or user types to the list—everyone uses search! You’re simply adding questions to your interview guide that will evoke search insights from the people you’ve already planned to talk to.

Of course, different user segments have different goals and priorities, and your organization might have different goals or content segmented by audience type, too. Because of this, it’s possible you’ll need to tailor your search-focused questions to your user types. 

Questions to ask 

The list of questions we ask users varies from project to project. The exact questions you ask will be determined by the context of your product, service, or subject matter. You’ll also want to consider whether the search has a transactional, informational, navigational, or visit-in-person context, like we discussed in Chapter 2.

Here are some sample search-focused questions we typically ask—you can modify them to meet your needs.

To learn about how people discover websites like yours, ask:

  • Have you ever searched for information around this product/service/topic online? 
  • Were you able to find the information you were looking for? 
  • How did you decide if the information was trustworthy or not? 

To learn what their search journey looks like, ask:

  • Tell me about the last time you looked for a product/service/topic like this online. How did you begin looking for information? What did you do next? (Keep in mind that they might not always start with a web search. Their search journey could begin with talking to someone in person, following a link from Twitter or Reddit, or doing a Google search. The point here is to find out and uncover the journey.)
  • How did you decide what to do? Will you walk me through the steps leading up to your purchase/decision/action? 
  • How did you research your decision online? (This is a slightly different angle to pull out missing steps in the journey if they haven’t covered it fully.)

To learn how search plays into the experience of current customers or users, ask:

  • Can you tell me about the last time you used our company’s website? 
  • Did you visit the site directly or start with a Google search (or another search engine)? If so, why? 
  • Were you able to find the information you were looking for? 

Even if the questions you’re asking aren’t specifically designed to draw out search insights, you can still get search-relevant insights by listening to users tell you about their context or challenges. You’re listening for how search plays into their experience, as well as the terminology and language they use to describe your topic.

Identify search behaviors and goals

As you go through your interview notes or call recordings, notice things users said that could impact your site’s search strategy, content, or design. In particular, be on the lookout for how users might be expressing search behaviors and search goals.

Search behaviors are actions or decisions that users make when performing a search. These behaviors can help you understand how and where search fits into the user journey, and which pages or areas of the site you should prioritize for search visibility. In user interviews, search behaviors sound something like this: 

  • “We always pick our hotel based on the activities we’re doing on the trip. So I plan out our trip itinerary, and then search for hotels that are close to what we’re doing on that leg of the trip.”
  • “I usually click the links with good ratings. I don’t really notice the search results without ratings.”
  • “I started off looking at ‘best-of’ articles or lists when I was researching our last vacation. When I found somewhere that felt like a fit, I’d check out Travelocity to see what hotels would cost us, and then dig a little deeper on ones that stood out.” 

Search goals are users’ desired outcomes for a search—the tasks they’re trying to accomplish. Search goals help you understand which pages need to exist and what information they need to deliver. In user interviews, search goals sound like this:

  • “When I’m prepping for a trip, I’m looking for local mountain biking trail maps above all else. It’s frustrating when that information is only available in a PDF and I can’t tell if it’s what I need until I skim over the whole document.” 
  • “I’m pregnant and want to take a vacation that’s easy and relaxing, so I’m looking for the best babymoon destinations.”
  • “Charlie, our dog, always goes on road trips with us. Pet-friendly rooms are our top priority. I like to look at the room layout and get a feel for the property too, like how far we’ll have to walk him to go potty or get a run in.” 

Try to capture the remarks as near to verbatim as possible. People’s exact words and phrases are useful for keyword research, copywriting, and stakeholder presentations. Don’t lose that valuable language behind summaries and paraphrases.

Turn themes into recommendations

Once you’ve identified search behaviors and goals, you need to translate them into actionable next steps for content, design, and code.

Start by grouping search behaviors and goals into thematic categories. You’ll start to notice which search needs are the most common or crucial—or which search needs you had assumed were relevant but were actually mentioned by very few users. Categorizing will also help you prioritize your recommendations and action items.

For example, during user interviews for our hotel client, we heard some folks mention specific search terms like “family-friendly hotels.” Others identified search behaviors like seeking out user-generated photos of hotel rooms to gauge whether the layout would be spacious enough to share with family members. Other users emphasized the importance of swimming pools and play areas when traveling with young children, and how having a mini-fridge and private bathroom vanity area made sharing rooms with family easier. When we looked at those search behaviors and search goals together, the theme became clear: users wanted family-friendly hotel rooms.

Themes made it easier to see what design and content changes needed to happen to better support the search experience—and ultimately create a better user experience, too. To help users find the family-friendly rooms on the hotel site, we made some recommendations to our client:

  • Create a page for family-friendly rooms, and make sure the page is highly visible in the site navigation.
  • Describe family-friendly amenities (like the playground and swimming pool) in both the meta description and introductory copy for the page, even if they’re already included in the list of amenities present on all room pages.
  • Include mobile-friendly pictures of family-friendly suites along with diagrams of room layouts, and make sure the alt text for each image includes the terms “family-friendly hotel rooms” and “kid-friendly hotel” where relevant.
  • Use keywords like “family-friendly hotel” and “group suites” in the page’s headings (h1 and h2 tags) where relevant.

As this small sample of recommendations demonstrates, SEO can touch anything from the site navigation to the copywriting to the imagery. When making your own search recommendations for a project, consider every element of the digital experience: What user needs did you hear? What questions did people ask? What does your website need to do in order to solve their problems? It will take a combination of content, design, IA, functionality, markup, and marketing to pull everything off.

SEO and Competitive Analysis

You probably already know the mix of brands in your market basket, but what about your search competition? When someone searches for your product, service, or information, they will always have choices. You should know what those choices are—whom you’re competing against, directly and indirectly, for search visibility. With a bit of manual sleuthing and a little help from inexpensive tools, you can better understand the competitive landscape in terms of search performance.

Here’s what you’ll scope out in your competitive analysis:

  • SERPs and your competition. Who shows up—and how do they show up—in Google search results when you do a search for your main products, services, or information?
  • Traffic and authority. How does your domain stack up against competitors in terms of traffic from organic search? Is your site at an advantage or a disadvantage from a link and authority perspective?
  • Gaps in content topics covered. What content topics are your competitors getting visibility for that you don’t cover?

SERPs and your competition

If you’ve gone through the search intent research process outlined in Chapter 2, you’ll already have a list of root terms that represent the core information, products, or services on your site. Search for these terms in private mode (you don’t want to be logged into your browser) to get a cursory list of organizations your site competes with in search.

Make a list of all of the organizations you see in the first two pages of search results. Then look at what they offer, the problem they’re solving, and the experience their site provides to narrow the list down to your three to five closest competitors.

Add these top search competitors to your existing list of competitors, and use a tool like Ahrefs or Semrush to get a sense of comparative rankings (Fig 3.1).

The Rank Tracker interface in Ahrefs’ Domain Analytics tool compares competitors on factors like visibility, position, traffic, and SERP features.

Fig 3.1: This is what the Rank Tracker panel in Ahref’s Domain Analytics tool looks like. Reference the Competitor Overview section to get a sense of how you rank compared to your competitors.

Estimated traffic

Many of the same keyword research tools we used in Chapter 2, such as Ahrefs and Semrush, can provide valuable competitive insights (Fig 3.2). These tools have access to an extensive set of keyword data, monthly search volume associated with each query, and insight on which sites rank for each query—which means they can provide an estimate of monthly organic search traffic for a site.

Detail of the Ahrefs Site Explorer dashboard offering a granular overview of a site’s organic search traffic across various time frames.

Fig 3.2: In addition to keyword research, tools like Ahrefs can also provide estimated organic search traffic insights for any website.

These estimates vary in accuracy, especially if your organization is regional or outside the United States. To gauge how accurate these estimates might be, first compare what each tool says about your site to what you actually know—you’ll probably see some inconsistencies. Then, when you look at the data for your competitors’ sites, keep that same margin of error in mind.

Link authority

As we’ve discussed, a high volume of inbound links from authoritative websites can help improve your site’s rank in search results, so it’s smart to know how you and your competitors measure up. Using your keyword research tool, look at the number of:

  • Referring domains. Referring domains are sites that link to your site. A high number of referring domains typically means more authority. The authority of the linking sites matters, too: the more authority a referring domain has, the more authority it grants your site.
  • Backlinks. As you may recall, backlinks are the number of actual links coming from those referring domains. As with referring domains, the more backlinks coming from authoritative sites, the better.

Looking into your competitors’ referring domains and backlinks can help you gauge how their authority might factor into SERP rankings. For example, if a competitor with comparatively subpar content is outranking your site and excelling in their referring domains and backlinks, you might deduce that those factors contribute to their competitive edge in search results. How did a weak website earn such quality backlinks? Maybe their site is just older and more established, and therefore more sites link to it. Maybe their brand is so well known that Google believes they should appear in search results, so they can get away with satisfying less search intent than you. Whatever the reason, if your site lacks referring domains and backlinks by comparison, it might be a good time to chat with your PR folks about developing a solid organic link-building strategy.

On the other hand, if you have the link advantage but aren’t getting more visibility than your competitor, this may mean your content doesn’t satisfy search intent as well. Your next step should be to look for potential gaps in your content.

Gaps in content coverage

Look at the information architecture and content of your competitors’ websites to understand their topics. Identify the sections, subsections, and individual pages within each part of the site; don’t worry about keywords, but try to notice the coverage and subject matter. Which content topics do they address that you don’t?

Take, for example, baking supply companies King Arthur Flour and Arrowhead Mills. Although they both sell grain-free flours that could be used in gluten-free, low-carb, or paleo diets, only King Arthur uses those terms in their navigation (Fig 3.3). Arrowhead Mills positions the same products as “gluten-free,” without using terms like “low-carb” or “paleo” (Fig 3.4). For reference, “paleo flour” has ten times the search volume of “grain-free flour”—shouldn’t products that fit that description rank for that search term?

King Arthur’s site navigation includes a Special Diet category with a dropdown linking to subcategories like Paleo/Low Carb.

Fig 3.3: King Arthur has multiple “special diet” categories accessible from their main navigation. Beyond being helpful for users, this page contains “paleo” in the URL and links to their gluten-free, low-carb, and paleo products—which helps the company earn visibility in all of those categories.

King Arthur also includes recipes and blog posts with words like “keto” and “paleo” (Fig 3.5), but no high-level category pages to group those recipes together. Two dedicated URLs with links to all their paleo and keto recipes, respectively, would improve their search visibility for those topics even more.

The Arrowhead Mills site navigation features a prominent gluten-free section/page, but makes no mention of products catering to other dietary needs.

Fig 3.4: Arrowhead Mills carries flour that could be considered paleo- or low-carb-friendly, but because they don’t have any product category pages or menu items with those labels, they are likely missing out on search visibility.
Search results returned when doing a search on “keto” on the King Arthur website link to recipes, products, and blog posts.

Fig 3.5: Multiple recipes, products, and blog posts appear when searching for “keto” on the King Arthur website, but a dedicated keto topic page to connect this content would be even better for search visibility.

Tool features like Content Gap (in Ahrefs) and Kombat (in SpyFu) can also help identify content gaps. These can show which keywords you share with your competitors and which you don’t (Fig 3.6), which can highlight potential opportunities for your site. You can also see the keywords ranked in order from highest search volume to lowest. Think of these keywords as potential content topics rather than searches. When a site has visibility for a keyword that you don’t, they likely have content on a topic you don’t cover on your site.

A Venn diagram-like interface from SpyFu shows keyword overlap between your site and competitors’ sites, plus how many keywords the competitors share.

Fig 3.6: SpyFu’s Kombat tool shows how many keywords overlap in the content for your site and competitors’ sites, as well as the keywords they share that you don’t (in this case, over forty thousand keywords).

You can also use some tools, like Ahrefs, to understand which pages, sections, or subdomains on your competitors’ sites generate the most organic search traffic. To access this information, run a Top Pages report and study the list of Top Keywords (Fig 3.7). Do you see any topics that you haven’t already identified? This report is handy because it doesn’t just identify content gaps for you; it identifies the most popular content on your competitors’ sites, the content their users find the most helpful and actively search for. Taking this extra step is a good way to help prioritize which content gaps you should tackle first.

Missing image?

Fig 3.7: With Ahrefs Top Pages, you can generate a report from your competitor’s site that shows you their top-performing pages, what keywords those pages are getting visibility for, and an estimate of the traffic those pages are driving to their site.

Analyzing the competitive landscape is an important part of content research and a prudent precursor to content auditing. Sure, you can audit the content you’ve got now against SEO best practices and your own set of criteria, but if you’re trying to rank in search results, you also have to audit your content against the sites you’ll compete with for search visibility. You’ll identify content gaps, learn more about why domains are ranking (and possibly outranking you), and hopefully find opportunities to meet search intent in more useful and relevant ways.

SEO and Content Audits 

If you’re working with content you already have (as opposed to planning for all new content), content audits are essential, especially for your search strategy. Although it’s common to see separate audits for UX, content, and SEO, that can lead to conflicting recommendations or duplicated work. You can avoid that by considering these three intertwined disciplines all in one audit.

Ideally, someone with a search background can pair up with a content strategist or UX designer to cocreate the audit criteria and tackle the work together. That way, the SEO specialist can ensure the audit covers the technical aspects of SEO. (If you want to learn more about what technical aspects to consider, check out Chapter 5.)

But even if you’re not a seasoned search professional, or this kind of collaboration isn’t possible on your team, you should still audit content to ensure it meets basic SEO best practices. It’s not just a matter of checking for on-page optimization and keyword targeting—it’s about using search metrics to home in on valuable content that should be included in your site audit, making sure that content satisfies search intent, and uncovering where search optimization can make the biggest impact.

Set up your inventory 

At its most basic, a content inventory looks like a spreadsheet listing all of the URLs on your site, often including individual files and PDFs. This is the most thorough way to capture and assess all available content.

In addition to a column for URLs—and any other columns you use in your content or UX audits—you’ll want to add columns for each metric you’ll use to analyze search performance. Start with some metrics that are available in your site’s analytics platform: 

  • Landing-page sessions. This is the aggregate traffic from pages where users first enter your site. Filter this metric for organic search to measure how much organic traffic any given page brings into your site.
  • Page views. A page view represents a single instance of a page being seen by a visitor. If a user reloads the page, or navigates elsewhere and then returns, a second page view is recorded. Make sure any pages on your site with high page views get included in the audit—those are highly visible (and important to search) pages! You should also audit any pages that your business considers important but that have disproportionally low page views.
  • Bounce rate. There are a lot of misconceptions about how a bounce is defined. But we’ll tell you here plainly—a bounce is a single-page visit to your site, with no visits to any other pages in the site in the same session. For example, if a user reads an article on your site but doesn’t visit other pages, that’s considered a bounce—even if they hang out on the page for twenty minutes! A high bounce rate isn’t necessarily bad; in fact, it can be a good thing if the page was designed to give the user all of the information they need right there. However, if your pages were designed to lead people deeper into your site, a high bounce rate likely indicates a problem. When someone visits a page from the SERP and doesn’t find what they’re looking for, they typically return to the search engine to continue their search. Google considers this pogo-sticking, which can negatively impact your rankings.
  • Time on site. Time on site is the average amount of time a user typically spends on a page. It’s important to note that if a user only visits one page (a single-page session), Google Analytics can’t track how much time is spent on that page. Too little time on site (except on pages designed specifically to direct visitors elsewhere) may indicate that users can’t find what they’re looking for.
  • Conversions. A conversion occurs any time a visitor to your site completes a desired action (e.g., watches a video, downloads a file, makes a purchase, etc.). If you’ve set up conversion tracking in your analytics package, you’ll want to grab that data for your audit, ideally including any macro or micro conversions you’re tracking.

We also recommend including some metrics and data that can be found in other tools:

  • Linking root domain count. Linking root domain count refers to the number of unique domains linking to a specific page on your site. As we mentioned earlier, the more sites that link to a URL, the more potential that page has to rank in search, so these pages play an important role in your current visibility. This metric is available in any SEO tool, like Moz or Ahrefs. Look particularly at pages with high linking root domain count in your audit to make sure the content is shipshape. Ensure these pages aren’t accidently removed in a redesign (without accounting for the positive impact they have on your search visibility).
  • Page titles. Each page in your site has a title tag, a short description that tells search engines what the page is about; the title appears at the top of the browser window and in SERPs. Titles should be no longer than sixty characters; longer titles are truncated and could look weird or, worse, misleading in SERP results. The website crawling tool Screaming Frog SEO Spider can show you all the page titles for your site.
  • Meta descriptions. This data is also available in Screaming Frog SEO Spider. A meta description is a tag in a page’s HTML that shows a summary (up to 156 characters) of a page’s content in SERPs. Meta descriptions are extremely important to the search experience, and they deserve as much love and care as the copy on your homepage. They’re literally the first thing a user sees in the SERPs, and often determine whether or not they’ll click through to your site at all.

Now, you could export all of this data from each platform separately, but if you want to save time, Screaming Frog SEO Spider can actually collect all of it for you. Their platform has API access to nearly every other SEO tool and analytics platform out there, including Google Analytics, Google Search Console, Page Speed Insights, Ahrefs, and Moz. So instead of running five separate reports manually, you can collect several different platforms’ worth of data from a single source.

Choose your pages

In addition to getting a complete list of everything living on your site, the main reason to create an inventory is to determine what content you’ll actually audit. Unless you have a website that has fewer than a hundred pages, there’s a good chance you’ll only audit a portion of your site’s content, such as a particular section, a set of key pages, a specific content type, or a sampling of subsections.

If you want to audit a sample of the overall site experience, choose pages that represent a range of content types, page templates, and site sections. Be sure to include:

  • Your homepage
  • Key product and service pages
  • Pages that are important to your brand or responsible for communicating key messages
  • Pages you know are important to users
  • Pages with time- or date-sensitive content
  • Landing pages that lead to the most conversions
  • Pages with high page views
  • Pages with high landing-page sessions
  • Pages with high landing-page sessions and high bounce rates (a sign that they might need improvement with forward paths into the site and internal linking)
  • Pages with high linking root domain count
  • Pages that are underperforming (i.e., pages that are essential to your business or that you believe should be popular, but with page views or conversions that suggest otherwise)

Once you’ve narrowed down your inventory, you should have a more manageable spreadsheet of URLs to audit. What’s more, you can be confident that your audit won’t accidentally overlook pages on your site that are important to users, pages that are playing an important role in your site’s organic search visibility, or underperforming pages that need attention.

Audit your content

Now you’re ready to take a closer look at your content’s search visibility factors—to actually audit. You’re auditing your selected content in order to answer the following questions:

  • Does the content include on-page optimization? Check each URL for the on-page elements that optimize visibility and drive traffic, such as: headings and body content with appropriate keywords; links to pages with related subject matter elsewhere on the site; appropriate authority and trust signals (like author bios and credentials); semantically relevant anchor text for links; and accurate image alt text.
  • Does the content satisfy search intent? If you’ve done the research outlined in Chapter 2, you should have some idea of what the major categories (and subcategories) of search intent are for each of your products, services, or topics. Add a column to your spreadsheet for search intent, assign the relevant theme of intent to each URL, and then review each page to see how well its content, features, and functionality satisfy the intent.
  • Is the content optimized for SERP display? Here, you’re auditing to make sure each page has the necessary elements to be as eye-catching, appealing, and helpful as possible in search results. Look at the title tag and meta description, check for applicable Schema.org markup, and consider content formatting and presentation.

If all of this sounds like an exact science, please remember it isn’t. While there are a few “yes” or “no” boxes to tick, most of this is gut-based and tied to your own assessment skill level. We’ll walk you through best practices for optimizing many of these elements in Chapter 4.

When it comes to the nuts and bolts of the audit, adding a single column to your spreadsheet for every single SEO element you’re looking at would be overwhelming and unwieldy. Instead, you can make aggregate evaluation easier by adding columns for each of the three categories we just mentioned: on-page optimization, search intent, and SERP display.

Stick to whatever grading scale you’re using for the rest of your audit work, or feel free to use ours: we use a scale of 1–3, where 1 is the worst score (none of the category criteria are met for a specific element) and 3 is the best score (all of the criteria are met). We sometimes use half-points if we need more nuanced scores. Use a notes column to cite exactly what’s weak or missing. You can also download an audit template with the criteria we use (http://bkaprt.com/seo38/03-02) (Fig 3.8).

Google Sheet containing an audit template with columns for current URL, future URL, audience, content status, landing-page sessions, and page views.

Fig 3.8: This snapshot of our audit document shows a few of the criteria columns we use to capture data about web content.

Whatever grading system you use, remember that it takes time and experience to understand which items in your audit will make the most impact for organic search, and how to weigh that impact against the effort it will take to implement those improvements. Your goal is to include an assessment of your content’s SEO strengths and weaknesses in search alongside your general content audit in order to avoid duplicative or even conflicting recommendations. This will help you identify opportunities for improvement in meeting users’ search intent holistically through content, features, functionality, and other aspects of user experience.

Incorporate data into decision-making

Your newly acquired SEO data can help validate (or push back on) content, design, and business decisions for your project. Without that data, you could end up removing pages that are important to users—satisfying multiple forms of search intent, answering critical questions, and providing helpful context about complex services. If such pages are deemed irrelevant to the project’s strategy, instead of simply deleting them, you can reframe them to support your strategy while retaining their search value.

Adding a search lens to your content audits will not only make you incredibly familiar with the ins and outs of your site’s search elements, but will also give you a sense of what’s working well, what needs improvement, and which patterns point to sitewide issues rather than one-page problems.

As you know by now, SEO is about so much more than keywords and headlines. It’s about using all of the tools we have to communicate meaning and context to search engines while making information easier for humans to find. In addition to serving as a holistic starting point for improving content, SEO, and UX, your audit findings will help you set performance and success metrics for your search strategy moving forward.

Research Wrap-Up

Adding a search lens to stakeholder interviews, user interviews, content audits, and competitive analysis is useful for making design decisions that lead to successful search outcomes. But it’s not the only way you can go about incorporating SEO into your research practice. Once you get comfortable with how SEO works and grok the basic metrics used to measure search behavior, you’ll find new ways to add SEO considerations to whatever forms of user research your team already uses. And most important, you’ll start to see that optimizing for search is truly tied to creating a better user experience overall.

In the next chapter, we’ll discuss practical ways to use what you’ve learned in research to make search-friendly design decisions that make humans happy, too.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset