Company research usually starts with what a company says, like its tagline, About page, and press releases. What a company builds is harder to fake and easier to miss. Company website analysis studies the structure of a company's site, looking at the pages it publishes, how they are organized, what the navigation promotes, and what is left out.
What a Company's Website Structure Reveals About Its Positioning
Company website analysis maps a site's pages to show which products, buyers, and markets a business targets.
We built this into aVenture because of a problem in our own research. A company's website holds more public information about it than anything else the company publishes, yet few analysts read past the homepage and pricing page. The rest of the site, often hundreds of pages, goes unread.
Each page is a choice the company made
A company decides whether to build a documentation portal, and whether to publish its prices or require a sales call. It also decides whether to list twelve open engineering roles on its careers page or take them down.
Each choice tells you something about how the company sells.
- A large documentation section points to a product-led company that expects practitioners to test before they buy.
- Public pricing points to self-serve sales. Without it, expect enterprise sales, negotiated deals, or a product that has not settled on a price.
- An active careers section shows the company is hiring, and the listed roles show which teams it is growing.
- A large press and news section suggests the company is actively working with the press. A small one suggests it has not needed to yet.
- The balance of marketing pages to product pages shows whether the company spends more effort on selling or on the product.
None of this requires the company to disclose anything. It only takes reading the whole site. Research often skips that step. Reading one large site by hand is tedious, and reading every site in a market by hand is not realistic.
What a full page map contains
We crawl a company's official website and build a page map. The map lists the pages that exist on the site, and it can be refreshed.
The map has four parts.
The sitemap tree
The first part is the tree of pages. It lists the web addresses we can find on the company's domain, organized by how pages nest under one another. Each page includes its title and last-modified date when the site provides them. The tree works as the site's table of contents.
Page classification
A list of addresses does not answer research questions on its own. We sort each page by type: pricing, careers, product, documentation, blog post, press release, or legal. Once pages have types, you can check whether a company publishes its prices, compare the size of its documentation with its marketing pages, and see when it stopped posting to its blog.
How the site is served
We note how each page is delivered, and which content-delivery network (CDN) or hosting company serves the site. Some sites send a finished page, while others assemble it in your browser with scripts. A recent move to newer hosting or page-building tools is a weak sign that the engineering team is active. An old setup with a blog last updated years ago suggests the opposite.
The link inventory
We list the site's links in two groups: links that stay on the company's own site and links that lead elsewhere. The outgoing links show which platforms the company integrates with, which communities it takes part in, and where else it keeps profiles. The company's GitHub account and social profiles are saved on its aVenture profile.
Reading positioning from structure
Once pages have types, you can read a company's positioning from its structure.
- The sections nearest the top of the site and the pages in the main navigation show what the company puts first. When a company reorganizes its site around a new product line, the change usually appears before the press release.
- Public pricing shows who the company expects to buy and how it expects buyers to compare it with alternatives.
- Where the company writes the most tells you who it sells to. A company with five hundred documentation pages and thirty marketing pages sells to technical users. The reverse points to a marketing-led company.
- Careers pages change more often than other sections, so comparing them across repeated crawls shows hiring changes as they happen.
- Comparing a refreshed map with the previous one shows pages appearing, disappearing, or moving. A pricing page that disappears is worth investigating, and so is a new "Enterprise" section.
Mapping a whole market
Mapping one company's site by hand is possible, but a research question usually covers a company and the eight companies around it, and the work repeats next quarter.
Maps are built in the background, so many companies can be mapped at once. You can refresh any company's map on demand when last month's crawl is too old. Reading the full websites of the companies in a market becomes a normal research step.
The engineering problems
Making the page maps accurate took most of the engineering work. Three problems were behind it.
- Some sites assemble their pages with scripts. Many company websites build pages that only appear when a browser runs those scripts, so a tool that reads only the raw page sees a nearly empty shell where a visitor sees a full product page. We detect when a site works that way and read it the way a browser does. When the raw page is enough, we read the page directly, which costs less than running a browser.
- One page can appear under many addresses. Tracking codes, redirects, and small differences in how an address is written can make one page show up under several addresses. Left alone, the map would count that page several times. We write every address in one standard form, so the tree counts each page once.
- Some links are not site pages. A footer link to the company's GitHub page or social profile leads off the website. The page map lists only the site's own pages. Mixing those links into the map would make both the map and the profile links wrong.
Explore the Website tab
The Website tab on company profiles shows an index of mapped pages when they are available. Pages are grouped by section (homepage, product, pricing, careers, blog, press) and link to the original site. If a company's pages have not been mapped yet, the tab says so and lets you request a refresh.

Explore Anthropic's published pages by topic without building the website index by hand.
Try it
aVenture is a research platform for private companies, and the Website tab puts a company's own pages on its profile.
The Free plan lets you open 15 company and person profiles a month, and includes funding history and news alerts. Create a free account, or see the pricing page for the full plan terms.

