I once spent twenty-four hours building a spreadsheet that was technically perfect and practically useless. I was hiring a team for a high-stakes migration-the kind where every second of downtime costs more than the annual salary of the person clicking the button-and I wanted to be objective.

I created fourteen categories. I weighted them according to a proprietary formula I’d concocted in a fever of late-night self-importance. I gave “Strategic Vision” a 20% weight and “Technical Execution” a 15% weight.

I was so proud of my math that I didn’t notice I had prioritized how a company talked about their tools over how they actually used them. The agency that won the bid had the most beautiful slide deck I had ever seen. Their typography was flawless. Their “Strategic Vision” section was a masterclass in aspirational prose.

They failed the migration within the first six hours because their lead developer had never actually touched the specific server environment we were using. I had bought a map from someone who had never walked the forest.

The Quiet Tragedy of the Matrix

This is the quiet tragedy of the procurement matrix. We believe that by turning subjective feelings into numbers, we are removing bias. In reality, we are just replacing an honest bias with a measurable one. We reward the skill of competing for work, which is a fundamentally different profession from doing the work.

In large agencies, these two tasks are performed by entirely different species of people. The “Pitch Team” is a group of highly polished, empathetic, and persuasive individuals whose entire career is dedicated to the first forty-five minutes of a relationship.

The “Delivery Team” consists of the people who actually have to make the pixels move and the code hold together under the weight of ten thousand simultaneous users. When you score an agency on a spreadsheet, you are often scoring the charisma of a person who will never touch your account again.

Column J: Innovation

The evaluation room is always too warm. It’s three hours into a six-hour session, and the air smells of expensive coffee and mild desperation. We are looking at Column J, which is labeled “Innovation.” It is scored from one to five.

There is no definition for what a “five” looks like, but we all know it when we see it in a keynote animation. Karen, who is the only person in the room who actually has to manage the website after it launches, suggests we stop looking at the slides for a moment.

She suggests we load each finalist’s last three launches on the office wifi and time how long they take to become interactive on a three-year-old iPhone. The chair of the committee looks at the clock and sighs. We are already behind on the calendar. We cannot afford the five minutes it would take to actually look at the product. Innovation gets scored from our memory of the slides. We choose the shiny thing.

This preference for the shiny over the functional has reshaped the entire landscape of professional services. When buying committees reward the pitch, capital flows to the pitch teams.

The best builders, the ones who spend their nights obsessing over GSAP motion curves or the efficiency of a schema markup, end up subcontracted invisibly beneath the best presenters. You end up hiring a salesperson who hires a project manager who hires a freelance developer in a different time zone. The original intent-to find the most competent partner-is lost in the layers.

The Baker’s Wisdom

Marie J.-C. is a third-shift baker I know who refuses to buy flour that comes in a pretty bag. She has spent her life understanding that the protein content of the grain is a physical reality that cannot be negotiated by a marketing department.

“To her, a fancy logo on a sack of wheat is a warning sign; it means the mill spent money on a graphic designer that they could have spent on a better sifter.”

– Marie J.-C., Baker

She judges her suppliers by the consistency of the crumb in her loaves, not the font on their invoices. Most procurement departments could learn a lot from Marie. They are currently buying the most expensive bags and wondering why the bread keeps falling flat.

Purchasing a Ghost

The data supports this frustration, though we rarely speak it aloud. Reframing the industry standard for “Pitch-to-Project” drift reveals a startling gap:

In human terms, this means the committee is voting on a ghost. They are purchasing the 86% of the presentation that will never exist. They are paying for a dream and receiving a maintenance contract.

Return to Verifiable Performance

The alternative to this matrix-induced madness is a return to verifiable performance. It requires a shift from asking “What can you do?” to “What have you done that is currently working?” It is the difference between looking at a blueprint and walking through a finished house.

If an agency claims to be an expert in Webflow or technical SEO, the proof shouldn’t be a bullet point. It should be a live URL that loads instantly, responds perfectly to a thumb-swipe, and carries the weight of a complex brand without stuttering.

This is why teams like Coherent Agency focus so heavily on the engineering aspect of the build; they understand that a website is a piece of infrastructure, not a digital brochure. When the engineering is handled in-house, from the brand identity through the GSAP motion work, there is no hand-off to fail. There is no “Pitch Team” to disappear once the contract is signed.

The spreadsheet is a comfort blanket for the risk-averse. It provides a paper trail that justifies a decision, but it rarely guarantees a result. If the winner of your RFP scored a “5” on Cultural Fit but their last three sites take eight seconds to load, you haven’t found a partner; you’ve found a very likable problem.

We need to start weighting the “Karen Test”-the act of actually using the product on a mediocre device-higher than the “Slide Test.” A heavy spreadsheet cannot balance the weight of a broken link.

I think back to my own mistake, the one with the typography and the failed migration. If I had spent thirty minutes talking to the developer who was actually going to move the data, instead of the account executive who was moving the conversation, I would have seen the gaps.

I would have noticed the lack of specificity in their answers. I would have realized that their “Strategic Vision” was just a collection of nouns they had harvested from a medium-tier conference. We often use the matrix to avoid the hard work of judging competence. We let the numbers do the thinking so we don’t have to be responsible for the feeling.

The Bottom Line of “Feeling”

But the feeling matters. The feeling of a site that snaps into place, the feeling of a CMS that doesn’t fight the marketing team, the feeling of a project that stays on the rails because the people in the meeting are the same people in the code-these are the metrics that actually drive growth.

They are harder to put into a cell in Column J, but they are the only things that show up on the bottom line after the launch party is over.

Selection processes shape the industries they serve. If we continue to reward the loudest and the brightest, we will continue to get agencies that are spectacular at talking and mediocre at building. We will get more layers, more subcontractors, and more “Innovation” slides that disappear the moment the ink is dry.

Prioritizing the Organism

We need to start looking at the flour, not the bag. We need to prioritize the engineers who view a website as a living organism rather than a static design file.

The next time you find yourself in a room with five agencies and one spreadsheet, try a different approach. Close the laptop. Turn off the projector.

Try the Reality Test

Ask each finalist to show you a live project they launched six months ago, and then ask them to explain-in plain language-one mistake they made during the build and how they fixed it.

The agencies that thrive on the pitch will stumble; they aren’t used to talking about reality. The builders will lean in. They will tell you about the GSAP conflict they solved or the way they optimized the Lottie animations for mobile users. They will talk about the work because they actually did the work.

A cracked mixing bowl proves that even the best recipe fails without sound equipment.

The weight of the presentation is a temporary gravity. Eventually, the slides are archived and the meetings end, and you are left with nothing but the code and the customer. If the code was written by a “Delivery Team” that was never in the room, you are already behind.

The real innovation isn’t in the way an agency sells itself; it’s in the way they refuse to let a single pixel fall out of place. It’s in the refusal to subcontract the soul of a project to the lowest bidder. It’s in the engineering.

Finding the Truth

We should stop trying to find the agency that fits the matrix and start finding the agency that renders the matrix irrelevant. When the work is good enough, you don’t need a formula to prove it. You just need to open the browser and see for yourself.

The truth of a company is always hidden in the things they don’t think to include in the pitch. It’s in the footer. It’s in the page load speed. It’s in the way the site feels when you’re standing in a parking lot with two bars of signal. That is the only score that ever truly counts.