AdminISC

Transparency vs Asymmetrical Information

Published February 9, 2012 |

“All things are subject to interpretation. Whichever interpretation prevails at a given time is a function of power and not truth.” – Friedrich Nietzsche

Everyone Except Me Should be Open

Being labeled as open or transparent is a great public relations strategy. Executed effectively it gets ditto heads to feel like they are part of a movement and spread your propaganda.

However actually being transparent is often a poor business strategy.

When WordAds opened up someone in the comments suggested that they should win by being open like Google. I read that and laughed. Where Google is losing you can count on them pushing the open label in order to build momentum & destroy the asymmetrical information advantages of existing market leaders. But where Google leads non-transparency is the norm.

A few examples & comparisons:

Claiming to run an open auction, while running obfuscated quality metrics that price gouge advertisers.
At the same time Google is trying to push social sites to offer transparent data, they decided to block some Google search referral data (unless you are paying for the clicks, then you get that data).
When planning some of the features behind Google+ one of their employees wrote a book about the social circles concept with Google’s blessings. Then, after he wrote the book, Google revoked permission to publish it!
Nuking affiliate links of some websites & then investing in Viglink, a network that automatically turns links into affiliate links.
Burning some networks of websites for being doorway pages & then investing in the Whaleshark Media roll up & launching Google Places.
Nuking some UK financial comparison sites for link buying & then buying BeatThatQuote.
Suggesting 60 or 90 days of penalty is a reasonable penalty for sketchy links & allowing BeatThatQuote to rank 2 weeks after penalizing it without cleaning up any of the paid links.
Android is open but internal Google emails revealed that carriers were getting wise to Google using compatibility as a club.
Not sharing revenue share stats with AdSense partners for a half-decade.
When websites are nuked they are frequently given no explanation. Worse yet, their content often re-appears in the search results on some other domain that stole it, in many cases while being wrapped in AdSense ads.
Arbitrarily making it hard to export AdWords campaigns to other services (& making it against the TOS to do same via the API).
The Panda update was needed to rid the web of garbage content. And yet Google is pre-paying Demand Media to post videos on YouTube. Since the Panda update downstream Google traffic to YouTube has more than doubled & YouTube is serving over a trillion streams per year!
In spite of not having permission to do so, Google has been scanning books for nearly a decade now. Yet whenever Google goes to court they try to get the court documents sealed so that their statements couldn’t be used against them.

Judge, Jury, Executioner

Calls for “transparency” in SEO may sound great on their face, but once you peal back the covers the absurdity is laughable. If Google didn’t discriminate against certain types of players & if Google didn’t compete in the very markets that it judges then perhaps transparency would be a good idea.

However Google is perhaps the single biggest direct competitor in many markets, so to be fully transparent with them when they are the opposite with you is a naive business strategy:

I also disagree that outing each other would make the industry less like a mafia, because SEOs aren’t the mafia. SEO is a symbiotic marketing channel reliant on Google, until the next big search engine/method comes along. In a mafioso analogy, Google would be the mafia – as they control the market. Removing all webspam wouldn’t necessarily create better search results or a fairer market, as Google still decides who wins and who loses. The biggest winner being Google itself, the next level being their friends.

Secrecy is also the cornerstone of all marketing channels. Social Media for instance works in a similar way to SEO, except they have secret voting methods rather than secret linking methods. You don’t see major social media companies outing a rival’s voting methods, as it would shine a torch on their own methods. Even outside of marketing, McDonalds probably worked out KFC’s magic blend of herbs and spices decades ago, but it’s not in their best interest to tell everybody.

Outing webspam helps an SEO blog to keep their UVs up and their VCs happy. It helps a failing newspaper to appear modern and edgy, whilst allowing the contributor to launch a protection racket off the back of another company’s misery.

Do You Want SEOs to Seem More Professional?

How often do you see tier-1 public relations firms marketing themselves by smearing other PR firms?

You don’t.

You might see a company like Google hire a PR firm to push a bogus study to smear the security of a competitor, but you rarely (if ever) will see one PR firm smear another in the media.

While some of the more intellectually challenged members of the SEO industry associate search spam with molesting children (talk to Google about that after their recent Chrome fiasco), those with a bit of intelligence and/or experience realize that many of the issues are gray and murky. What one person considers as spam one day they later sell as “advanced” months or years down the road. The ecosystem isn’t some static black & white code:

The question is less whether black hat and webspam are a good thing or not, but if Google is the unbiased and benevolent instance who shall make the rules. Google is a business and persuits its very own interestes, since it is aware of its market power with a lot of arrogance, aggresivity and obviously double standards. That was also Aaron’s point, but seomoz has been missing the point completly in the last time.

I expect an SEO portal/community to focus on how stuff actually works/can work, not to propagate how the monopolist does it want to work. It is their risk of doing business if they decide for an algorithm, not ours. It is our risk however, to decide whether to stick to the rules or not. And it’s not only about ethics but has several practical implications…

Full Disclosure Required, Except From Us

On paid links Google claims to require machine AND human readable disclosure. Then on their own site they use an ad color background that literally fades to white on many monitors. Maybe it is legitimate that they are only able to fool some of the users some of the time. But some of their ad initiatives have 0 disclosure at all. None.

That is now part of the “organic” search results, but is that a paid ad?

You wouldn’t know by looking at it, but according to the WSJ it is: “Google lists booking links to the airlines as advertisements, but the company declined to comment on how much money it makes from the arrangement.”

There is no disclosure that you are in a paid ad funnel until the very last click. And those who fail to pay are either unlisted, listed last, or have a broken booking process where their brand is arbitraged in an attempt to flip the click to somewhere else. According to Leocha, “Google and the airlines have a sweetheart deal with each other, and the consumers are getting screwed.”

In the hotel market Google is also testing comparison ads & price ads.

Notice how little they care about relevancy so long as they keep the click on Google or are paid for the referral. They rank the car rental company Avis as a top Las Vegas hotel! And even the ad links that are sold off of that do not line up. Priceline pushes the Plazzo Luxury Suites & Booking.com pushes the Venitian.

Retarding Investment in the Search Ecosystem

What do you suppose the above behavior does to cash flow & multiples of websites in that vertical? Of course it contracts them & retards investment. Who wants to start a new hotel website at this point? What other verticals have investment held back by the fear of Google’s eventual entry?

If you only had to manage competing against other market competitors & staying inside Google’s editorial guidelines then investment isn’t that difficult, but if you have to stay within Google’s guidelines in the short term yet try to build a business that is sustainable even after Google enters & destroys the market it is far more difficult.

Skimming the Cream

At any time Google can enter any market and skim off the cream: “An independent study from Leads360 showed consumers using Google’s comparison ads converted better than any other lead provider.”

Other affiliate networks which do not own the search channel have to fight through quality issues if they try to build similar scale.

A Self-serving Bias You Can Count On

When Google enters a market it might buy out a competitor, buy out a supplier, bundle, use predatory pricing, grant themselves superior search placement, adjust the relevancy algorithms and/or editorial guidelines, violate IP, scrape 3rd party content, work with sketchy advertisers & publishers to undermine competing business models, or any combination of the above.

They are rarely transparent with their interests when they enter a market. Almost everything is labeled as “a beta” and “just a test.” They promise to “act appropriately” & you may not be aware of the steamroller until you are under it.

Web Scrape Plus+ (Now With More Scraping)

When the +1 button & Google+ launched, Google highlighted how they would use the + button usage as a “relevancy” signal. Google recently started inserting + pages directly into the search results for brands & right from the very start they were using it as a scraper website that would outrank the original content source.

Google used the buy in from their promised relevancy signal to create a badge-based incentivized system which acts as a glorified PageRank funnel to further juice the rankings of these new pages on a domain name that already had a PageRank 10.

I recently read a blog post about how anyone could do the above & the opportunity is open to everyone. But the truth is, I can’t state that something will become a relevancy signal that manipulates the search results in order to get buy in. Or, if I did something which actually had the same net effect, Google would likely chop my legs off for promoting a link scheme.

Recently the topic of Google+ as a scraper site came up yet again via Read Write Web & on Hacker News a Googler stated that it was “childish” to place any of the blame on Google!!!!!!

Google determines how much information is shown near each listing & can create “relevancy” signals in ways that things tied to Google get over-represented (look at the +1 count here). When they do that & it destroys other business models *of course* Google deserves 100% of the blame.

It may be more profitable for Google to squeeze out some of the players, but if Google’s quest for free content manages to destroy business models & the ecosystem as a whole, then they are not “doing what is best for the user.”

Things We Do Not Approve…

Google can bundle themselves into markets, but when others do the same it is a big no no:

A Google spokesman said “applications that are installed without clear disclosure, that are hard to remove and that modify users’ experiences in unexpected ways are bad for users and the Web as a whole.”

Google’s founding research highlighted how bad ad-driven search engines were & then Google’s core revenue engine of paid search was built on their violation of Overture’s patent. They keep buying swaths of patents to protect against their other violations.

The business model of “violate & then buy protection” has helped lead to a protection-racket styled marketplace in patents that makes the risk of innovation for smaller players so expensive that it drives them under.

Where Google has gained a dominant position in a marketplace they can begin misdirecting for profit. Let’s say you link to your own location on Google Maps to drive traffic to Google & help your users locate your office. Well in some cases they then reciprocate by confusing users by putting an ad in your location bubble.

Once again, you are forced to buy your own brand unless you teach your customers (and prospective customers) to avoid Google products.

Sure I May Have Failed, But at Least That Failure Was Transparent…

If you are fully transparent against an arbitrary set of guidelines when the company that judges you also competes against you & brushes up against the limits of the DOJ & FTC then you might lose for no reason other than being transparent. And not only are you competing directly against Google, but the algorithms are biased toward certain players.

Creating a Two-tier Web

In 2006 Google’s Eric Schmidt admonished others for attempting to create a 2-tier web:

Today the Internet is an information highway where anybody — no matter how large or small, how traditional or unconventional — has equal access. But the phone and cable monopolies, who control almost all Internet access, want the power to choose who gets access to high-speed lanes and whose content gets seen first and fastest. They want to build a two-tiered system and block the on-ramps for those who can’t pay.

But when Google launched their Panda algorithm they did the same thing.

Their “quality content” thesis could have come across as being honest if they weren’t still pre-paying Demand Media to upload “content” to YouTube.

You might get smoked by a Panda update or have your accounts arbitrarily frozen while operating at a 7 out of 10 level, and then you see Ask is Google’s biggest advertiser, their arbitrage gets a pass, & that feed even monetizes misspelled searches for Google’s brand.

Risks

Risk is needed for adaptation, so some amount of risk is good, but…

If you invest in ultra-high quality content & then someone else scrapes you and outranks you then your business model might not be sustainable.
Google’s approach to patents has helped feed into a side current of risk for independent developers.
For many businesses the unknown Panda risk is every bit as damaging as the great firewall of China. Each additional unknown kills x% of small new online businesses. If unemployment is high, companies are not hiring & the bar for self-employment is too high then the web stagnates.

If the old established corporate competition needs to be as good as you to compete then there is little risk to being transparent if the competition is doing nothing beyond following you around. But if the playing field is tilted and the competition only needs to be 5% as good as you are to beat you (and can easily come from behind to copy any success you have) then full on transparency brings much more risk than potential profits.

You Are the Ad

We are moving into a media world where the content becomes ads & even how people interact with the ads and content becomes a part of the ad.

Further Google uses their data advantage to create other asymmetrical advantages. While credit card companies sell personalized ads in network, Google is creating a marketplace to buy and sell user data.

Every time you view a page and click an ad (or even don’t click an ad) you are feeding highly personal data back to Google. And they will use it as they wish. Here they are saying thousands of people like eBay, which is of course plenty reasonable, except for the fact they claim the people voted for that specific page rather than the site as a whole.

What’s worse is that sometimes they will put your picture next to a listing and claim that YOU PERSONALLY voted for a specific page & use that to market that item to your friends and contacts. The problem with this is that:

even after you remove the vote for a site they still keep showing it
you may vote for site A & they will show your image as voting for site B
when they show your picture they claim you voted specifically for the page being advertised (even if that page is promoting a scam or something else you wouldn’t endorse)

Once again, I will highlight that they use the votes against the wrong sites & pages and that they keep showing the votes even weeks after you remove them.

Where is the transparency in that deceptive crap?

Others Are Just as Bad, But Are Not Monopolies

But Aaron, you are just being hard on Google, why don’t you ever mention Ask or Yahoo! or Bing?

I did mention Ask above.

Bing has done numerous self-serving things, including some that are flat out sketchy.

Yahoo! offers a useless “buying guide” for fish tanks that is nothing more than a paid pointer to Overstock.com.

If you click on their coupons tab on that fish tanks search Yahoo! shows you coupons for tank tops, which is pretty idiotic.

Why is this Yahoo! Shopping & Yahoo! Deals product so ugly? They outsourced it years ago. So it is a non-product & thus the integration can’t be anything but crappy.

Why do Yahoo! & Bing typically get a pass? They own a fairly low search marketshare. Missing traffic from either or both of those is certainly significant enough to be felt, however even when they are combined it is still less than half of what Google controls in most markets. Market leaders are expected to operate in less conflicted & less self-serving ways than also ran players in their market do. If Microsoft would have had 10% or 15% marketshare for their operating system then it is unlikely their browser bundling would have come under such scrutiny.

Transparency in The Real World

In the past I highlighted how every form of media is manipulated in Why Outing is Bad, but I thought it would be fun to run through some other markets and highlight how transparency often exists only as an illusion (to lure in punters so they can be rooked).

TrueCar aimed to make that market more transparent by giving consumers pricing data online to remove some of the asymmetrical advantage dealers have & makes the sales process smoother for consumers. How does the automotive market respond? Honda issued threats to their dealers & now TrueCar has a hate video ranking for their brand.

This nontransparency is not something new, but rather the way it has always been.

It exists at every level of society. Countries spy on one another & companies may chose to show different views of the world to different markets.

And what they do internally doesn’t match the story they share publicly. Look no further than the News of the World’s hacking scandal:

News International’s leading profit centre, the News of the World, was dependent on a very ugly culture of lawbreaking, hacking and impunity. This freewheeling, ask-no-questions attitude spread to other parts of the organisation, such as the Times and the Sunday Times, both of which used have used illegal or unethical techniques. Even more troubling, when senior News International management were confronted with evidence of wrongdoing, the company made false statements and took actions which prevented key evidence from reaching the public domain.

The same company has not only been accused of hacking at some of its other news outlets (by its own employees no less) but was also accused of similar in other lines of business:

Both cases involve News America Marketing, an obscure but lucrative division of the News Corporation that is a big player in the business of retail marketing, including newspaper coupon inserts and in-store promotions. The company has come under scrutiny for a pattern of conduct that includes below-cost pricing, paying customers not to do business with competitors and accusations of computer hacking.

Were The Robber Barons Transparent?

Going back into history it is sort of hard to pick a starting point (one can go to the spice trade & orders that are unsealed at sea, or likely earlier than that) but to pick a somewhat recent starting point, we could look at the railroads:

So how did unnecessary, inefficient railroads get built? Because of government subsidies. In short, the federal government paid to build the railroads through massive financing subsidies and also gave them ample land grants. The trick to building a railroad was not knowing anything about railroads or even about business; it was having friends in Washington who could give you the right financing and land subsidies.

Even then, the railroads lost money. Not only was there insufficient demand for their services, but they were run by people who were generally incompetent. (For one thing, they didn’t even know their own costs of doing business.) Yet the people who owned the railroads made fabulous amounts of money (of which Stanford University is one symbol). The main way to do this was simple. The people who controlled a railroad (generally by putting up very little of their own money, thanks to the government subsidies) would also wholly own a construction company. They would cause the railroad to overpay the construction company to build the railroad—in effect transferring wealth from railroad stockholders and creditors into their own pockets

What did the Robber Barons invest in? In large part government, media & educational institutions so that they could help “educate” society on how to behave much more civilly than they have.

Corporate Advocacy

There are tons of marketing campaigns designed to “educate” society about the impacts of various companies. BP now markets the gulf coast economy they plundered.

AT&T’s astroturfing campaign to acquire T-Mobile was so over the top that it actually backfired.

“Get the facts” styled campaigns are rarely about promoting a complete worldview.

Remember the $500 million fine for Google from them pushing ads selling overseas Viagra in the US? Now they promote scaremongering ads against fakes from filthy labs.

Coca-cola runs The Beverage Institute & has “doctors” highlight how healthy soda is.

At the same time, when Pepsi was sued over an alleged rat being in a can of Mountain Dew. Pepsi’s defense claimed: “the mouse would have dissolved in the soda had it been in the can from the time of its bottling until the day the plaintiff drank it” turning the mouse into a ‘jelly-like’ substance. But don’t worry folks, it’s healthy.

At least we still have water.

When they are not busy making it illegal to collect rainwater, Bechtel wants you to follow them on Twitter.

It is hard to know what is in our food & those who label things as organic have to fill out more paperwork than those who manufacture frankenfood. Then there are the baseline chemicals sold as biodegradable which are not.

Oh well, at least we have insurance.

State Farm is the #1 ranked bad faith insurance company, but at least they upload & advertise irrelevant funny videos to YouTube to create brand signal for Google.

Transparency in Everyday Life

Of course some of the worst affiliate offers, the most aggressive sales calls & other scams are designed to prey on ignorance of small print & rebilling, but even generally good businesses practice in asymmetrical skimming.

A few recent examples:

You are reading this on a computer monitor right now, right? LCD manufacturers recently had to pay over a $553 million price fixing fine.
See this review about spam mail (the physical kind) from National Geographic.
Cell phone companies bill you for services you don’t even use and then there is a tax added to subsidize handing out free cell phones.
One of the largest religious institutions was found to be associated with illegally selling off hundreds of thousands of babies (after telling the single mother that their newborn child died). This process was going on through the late 1980′s!
Medtronic surgeons which were paid over $60 million held back nasty side effects.
Online poker was made illegal in the US a few years back. The thesis for why it was made illegal was reinterpreted internally by the DOJ in September, but that wasn’t announced publicly until just after one of the Absolute Poker co-owner admitted his guilt. The public announcement increased the stock price of numerous gaming companies, as Nevada gets ready for online poker.
This past holiday season Best Buy not only sold products they didn’t have, but in many cases when they did have them they charged a rate higher than the one advertised unless you caught it & forced them to charge you the advertised price.
When looking at my credit card bill I saw a scammy $22.99 charge on it for a credit report I have never ordered. I looked up information about the “company” offering that service & the #1 result (with sitelinks) was my darn credit card company’s website! They had to conduct a block on themselves, but if you don’t notice it they will steal $23 a month until you die.

Is Our Financial System Transparent?

When one looks at the field of finance it is story after story of deception, nontransparency & lawlessness. It is a constant reminder that there is no such thing as business ethics.

Wachovia laundered $3.84 billion in drug money for violent drug cartels. As if that wasn’t bad enough, we also sold them weapons that wound up at murder scenes with our own border patrol dead & the Koch brothers sold weapons to states that we brand as “rogue.”
Bank of New York Mellon ripped off their clients with unsavory Forex rates: “As investigators sought to determine whether the bank overcharged clients to execute their currency trades, a senior BNY Mellon executive nicknamed “Rambo” urged traders not to tell clients how much money they made on trading, according to the informant.”
A former Federal Reserve member writes about the Fed: “No matter the legalistic interpretation, the Fed is, working through the ECB, bailing out European banks and, indirectly, spendthrift European governments. It is difficult to count the number of things wrong with this arrangement.”
Bank of America recently had to pay $335 million to settle a discrimination lawsuit against minorities, due to Countrywide (who is NOT on your side) charging juiced interest rates. Bank of America had to pay an $8.5 billion settlement to investors who bought some of the junk mortgages out the other end.
“What’s happened is that, almost overnight, we’ve switched from democracy in real-property recording to oligarchy in real-property recording. There was no court case behind this, no statute from Congress or the state legislatures. It was accomplished in a private corporate decision. The banks just did it.” – Christopher Peterson
The financial markets are becoming glorified crack houses: “Frankly, I am concerned that Wall Street is becoming little more than a glorified crack house. Day after day, the sole focus of Wall Street is on more sugar, stronger sugar, Big Bazookas of sugar, unlimited sugar, and anything that will get somebody to deliver the sugar faster. This is like offering a lollipop to quiet down a 2-year old throwing a tantrum, and expecting that the result will be fewer tantrums. What we have increasingly observed over the past decade is nothing but the gradual destruction of the ability of the financial markets to allocate capital for the benefit of future growth. By preventing the natural discipline of the markets to impose losses on poor stewards of capital, and to impose interest rates high enough to force debtors to allocate the capital usefully, the world’s policy makers are increasingly wrecking the prospects for long-term economic growth.”
Companies are often brought private, leveraged up on debt & have their pension programs destroyed to make “profits” for private equity investors: “Nowadays private-equity firms often spend hundreds of millions of their own money on an acquisition (BW — Feb. 27). Just as often, though, they load up the companies with debt and use the money to pay themselves special dividends and other fees that allow them to profit even if the company itself struggles. Then the backers take the company public, often pocketing the lion’s share of the offering.”
Individuals who put in extra hours of work because they are sold on the promise of their options may also find those disappear: “Taking away the value of options that are vested means that the concept of vesting becomes bogus. It doesn’t matter whether the employee understood if this was the deal or not, it’s a scummy practice, and it’s ultimately self-defeating (both for the company and the industry as a whole). Who would go to work for Skype (or any PE-backed company) in the future? ”
Limitless fraud before the courts & dancing on the graves of the newly homeless: “Court records show that the firm angered state court judges for alleged false statements and filing suspect documents. Arthur Schack, a state court judge in Brooklyn, in a 2010 ruling said that pleadings by the Baum firm on behalf of HSBC Bank, a unit of London-based HSBC Holdings, in a foreclosure case were “so incredible, outrageous, ludicrous and disingenuous that they should have been authorized by the late Rod Serling, creator of the famous science-fiction television series, The Twilight Zone.”
…
The law firm said it would shut down after New York Times columnist Joe Nocera in November published photographs of a 2010 Baum firm Halloween party in which employees dressed up as homeless people. Another showed part of Baum’s office decorated to look like a row of foreclosed houses.”
That theft of physical property is ongoing: “Also announced over the weekend was the jaw-dropping, yet illuminating fact that the MF Global bankruptcy was fraudulently, nefariously and illegally drawn up as a Chapter 7 BK for a SECURITIES DEALER and NOT a commodity brokerage as it should have been. Look, MF Global was the second-largest non-bank FCM in the United States next to NewEdge which is the old FIMAT. If MF Global wasn’t an FCM, then there are no FCMs. Of course it was an FCM. It had $7.2 billion in customer seg funds as of August 31, 2011. And yet MF Global was immediately, from the get-go, put into Chapter 7 BK as a SECURITIES FIRM. This is fraud. MF Global’s BK should have OBVIOUSLY been established under Subchapter IV of the Chapter 7 code as a COMMODITY BROKERAGE.”
And as banking criminals literally steal money, destroy lives & undermine the rule of law to grow their “profits” sleazeballs like Jamie Dimon think that the reason people hate them is envy.

The above makes no mention of helping Greece hide governmental debt, bid-rigging bribes in Jefferson County, robosigning bogus foreclosure documents, and a host of other crimes. But one thing in common with all the above crimes is this: no jailtime for the banksters.

Since there is nothing stopping those criminals they keep up their crimes:

Big banks represent the ultimate in concentrated economic power in today’s economies. They are able to resist all meaningful reform that could really change their compensation schemes. Their executives want to get all the upside while facing none of the true downside.

But capitalism without the prospect of failure is not any kind of market economy. We are running a large-scale, nontransparent, and dangerous government subsidy scheme for the benefit primarily of a very few, extremely wealthy people.

The actions of the financial cartel are both obvious & predictable. And the damage they do is felt worldwide:

Credit-financed economic booms, by turns in private then public credit as one ratchets up the other over a series of booms and busts, are as irresistible to politicians as hookers and maids.
…
The failures of American FIRE Economy policies are behind the movements in Libya, Yemen, and Syria, as reflation measures, from quantitative easing to currency depreciation, steal purchasing power from low income families world wide, acting as the most regressive tax imaginable. Simmering hatreds are exacerbated by the developing global crisis over oil supplies and costs.
…
The so-called debate about debt ceilings, spending cuts, and entitlements reductions is a red herring. The public debt crisis arose from the 2007 – 2008 private credit market crisis, not the government liabilities that have been building for decades. The mistake of both the left and the right is thinking that we can escape an output gap without facing up to the politically unpopular task of demanding that creditors take a loss on loans taken out during the credit bubble era.

A creditor that makes bad loans deserves to go out of business. Their outsized compensation can’t be justified unless they are also made to eat their losses. But rather than holding them accountable for their own actions, societies the world over absorb that pain.

“Fascism should more appropriately be called Corporatism because it is a merger of state and corporate power”- Benito Mussolini

Slavery, Debt & Freedom

There are currently more slaves alive than at any point in history. And many people who are not slaves are still being enslaved by crushing debt:

Money is a human construct. The fact that our money is now backed by nothing more than our collective future ability to “produce” relegates us to that of slaves.

Money=paper=blood hours.

Blood hours are a finite measure. Heartbeats.

What’s in your wallet? Is it the new debt slavery card: “A personal bankruptcy is supposed to cut borrowers loose from lenders and debt collectors, but Capital One Financial Corp.—one of the nation’s largest credit-card issuers—sometimes doesn’t want to let go.”

Citigroup has an “effective” strategy they employ in some 3rd world countries to deal with those who can’t pay:

After dropping his younger daughter at school, Octa walked into Citibank’s credit card collection department on the fifth floor of the Jamsostek tower just after 10 a.m. Four hours later, he left the 25-story building slumped motionless in a wheelchair — a victim of what police allege was a violent assault by debt collectors. Driven to a nearby hospital in a Citibank car, Octa was pronounced dead on arrival.

Unfortunately, even if you stay out of debt, you are forced to support banking scams:

before being bailed out by governments, banks had never made any return in their history, assuming that their assets are properly marked to market. Nor should they produce any return in the long run, as their business model remains identical to what it was before, with only cosmetic modifications concerning trading risks.

So the facts are clear. But, as individual taxpayers, we are helpless, because we do not control outcomes, owing to the concerted efforts of lobbyists, or, worse, economic policymakers. Our subsidizing of bank managers and executives is completely involuntary.

In the US the reason the government debt outlook is so bad is in part due to overpaying for “assets” owned by the likes of Citibank:

The way the banks make money now is by hiding their losers off balance-sheet, or by forcing them on the taxpayers, and after having themselves declared “systemically important,” adjusting their on balance-sheet exposures accordingly, crashing the system and cashing out on their leveraged derivative bets, also at the taxpayers’ expense.

In real life, if there is such a thing anymore, all of the major banks are arguably insolvent. So, in reality, they’re not making any money at all, they are merely having it transferred to them by their political operatives in Congress and the Federal Reserve Bank. This, after all, is the modern purpose of the Congress, and has always been the purpose of the Federal Reserve System.

Even as they destroy savings, kill jobs & undermine the competitiveness of the economy, why does the government continue to support such scams? Without the scams & cost-shifting those in government wouldn’t have as much wealth, power & influence. It is debt & cost-shifting that fuels them:

government and banks are stuck together like a couple of dogs screwing and we don’t know which is on top. Here, Republicans need government to finance war and Democrats need it to finance social programs. Both need it to finance both, as that is how government attempts to maintain power and influence over the people this day and time.

The congress literally sells insider tips to hedge funds:

When Senate Democrats finally brokered a compromise over the proposed health-care law, a group of hedge funds were let in on the deal, learning details hours before a public announcement on Dec. 8, 2009.

The news was potentially worth millions of dollars to the investors, though none would publicly divulge how they used the information. They belong to a select group who pay for early, firsthand reports on Capitol Hill.

Since most money comes into circulation as debt (and due to the compounding nature of debt interest), if those at the top are not allowed to fail then those at the bottom will fall hard:

In the past, periods dominated by virtual credit money have also been periods where there have been social protections for debtors. Once you recognize that money is just a social construct, a credit, an IOU, then first of all what is to stop people from generating it endlessly? And how do you prevent the poor from falling into debt traps and becoming effectively enslaved to the rich? That’s why you had Mesopotamian clean slates, Biblical Jubilees, Medieval laws against usury in both Christianity and Islam and so on and so forth.

Since antiquity the worst-case scenario that everyone felt would lead to total social breakdown was a major debt crisis; ordinary people would become so indebted to the top one or two percent of the population that they would start selling family members into slavery, or eventually, even themselves.

Well, what happened this time around? Instead of creating some sort of overarching institution to protect debtors, they create these grandiose, world-scale institutions like the IMF or S&P to protect creditors. They essentially declare (in defiance of all traditional economic logic) that no debtor should ever be allowed to default. Needless to say the result is catastrophic. We are experiencing something that to me, at least, looks exactly like what the ancients were most afraid of: a population of debtors skating at the edge of disaster.

And, I might add, if Aristotle were around today, I very much doubt he would think that the distinction between renting yourself or members of your family out to work and selling yourself or members of your family to work was more than a legal nicety. He’d probably conclude that most Americans were, for all intents and purposes, slaves.
…
Clearly any pretence that markets maintain themselves, that debts always have to be honored, went by the boards in 2008. That’s one of the reasons I think you see the beginnings of a reaction in a remarkably similar form to what we saw during the heyday of the ‘Third World debt crisis’ – what got called, rather weirdly, the ‘anti-globalization movement’. This movement called for genuine democracy and actually tried to practice forms of direct, horizontal democracy. In the face of this there was the insidious alliance between financial elites and global bureaucrats (whether the IMF, World Bank, WTO, now EU, or what-have-you).

Those who have the least often give the most. Excessive income inequality (especially when driven by fraud) leads to a moral and cultural rot. Financial cartels & governments can only enslave people in so much debt & hand out so much soma before they either revolt or simply lose faith.

(On a related note, December saw record gun sales.)

State actors have repeatedly use violence to try to encourage a similar response. Instead they created a viral meme & the movement lives on.

Of course there are “opposition research” hacks willing to dig up dirt on anyone with wide reach who opposes the state-sponsored fraud: “It will be vital,” the memo says, “to understand who is funding it and what their backgrounds and motives are. If we can show that they have the same cynical motivation as a political opponent it will undermine their credibility in a profound way.”

The state has long manipulated mainstream media and has tools for spying on social networks, hacking accounts & astroturfing online, but sock puppets can only go so far against reality.

Who Does 100% Marketing Transparency Help & Who Does it Hurt?

We have an SEC that shreds over a decade of evidence (and engages in other illegal behaviors), a government that bails out the criminal enterprises & a court system that broadly makes it nearly impossible to win a financial fraud lawsuit.

The biggest companies & the biggest people in business at this point are simply above the rule of law & are not held accountable for their actions. Worse yet, the corrupt system has global influence.

In 2004 the FBI warned that there was an “epidemic” of mortgage fraud and that it would create a crisis.
“My administration is the only thing between you and the pitchforks,” the president told them.
And, in spite of the FBI highlighting the massive mortgage fraud, and the above quote, the president (who is a horrible human being) aims to keep the population misinformed & ignorant, publicly stating that what Wall St did wasn’t illegal!

Henry Kissinger has a famous quote about power: “Before the Freedom of Information Act, I used to say at meetings, ‘The illegal we do immediately; the unconstitutional takes a little longer.’ [laughter] But since the Freedom of Information Act, I’m afraid to say things like that.” Since then government officials have become much more evasive & smooth talking. Unfortunately, freedom of the press only goes so far:

this is how the much-lauded “freedom of the press” myth in the US actually works. If you perform the job of an actual journalist, telling truth to power, forget about attending press conferences at the White House, Pentagon or State Department. You won’t even be admitted in the building.

When you ask for total market transparency it changes nothing with the criminality at the top, but it does create a juicy data source for criminals while harming personal civil liberties & unpeople with limited power:

The people who most heavily rely on pseudonyms in online spaces are those who are most marginalized by systems of power. “Real names” policies aren’t empowering; they’re an authoritarian assertion of power over vulnerable people.

Categories:

business

Posted in Blog, Search Engine Optimization |

Leave a comment

6 Reasons You Need to Charge More

Published February 9, 2012 |

By AdminISC

Posted by Dr. Pete

man holding empty wallet I’m a reluctant Capitalist. I didn’t grow up with a lot of money (my dad was a country preacher, and my mom was a schoolteacher), and the transition from academia to building a start-up and then running my own consulting firm has been rocky at times. The one thing I still hear almost every week is “You need to charge more,” and I preach the same message to new SEOs even as I try to remember it. This post is a reminder to myself (and to you) of why what you charge matters, and why it’s not just about greed.

1. It’s Not All Billable

Almost every new consultant, freelancer, and even agency makes a critical math error. Pay attention, because this mistake could could haunt your business for years to come. It goes something like this:

I need to make $37,000 to pay the bills, and I’d like to make $50,000. A year is about 2000 work hours (50 weeks x 40 hours), so if I can just charge $25/hour, I’ll easily pay the bills and make my $50K goal.

I sincerely commend you for doing the math – it’s important to know what you need to pay the bills and to figure out what that means on a daily and hourly basis. Here’s the problem – in a 40-hour week, especially starting out, you’re going to spend half that week pounding the pavement (or more). You need to network, build your site/portfolio, blog, make phone calls, write proposals, and on and on. Once clients come in, you’ve got administrative work to do – somebody has to send the invoices, pay the taxes, and buy the toilet paper.

So, at best, only 20 hours of your week will be billable. Now, your $25/hour just netted you $25,000. You not only fell short of your $50K goal – you didn’t even pay your bills.

2. Delivery Kills Sales

But wait, it gets worse. That 20-hour billable week assumes that all of your pavement-pounding actually gets instant results. When it does finally pay off, what happens? You get a nice, juicy contract, pour all your time into delivering it, and then realize that you didn’t actually keep selling while you were doing the work. So, after you get that check, you go a month with no work at all while you rebuild your lead pipeline. Ultimately, you’ll be working a 20-hour billable week about every other week, especially for the first year or two. So, you’re averaging 10 hours per week and your $25/hour just netted you a $12,500 bottom line.

3. You Have New Costs

This one’s mostly for the freelancers and independent consultants. Revenue does not equal salary. Even being a consultant costs money – it’s not a high-overhead profession, but everything’s coming out of your pocket now. Some things that you didn’t think twice about when you were employed will suddenly seem shockingly expensive. Want to go to an industry tradeshow? With the full-conference pass, airfare, car, hotel, and meals, that’s about $2,000-3,000. Need a copy of Photoshop? You can’t just pop down to IT anymore – Adobe CS5.5 starts at $1,299. Suddenly your old boss doesn’t seem like such a cheapskate.

That doesn’t count the perks you’ve lost. You’ll hear all about the amazing tax breaks of self-employment from your friends who dream of self-employment but don’t actually have any idea what they’re talking about. Sure, you might be able to write off half your phone bill or a corner of your condo as office space, but meanwhile you’re paying both halves of your employment taxes, your own health insurance, and you’ve got no 401K. Even if you hit that $50K revenue goal, it’s probably more like a $40K salary. The $12,500 you barely squeezed out in the realistic scenario above is more like $10K, and that assumes you skip health insurance, which will run you roughly that entire amount.

4. You Set Your Value

People are funny – when we discount our prices, we expect the buyer will understand they’ve gotten a bargain. When we pay discount prices, we think we’ve walked away with something of less value. Let’s say you go to a fancy restaurant with a 50% Groupon – a month later, do you think “I should go back to that place, since I got such a great deal last time!” No, you think – “If I go back to that place, I’ll have to pay full price. That sucks!” My wife would rather die than go to Bed, Bath and Beyond without a coupon, and it’s entirely their fault for sending us 11 a day. They’ve set their value, and the message is “We don’t have any.”

What’s worse is that you send a broader message that that discount rate is your value to the market, and you even begin to believe it. Unless there’s an amazing opportunity and you’re 100% clear that this is a one-time deal, don’t even start. The legacy of discount pricing could haunt you forever.

5. Your Time Is Finite

We tend to price future work based on past work. On the surface, that makes perfect sense, but the problem is simple – the cost of 10 hours/week when you have nothing to do is a lot less than the cost of 10 hours/week when you’ve already got 40 hours booked. You only have so many hours in the day, and as you run out, they become more valuable. Think of your time like any marketable resource – with more scarcity comes higher prices.

Your time is like MegaBus. When the bus is empty, you may be able to charge $1 for a seat, but that last seat should fetch a premium price. People naturally want to book every available hour, but there’s an opportunity cost to being left with no time at all. Once the hours start to book, it’s time to raise your prices and protect your most non-renewable resource.

6. Cheap Attracts Cheap

Some people may take offense at this, but experience has taught me over and over (and by “taught” I mean “beat with a bat and left me for dead in the alley”) that the people who fight you over price will never stop fighting you. It’s easy to think that, since you gave them a discount and gave into all their demands, they’ll appreciate you more and manage their own expectations, but that’s never happened to me in almost 15 years of working with clients.

It’s almost never about the money – there are some people who just think vendors are meant to be beaten. If you win, they lose. Unfortunately, that means they’ll never see your relationship as win-win. Learn to recognize those clients during negotiation, and get out while you can.

There’s one exception – if you really want to help an organization and you know money is an issue for them, consider doing the work pro-bono. Scope a one-time project and donate your time. There’s nothing wrong with helping people. Where you go wrong is when you start letting other people define your value.

So, How Much Is “More”?

That’s the Million-dollar question, isn’t it? According to our SEO pricing survey last month, the most common hourly rate is between $76-$200 US. That’s quite a range. I think it comes back to that math in Reason #1. The trick is to do the math realistically. Be realistic about your costs and the number of hours really left in the day after sales and marketing are done (and you need to do sales and marketing every day, even when you’re working on deliverables). Maybe more importantly, decide what you want long-term and be careful about setting your value too low just to land a few clients. Today’s discount “just to pay the bills” could set your price for years to come.

Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Posted in Blog, Search Engine Optimization |

Leave a comment

Using blekko’s SEO Data to Evaluate Web Directories

Published February 9, 2012 |

By AdminISC

Posted by davidzimm

This post was originally in YouMoz, and was promoted to the main blog because it provides great value and interest to our community. The author’s views are entirely his or her own and may not reflect the views of SEOmoz, Inc.

If you haven’t tried it out yet, blekko.com is a unique search engine. Along with allowing you to customize your own search results (or view results customized by one of its editors) it transparently provides a plethora of data showing why it ranks sites in the search results. The best part is, even if you aren’t trying to increase visits from blekko, their SEO data is very useful.

Getting blekko’s SEO data

It’s simple to get the SEO data from blekko. First you need a blekko account. Then all you have to do is type a URL into the search box, hit the spacebar, and add /seo (what they call a “slashtag”) at the end of your search string.

blekko seo slashtag

One of blekko's most distinctive pieces of data is “Host Rank”. This is not so much a ranking of websites but a measure of website authority- like Domain Authority or PageRank. Unlike these other metrics, Host Rank is on a linear scale rather than an exponential scale. Typically a linear scale is a little easier to wrap your brain around. For example, while you might be tempted to think that a website with a PageRank of 4 is only a little bit better than a PR 3 website, we need to remember that this is an exponential scale and the former has a significantly higher authority than the later. In other words the difference between a Host Rank 30 and 40 website is simply 10 points but the difference between websites with Domain Authority 30 and 40 is not 10 points, it is 10 to the power of X points (it is an exponential scale- what's the exponent? ask Mr. Fishkin). Host Rank also avoids a maximum value on its scale unlike the coveted PR 10 website (or comparatively strong DA 100 website).

comparing linear vs exponential values

There's much more to blekko besides another number to compare websites. The /seo slashtag also provides a nifty pie chart outlining what countries the links tend to come from. Although there is nothing wrong with a link from India, for example, if a website is based in the United States and the audience is primarily in the United States, the origin of the links can be indicative of some (shall we say) risky SEO techniques.

I also find the “co-hosted with” list at the bottom of the /seo page very interesting. Does this website have dedicated hosting? If not, that’s not necessarily bad thing but if it is co-hosted with some (shall we call them) questionable websites, that might be a neighborhood you wouldn’t want to be associated with.

Blekko’s data gets even more specific. You can also slashtag a URL with /domainlinks to find a list of inbound links (you can also access this from the right sidebar of the /seo page). Now this list of links most closely resembles the defunct Yahoo! SiteExplorer in that it provides a very long list of links that you have to manually filter through to be useful, but it does a good job giving you an indication of the source of this website’s link authority.

I also like to take a look through a websites /sitepages. This gives a list of all the pages on a website, as sorted by Host Rank. This is a great way of seeing how Host Rank (and presumably PageRank or even Domain Authority) flows throughout a website. Of course, the homepage of any website will always have the most authority- but does any authority flow to interior pages on the website?

Let’s get a little more concrete with this data. We can use blekko’s SEO data to evaluate a couple of web directories to see if we should submit our site to them. Starting with SEOmoz’s directory list, let’s take a couple of authoritative directories (as measured by Domain Authority) and a couple of low authority directories.

The Yahoo Directory

The Yahoo! Directory (Domain Authority 100): http://blekko.com/ws/dir.yahoo.com+/seo

Anyone with (shall we say) the means to afford $299 a year has probably submitted their website to the Yahoo! Directory. For a while Google’s Webmaster Guidelines even suggested it. Is it worth the cost? What will we get out of this listing? Let’s use blekko’s SEO data and find out.

/seo

With a Host Rank of 2,054.9 we clearly see this is a very authoritative website (at least in blekko’s mind). Although this number doesn’t mean much in itself, I bet it’s higher than your personal website.
Most of the links are from the United States (64%). Not to be so Amero-centric here but there’s nothing in the geographical distribution of the links that would make me concerned here. This is an international directory, after all.
The site is co-hosted with (wait for it) Yahoo!. Even though it’s been a while since I’ve used Yahoo!, that’s a neighborhood I wouldn’t mind being associated with.

/domainlinks

Websites actually link to the Yahoo! Directory (who knew) and these seem to be authoritative and clean. It seems like a legitimate and natural backlink profile to me.

/sitepages

Authority seems to flow very quickly into the directory listings and the Host Rank doesn’t seem to drop-off very fast. If your website falls into one of these top ranked categories you’d definitely want to be listed there.
One of the top-ten pages, according to blekko, is the list of newly submitted websites. FTW!

top pages on the yahoo directory

BBB Web Directory

The Better Business Bureau (Domain Authority 99): http://blekko.com/ws/bbb.org+/seo

Got a brick-and-mortar along with your website? Why not submit it to BBB.org?

/seo

This site, according to blekko, actually has more authority than the Yahoo! Directory. It has a Host Rank of 2,948.4. This is tempting!
It makes sense that 86% of the links come from the United States- this is for US-based businesses, that’s how it should be.
WOW! What a list of sites are co-hosted with the BBB! Well, it’s co-hosted with pearljam.com so it’s gotta be a good neighborhood! (By the way, did you see Pearl Jam 20? Highly recommended)

/domainlinks

Sites linking to the BBB seem to be very similar to the Yahoo! Directory and they are all from legitimate and authoritative websites. You wish you could have a backlink profile like this site!

/sitepages

Unfortunately the first business I found was on the 6^th page of blekko’s /sitepages results. Most of the authoritative pages are designed to get you to sign up or are content pages. Getting a listing on this directory won’t pass much authority to your site.
Clearly the authority of the homepage does not transfer well to listings. The first business listing has a Host Rank 1/100^th of the homepage. Sure, you might get some eyeballs from a BBB.org listing, but I wouldn’t count on it for link building efforts.

top pages in the BBB directory

Sporge Web Directory

Sporge (Domain Authority 33): http://blekko.com/ws/sporge.com+/seo

With a name like that, who wouldn’t want to be in this directory? (I’m not much for branding but I’d recommend a name-change in this case). Still, it might be worth something. Let’s see

/seo

The Host Rank of this website is 20.2. Now you start to see the value of a linear website ranking scale- the Yahoo! Directory is 100x more authoritative that this directory.
The geographical distribution of the backlinks is actually fairly similar to the BBB’s website. Nothing unusual here.
Also similar to the BBB, there is a massive amount of websites co-hosted with the Sporge directory. Most of them seem benign.

/domainlinks

Most of the links to Sporge.com come from other web directories. Could this site be part of a directory network. Is there any value of submitting to this directory as opposed to any of the others? If I submit to this directory, should I even bother to submit to any of the others linking to it?

/sitepages

The Host Rank ends very quickly, but there’s not much authority to this website to start with in the first place. At least what little it has is able to get to the directory listings easily.

The Brick Wall Web Directory

The Brick Wall (Domain Authority 22): http://blekko.com/ws/thebrickwall.com+/seo

This is the least-authoritative directory, according to SEOmoz’s list. Is it even worth the 10 minutes it would take to submit your website?

/seo

The Host Rank is a whopping 4.3. This is another good illustration of the value of a linear ranking for websites. If you only looked at the Domain Authority of this website (as compared to Sporge- why do I blush when I say that?) you might think, “hey, that’s not so bad,” but blekko doesn't think very highly of this directory.
The links to this site come from four “other countries.” I can’t seem to find that on my globe. This is a little fishy.
It’s co-hosted with a few other UK-based websites. Nothing seems too bad among these websites.

/domainlinks

There really isn’t a large number of links to this website. Where is it getting its authority (what little it does have)?
There it is! Many of the links to this directory are reciprocal.

/sitepages

This little directory doesn’t have much authority to share, but if it did it seems it would get to the directory listings fairly efficiently.

Now blekko’s search market share is (shall we say) still growing, but the data they provide can help you do SEO in other search engines too. As with any third-party tool, you wouldn’t want to rely on this data exclusively- obviously neither Google nor Bing are using this data to determine how they rank webpages- but this information can still be a big help to any SEO attempting to evaluate websites for potential authority and value.

Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Posted in Blog, Search Engine Optimization |

Leave a comment

10 Ways Paid Marketers Can Leverage Inbound Marketing

Published February 9, 2012 |

By AdminISC

Posted by JoannaLord

It happened friends. After years of Rand exposing me to the many benefits of inbound marketing I am ready to admit it…{big gulp}…today's marketer needs to be doing more than paid marketing. In fact, I'd go as far as to say, if you are only doing paid marketing you are failing yourself and your company. THERE I SAID IT. I feel better. Way better actually.

Because it's true. Things have changed. There is no longer two main players in the game (SEO and PPC). Search marketing itself has evolved. We've covered a great deal of this here on the blog so I won't go into it too much. If you need a reminder, I urge you to go check out Rand's posts where he outlines The New Era of Inbound Marketing, and outlines how quickly it is growing. As marketers, we saw the shift coming, and now we are feeling it in our every day gigs. Our roles are expanding as traditional SEO itself expands. There is so much happening all around us. Who is freaking out? Yeah me too.

paid and inbound marketing crossover

The real question you may be asking yourself is, "why is this paid marketing lady talking about inbound marketing?" Good question. The other day I was running through my to-do list and I couldn't help but notice how not-focused it was on paid marketing. In fact, most of my day was spent brainstorming with others on how to better share data, repurpose existing assets, and collaborate. While Justin and I manage paid marketing here at Moz, more and more of our time is spent on learning and leveraging our inbound efforts more effectively.

I thought I'd run through some ways that I'm leaning on our inbound marketing efforts to both reduce Moz's costs and capture more leads. Did you all know you could get leads for free? Yeah, crazypants I know. Anyway, here are the top ten ways I've leveraged inbound as a paid marketer here at Moz;

#10: Share Persona Outlines
You know who is really good at researching a target audience? Content writers. Recently, Michael King actually did a killer webinar on understanding your target audience and using social media tools to help define your best audience. It covers this concept really well. The idea is there are so many excellent demographic tools available to us now that these social networks want us to buy ads on them. We can look at audience sizes, location, categories, etc. All of this information has been helping organic marketers write targeted content for years. Paid marketers should be leaning on this data. What have they discovered that could help me better target high-value leads? Outline your target audience and extracting personas can be really challenging, but the more teams connect on this the better all our marketing efforts are targeted.

#9: Leverage Landing Pages
Design resources are hard to come by. Here at Moz we have Derric and Ramil basically sleeping in the office and we still have a backlog of projects that need their creative brains. Ask any paid marketer what is the bottleneck and often you will hear design resources pop up. So what can we do? Use landing pages that our inbound marketers have already queued up for us! Brilliant! Often times these pages are beautifully designed, and laced with excellent engagement opportunities. These are mandatory in a solid inbound marketing page and they are requirements of a successful paid search lander…coincidence? I think not.

#8: Exchange Conversion Reports
Oh conversion data, how sweet you are. I think most paid marketers are looking at the SEO data at their company. At least I hope they are! Beyond that though, there is more data you should be looking at. Here at Moz, we are a little data crazy. Jen, our Community Wrangler, puts together amazing metrics on our social activities every week. I have found that by mining her weekly data summaries I can see what content has gone hot and where. I can see where we are increasing brand awareness and what type of people are taking to the Moz brand. From there I can better allocate our budget to supplement these efforts.

#7: Collaborate on Keyword Research
So this one is one of those things we keep saying we are going to do, but rarely does it actually happen. I am always amazed by the keyword research process. First off, it's really time consuming. Secondly, it's not effective as a one-time step, it really needs to be done in an ongoing basis. Yet despite all this, both paid teams and organic teams have been doing separate keyword research for years. Ick. Yuck.

An awesome benefit to doing inbound marketing is the speed in which we can detect if something resonates. Where as before I might have used paid search budget to test an adjective or product description, I can now push out a targeted piece of content and see how the audience responds. It's immediate data collection and its statistically valid. I can't get over the power of the social graph when it comes to crowdsourcing reactions to certain keywords. This is the new keyword research in my opinion. We must combine our traditional keyword tools with audience response across these inbound channels.

#6: Repurpose Content
This one is pretty obvious, yet, so easy to skip over. I am guilty of this too often myself. Paid marketers need to be driving traffic to past inbound marketing wins. For example, about a year and a half ago we updated the Beginners Guide to SEO. This has gone on to be downloaded close to a million times, translated into other languages, and continues to be an excellent traffic driver. Guess how much of my paid marketing budget goes to driving traffic to this excellent piece of content? Yup you guessed it…none.

In the past, my argument was "it didn't drive enough free trial signups to show ROI." What I've realized over the past few months is I need to go deeper into what "conversion" means. What does acquisition mean? What does growth mean? My paid marketing efforts should be wrapped around these already successful content pieces. Repurposing hot viral content through paid marketing channels is a great example of how we can accomplish cross-channel marketing. Isn't it pretty when we all get along? Who wants to hug? Bueller?

#5: Share Customer Feedback
Customer feedback is gold, pure gold. Inbound marketing is about being found online through a variety of activities — content publishing, social engagement, etc. A huge benefit of these conversations and interactions is the wealth of feedback you can receive from the community you have created. Often here at Moz, we will ask our community team to help us understand what our customers really love about our PRO service. We can hear right from them what keeps them happy, and what we can do better. This helps drive our marketing messages and our product roadmaps. Sharing the customer feedback and voice is so important, and the value found in sharing that across multiple teams in the organization is huge.

#4: Planning for Resources
Over the past few years we have seen the expectations of an online marketer change. We have more on our plates, more tools to log into, more reports to pull, more content to write, and so on and so forth. Inevitably these demands require more resources and more talent on any given project. I have found that by asking the organic marketers and community marketers here at the company what they are working on, I can better plan for my paid projects. If we are contracting a copyeditor for a content piece, I can slip in a request to revisit some ad copy headlines in the same contract. I can also repurpose design resources for banners, and landers. By knowing what your inbound team is working on, all of us can push out more faster. This is a huge benefit to connecting the to teams in both goals and resource planning.

#3: Fuel the Fire
I am a big fan of the halo effect as it applies to marketing. The halo effect, for those that might not know, is when customers show a bias to a product or brand based on some favorable or pleasant experience they have had previously. The beauty of it as it applies to today's marketing efforts is there are so many opportunities for a brand impression, and most of which are free.

A positive conversation a brand representative has with a user on a Facebook page may be enough to persuade a user to click a retargeting banner when faced with the brand's logo. Those two combined may build enough trust to persuade them to take a free trial. I call this "fueling the fire." While paid marketing may be measured on a CPA basis, there is a lot that happens prior to an action that influences the likelihood of a conversion. Inbound marketing offers mutiple opportunities to positively bias a potential customer. The goodwill a customer has in a brand often has very little to do with push marketing efforts, but has everything to do with these more organic experiences.

#2: Prequalify a Message
At the heart of it, marketers are story tellers. We love to persuade. As a paid marketer I spend most of my time coming up with ways to message my audience. Sometimes it's a new audience and sometimes it's my current audience, but either way I need to constantly be testing new ways to capture their attention. Prequalifying a message can be time consuming and can cost a lot of money depending on how I test it.

In the past I may have run a banner campaign on a relevant blog post and looked at metrics like CTR and CR. I may have also thrown money at a focus group (and whoa those can cost a lot) to see how people responded to a story we had crafted. These days I can use the power of social to test messages in record time. I can put together a presentation or a white paper and see how many times it gets shared, viewed, and downloaded. By counting these "social votes" I go beyond just clicks as a means of pre-qualification. It's a really great way for me to collect good data fast.

#1: Strengthen the Brand's Story
While the other nine ideas are great, this is my favorite. Nothing is more powerful than a consistent marketing message. Over the years I've worked to connect retargeting banners, paid search ads, landers, affiliate banners, and social advertising to send a strong and cohesive message. You know what stinks about that? All of those cost me money…which is no fun. Keeping money is fun. Spending all your money…not fun.

For promotions or time sensitive messages, if I really wanted to see an impact, I had to have serious budgets. There has to be a better way. Aligning some of these paid efforts with some inbound efforts makes for an even more compelling story for half the cost. As you push out new things and try to create buzz, you need to be asking yourself, "Is this the best use of my time and money?" I think as a paid marketer we can often forget to take that pause. We rest on the channels we know well but we need to push for more.

In Conclusion

Rand was right. In fact, all of my SEO friends were right. While paid marketing has a role to play in all of this, the direction the web has taken demands more from us marketers. While I am not sold that inbound marketing is all any marketer needs, I do believe there is a synergy between the two that can be very powerful. If we share resources, connect data, and collaborate rather than compete I think both teams win. I'm super excited about what this means for the future of paid search marketing. If you do paid and you aren't connecting with your organic marketing and social teams, you really are making your job harder than it needs to be.

I'd love to hear from you guys if there are other ways you have seen the teams connect and work more effectively together. Where do you see this all going as social marketing and content marketing continue to take more of our time as marketers? Where does paid fit into this?

Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Posted in Blog, Search Engine Optimization |

Leave a comment

Building a Technical SEO Process

Published February 9, 2012 |

By AdminISC

Posted by Stephanie Chang

One of the biggest challenges many of my clients face is building the right SEO processes in place, so that any problems are quickly accounted for before they lead to bigger issues. Below are three things you should consider when trying to create a more streamlined process for making sure the technical foundation of the site is solid. Though none are considered "quick" or necessarily easy wins and can initially take a significant amount of time, ultimately in the long-run, they will help make monitoring the SEO on your site more efficient. This means less time spent identifying and fixing site issues and more time focusing on other aspects of SEO, like linkbuilding, developing a content strategy, etc… Overtime, the impact this will have on your site can result in high rewards.

1) Technical Annotations in Google Analytics

Currently, many of my clients with Google Analytics accounts either don't include any annotations in Google Analytics, annotate only their email, PPC, social campaigns or use it to keep track of search engine algorithm changes (like Panda updates). However, the value of annotating any technical changes made to the site in Google Analytics creates a more efficient internal process.

Scenario 1: Let's say that you have set up Google Alerts to alert you of any spikes and drops in traffic. Then, having technical changes annotated in Google Analytics makes it quicker and easier for you to specifically determine the cause of this spike or drop, instead of investing hours later on trying to determine the cause of these changes in traffic. In addition, any major technical issue runs the risk of being implemented improperly (in terms of SEO considerations), simply because there are so many issues to take into account.

Here is more information on how to setup a Google Alert.

Scenario 2: Often times SEO is not a technical priority for the development team, mostly because it is difficult to measure the ROI of what is often times, a significant amount of invested time and effort. Creating annotations in Google Analytics could help with this process- for example, if a spike in traffic were to occur and the team was somehow able to attribute this to a technical implementation on the site, the technical team could be properly recognized as being the cause of this change.

2) Sitemaps- Google/Bing Webmaster Tools

SEOs should create an internal process where Google Webmaster Tools is checked at least once a month to ensure there are no major issues with the sitemaps or with bots crawling the site. Sitemaps are only useful if they are kept up to date and well-maintained.

Why is this important? Duane Forrester of Bing has stated that "Your Sitemap must be clean. We have a 1% allowance for dirt in a sitemap." His definition of dirt includes 404 or 500 status code errors and redirects. He continues by saying "If we see more than a 1% level of dirt, we begin losing trust in the Sitemap."

Best practices include submitting a new Sitemap regularly, depending on how often new content is generated on the site. A publishing site might need to update every few hours, an e-commerce site every week, and a relatively static site every month.

Sitemaps should be checked at least on a monthly basis in Webmaster Tools to ensure there are no issues with the Sitemap.

These include:

Checking for error messages
Checking number of pages submitted versus indexed
Checking for malware (and address these immediately!)
Checking for crawl errors (like 4xx and 5xx issues)

Using Screaming Frog

If you do have a Screaming Frog account, you can also use it to verify Google Webmaster Tools errors, especially because Google Webmaster Tools do not always update their errors. Thus, you don't want to be looking for 404s that have already been fixed. You can also use it to check your sitemap for errors. To do so, simply upload the XML sitemap into Screaming Frog and crawl it. Craig Bradford of Distliled work a fantastic blog post on how to use Screaming Frog to accomplish these tasks and more.

If Google Webmaster Tools is not periodically checked, the number of errors can seem overwhelming. Joe Robison wrote a fantastic SEOmoz post on fixing an overwhelming number of errors in Google Webmaster Tools.

3) Creating Automated Scripts

404 Pages Returning Status 200 Codes:

Barry Schwartz wrote a blog post on how 404 pages should not return status 200 codes. The reasoning being that it could be confusing to spiders as they see a page that exists technically have no content. This can affect rankings over time because it is creates massive duplicate content as bots are crawling through the same content over and over again across several URLs.

He also suggests creating automated scripts to check for this type of issue.

However, to initially help you determine the extent of this problem on your site and provide an estimation of the number of 404 pages that return status 200 codes, plug a site search query into Google. See example below:

site:example.com/ "page not found"

If the query returns results, you know your site is returning status 200 codes for 404 pages and that this issue needs to be fixed.

SEO Score Card:

I've talked about creating an SEO score card before. I've also recently recommended another version of this to another client who had hundreds of thousands of URLs. In this specific instance, they had difficulty making sure that only high-quality, non-duplicate content would be indexed. Being an e-commerce client, the site also had tons of products that were very similar (resulting in identical product descriptions and content on the site).

I suggested creating an internal score sheet that would automatically be re-run every month to make sure that all currently indexed pages are still considered high-quality, while also offer an opportunity for pages that were once deemed low-quality to reviewed regularly. Once those low-quality pages became high-quality, they will become automatically indexed.

This process could be used to generate the sitemaps – but the goal is to future-proof the site against future search engine algorithmic changes while improving the overall domain authority of the site.

There are caveats that need to be addressed when creating an SEO score sheet- we want to be careful about noindexing pages, especially as overtime, this could result in less and less of the site being indexed. Once the initial script is written, check the results and see if these are actually pages that you want noindexed. If not, the script might have to be rewritten.

The ultimate goal is to make sure that only quality pages are indexed, while also keeping tabs on how many more pages on the site need unique content. This type of knowledge can prove useful when creating the site's linkbuilding/content strategy.

Conclusion

The overall goal is to build a streamlined process for technically auditing a site that can be described and thus, communicated internally. Creating a more efficient process means more time invested in other important elements- compiling quality content, building an online community, and social media to name a few.

Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Posted in Blog, Search Engine Optimization |

Leave a comment

Find Your Site’s Biggest Technical Flaws in 60 Minutes

Published February 9, 2012 |

By AdminISC

Posted by Dave Sottimano

I've deliberately put myself in some hot water to demonstrate how I would do a technical SEO site audit in 1 hour to look for quick fixes, (and I've actually timed myself just to make it harder). For the pros out there, here's a look into a fellow SEO 's workflow; for the aspiring, here's a base set of checks you can do quickly.

I've got some lovely volunteers who have kindly allowed me to audit their sites to show you what can be done in as little as 60 minutes.

I'm specifically going to look for crawling, indexing and potential Panda threatening issues like:

Architecture (unnecessary redirection, orphaned pages, nofollow)
Indexing & Crawling (canonical, noindex, follow, nofollow, redirects, robots.txt, server errors)
Duplicate content & On page SEO (repeated text, pagination, parameter based, dupe/missing titles, h1s, etc..)

Don't worry if you're not technical, most of the tools and methods I'm going to use are very well documented around the web.

Let's meet our volunteers!

Here's what I'll be using to do this job:

SEOmoz toolbar – Make sure highlight nofollow links is turned on – so you can visibly diagnose crawl path restrictions
Screaming Frog Crawler - Full website crawl with Screaming Frog (User agent set to Googlebot) – Full user guide here
Chrome, and Firefox (FF will have Javascript, CSS disabled and User Agent as Googlebot) – To look for usability problems caused by CSS or Javascript
Google search queries – to check the index for issues like content duplication, dupe subdomains, penalties etc..

Here are other checks I've done, but left out in the interest of keeping it short:

Open Site Explorer - Download a back link report to see if you're missing out on links pointing to orphaned, 302 or incorrect URLs on your site. If you find people linking incorrectly, add some 301 rules on your site to harness that link juice
http://www.tomanthony.co.uk/tools/bulk-http-header-compare/ - Check if the site is redirecting Googlebot specifically
http://spyonweb.com/ - Any other domains connected you should know about? Mainly for duplicate content
http://builtwith.com/ - Find out if the site is using Apache, IIS, PHP and you'll know which vulnerabilities to look for automatically
Check for hidden text, CSS display:none funniness, robots.txt blocked external JS files, hacked / orphaned pages

My essential reports before I dive in:

Full website crawl with Screaming Frog (User agent set to Googlebot)
A report of everything in Google's index using the site: (1000 results per query unfortunately – this is how I do it)

Down to business…

Architecture Issues

1) Important broken links

We'll always have broken links here and there, and in an ideal world they would all work. Just make sure for SEO & usability that important links (homepage) are always in good shape. The following broken link is on webrevolve homepage that should be pointing to their blog, but returns a 404. This is an important link because it's a great feature and I definitely do want to read more of their content.

Fix: Get in there and point that link to the correct page which is http://www.webrevolve.com/our-blog/

How did I find it: Screaming Frog > response codes report

2) Unnecessary Redirection

This happens a lot more than people like to believe. The problem is that when we 301 a page to a new home we often forget to correct the internal links pointing to the old page (the one with the 301 redirect).

This page http://www.lexingtonlaw.com/credit-education/foreclosure.html 301 redirects to http://www.lexingtonlaw.com/credit-education/foreclosure-2.html

However, they still have internal links pointing to the old page.

http://www.lexingtonlaw.com/credit-education/bankruptcy.html?linkid=bankruptcy
http://www.lexingtonlaw.com/blog/category/credit-repair/page/10
http://www.lexingtonlaw.com/credit-education/bankruptcy.html?select_state=1&linkid=selectstate
http://www.lexingtonlaw.com/credit-education/collections.html

Fix: Get in that CMS and change the internal links to point to http://www.lexingtonlaw.com/credit-education/foreclosure-2.html

How did I find it: Screaming Frog > response codes report

3) Multiple subdomains – Canonicalizing the www or non-www version

One of the first basic principles of SEO, and there are still tons of legacy sites that are tragically splitting their link authority by not using redirecting the www to non-www or vice versa.

Sorry to pick on you CVSports :S

http://cvcsports.com/
http://www.cvcsports.com/

Oh, and a couple more have got their way into Google's index that you should remove too:

http://smtp.cvcsports.com/
http://pop.cvcsports.com/
http://mx1.cvcsports.com/
http://ww.cvcsports.com/
http://www.buildyourjacket.com/
http://buildyourjacket.com/

Basically, you have 7 copies of your site in the index..

Fix: I recommend using www.cvcsports.com as the main page, and you should use your htaccess file to create 301 redirects for all of these subdomains to the main www site.

How did I find it? Google query "site:cvcsports.com -www" (I also set my results number to 100 for check through the index quicker)

4) Keeping URL structure consistent

It's important to note that this only becomes a problem when external links are pointing to the wrong URLs. *Almost* every back link is precious, and we want to ensure that we get maximum value from each one. Except we can control how we get linked to; without www, with capitals, or trailing slashes for example. Short of contacting the webmaster to change it, we can always employ 301 redirects to harness as much value as possible. The one place this shouldn't happen is on your own site.

We all know that www.example.com/CAPITALS is different to www.example.com/captials when it comes to external link juice. As good SEOs we typically combat human error by having permanent redirect rules to enforce only one version of a URL (ex. forcing lowercase), which may cause unnecessary redirects if someone links in contradiction to redirects.

Here are some examples from our sites:

http://www.lexingtonlaw.com/credit-education/rebuild-credit 301's to trailing slash version
http://webrevolve.com/web-design-development/conversion-rate-optimisation/ Redirects to the www version

Fix: Determine your URL structure, should they all have trailing slashes, www, lowercase? Whatever you decide, be consistent and you can avoid future problems. Crawl your site, and fix these

Indexing & Crawling

1) Check for Penalties

None of our volunteers have any immediately noticeable penalties, so we can just move on. This is a 2 second check that you must do before trying to nitpick at other issues.

How did I do it? Google search queries for exact homepage URL and brand name. If it doesn't show up, you'll have to investigate further.

2) Canonical, noindex, follow, nofollow, robots.txt

I always do this so I understand how clued up SEO-wise the developers are, and to gain more insight into the site. You wouldn't check for these tags in detail unless you had just cause (ex. A page that should be ranking isn't

I'm going to combine this section as it requires much more than just a quick look, especially on bigger sites. First and foremost check robots.txt and look through some of the blocked directories, try and determine why they are being blocked and which bots they are blocking them from. Next, get Screaming Frog in the mix as it's internal crawl report will automatically check each URL for Meta Data (noindex, header level nofollow & follow) and give you the canonical URL if there happens to be one.

If you're spot checking a site, the first thing you should do is understand what tags are in use and why they're using them.

Take Webrevolve for instance, they've chosen to NOINDEX,FOLLOW all of their blog author pages.

http://www.webrevolve.com/author/tom/
http://www.webrevolve.com/author/paul/

This is a guess but I think these pages don't provide much value, and are generally not worth seeing in search results. If these were valuable, traffic driving pages, I would suggest they remove NOINDEX but in this case I believe they've made the right choice.

They also implement self-serving canonical tags (yes I just made that up), basically each page will have a canonical tag that points to itself. I generally have no problem with this practice as it usually makes it easier for developers.

Example: http://www.webrevolve.com/our-work/websites/ecommerce/

3) Number of pages VS Number of pages indexed by Google

What we really want to know here is how many pages Google has indexed. There's 2 ways of doing this, using Google Webmaster Tools by submitting a sitemap you'll get stats back on how many URLs are actually in the index.

OR you can do it without having access but it's much less efficient. This is how I would check…

Run a Screaming Frog Crawl (make sure you obey robots.txt)
Do a site: query
Get the *almost never accurate* results number and compare them to total pages in crawl

If the numbers aren't close, like CVCSports (206 pages vs 469 in the index) you probably want to look into it further.

I can tell you right now that CVCSports has 206 pages (not counting those that have been blocked by robots.txt). Just by doing this quickly I can tell there's something funny going on and I need to look deeper.

Just to cut to the chase, CVCsports has multiple copies of the domain on subdomains which is causing this.

Fix: It varies. You could have complicated problems, or it might just be as easy as using canonical, noindex, or 301 redirects. Don't be tempted to block the unwanted pages by robots.txt as this will not remove pages from the index, and will only prevent these pages from being crawled.

Duplicate Content & On Page SEO

Google's Panda update was definitely a game changer, and it caused massive losses for some sites. One of the easiest ways of avoiding at least part of Panda's destructive path is to avoid all duplicate content on your site.

1) Parameter based duplication

URL parameters like search= or keyword= often cause duplication unintentionally. Here's some examples:

http://www.lexingtonlaw.com/credit-repair-news/economic-and-credit-trends/mortgage-lenders-rejecting-more-applications.html
http://www.lexingtonlaw.com/credit-repair-news/economic-and-credit-trends/mortgage-lenders-rejecting-more-applications.html?select_state=1&linkid=selectstate
http://www.lexingtonlaw.com/credit-repair-news/credit-report-news/california-ruling-sets-off-credit-fraud-concerns.html
http://www.lexingtonlaw.com/credit-repair-news/credit-report-news/california-ruling-sets-off-credit-fraud-concerns.html?select_state=1&linkid=selectstate
http://www.lexingtonlaw.com/credit-repair-news/economic-and-credit-trends/one-third-dont-save-for-christmas.html
http://www.lexingtonlaw.com/credit-repair-news/economic-and-credit-trends/one-third-dont-save-for-christmas.html?select_state=1&linkid=selectstate
http://www.lexingtonlaw.com/credit-repair-news/economic-and-credit-trends/financial-issues-driving-many-families-to-double-triple-up.html
http://www.lexingtonlaw.com/credit-repair-news/economic-and-credit-trends/financial-issues-driving-many-families-to-double-triple-up.html?select_state=1&linkid=selectstate

Fix: Again, it varies. If I was giving general advice I would say use clean links in the first place – depending on the complexity of the site you might consider 301s, canonical tags or even NOINDEX. Either way, just get rid of them !

How did I find it? Screaming Frog > Internal Crawl > Hash tag column

Basically, Screaming Frog will create a unique hexadecimal number based on source code. If you have matching hash tags, you have duplicate source code (exact dupe content). Once you have your crawl ready, use excel to filter it out (complete instructions here).

2) Duplicate Text content

Having the same text on multiple pages shouldn't be a crime, but post Panda it's better to avoid it completely. I hate to disappoint here, but there's no exact science to finding duplicate text content.

Sorry CVCSports, you're up again

http://www.copyscape.com/?q=http%3A%2F%2Fwwww.cvcsports.com%2F

Don't worry, we've already addressed your issues above, just use 301 redirects to get rid of these copies

Fix: Write unique content as much as possible. Or be cheap and stick it in an image, that works too.

How did I find it? I used http://www.copyscape.com, but you can also copy & paste text into Google search

3) Duplication caused by pagination

Page 1, Page 2, Page 3… You get the picture. Over time, sites can accumulate thousands if not millions of duplicate pages because of those nifty page links. I swear I've seen a site with 300 pages for one product page.

Our examples:

http://cvcsports.com/blog?page=1
http://cvcsports.com/blog?page=2

Are they being indexed? Yes.

Another example?

http://www.lexingtonlaw.com/blog/page/23
http://www.lexingtonlaw.com/blog/page/22

Are they being indexed? Yes.

Fix: General advice is to use the NOINDEX, FOLLOW directive. (This tells Google not to add this page to the index, but crawl through the page). An alternative might be to use the canonical tag but this all depends on the reason why pagination exists. For example, if you had a story that was separated across 3 pages, you definitely would want them all indexed. However, these example pages are pretty thin and *could* be considered as low quality for Google.

How did I find it? Screaming Frog > Internal links > Check for pagination parameters

Open up the pages and you'll quickly determine if they are auto generated, thin pages. Once you know the pagination parameter or structure of the URL you can check Google's index like so: site:example.com inurl:page=

Time's up! There's so much more I wish I could do, but I was strict about the 1 hour time limit. A big thank you to the brave volunteers who put their sites forward for this post. There was one site that just didn't make the cut, mainly because they've done a great job technically, and, um, I couldn't find any technical faults.

Now it's time for the community to take some shots at me!

How did I do?
What could I have done better?
Any super awesome tools I forgot?
Any additional tips for the volunteer sites?

Thanks for reading, you can reach me on Twitter @dsottimano if want to chat and share your secrets

Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!

Posted in Blog, Search Engine Optimization |

Leave a comment

Find Your Site’s Biggest Technical Flaws in 60 Minutes

Published February 8, 2012 |

By AdminISC

Posted by Dave Sottimano

I've deliberately put myself in some hot water to demonstrate how I would do a technical SEO site audit in 1 hour to look for quick fixes, (and I've actually timed myself just to make it harder). For the pros out there, here's a look into a fellow SEO 's workflow; for the aspiring, here's a base set of checks you can do quickly.

I've got some lovely volunteers who have kindly allowed me to audit their sites to show you what can be done in as little as 60 minutes.

I'm specifically going to look for crawling, indexing and potential Panda threatening issues like:

Architecture (unnecessary redirection, orphaned pages, nofollow)
Indexing & Crawling (canonical, noindex, follow, nofollow, redirects, robots.txt, server errors)
Duplicate content & On page SEO (repeated text, pagination, parameter based, dupe/missing titles, h1s, etc..)

Don't worry if you're not technical, most of the tools and methods I'm going to use are very well documented around the web.

Let's meet our volunteers!

Here's what I'll be using to do this job:

SEOmoz toolbar – Make sure highlight nofollow links is turned on – so you can visibly diagnose crawl path restrictions
Screaming Frog Crawler - Full website crawl with Screaming Frog (User agent set to Googlebot) – Full user guide here
Chrome, and Firefox (FF will have Javascript, CSS disabled and User Agent as Googlebot) – To look for usability problems caused by CSS or Javascript
Google search queries – to check the index for issues like content duplication, dupe subdomains, penalties etc..

Here are other checks I've done, but left out in the interest of keeping it short:

Open Site Explorer - Download a back link report to see if you're missing out on links pointing to orphaned, 302 or incorrect URLs on your site. If you find people linking incorrectly, add some 301 rules on your site to harness that link juice
http://www.tomanthony.co.uk/tools/bulk-http-header-compare/ - Check if the site is redirecting Googlebot specifically
http://spyonweb.com/ - Any other domains connected you should know about? Mainly for duplicate content
http://builtwith.com/ - Find out if the site is using Apache, IIS, PHP and you'll know which vulnerabilities to look for automatically
Check for hidden text, CSS display:none funniness, robots.txt blocked external JS files, hacked / orphaned pages

My essential reports before I dive in:

Full website crawl with Screaming Frog (User agent set to Googlebot)
A report of everything in Google's index using the site: (1000 results per query unfortunately – this is how I do it)

Down to business…