Set up a crawler login for increased ad relevancy on pages behind a login

This is the second post in our two-part AdSense Crawler Errors series.

Recently we discussed ways to improve ad targeting and relevancy by making sure that the AdSense crawler can view all pages that have AdSense code on them. Sometimes though, it can become problematic when a publisher has a members only site that requires the user to log in to view the site’s content. In cases like this, the AdSense ads that are located behind the login aren’t as relevant and targeted as they could be.

If you’re a publisher with content behind a login page, be sure to set up an AdSense crawler login so that your ads are as well-targeted as possible. Doing so will give the AdSense crawler the ability to scan content on these pages, resulting in more relevant, targeted ads that can potentially increase your CTRs and revenue. Please note that adding a crawler login will only help to deliver better, more relevant ads to pages with AdSense code already on them, and will not have any effect on which pages of your site Google Search will index.

To grant the AdSense crawler access, log in to your AdSense account and click on ‘Account settings.’ From there, scroll down to the ‘Access and authorization’ section and click on ‘edit logins’ next to crawler logins.

Then click on ‘Add a Login.’ You’ll be prompted to fill in pertinent information that the AdSense crawler will use to log in to your site and crawl your content.

After that, you’ll need to log in to Webmaster Tools to verify your website, if you haven’t already done so. Once verified, the crawler will be able to log in successfully and scan your content to deliver more targeted ads.

For additional information, take a look at our help center article regarding displaying ads on login-protected pages.

Posted by Andrew Boni - Inside AdSense Team

AdSense crawler errors: Check your robots.txt file for improved ad targeting and relevancy

This is the first post in our two-part AdSense Crawler Errors series.

There are many ways that publishers can go about optimizing their site for AdSense; opting-in to text/image ads, upgrading to our preferred ad formats, and increasing ad coverage across a site are just a few of the more well-known ones. But did you know that there’s another straightforward optimization tip that many publishers often overlook?

A bit of context
Your site’s robots.txt file essentially acts as a gatekeeper that determines which web crawlers, web robots, and search engines have access to your site and which do not. Those that are granted permission can do things like view your pages and index your site. Those that don’t have permission are not able to view or index specific sections of your site, depending on what you’ve specified.

AdSense ads are displayed through the use of an AdSense web crawler. That crawler scans your page’s content and determines which ads to display, according to specific keywords. If our AdSense crawler is being blocked by your robots.txt file, we’re going to have a difficult time displaying relevant ads on your site. As a result, your users may see less relevant ads, which can lead to a lower CTR.

How you can help yourself
View the contents of your robots.txt file by going to [yourdomain.com]/robots.txt.  (If you have a subdomain, it likely has a robots.txt file as well, located at [sub.yourdomain.com]/robots.txt.) Be sure that the file is configured to allow our AdSense ad crawler to view your site. You can do that by simply adding the following two lines to the very top of the file:

User-agent: Mediapartners-Google
Disallow:

This will ensure that our AdSense ad crawler can access your site and will help display more relevant ads. As a result, you can potentially benefit from increased ad revenue. Please note that making this change will not impact your Google search rankings. Adding these two lines to your robots.txt file will only help to deliver better, more relevant ads to pages with AdSense code already on them. Pages that don’t have AdSense ad code will not be affected.

If you have URLs with any errors, you can see what they are by logging into your AdSense account and clicking on ‘Account Settings’ from the home page. From there, click on ‘View errors’ under ‘Access and Authorization.’

Stay tuned for the second post in our AdSense Crawler Errors series, where we’ll cover crawler login issues and how you can solve them.

Posted by Andrew Boni - Inside AdSense Team

Test your knowledge with the AdSense Academy

Whether you’re new to AdSense or have been using it for years, the AdSense Academy can help you successfully run your AdSense account by following six step-by-step learning modules. The Academy provides best practices on everything from implementing your ad units to building your traffic to controlling your ads.

The AdSense Academy includes checklists, videos and quizzes that you can take at the end of each module to test your knowledge.

	Join the Academy Now!

Please feel free to provide any feedback by commenting on this post or on the AdSense Forum.

Posted by Thomas Tran - Inside AdSense Team

Prepare for the upcoming holiday season with placement targeting

With the holidays right around the corner, premium brand-name AdWords advertisers are preparing for the season by increasing their marketing budgets and scheduling targeted campaigns. You can prepare too by taking advantage of placement targeting to allow advertisers to directly target your site.

While all sites are eligible for placement targeting, there are things you can do to help increase the amount of placement targeted ads on your site. First, turn your custom channels into ad placements. Be sure to fill out a well-written title and description to help potential advertisers understand the audiences they’ll reach by bidding on your site. Some details to include in the description are your site name, vertical, ad position, ad size and site demographic.

Next, ensure you are using our most successful ad units and are placing them in optimal positions. Finally, claim your site in Ad Planner. Following these steps will help advertisers find your site to target and choose where to place their ads on a specific section or area. Placement targeted ads typically receive much higher RPMs, which results in higher earnings for you.

Creating targeted channels is easy and a great way to earn extra revenue, but it takes time for them to show up for advertisers, so act soon! Just follow the instructions in our Help Center. Once you've made the changes, not only will your ads be ready for this holiday season, but they'll also be targetable by advertisers for every premium campaign in the future.

Posted by Jamie Firkus, Inside AdSense team

Sulit.com.ph lifts revenue by 50% using Custom Search Ads on the Search result pages.

Sulit in Filipino means “worth it” and refers to the deals available on Sulit.com.ph. The site helps users in Philippines locate, buy, and sell products online. Co-founder RJ recently spoke to us to describe how he optimized AdSense performance and revenue by moving from AdSense for Content to Custom Search Ads on the search result pages of Sulit. As a refresher, Custom Search Ads is a special feature that allows publishers to monetize their search results pages with targeted and customizable search ads similar to those found on Google.com.

Inside AdSense: Can you tell us a little about how and when www.sulit.com.ph got started?
RJ: Sulit.com.ph started as a project for my then-girlfriend and now-wife Arianne and I in 2006. We launched it as an experiment to understand the online market potential for our business and we wanted to determine which category the users were looking for and where we could invest as an online business.

After a few months, the traffic to the website started to grow which made us decide to push through with the classified ads site. The decision to move ahead with Sulit.com.ph proved to be a great call as Sulit has become one of the most visited websites in the Philippines today. Our purpose was to help connect Filipino buyers and sellers online, in a marketplace if you may.

IA: What role does AdSense play in your business?
RJ: By November 2006, the traffic to the website had started to increase. Since this was a bootstrap project, we did not have any business model in place at the beginning. I was using AdSense on some of my smaller websites and understood the value of having AdSense on our site. So we decided to monetize the site by using AdSense. We signed up for an account in November 2006 and got our very first AdSense check in February 2007. It was easy to use and the returns helped us grow our experiment to a full blown corporation. AdSense served as our primary revenue source while we were growing the business.

IA: Why did you decide to try out Custom Search Ads on your pages?
RJ: I received an optimization tip from the AdSense team suggesting I maximize revenue by changing from AdSense for content to AdSense for search on my search result pages. AdSense for content was an effective system as it displayed related ads to the content of a webpage. AdSense for search takes the relevancy to a whole new level and hence its more effective. The code allows us to display ads related to what the user is actually searching for. It benefits us by providing value to our users. When our users see related ads and no clutter on our search result pages, we guarantee return and loyal visitors which in turn helps our business grow.

And since the the ads are relevant we’ve seen more click and this helps us to continue providing this free service through the revenue we generate through AdSense.

IA: What were the results? Would you recommend this strategy to other publishers?
RJ: It surprised me that it is possible to serve advertising that gives value to our users. It allowed us to add more development resources in tweaking and adding more innovative features to Sulit.com.ph which is helping to get more and more users to use the website.

I’d recommend that other publishers who have a search based site consider optimizing revenue by adding Custom Search Ads on the search results. If the ads are appropriately positioned, it will provide a great user experience and also ensure that you maximize your Google AdSense returns. I would also recommend that you test the ad units on your site since you the publisher will know how the user responds, and navigates through your site best.

Since the implementation of Custom Search Ads on our site we’ve seen a 50% increase in our overall revenue through AdSense, which is fantastic!

If you have a search-based site, we encourage you to learn more about Custom Search Ads and apply to use the feature.

Posted by Amrita Kamat, AdSense Partnerships Specialist

Targeted link units bring in 25% of MyPlayCity’s online revenue.

MyPlayCity.com offers more than 350 full-version, downloadable games, all for free. Ksenia Kazak, director of marketing and PR, shared her experience with growing MyPlayCity’s revenue and improving AdSense performance just by adding link units to their pages.

Inside AdSense: Tell us a little more about MyPlayCity. When did it launch?

Ksenia Kazak: We created the site in 2006, and today have more than one million visitors daily. We offer casual games, which are easy to play, small, colorful and suitable for all ages. None of our games have time limits, and users can download them and play for as long as they want, for free. It’s great for our users, because gamers usually have to pay for their games.

IA: How do you use AdSense on your site?

KK: We’ve used AdSense from the very beginning – it was a clear choice for us. We’ve used features like AdSense for search, AdSense for feeds, and we recently implemented AdSense for games which has worked really well for us. From time to time we’ve tried using other ad networks, but they haven’t worked as well as AdSense – it is our main source of revenue.

IA: Why did you decide to start showing link units on your site?

KK: We learned about adding link units as we were setting up AdSense on our site. We’re always eager to try new things, so we decided to give link units a go. We learned that we could add up to three link units in addition to the three AdSense for content units we already have on each page, so we decided to give it a shot.

We wanted to ensure the site would stay user-friendly and create a positive user experience. So, we thought carefully about ad placement, as it’s important to us to emphasize our content and build a loyal user base that will keep coming back. Following recommendations from the AdSense team, we implemented a wide 728x15 format with four links on the top and bottom of the pages.

IA: What were the results? Would you recommend this strategy to other publishers?

KK: The link units are very efficient in terms of revenue – they bring in 25% of our total online revenue. The ads are quite targeted and they generate a huge user interest. Compared to our other AdSense for content ads, the link units perform very well. With this additional revenue from link units, we’ve been able to add more games to our collection. We’re able to improve our site and bring in a larger audience that’s increasingly loyal.

In terms of placement, our link units at the top of the page perform well, as users are more likely to see them there, yet they do not distract from the page content. At the same time, the link units also work really well at the bottom of the page, as users tend to scroll down to change the language of the site. It’s another opportunity for users to find the links. The AdSense team recommended using four link units instead of five, since the font is larger and they are more visible to the user.

I’d recommend other publishers adding link to their sites, as they are an excellent solution in limited space. They take up very little room, but the revenue is significant.

If you’d like to add link units to your site like MyPlayCity, sign in to your account today.

1. Once you’re signed in to your AdSense account, click the “My Ads” tab in the new AdSense interface
2. Scroll to the bottom of the ‘size’ drop-down and select your link unit size. We recommend trying one of our top-performing sizes: 728x15, 160x90 or 468x15
   

Once you've updated your pages, link units will appear immediately. If we haven't yet crawled your page, we may initially show your alternate ad or a 'View ads about' search box in the link unit.

Some additional link units tips and best practices from the AdSense team:

• Try wider formats with fewer links – for example, 728x15 (4 links), 160x90 (4 links), or 468x15 (4 links).
• Effective placements include the top of the page (after navigation and before page content) and at the bottom of the page (at the end of an article). Horizontal ad link units usually work better for this (728x15 and 468x15 formats).
• If the horizontal format is not adapted to your site, you can use vertical formats (such as 160x90 or 200x90) to fill small spaces in the sidebar. Or try wrapping text around the ad units inside an article to serve as a content breaker.
  

Posted by Jane Brinkley - AdSense Optimization Team

AdSense is in town: Join our publisher event in the UK

How can I make the most out of my AdSense revenue potential? Which opportunities are coming from current trends on the online market? How can I improve the user experience on my website?

We’ll be addressing these questions and many more at our upcoming AdSense publisher event, taking place in the London area the first week of June. We’d love to see you there. Sign up through the form below until Friday, May 27th and we’ll follow up via email with additional details if there's still room. Scheduling will be done on a first-come, first-served basis, but we’ll do our best to include as many of you as space will allow.

Sign up now!

During the event we’re offering many interesting workshops and presentations on website monetization. You’ll also have the opportunity to meet our optimization specialists for one-on-one optimization consultations.

We look forward to hearing from you!

Posted by Sophie Emmerich - Google AdSense Optimization Specialist

Tell us about your experience with our customized suggestions

Many of you have opted in to receive our customized suggestions about your AdSense implementation. When publishers opt in to this communication, we regularly send them best practice tips that are relevant to their specific site, to help them optimize and earn more with Google AdSense.

Take a look at how publisher Johnny Hayes now earns 51% more with AdSense on his site, funcheapsf.com, as a result of implementing one of the tips we sent him. You can also learn how publisher Eric Bort’s AdSense revenue increased by more than 200% on his site surgerysquad.com by making a change we recommended via email.

How do you sign up to receive personalized performance suggestions?
Step 1. Go to your account settings, and in the Personal settings section, click "edit"
Step 2. Check the box next to "Customized help and Suggestions"
Step 3. Click "Save"

For the publishers who’ve already opted in:
We'd love to hear your story as well. Tell us about your experiences with the tips we’ve sent you and the increase in AdSense revenue you’ve seen. Also, let us know any feedback you might have regarding our customized suggestions, so we can keep improving how we provide you with tips and advice.

If you haven't yet opted in, don’t miss out on additional earnings - opt in today! Make sure to check that the contact information in your account is up-to-date, so we'll be sure to reach you.

Posted by Nathaniel Kolenberg - Inside AdSense Team

How integrating new ad sizes helped CareerPlanner.com increase revenue by 165%

In 1997, CareerPlanner.com founder Michael Robinson decided to pursue his passion of helping people discover their true career directions. He initially wanted to go into high schools and work directly with students, but decided instead to start a website so that he could keep his day job. Today, CareerPlanner.com helps high school students, college students, and adults alike discover their optimal career paths and learn how to start careers or make career changes.

In 2007, Michael and CareerPlanner.com's top graphic designer realized that 2.5 million visitors per year weren't purchasing any CareerPlanner.com products. "These visitors were clearly looking for something, but it was not anything we offered," says Michael, so they decided to give AdSense a try. Today, AdSense is on over 95% of CareerPlanner.com’s pages and the site receives over 5.5 million visitors a year. The revenue from Google AdSense now helps fund CareerPlanner.com’s Research and Development efforts, IT expansion, as well as special marketing projects that they always wanted to try but could never afford.

Getting more out of AdSense

Following advice from the AdSense team, Michael decided to update his AdSense ad units with the goal of increasing performance. Instead of the three 120 x 600 skyscrapers that had been running one on top another down the right side of each page, Michael began running one 160x600 wide skyscraper on the left column, one 300 x 250 medium rectangle in the center, integrated into his content below the fold, and one 160 x 600 wide skyscraper on the right column. Michael also changed the color scheme of the ad units to match the color scheme of his webpages. Initially, Michael made these changes to 75% of his pages. Within one month, his AdSense for content revenue increased 80%.

The initial revenue growth CareerPlanner.com saw in the first month inspired Michael to take the time to implement the same changes on more of his pages. Today, Michael has optimized 99% of his pages and increased his AdSense for content revenue by 165%.
"The best news," says Michael, "is that since we have made the optimization changes, our Google AdSense revenue has been setting new records every month."

Sign in to your account to upgrade your ad units like CareerPlanner.com today!

Posted by Jane Brinkley - AdSense Optimization team

Surgery Squad lifts CTR and enhances revenue with a simple optimization procedure

Surgery Squad adds a third ad unit to its pages to boost performance and AdSense earnings by 200%.

SurgerySquad.com educates patients about what takes place during surgical procedures through interactive, virtual surgery modules. Creator Eric Bort recently spoke with us to describe how he’s optimized Surgery Squad’s AdSense performance and revenue by simply adding a third ad unit to his pages.

Inside AdSense: Can you tell us a little about how Surgery Squad got started?
Eric Bort: I launched Surgery Squad in August 2010 after having spent more than a decade developing corporate training and e-learning programs. As part of these programs, I’d created some virtual surgeries which were well-received, so I decided to make a website devoted to this topic. People have lots of questions about surgeries. They want to know, “What happens to my body while I’m asleep on the operating table?” It’s a very intriguing topic from a human perspective.

IA: What role does AdSense play in your business?
EB: We’ve used AdSense on Surgery Squad since its launch, because we’ve previously seen a lot of success with AdSense on some of our other sites. AdSense is currently responsible for all of Surgery Squad’s revenue. It was really quick to set up – once our account was approved, we were up and running within 10 minutes. And with the breadth of advertisers in the network, I know that AdSense will always have high quality ads to display.

IA: Why did you decide to add another ad unit to your pages?
EB: I received an optimization tip from the AdSense team suggesting I maximize revenue by adding an additional ad unit to my pages. Initially, I was wary of overwhelming visitors with ads, because it’s very important to me to create a good user experience. But I decided to give it a try because I know how important it is to test new strategies and see what works best. So, I added a third ad unit to all my pages, toward the bottom of each page.

IA: What were the results? Would you recommend this strategy to other publishers?
EB: I was surprised to see the new ad unit performing just as well, if not better, than the other two ad units. I think it’s due to visitors who scroll down to the bottom of the page to add comments, and then find ads they want in addition to our content. Our clickthrough rate has increased substantially. It’s amazing. Our eCPM has also increased 168 percent and our overall revenue earnings have grown by more than 200 percent. With this additional revenue from AdSense, we’re able to cover our costs and sustain our business. To know these costs are covered is hugely important when you’re running a small business.

I’d recommend that other publishers consider optimizing revenue by adding new ad units. If presented in the right way, ads can enhance the user experience. But it’s really important to test and see what works best with your content, format, and user behavior. Have the patience to wait and see what works and what doesn’t.

If you want to add an additional ad unit like Surgery Squad, sign in to your account today.

Posted by Meredith Blackwell - Inside AdSense team