Google is making some important changes to the user permissions and roles, please review these changes so you know how you may be affected.
Please visit Search Engine Land for the full article.
Email has changed the way we communicate – it empowers us as marketeers to give consumers exactly what they want and when they want it. What’s more, it continues to be the most powerful revenue-generating channel for brands to reach their customers; for every $1 spent on email, $32 are returned.
With more choice comes greater competition in the inbox, and – for email to stay relevant – innovation and transformation are both key. Today, consumers expect brand messages to be contextual, relevant to both their preferences and activity. And, to effectively achieve this seamless journey, it’s essential that you pair the right data with the right messages.
So, why not let our Digital Marketing Specialists provide a fresh perspective on your email marketing strategy? Whether you want to deliver a high-value showstopper, or just looking for interim support on the everyday stuff, we’re in the best position to step in and provide specialist support for great ROI.
Let us work alongside you to:
How do you stack up against other brands in their email marketing? Check out our Hitting the Mark benchmark report – a free download featuring the hottest insights into the email marketing strategy of 100 UK and US brands.
*Please speak to your Account Manager for more information on copywriting services and campaign management hours.
Posted by dudleycarr
Today we’re making an announcement that’s exciting for marketers at local businesses, enterprises, and agencies focused on digital marketing.
Back in August we announced the industry’s most advanced duplicate detection and closure toolset. And just last month we unleashed our new Moz Local packages, adding Google My Business sync, listing alerts, Apple Maps distribution, reputation monitoring and management, and more to the mix. Well, we have one more announcement to squeeze in before the year ends, and it’s a big deal!
We’re announcing a partnership with Yelp — the leading source for consumer reviews — bringing a new level of Moz Local product integration that will help you make Local your advantage. This integration is the first of its kind in our industry; one that will enable marketers to capitalize on the convergence of local search and consumer reviews more easily than ever before. Whether you have one location or one thousand, you can now claim and manage all your Yelp locations directly from your Moz Local dashboard.
Marketers will now be able to claim and manage data for all of their Yelp listings in Moz Local to increase the likelihood that more new customers will be able to find their business in local and map searches.
Businesses can now use their Yelp login to claim and manage their listings through Moz Local — either individually or as a group. Create a new Yelp account or use your existing one, you can manage it all through us!
Once claimed, Yelp listings can be accessed and updated by Moz Local. This includes pushing updates to those Yelp pages from the Moz Local dashboard as well as monitoring the status of those updates and getting listing alerts in our recently introduced activity feed.
This new advanced Yelp functionality in Moz Local — claiming and active management functions — will complement our existing Reputation Management functionality, which provides notifications of new Yelp reviews and review snippets themselves right in the Moz Local dashboard, enabling users to link to the review user experience on Yelp.com in order to respond to a review.
We’re excited about this partnership for a number of reasons. First off, our primary goal has always been to make it easier for brands and marketers to manage their local marketing strategy. As the leading consumer review service, Yelp is one of the most authoritative citation sources in the Local SEO ecosystem, and, as such, is an important source of information to Google. On top of that, Yelp data is critically important to Bing, Apple Maps/Siri, Amazon Alexa, and Yahoo, which use both its location data and reviews directly for their own results.
Everyone agrees Yelp is vital to local marketing strategy, and businesses that employ digital marketing have always told us they would love to be able to update and manage their Yelp listings. In both small and large-scale scenarios, they’ve been waiting for an efficient solution for updating their listings. A comprehensive solution that enables them to do this, as well as manage their Yelp reviews, streamlines the online management process substantially.
Finally, as the leading consumer review site, Yelp attracts over 100 million unique visitors monthly. It provides a critical customer touchpoint for businesses, and having listings on Yelp helps a business rank in local searches.
Moz Local users will provide the email address associated with the Yelp page(s) for their business location(s) to Moz Local, which will then start the claiming process. This will include a bulk claiming process that will prove especially valuable for businesses that have a large number of locations.
Once the Yelp page(s) for their business have been claimed by Moz Local on the user’s behalf, then automatically associated with Moz Local listings as appropriate, the user will be able to monitor and update those pages with all the efficiency and effectiveness that Moz Local provides through its unique, industry leading Active Location Data Management process. This will be available in all Moz Local product packages (Moz Local Essential, Moz Local Professional, and Moz Local Premium).
Yelp review snippets and review notifications are available in the Reputation tab in all Moz Local product packages.
Yelp performance metrics will become available in the Performance and Visibility tabs of Moz Local Professional and Moz Local Premium packages, our product packages that offer SEO analytics.
The new Yelp advanced functionality will be available in early 2017.
Questions about this announcement? Leave a comment or contact us at firstname.lastname@example.org.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!
Why did you decide to come to dotmailer?
I first got to know dotmailer when the company was just a bunch of young enthusiastic web developers called Ellipsis Media back in 1999. I was introduced by one of my suppliers and we decided to bring them on board to build a recruitment website for one of our clients. That client was Amnesty International and the job role was Secretary General. Not bad for a Croydon company whose biggest client before that was Scobles the plumber’s merchants. So, I was probably dotmailer’s first ever corporate client! After that, I used dotmailer at each company I worked for and then one day they approached a colleague and me and asked us if we wanted to work for them. That was 2013. We grabbed the opportunity with both hands and haven’t looked back since.
Tell us a bit about your role
I’m the Global Head of Technical Solutions which actually gives me responsibility for 2 teams. First, Custom Technical Solutions (CTS), who build bespoke applications and tools for customers that allow them to integrate more closely with dotmailer and make life easier. Second, Technical Pre-sales, which spans our 3 territories (EMEA, US and APAC) and works with prospective and existing clients to figure out the best solution and fit within dotmailer.
What accomplishments are you most proud of from your dotmailer time so far?
I would say so far it has to be helping to turn the CTS team from just 2 people into a group of 7 highly skilled and dedicated men and women who have become an intrinsic and valued part of the dotmailer organization. Also I really enjoy being part of the Senior Technical Management team. Here we have the ability to influence the direction and structure of the platform on a daily basis.
Can you speak a bit about your background and that of your team? What experience and expertise is required to join this team?
My background is quite diverse from a stint in the Army, through design college, web development, business analysis to heading up my current teams. I would say the most valuable skill that I have is being highly analytical. I love nothing more than listening to a client’s requirements and digging deep to work out how we can answer these if not exceed them.
As a team, we love nothing more than brainstorming our ideas. Every member has a valid input and we listen. Everyone has the opportunity to influence what we do and our motto is “there is no such thing as a stupid question.”
To work in my teams you have to be analytical but open minded to the fact that other people may have a better answer than you. Embrace other people’s input and use it to give our clients the best possible solution. We are hugely detail conscious, but have to be acutely aware that we need to tailor what we say to our audience so being able to talk to anyone at any level is hugely valuable.
How much of the dotmailer platform is easily customizable and when does it cross over into something that requires your team’s expertise? How much time is spent on these custom solutions one-time or ongoing?
I’ll let you in on a little secret here. We don’t actually do anything that our customers can’t do with dotmailer given the right knowledge and resources. This is because we build all of our solutions using the dotmailer public API. The API has hundreds of methods in both SOAP and REST versions, which allows you to do a huge amount with the dotmailer platform. We do have a vast amount of experience and knowledge in the team so we may well be able to build a solution quicker than our customers. We are more than happy to help them and their development teams build a solution using us on a consultancy basis to lessen the steepness of the learning curve.
Our aim when building a solution for a customer is that it runs silently in the background and does what it should without any fuss.
What are your plans for the Custom Tech Solutions team going forward?
The great thing about Custom Technical Solutions is you never know what is around the corner as our customers have very diverse needs. What we are concentrating on at the moment is refining our processes to ensure that they are as streamlined as possible and allow us to give as much information to the customer as we can. We are also always looking at the technology and coding approaches that we use to make sure that we build the most innovative and robust solutions.
We are also looking at our external marketing and sharing our knowledge through blogs so keep an eye on the website for our insights.
What are the most common questions that you get when speaking to a prospective customer?
Most questions seem to revolve around reassurance such as “Have you done this before?”, “How safe is my data?”, “What about security?”, “Can you talk to my developers?”, “Do I need to do anything?”. In most instances, we are the ones asking the questions as we need to find out information as soon as possible so that we can analyse it to ensure that we have the right detail to provide the right solution.
Can you tell us about the dotmailer differentiators you highlight when speaking to prospective customers that seem to really resonate?
We talk a lot about working with best of breed so for example a customer can use our Channel Extensions in automation programs to fire out an SMS to a contact using their existing provider. We don’t force customers down one route, we like to let them decide for themselves.
Also, I really like to emphasize the fact that there is always more than one way to do something within the dotmailer platform. This means we can usually find a way to do something that works for a client within the platform. If not, then we call in CTS to work out if there is a way that we can build something that will — whether this is automating uploads for a small client or mass sending from thousands of child accounts for an enterprise level one.
What do you see as the future of marketing automation technology? Will one size ever fit all? Or more customization going forward?
The 64 million dollar question. One size will never fit all. Companies and their systems are too organic for that. There isn’t one car that suits every driver or one racquet that suits every sport. Working with a top drawer partner network and building our system to be as open as possible from an integration perspective means that our customers can make dotmailer mold to their business and not the other way round…and adding to that the fact that we are building lots of features in the platform that will blow your socks off.
Tell us a bit about yourself – favorite sports team, favorite food, guilty pleasure, favorite band, favorite vacation spot?
I’m a dyed in the wool Gooner (aka Arsenal Football Club fan) thanks to my Grandfather leading me down the right path as a child. If you are still reading this after that bombshell, then food-wise I pretty much like everything apart from coriander which as far as I’m concerned is the Devils own spawn. I don’t really have a favorite band, but am partial to a bit of Level 42 and Kings of Leon and you will also find me listening to 90s drum and bass and proper old school hip hop. My favorite holiday destination is any decent villa that I can relax in and spend time with my family and I went to Paris recently and loved that. Guilty pleasure – well that probably has to be confessing to liking Coldplay or the fact that my favorite sandwich is peanut butter, cheese and salad cream. Go on try it, you’ll love it.
While the program is recently revamped, dotmailer has enjoyed a 17-year history of working side-by-side with partners like Magento, Salesforce and Microsoft Dynamics. We value these relationships as an opportunity to help deliver the best marketing strategies that lead to more business for you and your clients. Our new partnership program extends these relationships with the right tools, resources and benefits to help you build, run and grow a profitable agency, marketing or technology reseller business.
Here are the top five questions about the partner program answered:
Our partner program delivers two types of certification for two distinct types of audiences:
dotmailer is a fast, powerful, and easy-to-use marketing automation platform with email at its core. Our world-class integrations make dotmailer extensible, and suitable for both B2C and B2B marketers alike. Here’s what some of our current partners have to say:
“We have found that dotmailer offers a strong solution. Not only do they cater to retail brands, but they also have a distinct B2B focus, which aligns with the more than 60% of our clients that have a B2B component as part of their ecommerce channels. Leveraging the dotmailer solution makes these conversations more relevant when discussing their marketing needs. As Magento’s Premier email marketing automation provider, they have invested heavily in both the technology and the sales enablement tools we need to win over customers.” – Caleb Bryant, Strategic Alliances Manager at Gorilla Group
“dotmailer enhances and extends our opportunity to bring customers a solution that provides highly personalized, automated and measureable email interactions to their customers to further nurture leads and customer engagement.” “An additional benefit of dotmailer is the pricing flexibility and geographical reach.” – Motti Danino, VP of Operations, Oro Inc.
The dotmailer partner program is free to join and benefits are offered in three tiers: Bronze, Silver and Gold. The benefits include commission, guest blogging, partner case studies, co-hosted webinars, event sponsorship and more. Our main aim is help partners become more successful and rise through the ranks as they become more affluent in offering the dotmailer platform and services.
dotmailer is committed to ensuring our agency partners have the tools at their disposal to continue them to grow service retainers and effectively sell a best-of-breed email marketing automation platform. Our philosophy has always been to innovate and we still run in bi-weekly development cycles with quarterly releases. We are constantly innovating on both the platform and our integrations, meaning the partner program will continue to evolve as does the dotmailer feature set.
For more information and to submit your details so we can get in touch, visit our partners page.
Posted by KelseyLibert
When it comes to job availability and security, the future looks bright for inbound marketers.
The Bureau of Labor Statistics (BLS) projects that employment for marketing managers will grow by 13% between 2012 and 2022. Job security for marketing managers also looks positive according to the BLS, which cites that marketing employees are less likely to be laid off since marketing drives revenue for most businesses.
While the BLS provides growth estimates for managerial-level marketing roles, these projections don’t give much insight into the growth of digital marketing, specifically the disciplines within digital marketing. As we know, “marketing” can refer to a variety of different specializations and methodologies. Since digital marketing is still relatively new compared to other fields, there is not much comprehensive research on job growth and trends in our industry.
To gain a better understanding of the current state of digital marketing careers, Fractl teamed up with Moz to identify which skills and roles are the most in demand and which states have the greatest concentration of jobs.
We analyzed 75,315 job listings posted on Indeed.com during June 2015 based on data gathered from job ads containing the following terms:
We chose the above keywords based on their likelihood to return results that were marketing-focused roles (for example, just searching for “social media” may return a lot of jobs that are not primarily marketing focused, such as customer service). The occurrence of each of these terms in job listings was quantified and segmented by state. We then combined the job listing data with U.S. Census Bureau population estimates to calculate the jobs per capita for each keyword, giving us the states with the greatest concentration of jobs for a given search query.
Using the same data, we identified which job titles appeared most frequently. We used existing data from Indeed to determine job trends and average salaries. LinkedIn search results were also used to identify keyword growth in user profiles.
As the marketing industry continues to evolve due to emerging technology and marketing platforms, marketers are expected to pick up new skills and broaden their knowledge more quickly than ever before. Many believe this rapid rate of change has caused a marketing skills gap, making it difficult to find candidates with the technical, creative, and business proficiencies needed to succeed in digital marketing.
The ability to combine analytical thinking with creative execution is highly desirable and necessary in today’s marketing landscape. According to an article in The Guardian, “Companies will increasingly look for rounded individuals who can combine analytical rigor with the ability to apply this knowledge in a practical and creative context.” Being both detail-oriented and a big picture thinker is also a sought-after combination of attributes. A report by The Economist and Marketo found that “CMOs want people with the ability to grasp and manage the details (in data, technology, and marketing operations) combined with a view of the strategic big picture.”
But well-rounded marketers are hard to come by. In a study conducted by Bullhorn, 64% of recruiters reported a shortage of skilled candidates for available marketing roles. Wanted Analytics recently found that one of the biggest national talent shortages is for marketing manager roles, with only two available candidates per job opening.
While recruiter frustrations may indicate a shallow talent pool, LinkedIn tells a different story—the number of U.S.-based marketers who identify themselves as having digital marketing skills is on the rise. Using data tracked by Rand and LinkedIn, we found the following increases of marketing keywords within user profiles.
The number of profiles containing “content marketing” has seen the largest growth, with a 168% increase since 2013. “Social media” has also seen significant growth with a 137% increase. “Social media” appears on a significantly higher volume of profiles than the other keywords, with more than 2.2 million profiles containing some mention of social media. Although “SEO” has not seen as much growth as the other keywords, it still has the second-highest volume with it appearing in 630,717 profiles.
Why is there a growing number of people self-identifying as having the marketing skills recruiters want, yet recruiters think there is a lack of talent?
While there may be a lot of specialists out there, perhaps recruiters are struggling to fill marketing roles due to a lack of generalists or even a lack of specialists with surface-level knowledge of other areas of digital marketing (also known as a T-shaped marketer).
The data we gathered from LinkedIn confirm this, as the 20 most common digital marketing-related job titles being advertised call for a broad mix of skills.
It’s no wonder that marketing manager roles are hard to fill, considering the job ads are looking for proficiency in a wide range of marketing disciplines including social media marketing, SEO, PPC, content marketing, Google Analytics, and digital marketing. Even job descriptions for specialist roles tend to call for skills in other disciplines. A particular role such as SEO Specialist may call for several skills other than SEO, such as PPC, content marketing, and Google Analytics.
Taking a more granular look at job titles, the chart below shows the five most common titles for each search query. One might expect mostly specialist roles to appear here, but there is a high occurrence of generalist positions, such as Digital Marketing Manager and Marketing Manager.
Only one job title containing “SEO” cracked the top five. This indicates that SEO knowledge is a desirable skill within other roles, such as general digital marketing and development.
Recruiter was the third most common job title among job listings containing social media keywords, which suggests a need for social media skills in non-marketing roles.
Similar to what we saw with SEO job titles, only one job title specific to PPC (Paid Search Specialist) made it into the top job titles. PPC skills are becoming necessary for more general marketing roles, such as Marketing Manager and Digital Marketing Specialist.
Across all search queries, the most common jobs advertised call for a broad mix of skills. This tells us hiring managers are on the hunt for well-rounded candidates with a diverse range of marketing skills, as opposed to candidates with expertise in one area.
Marketers who cultivate diverse skill sets are better poised to gain an advantage over other job seekers, excel in their job role, and accelerate career growth. Jason Miller says it best in his piece about the new breed hybrid marketer:
Using data from Indeed, we identified which inbound skills have the highest demand and which jobs are seeing the most growth. Social media keywords claim the largest volume of results out of the terms we searched for during June 2015.
“Social media marketing” or “social media management” appeared the most frequently in the job postings we analyzed, with 46.7% containing these keywords. “PPC” returned the smallest number of results, with only 3.8% of listings containing this term.
Perhaps this is due to social media becoming a more necessary skill across many industries and not only a necessity for marketers (for example, social media’s role in customer service and recruitment). On the other hand, job roles calling for PPC or SEO skills are most likely marketing-focused. The prevalence of social media jobs also may indicate that social media has gained wide acceptance as a necessary part of a marketing strategy. Additionally, social media skills are less valuable compared to other marketing skills, making it cheaper to hire for these positions (we will explore this further in the average salaries section below).
Our search results also included a high volume of jobs containing “digital marketing” and “SEO” keywords, which made up 19.5% and 15.5% respectively. At 5.8%, “content marketing” had the lowest search volume after “PPC.”
While the number of job listings tells us which skills are most in demand today, looking at which jobs are seeing the most growth can give insight into shifting demands.
Digital marketing job listings have seen substantial growth since 2009, when it accounted for less than 0.1% of Indeed.com search results. In January 2015, this number had climbed to nearly 0.3%.
While social media marketing jobs have seen some uneven growth, as of January 2015 more than 0.1% of all job listings on Indeed.com contained the term “social media marketing” or “social media management.” This shows a significant upward trend considering this number was around 0.05% for most of 2014. It’s also worth noting that “social media” is currently ranked No. 10 on Indeed’s list of top job trends.
Despite its growth from 0.02% to nearly 0.09% of search volume in the last four years, “content marketing” does not make up a large volume of job postings compared to “digital marketing” or “social media.” In fact, “SEO” has seen a decrease in growth but still constitutes a higher percentage of job listings than content marketing.
On the other hand, search volume on Indeed has either decreased or plateaued for “SEO,” “PPC,” and “Google Analytics.”
As we see in the graph, the volume of “SEO job” listings peaked between 2011 and 2012. This is also around the time content marketing began gaining popularity, thanks to the Panda and Penguin updates. The decrease may be explained by companies moving their marketing budgets away from SEO and toward content or social media positions. However, “SEO” still has a significant amount of job listings, with it appearing in more than 0.2% of job listings on Indeed as of 2015.
“PPC” has seen the most staggered growth among all the search terms we analyzed, with its peak of nearly 0.1% happening between 2012 and 2013. As of January of this year, search volume was below 0.05% for “PPC.”
Despite a lack of growth, the need for this skill remains steady. Between 2008 and 2009, “Google Analytics” job ads saw a huge spike on Indeed. Since then, the search volume has tapered off and plateaued through January 2015.
So we know the number of social media, digital marketing, and content marketing jobs are on the rise. But which skills are worth the most? We looked at the average salaries based on keywords and estimates from Indeed and salaries listed in job ads.
Job titles containing “SEO” had an average salary of $102,000. Meanwhile, job titles containing “social media marketing” had an average salary of $51,000. Considering such a large percentage of the job listings we analyzed contained “social media” keywords, there is a much larger pool of jobs; therefore, a lot of entry level social media jobs or internships are probably bringing down the average salary.
Job titles containing “Google Analytics” had the second-highest average salary at $82,000, but this should be taken with a grain of salt considering “Google Analytics” will rarely appear as part of a job title. The chart below, which shows average salaries for jobs containing keywords anywhere in the listing as opposed to only in the title, gives a more accurate idea of how much “Google Analytics” job roles earn on average.
Looking at the average salaries based on keywords that appeared anywhere within the job listing (job title, job description, etc.) shows a slightly different picture. Based on this, jobs containing “digital marketing” or “inbound marketing” had the highest average salary of $84,000. “SEO” and “Google Analytics” are tied for second with $76,000 as the average salary.
“Social media marketing” takes the bottom spot with an average salary of $57,000. However, notice that there is a higher average salary for jobs that contain “social media” within the job listing as opposed to jobs that contain “social media” within the title. This suggests that social media skills may be more valuable when combined with other responsibilities and skills, whereas a strictly social media job, such as Social Media Manager or Social Media Specialist, does not earn as much.
Looking for a new job? Maybe it’s time to pack your bags for Boston.
Massachusetts led the U.S. with the most jobs per capita for digital marketing, content marketing, SEO, and Google Analytics. New York took the top spot for social media jobs per capita, while Utah had the highest concentration of PPC jobs. California ranked in the top three for digital marketing, content marketing, social media, and Google Analytics. Illinois appeared in the top 10 for every term and usually ranked within the top five. Most of the states with the highest job concentrations are in the Northeast, West, and East Coast, with a few exceptions such as Illinois and Minnesota.
But you don’t necessarily have to move to a new state to increase the odds of landing an inbound marketing job. Some unexpected states also made the cut, with Connecticut and Vermont ranking within the top 10 for several keywords.
Job listings containing “digital marketing” or “inbound marketing” were most prevalent in Massachusetts, New York, Illinois, and California, which is most likely due to these states being home to major cities where marketing agencies and large brands are headquartered or have a presence. You will notice these four states make an appearance in the top 10 for every other search query and usually rank close to the top of the list.
More surprising to find in the top 10 were smaller states such as Connecticut and Vermont. Many major organizations are headquartered in Connecticut, which may be driving the state’s need for digital marketing talent. Vermont’s high-tech industry growth may explain its high concentration of digital marketing jobs.
Although content marketing jobs are growing, there are still a low volume overall of available jobs, as shown by the low jobs per capita compared to most of the other search queries. With more than three jobs per capita, Massachusetts and New York topped the list for the highest concentration of job listings containing “content marketing” or “content strategy.” California and Illinois rank in third and fourth with 2.8 and 2.1 jobs per capita respectively.
Again, Massachusetts and New York took the top spots, each with more than eight SEO jobs per capita. Utah took third place for the highest concentration of SEO jobs. Surprised to see Utah rank in the top 10? Its inclusion on this list and others may be due to its booming tech startup scene, which has earned the metropolitan areas of Salt Lake City, Provo, and Park City the nickname Silicon Slopes.
Compared to the other keywords, “social media” sees a much higher concentration of jobs. New York dominates the rankings with nearly 24 social media jobs per capita. The other top contenders of California, Massachusetts, and Illinois all have more than 15 social media jobs per capita.
The numbers at the bottom of this list can give you an idea of how prevalent social media jobs were compared to any other keyword we analyzed. Minnesota’s 12.1 jobs per capita, the lowest ranking state in the top 10 for social media, trumps even the highest ranking state for any other keyword (11.5 digital marketing jobs per capita in Massachusetts).
Due to its low overall number of available jobs, “PPC” sees the lowest jobs per capita out of all the search queries. Utah has the highest concentration of jobs with just two PPC jobs per 100,000 residents. It is also the only state in the top 10 to crack two jobs per capita.
Regionally, the Northeast and West dominate the rankings, with the exception of Illinois. Massachusetts and New York are tied for the most Google Analytics job postings, each with nearly five jobs per capita. At more than three jobs per 100,000 residents, California, Illinois, and Colorado round out the top five.
Overall, our findings indicate that none of the marketing disciplines we analyzed are dying career choices, but there is a need to become more than a one-trick pony—or else you’ll risk getting passed up for job opportunities. As the marketing industry evolves, there is a greater need for marketers who “wear many hats” and have competencies across different marketing disciplines. Marketers who develop diverse skill sets can gain a competitive advantage in the job market and achieve greater career growth.
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!
Posted by kristihines
If you don’t know what Google Analytics is, haven’t installed it on your website, or have installed it but never look at your data, then this post is for you. While it’s hard for many to believe, there are still websites that are not using Google Analytics (or any analytics, for that matter) to measure their traffic. In this post, we’re going to look at Google Analytics from the absolute beginner’s point of view. Why you need it, how to get it, how to use it, and workarounds to common problems.
Do you have a blog? Do you have a static website? If the answer is yes, whether they are for personal or business use, then you need Google Analytics. Here are just a few of the many questions about your website that you can answer using Google Analytics.
There are many, many additional questions that Google Analytics can answer, but these are the ones that are most important for most website owners. Now let’s look at how you can get Google Analytics on your website.
First, you need a Google Analytics account. If you have a primary Google account that you use for other services like Gmail, Google Drive, Google Calendar, Google+, or YouTube, then you should set up your Google Analytics using that Google account. Or you will need to create a new one.
This should be a Google account you plan to keep forever and that only you have access to. You can always grant access to your Google Analytics to other people down the road, but you don’t want someone else to have full control over it.
Big tip: don’t let your anyone (your web designer, web developer, web host, SEO person, etc.) create your website’s Google Analytics account under their own Google account so they can “manage” it for you. If you and this person part ways, they will take your Google Analytics data with them, and you will have to start all over.
Once you have a Google account, you can go to Google Analytics and click the Sign into Google Analytics button. You will then be greeted with the three steps you must take to set up Google Analytics.
After you click the Sign Up button, you will fill out information for your website.
Google Analytics offers hierarchies to organize your account. You can have up to 100 Google Analytics accounts under one Google account. You can have up to 50 website properties under one Google Analytics account. You can have up to 25 views under one website property.
Here are a few scenarios.
There are no right or wrong ways to set up your Google Analytics account—it’s just a matter of how you want to organize your sites. You can always rename your accounts or properties down the road. Note that you can’t move a property (website) from one Google Analytics account to another—you would have to set up a new property under the new account and lose the historical data you collected from the original property.
For the absolute beginner’s guide, we’re going to assume you have one website and only need one view (the default, all data view. The setup would look something like this.
Beneath this, you will have the option to configure where your Google Analytics data can be shared.
Once you are finished, you will click the Get Tracking ID button. You will get a popup of the Google Analytics terms and conditions, which you have to agree to. Then you will get your Google Analytics code.
This must be installed on every page on your website. The installation will depend on what type of website you have. For example, I have a WordPress website on my own domain using the Genesis Framework. This framework has a specific area to add header and footer scripts to my website.
Alternatively, if you have a WordPress on your own domain, you can use the Google Analytics by Yoast plugin to install your code easily no matter what theme or framework you are using.
If you have a website built with HTML files, you will add the tracking code before the </head> tag on each of your pages. You can do this by using a text editor program (such as TextEdit for Mac or Notepad for Windows) and then uploading the file to your web host using an FTP program (such as FileZilla).
If you have a Shopify e-commerce store, you will go to your Online Store settings and paste in your tracking code where specified.
If you have a blog on Tumblr, you will go to your blog, click the Edit Theme button at the top right of your blog, and then enter just the Google Analytics ID in your settings.
As you can see, the installation of Google Analytics varies based on the platform you use (content management system, website builder, e-commerce software, etc.), the theme you use, and the plugins you use. You should be able to find easy instructions to install Google Analytics on any website by doing a web search for your platform + how to install Google Analytics.
After you install your tracking code on your website, you will want to configure a small (but very useful) setting in your website’s profile on Google Analytics. This is your Goals setting. You can find it by clicking on the Admin link at the top of your Google Analytics and then clicking on Goals under your website’s View column.
Goals will tell Google Analytics when something important has happened on your website. For example, if you have a website where you generate leads through a contact form, you will want to find (or create) a thank you page that visitors end upon once they have submitted their contact information. Or, if you have a website where you sell products, you will want to find (or create) a final thank you or confirmation page for visitors to land upon once they have completed a purchase.
That URL will likely look something like this.
In Google Analytics, you will click on the New Goal button.
You will choose the Custom option (unless one of the other options are more applicable to your website) and click the Next Step button.
You will name your goal something you will remember, select Destination, and then click the Next Step button.
You will enter your thank you or confirmation page’s URL after the .com of your website in the Destination field and change the drop-down to “Begins with”.
You will then toggle the value and enter a specific dollar value for that conversion (if applicable) and click Create Goal to complete the setup.
If you have other similar goals / conversions you would like to track on your website, you can follow these steps again. You can create up to 20 goals on your website. Be sure that the ones you create are highly important to your business. These goals (for most businesses) include lead form submissions, email list sign ups, and purchase completions. Depending on your website and its purpose, your goals may vary.
Note that this is the simplest of all conversion tracking in Google Analytics. You can review the documentation in Google Analytics support to learn more about setting up goal tracking.
Another thing you can set up really quickly that will give you valuable data down the road is Site Search. This is for any website with a search box on it, like the search box at the top of the Moz Blog.
First, run a search on your website. Then keep the tab open. You will need the URL momentarily.
Go to your Google Analytics Admin menu again, and in the View column, click on View Settings.
Scroll down until you see Site Settings and toggle it to On.
Look back at your URL for your search results. Enter the query parameter (usually s or q) and click Save. On Moz, for example, the query parameter is q.
This will allow Google Analytics to track any searches made on your website so you can learn more about what your visitors are looking for on specific pages.
If you want to add a new Google Analytics account, you can do so by going to your Admin menu, clicking on the drop-down under the Account column, and clicking the Create New Account link.
Likewise, if you want to add a new website under your Google Analytics account, you can do so by going to your Admin menu, clicking on the drop-down under the Property column, and clicking the Create New Property link.
Then you will continue through all of the above-mentioned steps.
Once you’ve installed Google Analytics on your website(s), set up your goals, and set up site search(es), you should wait about 24 hours for it to start getting data. Then you will be able to start viewing your data.
Once you start getting in Google Analytics data, you can start learning about your website traffic. Each time you log in to Google Analytics, you will be taken to your Audience Overview report. Alternatively, if you have more than one website, you will be taken to your list of websites to choose from, and then taken to the Audience Overview report for that website. This is the first of over 50 reports that are available to you in Google Analytics. You can also access these reports by clicking on the Reporting link at the top.
Most of the standard reports within Google Analytics will look similar to this. At the top right, you can click on the drop-down arrow next to your website to switch to different websites within all of your Google Analytics accounts. Or you can click the Home link at the top.
In the report at the top right, you can click on the dates to change the date range of the data you are viewing. You can also check the Compare box to compare your data from one date range (such as this month) to a previous date range (such as last month) to view your data.
You can hover over a variety of areas on your Google Analytics reports to get more information. For example, in the Audience Overview, hovering over the line on the graph will give you the number of sessions for a particular day. Hovering over the metrics beneath the graph will tell you what each one means.
Beneath the main metrics, you will see reports that you can switch through to see the top ten languages, countries, cities, browsers, operating systems, services providers, and screen resolutions of your visitors.
You can click the full report link on each to see the full reports. Or you can click on any of the top ten links to see more details. For example, clicking on the United States in Countries will take you to the full Location report, focused in on visitors from states within the US.
In this view, you can hover over each state to see the number of visitors from that state. You can scroll down to the table and hover over each column name to learn more about each metric.
You can also click on the name of each state to see visitors from cities within the state. Effectively, any time you see a clickable link or a ? next to something, you can click on it or hover over it to learn more. The deeper you dive into your analytics, the more interesting information you will find.
Speaking of reports, here is quick summary of what you will find in each of the standard Google Analytics reporting sections, accessible in the left sidebar.
Everything in (parenthesis) is a specific report or set of reports within the following sections that you can refer to.
These reports tell you everything you want to know about your visitors. In them, you will find detailed reports for your visitors’ age and gender (Demographics), what their general interests are (Interests), where they come from (Geo > Location) and what language they speak (Geo > Language), how often they visit your website (Behavior), and the technology they use to view your website (Technology and Mobile).
These reports will tell you everything you want to know about what drove visitors to your website (All Traffic). You will see your traffic broken down by main categories (All Traffic > Channels) and specific sources (All Traffic > Source/Medium).
You can learn everything about traffic from social networks (Social). You can also connect Google Analytics to AdWords to learn more about PPC campaigns and to Google Webmaster Tools / Search Console to learn more about search traffic (Search Engine Optimization)
These reports will tell you everything you want to know about your content. Particularly, the top pages on your website (Site Content > All Pages), the top entry pages on your website (Site Content > Landing Pages), and the top exit pages on your website (Site Content > Exit Pages).
If you set up Site Search, you will be able to see what terms are searched for (Site Search > Search Terms) and the pages they are searched upon (Site Search > Pages).
You can also learn how fast your website loads (Site Speed) as well as find specific suggestions from Google on how to make your website faster (Site Speed > Speed Suggestions).
If you set up Goals within your Google Analytics, you can see how many conversions your website has received (Goals > Overview) and what URLs they happened upon (Goals > Goal URLs). You can also see the path that visitors took to complete the conversion (Goals > Reverse Goal Path).
Speaking of goals and conversions, most of the tables within Google Analytics standard reports will tie specific data to your conversions. For example, you can see the number of conversions made by visitors from California in the Audience > Geo > Location report. You can see the number of conversions made by visitors from Facebook in the Acquisitions > All Traffic > Source/Medium report. You can see the number of conversions made by visitors who landed on specific pages in the Behavior > Site Content > Landing Pages report.
If you have multiple goals, you can use the dropdown at the top of that section of data to switch to the goal you want to view or all of your goals if you prefer.
While you won’t need every report within Google Analytics, you should explore them all to see what they have to offer. When you find some that you want to visit again and again, use the Shortcut link at the top of the report to add them to the Shortcuts in your left sidebar for faster access.
Or, use the email button to have them emailed to you (or others on your team) on a regular basis.
If you choose to send emails to someone outside of your organization, be sure to regularly check your emails by going to your Admin menu and clicking on the Scheduled Emails box under the View column to ensure only people working with your company are getting your data.
Got a few questions? Here are some of the common ones that come up with Google Analytics.
You don’t have to give your Google account information over to someone who needs access to your Google Analytics data. You just need to go to your Admin menu and under the Account, Property (website) or View you want someone to see, click the User Management menu.
From there, you can add the email address of anyone you would like to view your Google Analytics data and choose the permissions you would like them to have.
Yes! Quill Engage is a service that will take your Google Analytics data and summarize it in an easy-to-read report for you. Best of all, it’s free for up to ten profiles (websites).
You have two options in this scenario. You start by going to the Home screen of Google Analytics. There, you will find a listing of all your websites and an overview of the top metrics—sessions, average session duration, bounce rate, and conversion rate.
You can also try business dashboard solutions like Cyfe. For $19 a month, you can create unlimited dashboards with unlimited widgets, including a large selection of data from Google Analytics, alongside data from your social media networks, keyword rankings, Moz stats, and more.
This solution significantly cuts down on the time spent looking at analytics across the board for your entire business.
(not provided) is Google’s way of protecting search engine user’s privacy by hiding the keywords they use to discover your website in search results. Tools like Google Webmaster Tools (now Search Console, free), Authority Lab’s Now Provided Reports (paid), and Hittail (paid) can all help you uncover some of those keywords.
They won’t be linked to your conversions or other Google Analytics data, but at least you will have some clue what keywords searchers are using to find your website.
If you’re ready to move to the next level in Google Analytics, Custom Reports, Dashboards, and Segments are the way to go.
Custom Reports (under the Customization menu at the top) allow you to create reports that look similar to the standard Google Analytics reports with the metrics you want to view.
Dashboards allow you to view your Google Analytics data in a dashboard format. You can access them at the top of the left sidebar.
Segments allow you to view all of your Google Analytics data based on a specific dimension, such as all of your Google Analytics data based on visitors from the United States. You can also use them to compare up to four segments of data, such as United States versus United Kingdom traffic, search versus social traffic, mobile versus desktop traffic, and more. You can access Segments in each of your reports.
The nice part about these is that you don’t have to create them from scratch. You can start by using pre-defined Custom Reports, Dashboards, and Segments from the Google Solutions Gallery.
There, you will find lots of Custom Reports, Dashboards, Segments, and other solutions that you can import into your Google Analytics and edit to fit your needs. Edit Custom Reports with the Edit button at the top.
Edit Dashboards using the Add Widget or Customize Dashboard buttons at the top.
Edit Segments by clicking the Action button inside the Segments selector box and choosing Edit.
Or, when you have applied Segments to your reports, use the drop-down arrow at the top right to find the Edit option.
As you get used to editing Custom Reports, Dashboards, and Segments, you will get more familiar with the way each works so you can create new ones on your own.
I hope you’ve enjoyed this beginner’s introduction to Google Analytics for beginners. If you’re a beginner and have a burning questions, please ask in the comments. I’ll be happy to help!
Sign up for The Moz Top 10, a semimonthly mailer updating you on the top ten hottest pieces of SEO news, tips, and rad links uncovered by the Moz team. Think of it as your exclusive digest of stuff you don’t have time to hunt down but want to read!
Majestic offers an incredible amount of data for us to use in our SEO efforts to increase rankings in the organic arena and position our Brand. As the size of the website increases so does the challenge to identify the most appropriate dataset to answer a specific question Management will formulate: Why has there been…
Posted by RuthBurrReedy
It was once commonplace for developers to code relative URLs into a site. There are a number of reasons why that might not be the best idea for SEO, and in today’s Whiteboard Friday, Ruth Burr Reedy is here to tell you all about why.
Howdy, Moz fans. My name is Ruth Burr Reedy. You may recognize me from such projects as when I used to be the Head of SEO at Moz. I’m now the Senior SEO Manager at BigWing Interactive in Oklahoma City. Today we’re going to talk about relative versus absolute URLs and why they are important.
At any given time, your website can have several different configurations that might be causing duplicate content issues. You could have just a standard http://www.example.com. That’s a pretty standard format for a website.
But the main sources that we see of domain level duplicate content are when the non-www.example.com does not redirect to the www or vice-versa, and when the HTTPS versions of your URLs are not forced to resolve to HTTP versions or, again, vice-versa. What this can mean is if all of these scenarios are true, if all four of these URLs resolve without being forced to resolve to a canonical version, you can, in essence, have four versions of your website out on the Internet. This may or may not be a problem.
It’s not ideal for a couple of reasons. Number one, duplicate content is a problem because some people think that duplicate content is going to give you a penalty. Duplicate content is not going to get your website penalized in the same way that you might see a spammy link penalty from Penguin. There’s no actual penalty involved. You won’t be punished for having duplicate content.
The problem with duplicate content is that you’re basically relying on Google to figure out what the real version of your website is. Google is seeing the URL from all four versions of your website. They’re going to try to figure out which URL is the real URL and just rank that one. The problem with that is you’re basically leaving that decision up to Google when it’s something that you could take control of for yourself.
There are a couple of other reasons that we’ll go into a little bit later for why duplicate content can be a problem. But in short, duplicate content is no good.
However, just having these URLs not resolve to each other may or may not be a huge problem. When it really becomes a serious issue is when that problem is combined with injudicious use of relative URLs in internal links. So let’s talk a little bit about the difference between a relative URL and an absolute URL when it comes to internal linking.
With an absolute URL, you are putting the entire web address of the page that you are linking to in the link. You’re putting your full domain, everything in the link, including /page. That’s an absolute URL.
However, when coding a website, it’s a fairly common web development practice to instead code internal links with what’s called a relative URL. A relative URL is just /page. Basically what that does is it relies on your browser to understand, “Okay, this link is pointing to a page that’s on the same domain that we’re already on. I’m just going to assume that that is the case and go there.”
When you are a web developer and you’re building a site and there thousands of pages, coding relative versus absolute URLs is a way to be more efficient. You’ll see it happen a lot.
Another reason why you might see relative versus absolute URLs is some content management systems — and SharePoint is a great example of this — have a staging environment that’s on its own domain. Instead of being example.com, it will be examplestaging.com. The entire website will basically be replicated on that staging domain. Having relative versus absolute URLs means that the same website can exist on staging and on production, or the live accessible version of your website, without having to go back in and recode all of those URLs. Again, it’s more efficient for your web development team. Those are really perfectly valid reasons to do those things. So don’t yell at your web dev team if they’ve coded relative URLS, because from their perspective it is a better solution.
Relative URLs will also cause your page to load slightly faster. However, in my experience, the SEO benefits of having absolute versus relative URLs in your website far outweigh the teeny-tiny bit longer that it will take the page to load. It’s very negligible. If you have a really, really long page load time, there’s going to be a whole boatload of things that you can change that will make a bigger difference than coding your URLs as relative versus absolute.
Page load time, in my opinion, not a concern here. However, it is something that your web dev team may bring up with you when you try to address with them the fact that, from an SEO perspective, coding your website with relative versus absolute URLs, especially in the nav, is not a good solution.
If you have all of your internal links as relative URLs, it would be very, very, very easy for a scraper to simply scrape your whole website and put it up on a new domain, and the whole website would just work. That sucks for you, and it’s great for that scraper. But unless you are out there doing public services for scrapers, for some reason, that’s probably not something that you want happening with your beautiful, hardworking, handcrafted website. That’s one reason. There is a scraper risk.
But the other reason why it’s very important to have absolute versus relative URLs is that it really mitigates the duplicate content risk that can be presented when you don’t have all of these versions of your website resolving to one version. Google could potentially enter your site on any one of these four pages, which they’re the same page to you. They’re four different pages to Google. They’re the same domain to you. They are four different domains to Google.
But they could enter your site, and if all of your URLs are relative, they can then crawl and index your entire domain using whatever format these are. Whereas if you have absolute links coded, even if Google enters your site on www. and that resolves, once they crawl to another page, that you’ve got coded without the www., all of that other internal link juice and all of the other pages on your website, Google is not going to assume that those live at the www. version. That really cuts down on different versions of each page of your website. If you have relative URLs throughout, you basically have four different websites if you haven’t fixed this problem.
Again, it’s not always a huge issue. Duplicate content, it’s not ideal. However, Google has gotten pretty good at figuring out what the real version of your website is.
You do want to think about internal linking, when you’re thinking about this. If you have basically four different versions of any URL that anybody could just copy and paste when they want to link to you or when they want to share something that you’ve built, you’re diluting your internal links by four, which is not great. You basically would have to build four times as many links in order to get the same authority. So that’s one reason.
The other reason why it’s pretty important not to do is because of crawl budget. I’m going to point it out like this instead.
When we talk about crawl budget, basically what that is, is every time Google crawls your website, there is a finite depth that they will. There’s a finite number of URLs that they will crawl and then they decide, “Okay, I’m done.” That’s based on a few different things. Your site authority is one of them. Your actual PageRank, not toolbar PageRank, but how good Google actually thinks your website is, is a big part of that. But also how complex your site is, how often it’s updated, things like that are also going to contribute to how often and how deep Google is going to crawl your site.
It’s important to remember when we think about crawl budget that, for Google, crawl budget cost actual dollars. One of Google’s biggest expenditures as a company is the money and the bandwidth it takes to crawl and index the Web. All of that energy that’s going into crawling and indexing the Web, that lives on servers. That bandwidth comes from servers, and that means that using bandwidth cost Google actual real dollars.
So Google is incentivized to crawl as efficiently as possible, because when they crawl inefficiently, it cost them money. If your site is not efficient to crawl, Google is going to save itself some money by crawling it less frequently and crawling to a fewer number of pages per crawl. That can mean that if you have a site that’s updated frequently, your site may not be updating in the index as frequently as you’re updating it. It may also mean that Google, while it’s crawling and indexing, may be crawling and indexing a version of your website that isn’t the version that you really want it to crawl and index.
So having four different versions of your website, all of which are completely crawlable to the last page, because you’ve got relative URLs and you haven’t fixed this duplicate content problem, means that Google has to spend four times as much money in order to really crawl and understand your website. Over time they’re going to do that less and less frequently, especially if you don’t have a really high authority website. If you’re a small website, if you’re just starting out, if you’ve only got a medium number of inbound links, over time you’re going to see your crawl rate and frequency impacted, and that’s bad. We don’t want that. We want Google to come back all the time, see all our pages. They’re beautiful. Put them up in the index. Rank them well. That’s what we want. So that’s what we should do.
You have to make sure that you are forcing all of these different versions of your domain to resolve to one version of your domain. For me, I’m pretty agnostic as to which version you pick. You should probably already have a pretty good idea of which version of your website is the real version, whether that’s www, non-www, HTTPS, or HTTP. From my view, what’s most important is that all four of these versions resolve to one version.
From an SEO standpoint, there is evidence to suggest and Google has certainly said that HTTPS is a little bit better than HTTP. From a URL length perspective, I like to not have the www. in there because it doesn’t really do anything. It just makes your URLs four characters longer. If you don’t know which one to pick, I would pick one this one HTTPS, no W’s. But whichever one you pick, what’s really most important is that all of them resolve to one version. You can do that on the server side, and that’s usually pretty easy for your dev team to fix once you tell them that it needs to happen.
Great. So you fixed it on your server side. Now you need to fix your internal links, and you need to recode them for being relative to being absolute. This is something that your dev team is not going to want to do because it is time consuming and, from a web dev perspective, not that important. However, you should use resources like this Whiteboard Friday to explain to them, from an SEO perspective, both from the scraper risk and from a duplicate content standpoint, having those absolute URLs is a high priority and something that should get done.
You’ll need to fix those, especially in your navigational elements. But once you’ve got your nav fixed, also pull out your database or run a Screaming Frog crawl or however you want to discover internal links that aren’t part of your nav, and make sure you’re updating those to be absolute as well.
Then you’ll do some education with everybody who touches your website saying, “Hey, when you link internally, make sure you’re using the absolute URL and make sure it’s in our preferred format,” because that’s really going to give you the most bang for your buck per internal link. So do some education. Fix your internal links.
Sometimes your dev team going to say, “No, we can’t do that. We’re not going to recode the whole nav. It’s not a good use of our time,” and sometimes they are right. The dev team has more important things to do. That’s okay.
If you can’t get your internal links fixed or if they’re not going to get fixed anytime in the near future, a stopgap or a Band-Aid that you can kind of put on this problem is to canonicalize all of your pages. As you’re changing your server to force all of these different versions of your domain to resolve to one, at the same time you should be implementing the canonical tag on all of the pages of your website to self-canonize. On every page, you have a canonical page tag saying, “This page right here that they were already on is the canonical version of this page. ” Or if there’s another page that’s the canonical version, then obviously you point to that instead.
But having each page self-canonicalize will mitigate both the risk of duplicate content internally and some of the risk posed by scrappers, because when they scrape, if they are scraping your website and slapping it up somewhere else, those canonical tags will often stay in place, and that lets Google know this is not the real version of the website.
In conclusion, relative links, not as good. Absolute links, those are the way to go. Make sure that you’re fixing these very common domain level duplicate content problems. If your dev team tries to tell you that they don’t want to do this, just tell them I sent you. Thanks guys.
Posted by SamuelScott
It’s ten o’clock. Do you know where your logs are?
I’m introducing this guide with a pun on a common public-service announcement that has run on late-night TV news broadcasts in the United States because log analysis is something that is extremely newsworthy and important.
If your technical and on-page SEO is poor, then nothing else that you do will matter. Technical SEO is the key to helping search engines to crawl, parse, and index websites, and thereby rank them appropriately long before any marketing work begins.
The important thing to remember: Your log files contain the only data that is 100% accurate in terms of how search engines are crawling your website. By helping Google to do its job, you will set the stage for your future SEO work and make your job easier. Log analysis is one facet of technical SEO, and correcting the problems found in your logs will help to lead to higher rankings, more traffic, and more conversions and sales.
Here are just a few reasons why:
However, log analysis is something that is unfortunately discussed all too rarely in SEO circles. So, here, I wanted to give the Moz community an introductory guide to log analytics that I hope will help. If you have any questions, feel free to ask in the comments!
Computer servers, operating systems, network devices, and computer applications automatically generate something called a log entry whenever they perform an action. In a SEO and digital marketing context, one type of action is whenever a page is requested by a visiting bot or human.
127.0.0.1 user-identifier frank [10/Oct/2000:13:55:36 -0700] "GET /apache_pb.gif HTTP/1.0" 200 2326
Note: A hyphen is shown in a field when that information is unavailable.
Every single time that you — or the Googlebot — visit a page on a website, a line with this information is output, recorded, and stored by the server.
Log entries are generated continuously and anywhere from several to thousands can be created every second — depending on the level of a given server, network, or application’s activity. A collection of log entries is called a log file (or often in slang, “the log” or “the logs”), and it is displayed with the most-recent log entry at the bottom. Individual log files often contain a calendar day’s worth of log entries.
Different types of servers store and manage their log files differently. Here are the general guides to finding and managing log data on three of the most-popular types of servers:
Log analysis (or log analytics) is the process of going through log files to learn something from the data. Some common reasons include:
Log analysis is rarely performed regularly. Usually, people go into log files only in response to something — a bug, a hack, a subpoena, an error, or a malfunction. It’s not something that anyone wants to do on an ongoing basis.
Why? This is a screenshot of ours of just a very small part of an original (unstructured) log file:
Ouch. If a website gets 10,000 visitors who each go to ten pages per day, then the server will create a log file every day that will consist of 100,000 log entries. No one has the time to go through all of that manually.
There are three general ways to make log analysis easier in SEO or any other context:
Tim Resnik’s Moz essay from a few years ago walks you through the process of exporting a batch of log files into Excel. This is a (relatively) quick and easy way to do simple log analysis, but the downside is that one will see only a snapshot in time and not any overall trends. To obtain the best data, it’s crucial to use either proprietary tools or the ELK Stack.
Splunk and Sumo-Logic are proprietary log analysis tools that are primarily used by enterprise companies. The ELK Stack is a free and open-source batch of three platforms (Elasticsearch, Logstash, and Kibana) that is owned by Elastic and used more often by smaller businesses. (Disclosure: We at Logz.io use the ELK Stack to monitor our own internal systems as well as for the basis of our own log management software.)
For those who are interested in using this process to do technical SEO analysis, monitor system or application performance, or for any other reason, our CEO, Tomer Levy, has written a guide to deploying the ELK Stack.
However you choose to access and understand your log data, there are many important technical SEO issues to address as needed. I’ve included screenshots of our technical SEO dashboard with our own website’s data to demonstrate what to examine in your logs.
It’s important to know the number of requests made by Baidu, BingBot, GoogleBot, Yahoo, Yandex, and others over a given period time. If, for example, you want to get found in search in Russia but Yandex is not crawling your website, that is a problem. (You’d want to consult Yandex Webmaster and see this article on Search Engine Land.)
Moz has a great primer on the meanings of the different status codes. I have an alert system setup that tells me about 4XX and 5XX errors immediately because those are very significant.
Temporary 302 redirects do not pass along the “link juice” of external links from the old URL to the new one. Almost all of the time, they should be changed to permanent 301 redirects.
Google assigns a crawl budget to each website based on numerous factors. If your crawl budget is, say, 100 pages per day (or the equivalent amount of data), then you want to be sure that all 100 are things that you want to appear in the SERPs. No matter what you write in your robots.txt file and meta-robots tags, you might still be wasting your crawl budget on advertising landing pages, internal scripts, and more. The logs will tell you — I’ve outlined two script-based examples in red above.
If you hit your crawl limit but still have new content that should be indexed to appear in search results, Google may abandon your site before finding it.
The addition of URL parameters — typically used in tracking for marketing purposes — often results in search engines wasting crawl budgets by crawling different URLs with the same content. To learn how to address this issue, I recommend reading the resources on Google and Search Engine Land here, here, here, and here.
Google might be ignoring (and not crawling or indexing) a crucial page or section of your website. The logs will reveal what URLs and/or directories are getting the most and least attention. If, for example, you have published an e-book that attempts to rank for targeted search queries but it sits in a directory that Google only visits once every six months, then you won’t get any organic search traffic from the e-book for up to six months.
If a part of your website is not being crawled very often — and it is updated often enough that it should be — then you might need to check your internal-linking structure and the crawl-priority settings in your XML sitemap.
Have you uploaded something that you hope will be indexed quickly? The log files will tell you when Google has crawled it.
One thing I personally like to check and see is Googlebot’s real-time activity on our site because the crawl budget that the search engine assigns to a website is a rough indicator — a very rough one — of how much it “likes” your site. Google ideally does not want to waste valuable crawling time on a bad website. Here, I had seen that Googlebot had made 154 requests of our new startup’s website over the prior twenty-four hours. Hopefully, that number will go up!
As I hope you can see, log analysis is critically important in technical SEO. It’s eleven o’clock — do you know where your logs are now?