While evaluating pingdom for website monitoring, I noticed that it tries to crawl over all of our web servers, for a given url and then seem to be further analyzing/indexing/crawling all of web pages. This has increased load on the web servers and their user agent "Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)" is causing constant failure/error logs in web server.
Created a new empty Vendor
Vendor: quiz = 0
Create RunSession
new runssn.getId() == xxxxxxx ip=
RunFront: trying to load skin config from database
RunFront: Found with base path
Weblog addRequest start
addRequest: type=start
Weblog2.addRequest(start)
WelogEntry failed: action=launch remote=xxxxxxxxx ref=null agent=Pingdom.com_bot_version_1.4_(http://www.pingdom.com/)
java.sql.SQLException: ORA-01653: unable to extend table EvalSite.WEBLOG_TEMP by 16158 in tablespace GAPP
at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:168)
at oracle.jdbc.oci8.OCIDBAccess.check_error(OCIDBAccess.java:1597)
at oracle.jdbc.oci8.OCIDBAccess.executeFetch(OCIDBAccess.java:1209)
at oracle.jdbc.oci8.OCIDBAccess.parseExecuteFetch(OCIDBAccess.java:1321)
at oracle.jdbc.driver.OracleStatement.executeNonQuery(OracleStatement.java:1446)
at oracle.jdbc.driver.OracleStatement.doExecuteOther(OracleStatement.java:1371)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1900)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:363)
at org.apache.tomcat.dbcp.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:101)
at com.EvalSite.site.WeblogEntry.create(WeblogEntry.java:82)
at com.EvalSite.site.WeblogEntry.update(WeblogEntry.java:174)
at com.EvalSite.site.Weblog2.addRequest(Weblog2.java:31)
at com.EvalSite.site.RunFront.doGet(RunFront.java:1981)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:432)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:392)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:541)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:199)
at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:282)
at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:767)
at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:697)
at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Unknown Source)
RunFront: using URL /evalsite/check.jsp
Created a new empty Vendor
Other references to the topic:
An Open Letter to Pingdom.com on the Topic of Referrer Spam — HNBP
<
p>Pingdom Search Engine Spider and User Agent Identification forum at WebmasterWorld
