[EHPweb] Earthquake Webserver Issues

[Bidwell, Christopher]

All, since about 1:00 this morning, all of the earthquake webservers began
to experience severe latency.  There was an ESN failover test last night
that ended at 10:30P and all seemed to work fine.  Got a call from our out
of hours support at 1:30A informing of the latency.

After checking further, I found that all 6 webservers (ehp1-4 and
ehpcache-*) were all maxed out on apache processes.  Restarted apache on
ehp1-4 and restarted squid on caching and didn't have any affect.
 Processes spiked right back up to max.

I submitted a trouble ticket with level 3 so that they can locate a
potential DOS'ing IP(s).  I'm waiting to hear back from them at this time.

-- 

Chris Bidwell, CEH, CPT, RHCSA
Red Hat Linux Administrator
National Earthquake Information Center
US Geological Survey
email: cbidwell at usgs.gov
work: 303-273-8642
mobile: 303-435-6362
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://geohazards.usgs.gov/pipermail/ehpweb/attachments/20130604/0fe0d3bc/attachment.html>