[EHPweb] Fwd: ANSS Firewall CutOver
Eric M Martinez
emartinez at usgs.gov
Mon Dec 21 23:49:42 UTC 2009
The failure to Dev Lab B (see below) effectively removed all access to
EHPStage during the cutover trial period. Dan Mackin at applied trust
is going to work to resolve this in case an actual fail over becomes
required.
If you noticed any problems using the deployment tool or otherwise
accessing EHPStage (SSH, HTTP, etc) from about 2:00 - 3:00 mountain
time it was likely due to this test. Please let me (or the broader
community) know if you are still having any access problems.
Thanks,
~Eric.
Begin forwarded message:
> From: "David B Mason" <dmason1 at usgs.gov>
> Date: December 21, 2009 3:26:39 PM MST
> To: "GS-G-CR Hazards anss-it-staff" <anss-it-staff>
> Cc: David B Mason <dmason1 at usgs.gov>
> Subject: Fw: ANSS Firewall CutOver
>
>
> All,
>
> The test has been completed. Connectivity was successfully re-
> established through the backup firewall within tens of seconds for
> most connections. Some of the incoming waveform data feeds took
> several minutes but eventually reconnected as well. The only
> problem was that Dev Lab B was inaccessible. Thanks to the test,
> Applied Trust was able to isolate the cause to a port configuration
> on the InterZone switch and will be working to get that corrected
> this week.
>
> We are now back on the primary firewall. Dev Lab B is accessible
> through that one.
>
> I anticipate no further interruptions with regard to the new
> firewalls.
>
> Thank-You for your cooperation and patience.
>
> David
>
> ----- Forwarded by David B Mason/GD/USGS/DOI on 12/21/2009 03:18 PM
> -----
> From: David B Mason/GD/USGS/DOI
> To: GS-G-CR Hazards anss-it-staff
> Cc: David B Mason <dmason1 at usgs.gov>
> Date: 12/21/2009 12:07 PM
> Subject: Fw: ANSS Firewall CutOver
>
>
>
>
>
> All,
>
> The firewall failover test has been re-scheduled for today at 2 pm.
> I will check with the analysts to make sure the earth is cooperating
> before giving the go-ahead for Applied Trust (Dan Mackin) to fail
> over to the secondary device. If all goes as expected, the
> interruption of your session connections should last only about a
> minute. However, you may find it necessary to restart some
> applications.
>
> For NEIC Operations, please save your work at about 1:55. Also, I
> recommend that you not be typing anything into your Chicxulub
> session from then until about 2:05. It may still be necessary for
> you to log out and back in. I do not think it will be necessary to
> restart your Hydra displays.
>
> If all goes as expected, Dan will fail back to the primary firewall
> at 2:21. It is possible the failback may not occur until as late as
> 2:40. I will try to let the NEIC Operations folks know several
> minutes before that actually happens.
>
> David
>
> ----- Forwarded by David B Mason/GD/USGS/DOI on 12/21/2009 11:45 AM
> -----
> From: David B Mason/GD/USGS/DOI
> To: GS-G-CR Hazards anss-it-staff
> Cc: David B Mason <dmason1 at usgs.gov>, dan at atrust.com, seidel at atrust.com
> , ned at trust.com
> Date: 12/16/2009 09:56 AM
> Subject: Fw: ANSS Firewall CutOver
>
>
>
>
>
>
> All,
>
> Due to some system problems occurring this morning, I'm cancelling
> the firewall failover test scheduled for this afternoon. The
> problems are unrelated to the new firewalls but involve network and
> remote access issues that will interfere with the planned test.
>
> I will inform you when a new date/time has been scheduled.
>
> David
>
> ----- Forwarded by David B Mason/GD/USGS/DOI on 12/16/2009 09:53 AM
> -----
> From: David B Mason/GD/USGS/DOI
> To: GS-G-CR Hazards anss-it-staff
> Cc: David B Mason <dmason1 at usgs.gov>, dan at atrust.com, seidel at atrust.com
> , ned at atrust.com
> Date: 12/15/2009 04:28 PM
> Subject: Fw: ANSS Firewall CutOver
>
>
>
>
>
>
>
> All,
>
> Yesterday's firewall replacement went very smoothly, and there
> appear to be no problems.
>
> Tomorrow, December 16th, beginning at 1 pm Mountain time, we will be
> performing a failover test to the new backup firewall that was
> installed yesterday. Unless an important earthquake is occurring at
> the time, Dan Mackin of Applied Trust, will simulate of failure of
> the primary firewall at precisely 1 o'clock. The network should
> automatically fail over to the backup firewall, and connections
> should re-establish within about a minute. The service will be
> switched back to the primary by 1:45.
>
> For the analysts on duty at that time, we recommend that you save
> your work several minutes before 1 o'clock. Also, refrain from
> typing into your remote connection to Chicxulub during the few
> minutes surrounding that time. I will notify you several minutes
> prior to the switch-back.
>
> About a dozen subject matter experts will be actively checking their
> systems for connectivity and notifying Dan of the status over a
> phone bridge throughout the test. If you notice unexpected problems
> persisting beyond 1:45, you may contact Dan at the number given in
> his last email below. He will remain available in the large
> computer room in the basement until at least 2 o'clock.
> Alternatively, you may contact me at my cell: 303-358-6597.
>
> Thank-You for you patience in what we hope will be the last
> interruption for this project.
>
> David
>
> ----- Forwarded by David B Mason/GD/USGS/DOI on 12/15/2009 04:12 PM
> -----
> From: Dan Mackin <dan at atrust.com>
> To: gs-g-cr <gs-g-cr_hazards_anss-it-staff at usgs.gov>, gs-g-cr <gs-g-cr_hazards_fire at usgs.gov
> >
> Cc: seals <seal at atrust.com>
> Date: 12/14/2009 10:26 AM
> Subject: Re: ANSS Firewall CutOver
>
>
>
>
>
>
>
> All:
> We have cut over to the new ANSS firewalls and as of right now
> everything seems to be good. We are still testing some connections
> and will be available for the rest of the day if you all experience
> any problems relating to this firewall cut over. Please contact us
> immediately if you notice any problems or need help
> troubleshooting. Thank you all so much for your help.
> -Dan Mackin
> dan-pager at atrust.com
> dan at atrust.com
> 720-299-0767
>
> ----- Original Message -----
> From: "Dan Mackin" <dan at atrust.com>
> To: "gs-g-cr" <gs-g-cr_hazards_anss-it-staff at usgs.gov>, "gs-g-cr" <gs-g-cr_hazards_fire at usgs.gov
> >
> Cc: "seals" <seals at atrust.com>
> Sent: Monday, December 14, 2009 9:40:27 AM GMT -07:00 US/Canada
> Mountain
> Subject: Fwd: ANSS Firewall CutOver
>
> All:
> This is the 20 minute heads-up warning that we're going to cut over
> the ANSS firewall right at 10:00AM MST. Please let me know
> immediately if you have any issues with this plan. Thank you.
> -Dan Mackin
> Cell: 720-299-0767
>
> ----- Forwarded Message -----
> From: "Dan Mackin" <dan at atrust.com>
> To: "gs-g-cr hazards anss-it-staff" <gs-g-cr_hazards_anss-it-staff at usgs.gov
> >
> Cc: "gs-g-cr hazards fire" <gs-g-cr_hazards_fire at usgs.gov>
> Sent: Sunday, December 13, 2009 8:37:44 PM GMT -07:00 US/Canada
> Mountain
> Subject: Fwd: ANSS Firewall CutOver
>
> All:
> Just a reminder that we'll be cutting over the ANSS firewall
> tomorrow morning (Monday) at 10:00AM MST. IT maintenance
> announcement document is attached. Thanks.
> -Dan Mackin
>
> ----- Forwarded Message -----
> From: "Dan Mackin" <dan at atrust.com>
> To: "gs-g-cr hazards anss-it-staff" <gs-g-cr_hazards_anss-it-staff at usgs.gov
> >
> Cc: "gs-g-cr hazards fire" <gs-g-cr_hazards_fire at usgs.gov>, seal at atrust.com
> Sent: Friday, December 11, 2009 12:50:16 PM GMT -07:00 US/Canada
> Mountain
> Subject: ANSS Firewall CutOver
>
> All:
> We'll be cutting over the ANSS firewall on Monday morning at 10:00
> MST.
> Attached is the IT Maintenance Announcement. Please let me know if
> you
> have any questions. I'll send out this announcement once more Sunday
> afternoon and again Monday morning before the cut over (at 9:40AM).
> Thanks!
>
> --
> -----------------------------------------------------------------------------
> Dan Mackin
> Applied Trust Engineering - http://www.atrust.com - 303.245.4516
> Security, Performance, Availability, and Incident Management
> ---- visit our blog at http://www.barkingseal.com ----
>
>
> --
> --------------------------------------------------------------------------------------
> Dan Mackin
> Applied Trust Engineering - www.atrust.com - 303.245.4516
> Providing IT Consulting Services focused on Security, Performance,
> Availability, Ecoinfrastructure, and Incident Management.
> ---- visit our blog at http://www.barkingseal.com ----
>
> --
> --------------------------------------------------------------------------------------
> Dan Mackin
> Applied Trust Engineering - www.atrust.com - 303.245.4516
> Providing IT Consulting Services focused on Security, Performance,
> Availability, Ecoinfrastructure, and Incident Management.
> ---- visit our blog at http://www.barkingseal.com ----
>
> --
> --------------------------------------------------------------------------------------
> Dan Mackin
> Applied Trust Engineering - www.atrust.com - 303.245.4516
> Providing IT Consulting Services focused on Security, Performance,
> Availability, Ecoinfrastructure, and Incident Management.
> ---- visit our blog at http://www.barkingseal.com ----
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://geohazards.usgs.gov/pipermail/ehpweb/attachments/20091221/ab75986d/attachment-0001.html>
More information about the EHPweb
mailing list