Update - Hi again Fool's. We have been delayed a little bit, but the plan is to deploy our performance fixes and perform testing tonight around 10pm. If all the testing goes well the activity feeds for all premium services will be re-enabled and page load times should be improved. Once we make progress I will post another update - again thank you for being patient.
Feb 26, 21:44 EST
Update - We have some updates regarding the current state of our newsletter services as well as the continued plan to solve this issue and improve the response time of our premium services.
The activity feeds and headlines are currently disabled on all premium services which has been done to alleviate the load issues which started last Friday. The plan is to restore those feeds within the next 24 hours and we have additional performance improvements that are being worked on right now. We are taking time to fix some long running performance issues that have affected the Homepage of each premium site as well as the Fool One all-access page. Our goal is to deploy these performance fixes by the end of this week - we are looking forward to these improvements and wanted to apologize to all the Fools out there that are patiently waiting. Once we make steps in our plan, there will be updates posted here, so please follow this post if you' d like to receive updates.
Feb 25, 14:36 EST
Monitoring - Hi Fools - very sorry about all the site issues today. Many techies have been on the case all day trying to get things under control.
What was the problem?
We actually had 2 separate problems.
The first issue was right at noon we had a publishing issue that took down all our front webservers which we had to force reload our web services in order to clear the problem.
The second issue that came up around 2pm was purely load related with the new Stock Advisor article that was emailed out to members. Our backend database servers were overloaded (these servers hold all the articles and ticker data that are displayed on the page). The short term fix for this was to turn off a couple of resource intensive website features on premium sites... currently "Latest Headlines" and "What’s on our mind …" is turned off which allowed the premium sites to recover.
The plan to fix all this:
Right now those 2 features are turned off. After the traffic dies down around 6pm or so, we will re-enable those 2 features. Our long term plan is already in motion. We have engineers and developers working to optimize the article feeds on all premium services which includes the "Latest Headlines" and "What’s on our mind …" boxes. This will take some time and should be done early next week.
Again Fool, thank you so much for your patience and sorry for all the trouble.
Feb 20, 17:34 EST
Identified - We are experiencing another problem on our premium newsletter websites. Our backend database servers are overloaded causing slow pages and timeouts. We are working to get things under control and will post updates once we have more info.
Thanks for your patience Fools.
Feb 20, 15:10 EST
Monitoring - Our webservers running premium content were unexpectedly overloaded. Right now it is unclear as to what caused the problem, but we were able to stabilize the site by resetting the services that run these sites. Engineers are currently looking deeper to try and find a cause and we are closely monitoring the site.
Sorry for the interruption Fools, we are not giving the official green flag yet since we are still investigating and monitoring, but the sites are operational at this time - we will post an update once we know more - Stay Foolish!
Feb 20, 13:01 EST
Investigating - Fools, we are experience an outage on all our premium newsletter services. We are working to restore connectivity to these sites and will post an update once we know more.
Feb 20, 12:16 EST