Author Topic: Firefox Sync issues
Ravynmagi 
Title: Moderator
Posts: 29,978
Registered: Dec 23, '01
Extended Info (if available)
Real Post Cnt: 29,452
User ID: 572,278
Subject: Firefox Sync issues
For those getting Sync errors from Firefox. Mozilla has been looking into the issue for the past 6 days. And it sounds like it might be some servers being overloaded (which is why it's only affecting some people).

Here are a couple recent updates.

"It's an ongoing load problem with the server-side. We are working on it."

"Update: We are bringing several more cabinets of Sync servers online and migrating users off the most overloaded systems as we speak."

"(we aren't out of the woods yet, but progress is being made.)"

You can follow the mozservices Twitter feed for updates.
http://twitter.com/#!/mozservices

 

-----signature-----
(none)
Link to this post
Speak-pkhq 
Title: Sheep's bane
Posts: 9,159
Registered: Jul 7, '02
Extended Info (if available)
Real Post Cnt: 8,993
User ID: 695,362
Subject: Firefox Sync issues
i've had the error the past few days but today it seems to be cleared up, for me at least.

 

-----signature-----
Wailing HoHoHoMerryXmas Hero, daoc Kay
Bardog Mage, wow Thunderlord <Schizm>
http://7-zip.org/
trollop hunter
flag flag flag flag flag
Link to this post
Speak-pkhq 
Title: Sheep's bane
Posts: 9,159
Registered: Jul 7, '02
Extended Info (if available)
Real Post Cnt: 8,993
User ID: 695,362
Subject: Firefox Sync issues
and now it's back to broken grin lol

 

-----signature-----
Wailing HoHoHoMerryXmas Hero, daoc Kay
Bardog Mage, wow Thunderlord <Schizm>
http://7-zip.org/
trollop hunter
flag flag flag flag flag
Link to this post
Ravynmagi 
Title: Moderator
Posts: 29,978
Registered: Dec 23, '01
Extended Info (if available)
Real Post Cnt: 29,452
User ID: 572,278
Subject: Firefox Sync issues
If you are curious about the cause of the Firefox Sync "meltdown", Mozilla has posted a blog explaining what happened. A good read for IT people that like to read about someone else's disaster for a change. happy

http://blog.mozilla.com/jv/2011/10/25/the-sync-platform-meltdown-explained/

Summary of what happened...

Firefox 7 added a new Instant Sync feature to the client. The operations team wasn't aware of this and remained unaware of the feature for several days even as the feature proceeded to rip their databases a new one.

Mozilla Ops noticed Sync activity was starting to ramp up quickly after Firefox 7 was released and not from new user accounts, but from existing accounts. At the same time they started having an unusually high number of disk failures at it's California location that uses older equipment. They discovered the drives were working extremely hard by overloaded databases and were pushed to their breaking point. The Phoenix location had newer servers and so had fewer problems.

The operations guys scrutinized the Firefox 7 bug list and saw a mention of an Instant Sync feature. They were aware of it, but not that it went live in Firefox 7. Firefox has a Back-Off feature that the servers can send to the browser to tell them not to try syncing data and try again later. So they turned this on, only to realize this feature no longer worked with Firefox 6 or 7. It hadn't been needed, so they were unaware it was broken until it was finally needed.

Besides the Instant Sync feature, old servers, and old versions of MySQL, another part of the reason the databases were having problems is they hadn't been cleaned up in a long time and contained months of old history data. So they tried purging the data and forcing clients to do a fresh sync, but this actually made things worse. Because of Instant Sync many clients began immediately hammering the servers even more to refresh their data.

But fortunately Mozilla had bought a lot of used servers from an auction earlier and were not even using half of them. So they had a lot of unused servers just powered off. For the next couple days they were able to configure and load up 60 new servers for Sync and then began migrating users off the overloaded servers.

Good times.

 

-----signature-----
(none)
Link to this post
Marzuk 
Posts: 12,545
Registered: Oct 21, '02
Extended Info (if available)
Real Post Cnt: 12,348
User ID: 729,742
Subject: Firefox Sync issues
Wow that looks like epic fail from every direction happy

At the end of the day stuff like this just makes me chuckle at some of the stuff clients rage at.

 

-----signature-----
(none)
Link to this post

Valid XHTML 1.0 Transitional Powered by PHP