Bumpgate: Difference between revisions
→Companies involved and responses: Removed some irrelevant details and dialed back some of the editorializations; realized there was a bit of "original research", and a few off-tone sentences. |
Removed the "Misdiagnosis/Poor Repair of Faults" section; spread its information to more specific consumer response segments. Also added a subsegment under Sony's consumer response that details how consumers performed their own repairs and discovered the cause of the fault. |
||
Line 34: | Line 34: | ||
BBC Watchdog aired a segment in 2009 covering the "Yellow Light of Death".<ref name=":1">{{Cite web |last=HelpForPS3 (Reuploader) |last2=BBC |date=17 Dec 2009 |title=Sony PS3 Yellow Light of Death - BBC |url=https://www.youtube.com/watch?v=E_ef8bDQktI |url-status=live |access-date=3 Jun 2025 |website=YouTube}}</ref> The hosts stated that when viewers called Sony because their console was malfunctioning, Sony told them that it could have been for a variety of reasons, and they couldn't determine exactly what the problem was without disassembling the console having the issue. While all of this is true- the LED indicators do simply indicate a general hardware failure that requires troubleshooting by connecting to the System Controller (Syscon) and checking for error codes- it is worth noting that by August 2008, Sony was building consoles with the 65nm RSX<ref name=":6">{{Cite web |last=Miller |first=R. |date=26 Jun 2008 |title=PS3 graphics chip going 65nm this Fall |url=https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |url-status=live |archive-url=https://web.archive.org/web/20210924101930/https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |archive-date=24 Sep 2021 |access-date=3 Jun 2025 |website=Engadget}}</ref><ref>{{Cite web |title=NVIDIA Playstation 3 GPU 65nm Specs |url=https://www.techpowerup.com/gpu-specs/playstation-3-gpu-65nm.c1682 |url-status=live |access-date=3 Jun 2025 |website=TechPowerUp GPU Database}}</ref>, which has been confirmed by enthusiasts to not suffer from the theoretically Bumpgate-related fault.<ref name=":2">{{Cite web |last=RIP Felix |date=15 Jan 2024 |title=A 360 Story - The RED Ring of Death & the 7th Generation Console War |url=https://www.youtube.com/watch?v=3qKtS_uxdcU |url-status=live |access-date=2 Jun 2025 |website=YouTube}}</ref><ref name=":14">{{Cite web |last=RIP Felix |date=9 Jun 2025 |title=A PS3 Story 2: Defending BumpGate Theory |url=https://www.youtube.com/watch?v=vpjtRjGPLhI |url-status=live |access-date=10 Jun 2025 |website=YouTube}}</ref> | BBC Watchdog aired a segment in 2009 covering the "Yellow Light of Death".<ref name=":1">{{Cite web |last=HelpForPS3 (Reuploader) |last2=BBC |date=17 Dec 2009 |title=Sony PS3 Yellow Light of Death - BBC |url=https://www.youtube.com/watch?v=E_ef8bDQktI |url-status=live |access-date=3 Jun 2025 |website=YouTube}}</ref> The hosts stated that when viewers called Sony because their console was malfunctioning, Sony told them that it could have been for a variety of reasons, and they couldn't determine exactly what the problem was without disassembling the console having the issue. While all of this is true- the LED indicators do simply indicate a general hardware failure that requires troubleshooting by connecting to the System Controller (Syscon) and checking for error codes- it is worth noting that by August 2008, Sony was building consoles with the 65nm RSX<ref name=":6">{{Cite web |last=Miller |first=R. |date=26 Jun 2008 |title=PS3 graphics chip going 65nm this Fall |url=https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |url-status=live |archive-url=https://web.archive.org/web/20210924101930/https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |archive-date=24 Sep 2021 |access-date=3 Jun 2025 |website=Engadget}}</ref><ref>{{Cite web |title=NVIDIA Playstation 3 GPU 65nm Specs |url=https://www.techpowerup.com/gpu-specs/playstation-3-gpu-65nm.c1682 |url-status=live |access-date=3 Jun 2025 |website=TechPowerUp GPU Database}}</ref>, which has been confirmed by enthusiasts to not suffer from the theoretically Bumpgate-related fault.<ref name=":2">{{Cite web |last=RIP Felix |date=15 Jan 2024 |title=A 360 Story - The RED Ring of Death & the 7th Generation Console War |url=https://www.youtube.com/watch?v=3qKtS_uxdcU |url-status=live |access-date=2 Jun 2025 |website=YouTube}}</ref><ref name=":14">{{Cite web |last=RIP Felix |date=9 Jun 2025 |title=A PS3 Story 2: Defending BumpGate Theory |url=https://www.youtube.com/watch?v=vpjtRjGPLhI |url-status=live |access-date=10 Jun 2025 |website=YouTube}}</ref> | ||
According to one of the individuals interviewed in the BBC Watchdog segment, if the system was outside of its one year warranty period, consumers would have to pay £128 (~$173) to get the system fixed, and Sony would only provide customers with a three-month post-repair warranty. If it failed again after that point, they would have to pay out of pocket again. Keeping in mind that the fault was very likely caused by a GPU defect, this possibility was very likely unless Sony's repair technicians replaced the defective 90nm GPU with a non-defective one- such as a 65nm or | According to one of the individuals interviewed in the BBC Watchdog segment, if the system was outside of its one year warranty period, consumers would have to pay £128 (~$173) to get the system fixed, and Sony would only provide customers with a three-month post-repair warranty. If it failed again after that point, they would have to pay out of pocket again. Keeping in mind that the fault was very likely caused by a GPU defect, this possibility was very likely unless Sony's repair technicians replaced the defective 90nm GPU with a non-defective one- such as a 65nm or 40nm GPU, which they were able to do for some consoles.<ref name=":17">{{Cite web |last=Icferrum |date=2 Feb 2020 |title=Frankenstein PHAT PS3: CECHA with 40nm RSX |url=https://www.psx-place.com/threads/frankenstein-phat-ps3-cecha-with-40nm-rsx.28069/ |url-status=live |access-date=14 Jun 2025 |website=PSX-Place}}</ref><ref>{{Cite web |last=Mystic |date=9 Apr 2025 |title=Sony's PS3 Upgrade They Never Told You About: Official 40nm RSX Frankenstein Console From Sony |url=https://www.youtube.com/watch?v=2abnrOADoCc |url-status=live |access-date=14 Jun 2025 |website=YouTube}}</ref> In addition, the console would also be reset during the repair, meaning that the owner would lose all data that was not backed up prior to the failure, such as game saves.<ref name=":1" /> | ||
Sony never issued a recall or extended warranty for these systems; all consumers had to pay if they wanted their consoles repaired, unless the system failed during the standard one-year warranty period. However, that was rare; the PS3's fan table accommodated better for the temperature changes than the Xbox 360 did, so it took longer for the defect to break the console. Depending on how frequently the console was used, some consumers could have had their console for a few years before it displayed symptoms. | Sony never issued a recall or extended warranty for these systems; all consumers had to pay if they wanted their consoles repaired, unless the system failed during the standard one-year warranty period. However, that was rare; the PS3's fan table accommodated better for the temperature changes than the Xbox 360 did, so it took longer for the defect to break the console. Depending on how frequently the console was used, some consumers could have had their console for a few years before it displayed symptoms. | ||
Line 91: | Line 91: | ||
===Xbox 360/Microsoft Consumer response=== | ===Xbox 360/Microsoft Consumer response=== | ||
At first, consumers were angry at Microsoft. During the months that the company would not acknowledge the widespread "Red Ring of Death", many consumers felt as if they'd been tricked and made a bad investment when they purchased an Xbox 360. However, when Microsoft extended the warranty on Xbox 360s experiencing an E74 error to three years after purchase, consumer sentiment improved. | At first, consumers were angry at Microsoft. During the months that the company would not acknowledge the widespread "Red Ring of Death", many consumers felt as if they'd been tricked and made a bad investment when they purchased an Xbox 360. However, when Microsoft extended the warranty on Xbox 360s experiencing an E74 error to three years after purchase, consumer sentiment improved. In Chapter 5 of ''Power On: The Story of Xbox,''<ref name=":3" /> hardware engineers for Xbox during this era explained the problem that caused the "Red Ring of Death" in enough detail for consumers to understand, leaving many consumers who remembered dealing with this issue feeling further validated and restoring some trust in Microsoft and the Xbox brand. | ||
Although | In addition, the release of the information in ''Power On'' helped enthusiasts learn more about how to fix the issue in early Xbox 360s themselves, if necessary. Many consumers who had purchased an Xbox 360 from this era<ref>{{Cite web |last=Enever |first=Liam |date=1 Oct 2017 |title=Why has my got the red ring of death (sic) |url=https://www.ifixit.com/Answers/View/430460/Why+has+my+got+the+red+ring+of+death |url-status=live |access-date=4 Jun 2025 |website=iFixIt Answers Forum}}</ref> and even some independent repair technicians<ref>{{Cite web |date=8 Apr 2014 |title=Xbox 360 Red Ring of Death: Why Lead-Free Solder or Solder Failure Are the Problem |url=https://electronicfix.com.au/console-repairs/what-does-the-rrod-mean/ |url-status=live |access-date=4 Jun 2025 |website=The Electronic Fix}}</ref> had initially assumed that the issue was caused by Microsoft using lead-free solder balls- which are used to connect the Xenos GPU to the motherboard- in order to meet new-at-the-time RoHS standards in the European Union. These individuals alleged that the brittler nature of non-leaded solder made the connections weaker compared to traditional leaded solder, causing the defect. Other consumers had a similar assumption, and thought it was related to the solder balls' melting point, and that the console was getting too hot and "desoldering" the GPU from the motherboard as a result. These misconceptions largely faded into obscurity when Microsoft released the non-defective revisions of the Xbox 360 and announced their extended warranty on their defective consoles, but they were dispelled entirely once Chapter 5 of ''Power On'' was released. | ||
Although the majority of Xbox 360 consoles affected by Bumpgate were repaired by Microsoft as part of their extended warranty program, there were some that managed to slip through the cracks, so consumers today still need to be informed. It is generally recommended by retro console enthusiasts to purchase Xbox 360 consoles manufactured after May 2008 (or marked "Q2 2008") and avoid consoles manufactured before this point, but the Tonasket (AKA "Jasper Kronos" or "Jasper V2") motherboard revision is generally considered to be the most reliable of the original "phat" model Xbox 360 consoles.<ref>{{Cite web |last=Nadaman |last2=et al. |date=8 Jun 2025 |title=Xbox 360 - Buying Guide |url=https://consolemods.org/wiki/Xbox_360:Buying_Guide |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref> | |||
===PlayStation 3/Sony Consumer Response=== | ===PlayStation 3/Sony Consumer Response=== | ||
Consumers who experienced the "Yellow Light of Death" were upset with Sony for their poor response. Some, such as PS3 modding and repair enthusiast "RIP Felix", described Sony's response as "gaslighting"<ref name=":2" />- saying that Sony had manipulated consumers into thinking that there was no widespread defect. The six-page letter from Ray Maguire to the BBC following their Watchdog segment takes a tone that supports Felix's claim<ref name=":12" /><ref name=":13" />; By 2009, Sony had stopped producing PS3s with the defective 90nm RSX- which left many consumers suspicious that Sony was trying to cover up the problem to avoid taking responsibility for it. | Consumers who experienced the "Yellow Light of Death" were upset with Sony for their poor response. Some, such as PS3 modding and repair enthusiast "RIP Felix", described Sony's response as "gaslighting"<ref name=":2" />- saying that Sony had manipulated consumers into thinking that there was no widespread defect. The six-page letter from Ray Maguire to the BBC following their Watchdog segment takes a tone that supports Felix's claim<ref name=":12" /><ref name=":13" />; By 2009, Sony had stopped producing PS3s with the defective 90nm RSX- which left many consumers suspicious that Sony was trying to cover up the problem to avoid taking responsibility for it. | ||
In 2006, when the PlayStation 3 was new, the console costed $599 USD for the 60GB model ($499 USD for the 20GB model).<ref name=":3" /> This was a major price to pay for a game console; the Nintendo Wii launched at $249.99 USD in November 2006,<ref>{{Cite web |last=Sanders |first=Kathleen |last2=Casamassina |first2=Matt |date=14 Sep 2006 |title=US Wii Price, Launch Date Revealed |url=https://www.ign.com/articles/2006/09/14/us-wii-price-launch-date-revealed |url-status=live |access-date=10 Jun 2025 |website=IGN}}</ref> and the Xbox 360 launched in late November 2005 at $399 USD ($299 USD for the Core System version).<ref>{{Cite web |last=Surette |first=Tim |date=17 Aug 2005 |title=Xbox 360 pricing revealed: $299 and $399 models due at launch |url=http://www.gamespot.com/news/xbox-360-pricing-revealed-299-and-399-models-due-at-launch-6131245 |url-status=dead |archive-url=https://web.archive.org/web/20130605013951/http://www.gamespot.com/news/xbox-360-pricing-revealed-299-and-399-models-due-at-launch-6131245 |archive-date=5 Jun 2013 |access-date=10 Jun 2025 |website=GameSpot}}</ref> Because of the extremely high price compared to competitors, consumers felt that they were making a major investment in a high quality system that would be well-supported if there was a defect. | In 2006, when the PlayStation 3 was new, the console costed $599 USD for the 60GB model ($499 USD for the 20GB model).<ref name=":3" /> This was a major price to pay for a game console at the time; the Nintendo Wii launched at $249.99 USD in November 2006,<ref>{{Cite web |last=Sanders |first=Kathleen |last2=Casamassina |first2=Matt |date=14 Sep 2006 |title=US Wii Price, Launch Date Revealed |url=https://www.ign.com/articles/2006/09/14/us-wii-price-launch-date-revealed |url-status=live |access-date=10 Jun 2025 |website=IGN}}</ref> and the Xbox 360 launched in late November 2005 at $399 USD ($299 USD for the Core System version).<ref>{{Cite web |last=Surette |first=Tim |date=17 Aug 2005 |title=Xbox 360 pricing revealed: $299 and $399 models due at launch |url=http://www.gamespot.com/news/xbox-360-pricing-revealed-299-and-399-models-due-at-launch-6131245 |url-status=dead |archive-url=https://web.archive.org/web/20130605013951/http://www.gamespot.com/news/xbox-360-pricing-revealed-299-and-399-models-due-at-launch-6131245 |archive-date=5 Jun 2013 |access-date=10 Jun 2025 |website=GameSpot}}</ref> Because of the extremely high price compared to competitors, consumers felt that they were making a major investment in a high quality system that would be well-supported if there was a defect. Unfortunately, Sony failed to ever acknowledge the "Yellow Light of Death", other than denying how widespread it was in their only official rebuttal from Ray Maguire, and made consumers pay for an issue that was never their fault. | ||
Some consumers who dealt with the "Yellow Light of Death" paid Sony to repair their systems, but others decided to consider it a loss. For consumers whose systems failed after the "Slim" models came out, some of them chose to re-purchase the cheaper, allegedly more reliable Slim models. At the time, it was assumed that these models were not prone to "Yellow Light of Death" (they have since been confirmed completely non-defective), but there was still some uncertainty among the community at the time. However, others gave up on Sony entirely, switching to other platforms- particularly, the Xbox 360. | |||
==== Consumers perform their own repairs ==== | |||
As a result of the poor response from Sony, consumers largely took things into their own hands. When the PS3 was still supported, informed consumers were sure to warn prospective buyers that the "backwards compatible" and "phat" models of PS3 were prone to the "Yellow Light of Death", that Sony wouldn't fix it for free, and even if they were willing to send it in for repairs, the system would be reset. In the United Kingdom, there was the BBC Watchdog segment that- while misguided on the cause of the problem- did inform consumers across the UK about the issues, so they knew to avoid these early PS3s and choose a newer Slim model if they wanted a PS3. | As a result of the poor response from Sony, consumers largely took things into their own hands. When the PS3 was still supported, informed consumers were sure to warn prospective buyers that the "backwards compatible" and "phat" models of PS3 were prone to the "Yellow Light of Death", that Sony wouldn't fix it for free, and even if they were willing to send it in for repairs, the system would be reset. In the United Kingdom, there was the BBC Watchdog segment that- while misguided on the cause of the problem- did inform consumers across the UK about the issues, so they knew to avoid these early PS3s and choose a newer Slim model if they wanted a PS3. | ||
As of 2025, nearly every | As of 2025, nearly every PS3 enthusiast knows about the reliability issues of the early, "backwards compatible" PlayStation 3s. Despite this, though, these systems are quite popular among retro console repair and modding enthusiasts particularly for their ability to play not only original PlayStation games, but also PlayStation 2 games. The earliest two revisions, CECHAxx and CECHBxx, even have real PlayStation 2 processors built-in.<ref name=":18" /> This is especially enticing to consumers who own a PlayStation 5, which is capable of playing PlayStation 4 games, so a person could play any PlayStation game across any generation on legitimate hardware with only two consoles. The reliability issues of these early PS3s is a major downside to consumers, though, so the community has been looking for ways to permanently repair these systems for nearly two decades. | ||
However, because Sony never acknowledged the defect, it was far less clear to consumers what exactly was causing the fault than it was for the Xbox 360. This led many retro console and repair enthusiasts to make poorly informed choices in how to attempt to repair their devices. The only guidance that consumers had for what the fault could be was from the BBC Watchdog segment stating that it was a GPU failure- however, they had incorrectly diagnosed the cause in the segment. BBC Watchdog had also employed technicians to reflow the components on afflicted PS3s' motherboards- which led enthusiasts to believe that doing the same to their console would fix it. However, this would only temporarily restore functionality to the system. | |||
By 2018, frustrated PS3 owners were searching for a better solution- preferably, an easier fix. As a result, rumors began to spread that it was not the RSX GPU that was defective, but rather, the NEC-Tokin capacitors surrounding it.<ref name=":4" /> The reason for the misconception was because Toshiba laptops from the same era had their NEC-Tokins fail prematurely due to a design flaw specific to those laptops. In addition, a failure of the NEC-Tokins can result in similar behavior from the PS3, lending further credence to the claim. It was all but "confirmed" when enthusiasts tried replacing them with tantalum capacitors, and it worked for some. However, the reason for this is because it is possible for PS3s to have a GPU-related failure because of the NEC-Tokin capacitors. It has since been confirmed that the NEC-Tokins are not defective or poorly placed, and if they have failed in a console, it is likely due to normal aging. In fact, these capacitors are specialized for their purpose in the PS3, and should not be replaced unless they truly have failed. | |||
In 2020, PSX-Place forum user "Icferrum" discovered a CECHAxx PS3 with a 40nm RSX inside instead of a standard 90nm RSX. There was no information about this modification online, so the only explanation was that Sony had done this officially. This set enthusiasts off to find a way to perform the same modification. A breakthrough was eventually made with the development of the "Frankenstein Mod" in 2021 (sometimes referred to as the "Orbis Mod"), which utilizes an Orbis modchip to make a 40nm RSX compatible with older PS3 models.<ref name=":17" /> | |||
There was | |||
As for how consumers largely discovered that the problem was related to Bumpgate, YouTube and PSX-Place user "RIP Felix" published multiple videos detailing his research and theories regarding the early PS3s' defect. Most significantly, Felix published a video where he and Xbox 360 repair and modding enthusiast Josh Davidson (Octal450 on the ConsoleMods Wiki) performed various experiments to confirm their theory that the PS3's 90nm RSX was affected by Bumpgate. They tested the solder bumps under the 90nm RSX's die to confirm the use of high-lead solder bumps, and also performed a variety of tests on the underfill, comparing it to similar defective and non-defective GPUs from the same era- such as the Xbox 360's GPUs and Nvidia's GPUs. The tests included simply shining an ultraviolet light on the underfill to see the similarities in color and luminescence, poking the underfill of each of the GPUs with a soldering iron at various temperatures to compare the reactions, and even using a UV visual spectrophotometer to visualize the difference between compositions in various underfills. The results strongly support Felix's theory that the PS3's 90nm RSX's defects were due to Bumpgate; each test showed that the 90nm RSX was remarkably similar to known defective GPUs, but distinct from non-defective ones.<ref name=":14" /> Felix and Davidson's findings effectively confirm that the only way to repair early PlayStation 3s with the "Yellow Light of Death" caused by a GPU failure is to replace the GPU with a non-defective model. | |||
Thanks to the work of retro console modding and repair enthusiasts, consumers have an option to permanently repair these valuable systems. However, the "Frankenstein Mod" is not recommended for inexperienced modders or those who don't have access to a BGA rework station. Because of the specialized nature of this modification, most people will still recommend for consumers to find someone skilled enough to do the modification for them, buy a system that is already modified, or to simply avoid purchasing any consoles impacted by Bumpgate. | |||
===Nvidia Consumer Response=== | |||
Many consumers were uncomfortable with purchasing Nvidia's products for several years, because they saw Nvidia as untrustworthy after their perceived response to the Bumpgate scandal. A GPU is one of the most expensive components in a computer, and it's an investment expected to last for approximately as long as the component remains technologically relevant. Therefore, consumers had some right to be cautious when hearing about defective Nvidia GPUs- especially before the defect was publicly acknowledged. | |||
If a product does not last because of a defect, then the company should respect their customer's investment by honoring the warranty- or by recalling the product if the defect is found to be common, as with Bumpgate. Nvidia's SEC report<ref name=":10" /> shows that they appeared to have this intention, and the company informing Dell<ref name=":8" /> and HP<ref name=":7" /> of the defect also seem to demonstrate this. In addition, based on the fact that Bumpgate affected some non-Nvidia processors (such as the Xbox 360's ''ATI'' graphics processor<ref name=":3" />), Nvidia was likely not fully responsible for the underfill defect. In fact, they alleged in the SEC report that it was their packaging company that caused the problem. However, this did not quell consumers' anger at Nvidia, and a class action lawsuit was filed. Unfortunately, the results of that lawsuit and subsequent settlement left consumers still angry and frustrated at the company- especially those who received insufficient compensation, like those who ended up with a budget laptop to replace their high-end laptop.<ref name=":15" /> This only fueled consumer distrust for Nvidia. Although the defect may not have fully been Nvidia's fault, their failure to properly compensate some Class Members when they agreed to settle was unacceptable to many consumers. | |||
==References== | ==References== |