Bumpgate: Difference between revisions

Line 14:

==Companies involved and responses==

Bumpgate was a worldwide issue ~~for any consumer~~ that ~~purchased these defective graphics processors~~. ~~However~~, it's ~~not fully clear who~~ was the most responsible for the incident. Building a GPU is a specialized process that requires it to go through multiple partner companies before ultimately ending up with the company that sells the unit (i.e., Microsoft, Sony, Nvidia, etc.). ~~With this in mind~~, it is still important to note the response of each of the companies that were the public faces involved in this incident.

Bumpgate was a worldwide, almost industry-wide issue that impacted multiple GPUs from Nvidia and ATI. Therefore, it's unclear what company was the most responsible for the incident. Building a GPU is a specialized process that requires it to go through multiple partner companies before ultimately ending up with the company that sells the unit or the system it's contained in (i.e., Microsoft, Sony, Nvidia, etc.). However, it is still important to note the response of each of the companies that were the public faces involved in this incident.

====Microsoft's Response - The "Red Ring of Death"====

[[File:GPU early.jpg|alt=An image of a 90 nanometer graphics processing unit from a Microsoft Xbox 360. The die is in the center of the green square, and the eDRAM is located to the left of it. The die has dark greenish low Tg underfill under it, indicating that it is defective.|thumb|200x200px|A ''defective'' 90nm "Xenos" GPU from an '''early''' Xbox 360 (Xenon revision). Note the large die in the center of the chip, and the dark greenish underfill. The color of the underfill is one way to tell if the chip has the low Tg underfill.]]<blockquote>''"The breakthrough came when we understood that the connections that were being broken were not located on the motherboard, but they were actually located inside the components."''

- Leo Del Castillo, member of Xbox's hardware engineering group; ''Power On: The Story of Xbox (2021)''<ref name=":3">{{Cite web |last=Xbox |date=13 Dec 2021 |title=Power On: The Story of Xbox {{!}} Chapter 5: The Red Ring of Death |url=https://www.youtube.com/watch?v=z2d6IMBS8oY |url-status=live |archive-url=https://archive.org/details/power-on-the-story-of-xbox/The+Story+of+the+Xbox+-+Chapter+5/Power+On+-+The+Story+of+Xbox+-+Chapter+5+-+The+Red+Ring+of+Death.mp4 |archive-date=13 Dec 2021 |access-date=4 Jun 2025 |website=YouTube}}</ref></blockquote>In November 2005, Microsoft released the Xbox 360 with the ATI Xenos GPU. According to leaked internal Microsoft documents from the time, 1.2 million 360s shipped out to consumers by November 30th, 2005. 3% of customers had some type of issue with their system. Out of that 3%, 19% had three flashing red rings, and 24% had freezing problems.<ref name=":2" />

- Leo Del Castillo, member of Xbox's hardware engineering group; ''Power On: The Story of Xbox (2021)''<ref name=":3">{{Cite web |last=Xbox |date=13 Dec 2021 |title=Power On: The Story of Xbox {{!}} Chapter 5: The Red Ring of Death |url=https://www.youtube.com/watch?v=z2d6IMBS8oY |url-status=live |archive-url=https://archive.org/details/power-on-the-story-of-xbox/The+Story+of+the+Xbox+-+Chapter+5/Power+On+-+The+Story+of+Xbox+-+Chapter+5+-+The+Red+Ring+of+Death.mp4 |archive-date=13 Dec 2021 |access-date=4 Jun 2025 |website=YouTube}}</ref></blockquote>In November 2005, Microsoft released the Xbox 360 with the ATI Xenos GPU. According to leaked internal Microsoft documents from the time, 1.2 million 360s shipped out to consumers by November 30th, 2005. 3% of customers had some type of issue with their system. Out of that 3%, 19% had three flashing red rings, and 24% had freezing problems.<ref name=":2" /> This is notable because this means shortly after launch, 43% of consumers had consoles showing symptoms of the now-infamous "Red Ring of Death"- which is what consumers around the world called the Xbox 360's confirmed Bumpgate-related fault.<ref name=":3" />

Therefore, 43% of consumers shortly after launch had these familiar symptoms to retro console enthusiasts: the "Red Ring of Death"- which is what consumers around the world called the Xbox 360's Bumpgate-related fault. However, "~~three~~ flashing red rings" on the Xbox 360 simply means "core digital error"- ~~in other words~~, a general hardware failure. It takes multiple power-on cycles to cause a failure in the solder bumps, so it is ~~unlikely~~ that ~~these systems~~ were ~~failing specifically because of~~ the ~~Bumpgate defect~~. 56% of systems worked on the first try, and ~~after component reworks,~~ that number improved to 71%~~. Only 200,000 consoles went to what Microsoft termed "the bonepile", a collection of broken consoles that still did not work~~ after a component ~~rework~~. ~~However, it is also worth noting that some owners discovered that some afflicted Xbox 360s will work again after a "reflow"- which is effectively redoing all~~ of ~~the components on the motherboard at once. In addition, Microsoft wasn't aware that~~ the "Red Ring of Death" ~~was a specific widespread problem yet~~, so they ~~would not have been taking major note of consoles with a GPU problem. At~~ the ~~height of the Bumpgate~~-~~related defect, approximately 600,000~~ to ~~1,000,000~~ Xbox 360s ~~were suffering from the~~ "~~Red Ring of Death~~".

"Three flashing red rings" on the Xbox 360 simply means "core digital error"- or, a general hardware failure. This can mean a variety of things, including a GPU failure. However, it takes multiple power-on cycles to cause a failure in the solder bumps. Depending on how many power cycle tests the consoles may have went through prior to being shipped out, it is possible that some or even all 43% of those defective consoles could have had GPU failures. Only 200,000 Xbox 360s were in what Microsoft termed "the bonepile" at launch- non-functioning Xbox 360s that they decided to repair and ship out later. 56% of systems worked on the first try after manufacture, and that number improved to 71% after component reworks. At the height of the "Red Ring of Death" crisis, some consumers discovered that if they reflowed the motherboard- which is similar to what Microsoft may have done to improve their yield of working Xbox 360s- their console may start functioning again for a limited, varying amount of time.<ref name=":2" />

[[File:GPU late.jpg|alt=An image of a 65 nanometer graphics processing unit from a Microsoft Xbox 360. The die is in the center of the green square, and the eDRAM is located to the left of it. The die has a light, whitish underfill- indicating that it is not one of the defective units.|thumb|204x204px|A ''non-defective'' 65nm "Xenos" GPU from a later revision of Xbox 360 (Jasper V2 on "Kronos 1" package). Note the smaller die and the light, whitish underfill.]]

For several months, Microsoft had consumers pay to repair their consoles. However, in 2007, they chose to extend the warranty for Xbox 360 consoles displaying an E74 error (an on-screen error also associated with "Red Ring of Death") from one year from date of purchase, to three years from date of purchase. This allowed most consumers who had consoles with the issue to get their consoles refurbished. In addition, they refunded any consumers who had paid to have their afflicted systems repaired.<ref>{{Cite web |last=Moore |first=Peter |date=2007 |title=Open Letter From Peter Moore |url=http://xbox.com/en-ca/support/petermooreletter.htm |url-status=dead |archive-url=https://web.archive.org/web/20071023004948/http://xbox.com/en-ca/support/petermooreletter.htm |archive-date=23 Oct 2007 |access-date=4 Jun 2025 |website=Xbox}}</ref>

At the height of the Bumpgate-related defect, approximately 600,000 to 1,000,000 Xbox 360s were suffering from the "Red Ring of Death". For several months, Microsoft had consumers pay to repair their consoles. However, in 2007, they chose to extend the warranty for Xbox 360 consoles displaying an E74 error (an on-screen error also associated with "Red Ring of Death") from one year from date of purchase, to three years from date of purchase. This allowed most consumers who had consoles with the issue to get their consoles refurbished. In addition, they refunded any consumers who had previously paid to have their afflicted systems repaired.<ref>{{Cite web |last=Moore |first=Peter |date=2007 |title=Open Letter From Peter Moore |url=http://xbox.com/en-ca/support/petermooreletter.htm |url-status=dead |archive-url=https://web.archive.org/web/20071023004948/http://xbox.com/en-ca/support/petermooreletter.htm |archive-date=23 Oct 2007 |access-date=4 Jun 2025 |website=Xbox}}</ref> By mid-2008, the cause of the issue was confirmed to be "within the components"- the low Tg underfill. ATI and Microsoft completely fixed the issue in Xbox 360s made after this point.

Microsoft primarily seemed to have done this to protect the Xbox brand. The Xbox 360 was only their second console, and the original Xbox hadn't done as well as they'd hoped it would. Microsoft confirmed this in Chapter 5 of their 2021 documentary, ''Power On: The Story of Xbox''.<ref name=":3" />

By mid-2008, the cause of the issue was confirmed to be "within the components"- the low Tg underfill. ATI and Microsoft completely fixed the issue in Xbox 360s made after this point. Generally, it is recommended by retro console enthusiasts to purchase consoles manufactured after May 2008 (or marked "Q2 2008") and avoid consoles manufactured before this point, but the Tonasket (AKA "Jasper Kronos" or "Jasper V2") motherboard revision is generally considered to be the most reliable of the original "phat" model Xbox 360 consoles.<ref>{{Cite web |last=Nadaman |last2=et al. |date=8 Jun 2025 |title=Xbox 360 - Buying Guide |url=https://consolemods.org/wiki/Xbox_360:Buying_Guide |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref>

====Sony's Response - The "Yellow Light of Death"====

<blockquote>''"We entirely refute the suggestion that PS3 consoles have an inherent defect or other design issue which is akin to any warranty issue experienced by another console manufacturer. [...] We think it is highly unfair to suggest that from an installed base of 2.5 million that the numbers you mention somehow are evidence of a 'manufacturing defect'..."''

- Ray Maguire, managing director and senior vice president of Sony Computer Entertainment Europe in 2009; in a letter responding to a BBC Watchdog segment covering the "Yellow Light of Death".<ref name=":12">{{Cite web |last=BBC |date=18 Sep 2009 |title=Sony rebuts BBC PlayStation claim |url=http://news.bbc.co.uk/2/hi/technology/8263063.stm |url-status=live |archive-url=https://web.archive.org/web/20250219154020/http://news.bbc.co.uk/2/hi/technology/8263063.stm |archive-date=19 Feb 2025 |access-date=4 Jun 2025 |website=BBC NEWS}}</ref><ref name=":13">{{Cite web |last=Martin |first=Matt |date=17 Sep 2009 |title=Sony tackles BBC over 'PS3 failure' report |url=https://www.gamesindustry.biz/sony-tackles-bbc-over-ps3-failure-report |url-status=live |access-date=10 Jun 2025 |website=Gamesindustry.biz}}</ref></blockquote>In November 2006, Sony released the PlayStation 3. Like the Xbox 360, the early models of PlayStation 3 had what consumers believe to be Bumpgate-related issues with its Nvidia-based RSX GPU. Many consumers who had bought ~~launch~~ models- what are now commonly known as "~~PlayStation 2 backwards compatible~~" models- found that their systems were malfunctioning. PlayStation 3 systems that were exhibiting the issue may freeze suddenly during gameplay and shut off, but all users who dealt with the defect had a common experience: when attempting to turn their PlayStation 3 on, the LED power indicator would turn green for a moment, then the system would beep three times, very briefly flash to a yellow light, then it would continuously blink red without booting the system. This was coined by consumers as the "Yellow Light of Death".

- Ray Maguire, managing director and senior vice president of Sony Computer Entertainment Europe in 2009; in a letter responding to a BBC Watchdog segment covering the "Yellow Light of Death".<ref name=":12">{{Cite web |last=BBC |date=18 Sep 2009 |title=Sony rebuts BBC PlayStation claim |url=http://news.bbc.co.uk/2/hi/technology/8263063.stm |url-status=live |archive-url=https://web.archive.org/web/20250219154020/http://news.bbc.co.uk/2/hi/technology/8263063.stm |archive-date=19 Feb 2025 |access-date=4 Jun 2025 |website=BBC NEWS}}</ref><ref name=":13">{{Cite web |last=Martin |first=Matt |date=17 Sep 2009 |title=Sony tackles BBC over 'PS3 failure' report |url=https://www.gamesindustry.biz/sony-tackles-bbc-over-ps3-failure-report |url-status=live |access-date=10 Jun 2025 |website=Gamesindustry.biz}}</ref></blockquote>In November 2006, Sony released the PlayStation 3. Like the Xbox 360, the early models of PlayStation 3 had what consumers believe to be Bumpgate-related issues with its Nvidia-based Reality Synthesizer (RSX) GPU. Many consumers who had bought early models with a 90nm GPU- what are now commonly known as "phat" models- found that their systems were malfunctioning. PlayStation 3 systems that were exhibiting the issue may freeze suddenly during gameplay and shut off, but all users who dealt with the defect had a common experience: when attempting to turn their PlayStation 3 on, the LED power indicator would turn green for a moment, then the system would beep three times, very briefly flash to a yellow light, then it would continuously blink red without booting the system. This was coined by consumers as the "Yellow Light of Death".

BBC Watchdog aired a segment in 2009 covering the "Yellow Light of Death".<ref name=":1">{{Cite web |last=HelpForPS3 (Reuploader) |last2=BBC |date=17 Dec 2009 |title=Sony PS3 Yellow Light of Death - BBC |url=https://www.youtube.com/watch?v=E_ef8bDQktI |url-status=live |access-date=3 Jun 2025 |website=YouTube}}</ref> The hosts stated that when viewers called Sony because their console was malfunctioning, Sony told them that it could have been for a variety of reasons, and they couldn't determine exactly what the problem was without disassembling the console having the issue. While all of this is true- the LED indicators do simply indicate a general hardware failure that requires troubleshooting by connecting to the System Controller (Syscon) and checking for error codes- it is worth noting that by August 2008, Sony was building consoles with the 65nm RSX<ref name=":6">{{Cite web |last=Miller |first=R. |date=26 Jun 2008 |title=PS3 graphics chip going 65nm this Fall |url=https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |url-status=live |archive-url=https://web.archive.org/web/20210924101930/https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |archive-date=24 Sep 2021 |access-date=3 Jun 2025 |website=Engadget}}</ref><ref>{{Cite web |title=NVIDIA Playstation 3 GPU 65nm Specs |url=https://www.techpowerup.com/gpu-specs/playstation-3-gpu-65nm.c1682 |url-status=live |access-date=3 Jun 2025 |website=TechPowerUp GPU Database}}</ref>, which has been confirmed by enthusiasts to not suffer from the theoretically Bumpgate-related fault.<ref name=":2">{{Cite web |last=RIP Felix |date=15 Jan 2024 |title=A 360 Story - The RED Ring of Death & the 7th Generation Console War |url=https://www.youtube.com/watch?v=3qKtS_uxdcU |url-status=live |access-date=2 Jun 2025 |website=YouTube}}</ref><ref name=":14" />

BBC Watchdog aired a segment in 2009 covering the "Yellow Light of Death".<ref name=":1">{{Cite web |last=HelpForPS3 (Reuploader) |last2=BBC |date=17 Dec 2009 |title=Sony PS3 Yellow Light of Death - BBC |url=https://www.youtube.com/watch?v=E_ef8bDQktI |url-status=live |access-date=3 Jun 2025 |website=YouTube}}</ref> The hosts stated that when viewers called Sony because their console was malfunctioning, Sony told them that it could have been for a variety of reasons, and they couldn't determine exactly what the problem was without disassembling the console having the issue. While all of this is true- the LED indicators do simply indicate a general hardware failure that requires troubleshooting by connecting to the System Controller (Syscon) and checking for error codes- it is worth noting that by August 2008, Sony was building consoles with the 65nm RSX<ref name=":6">{{Cite web |last=Miller |first=R. |date=26 Jun 2008 |title=PS3 graphics chip going 65nm this Fall |url=https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |url-status=live |archive-url=https://web.archive.org/web/20210924101930/https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |archive-date=24 Sep 2021 |access-date=3 Jun 2025 |website=Engadget}}</ref><ref>{{Cite web |title=NVIDIA Playstation 3 GPU 65nm Specs |url=https://www.techpowerup.com/gpu-specs/playstation-3-gpu-65nm.c1682 |url-status=live |access-date=3 Jun 2025 |website=TechPowerUp GPU Database}}</ref>, which has been confirmed by enthusiasts to not suffer from the theoretically Bumpgate-related fault.<ref name=":2">{{Cite web |last=RIP Felix |date=15 Jan 2024 |title=A 360 Story - The RED Ring of Death & the 7th Generation Console War |url=https://www.youtube.com/watch?v=3qKtS_uxdcU |url-status=live |access-date=2 Jun 2025 |website=YouTube}}</ref><ref name=":14">{{Cite web |last=RIP Felix |date=9 Jun 2025 |title=A PS3 Story 2: Defending BumpGate Theory |url=https://www.youtube.com/watch?v=vpjtRjGPLhI |url-status=live |access-date=10 Jun 2025 |website=YouTube}}</ref>

Sony ~~never issued~~ a ~~recall or extended~~ warranty ~~for these systems; all consumers had~~ to pay out of ~~their own~~ pocket ~~if they wanted their consoles repaired~~, unless the ~~system failed during the standard~~ one-~~year warranty period~~. ~~However, that was rare; the~~ PS3's ~~fan table accommodated better for the temperature changes than the Xbox 360 did~~, ~~so it took longer for the defect to break~~ the console~~. Depending on how frequently~~ the ~~console was used~~, ~~some consumers could have had their console for a few years before it displayed symptoms. However, for a console~~ that was ~~advertised~~ to ~~still be relevant "ten years [from release]"~~, ~~a few years was not an acceptable lifespan~~. <~~!-- Needs citation for the~~ "~~ten years from release~~" ~~quote. -V --~~>

According to one of the individuals interviewed in the BBC Watchdog segment, if the system was outside of its one year warranty period, consumers would have to pay £128 (~$173) to get the system fixed, and Sony would only provide customers with a three-month post-repair warranty. If it failed again after that point, they would have to pay out of pocket again. Keeping in mind that the fault was very likely caused by a GPU defect, this possibility was very likely unless Sony's repair technicians replaced the defective 90nm GPU with a non-defective one- such as a 65nm or 45nm GPU, which they were able to do for some consoles.<ref name=":17">{{Cite web |last=Icferrum |date=2 Feb 2020 |title=Frankenstein PHAT PS3: CECHA with 40nm RSX |url=https://www.psx-place.com/threads/frankenstein-phat-ps3-cecha-with-40nm-rsx.28069/ |url-status=live |access-date=14 Jun 2025 |website=PSX-Place}}</ref><ref>{{Cite web |last=Mystic |date=9 Apr 2025 |title=Sony's PS3 Upgrade They Never Told You About: Official 40nm RSX Frankenstein Console From Sony |url=https://www.youtube.com/watch?v=2abnrOADoCc |url-status=live |access-date=14 Jun 2025 |website=YouTube}}</ref> In addition, the console would also be reset during the repair, meaning that the owner would lose all data that was not backed up prior to the failure, such as game saves.<ref name=":1" />

~~According~~ to ~~one of the individuals interviewed in BBC's Watchdog segment~~, if the system ~~was outside of its~~ one year warranty period~~, they would have to pay £128 (~$173) to get the system fixed, and they would only provide customers with a three-month post-repair warranty~~. ~~If it failed again after that point~~, ~~they would have to pay out of pocket again. Keeping in mind~~ that ~~the fault~~ was ~~very likely caused by a GPU defect, this possibility was very likely unless Sony's repair technicians replaced~~ the ~~defective 90nm GPU with a non-defective one, which they were able to do for some consoles.<ref name=":17">{{Cite web |last=Icferrum |date=2 Feb 2020 |title=Frankenstein PHAT~~ PS3: CECHA with 40nm RSX |url=https://www.psx-place.com/threads/frankenstein-phat-ps3-cecha-with-40nm-rsx.28069/ |url-status=live |access-date=14 Jun 2025 |website=PSX-Place}}</ref><ref>{{Cite web |last=Mystic |date=9 Apr 2025 |title=Sony's PS3 Upgrade They Never Told You About: Official 40nm RSX Frankenstein Console From Sony |url=https://www.youtube.com/watch?v=2abnrOADoCc |url-status=live |access-date=14 Jun 2025 |website=YouTube}}</ref> In addition, the ~~console would also be reset during~~ the ~~repair~~, ~~meaning that~~ the ~~owner would lose all data that was not backed up prior~~ to the ~~failure~~, ~~such as game saves~~.~~<ref name=":1" />~~

Sony never issued a recall or extended warranty for these systems; all consumers had to pay if they wanted their consoles repaired, unless the system failed during the standard one-year warranty period. However, that was rare; the PS3's fan table accommodated better for the temperature changes than the Xbox 360 did, so it took longer for the defect to break the console. Depending on how frequently the console was used, some consumers could have had their console for a few years before it displayed symptoms.

~~Instead of admitting that there was a defect and issuing an extended warranty to consumers (like Microsoft did) Sony simply quietly fixed the defect around~~ the ~~same~~ time ~~that Microsoft did for~~ the ~~Xbox 360~~, so PS3 "slim" revisions and newer were not affected. ~~Specifically, it was only 90nm GPUs that appeared to have low Tg underfill- and hence, the defect. As~~ of 2025, Sony has still never made a statement confirming that "Yellow Light of Death", their theoretically Bumpgate-related issue, was a widespread problem in early PlayStation 3 models. The only reason that consumers know that the RSX was likely afflicted by Bumpgate is thanks to console repair and modding enthusiasts- who had to do extensive research to find out the true cause of the problem. It was clear from the timeline of what systems have been observed to be reliable or unreliable revisions,<ref name=":4" /><ref name=":18">{{Cite web |last=Derf |last2=Nadaman |last3=et al. |date=14 Jun 2025 |title=PlayStation 3 - Buying Guide |url=https://consolemods.org/wiki/PS3:Buying_Guide#PlayStation_3_%22Fat/Phat%22_(2006-2009) |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref> as well as tests performed by console repair and modding enthusiasts,<ref name=":14">{{Cite web |last=RIP Felix |date=9 Jun 2025 |title=A PS3 Story 2: Defending BumpGate Theory |url=https://www.youtube.com/watch?v=vpjtRjGPLhI |url-status=live |access-date=10 Jun 2025 |website=YouTube}}</ref> that this was ~~a Bumpgate-related~~ defect.

By the time the 65nm RSX was released in Fall 2008,<ref name=":6" /> the defect was no longer present- so PS3 "slim" revisions and newer were not affected. The timing of this led some consumers<ref name=":4" /> to suspect that Sony simply quietly fixed the defect around the same time that Microsoft did for the Xbox 360, as well as while Nvidia was being confronted for the same defect in their G84 and G86 GPUs.

The RSX is a modified version of Nvidia's 256MB GeForce 7800 GTX.<ref>{{Cite web |last=Shimpi |first=Anand |last2=Wilson |first2=Derek |date=24 Jun 2005 |title=Microsoft's Xbox 360, Sony's PS3 - A Hardware Discussion |url=https://www.anandtech.com/show/1719/9 |url-status=live |access-date=16 Jun 2025 |website=AnandTech}}</ref> The GeForce 7 series does have some defective graphics cards, but it's unclear if the 7800 GTX is among them. None of the notebook laptops covered by the Nvidia class action lawsuit settlement<ref name=":16" /> seem to have the 7800 GTX GPU (or a mobile version of it), and no sources have been found showing consumers complaining about problems with this GPU. However, that doesn't necessarily mean that Sony did not know there was a defect with the 90nm RSX. This also does not mean that the 90nm RSX wasn't affected by Bumpgate. Console repair and modding enthusiasts have done extensive research<ref name=":4" /><ref name=":18">{{Cite web |last=Derf |last2=Nadaman |last3=et al. |date=14 Jun 2025 |title=PlayStation 3 - Buying Guide |url=https://consolemods.org/wiki/PS3:Buying_Guide#PlayStation_3_%22Fat/Phat%22_(2006-2009) |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref> and testing<ref name=":14" /> to find the true cause of the problem so that consumers can fix impacted systems, and it has been determined that the "Yellow Light of Death" is extremely likely to be Bumpgate-related.

As of 2025, Sony has still never made a statement confirming that "Yellow Light of Death", their theoretically Bumpgate-related issue, was a widespread problem in early PlayStation 3 models.

====Dell's and HP (HP-Compaq)'s Responses - BIOS Updates and Free Repairs====

There were a variety of Dell and HP-Compaq notebook laptops that were affected by the Bumpgate defect, as evidenced by the Nvidia class action lawsuit.<ref name=":16" /> Upon being informed of the defect by Nvidia in 2008, both companies distributed BIOS updates for affected systems with Nvidia GPUs that according to The Inquirer, "[ran] the fan all the time".<ref name=":5" /> The purpose of this was to attempt to prevent the problem from occurring so that consumers wouldn't have to get their systems repaired. However, both companies also provided free repairs for systems already exhibiting symptoms of a failing GPU, such as no video output to the monitor or the computer failing to boot. It's implied in an SEC report that Nvidia filed in 2008 that the companies were compensated for providing this service.<ref name=":10" />

Line 48:

Line 49:

====Apple's Response - Macbook Pro, May 2007 - September 2008====

In May 2007, Apple released a version of the aluminum Macbook Pro that used the Nvidia GeForce 8600M GT GPU, and manufactured the computers with this GPU until September 2008. They stopped manufacturing them with this GPU because they discovered it was one of the models affected by Bumpgate. Unlike the issues with the PlayStation 3 and Xbox 360 where the system wouldn't even boot, consumers ran into distorted video or no video output on their devices. Nvidia had assured Apple that the graphics processors were not defective, so Apple initially ignored reports expressing that possibility.<ref name=":9">{{Cite web |last=Foresman |first=Chris |date=10 Oct 2008 |title=Apple: NVIDIA chips to blame for MacBook Pro video problems |url=https://arstechnica.com/gadgets/2008/10/apple-nvidia-chips-to-blame-for-macbook-pro-video-problems/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref><ref>{{Cite web |last=Buchanan |first=Matt |date=10 Oct 2008 |title=Apple Confirms Failing Nvidia Graphics Cards in MacBook Pros, Offers Free Repairs and Refunds |url=https://gizmodo.com/apple-confirms-failing-nvidia-graphics-cards-in-macbook-5061605 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref> However, after doing their own investigation, Apple had found that the processors were ~~indeed~~ defective. Because of this, Apple offered extended repair coverage adding up to four years from the date of original purchase, and refunded customers who already paid to repair systems affected by this defect.<ref>{{Cite web |last=Apple Support |date=18 Nov 2014 |title=MacBook Pro: Distorted video or no video issues |url=http://support.apple.com/en-us/HT203254 |url-status=dead |archive-url=https://web.archive.org/web/20141202230527/http://support.apple.com/en-us/HT203254 |archive-date=2 Dec 2014 |access-date=7 Jun 2025 |website=Apple}}</ref>

In May 2007, Apple released a version of the aluminum Macbook Pro that used the Nvidia GeForce 8600M GT GPU, and manufactured the computers with this GPU until September 2008. They stopped manufacturing them with this GPU because they discovered it was one of the models affected by Bumpgate. Unlike the issues with the PlayStation 3 and Xbox 360 where the system wouldn't even boot, consumers ran into distorted video or no video output on their devices. Nvidia had assured Apple that the graphics processors were not defective, so Apple initially ignored reports expressing that possibility.<ref name=":9">{{Cite web |last=Foresman |first=Chris |date=10 Oct 2008 |title=Apple: NVIDIA chips to blame for MacBook Pro video problems |url=https://arstechnica.com/gadgets/2008/10/apple-nvidia-chips-to-blame-for-macbook-pro-video-problems/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref><ref>{{Cite web |last=Buchanan |first=Matt |date=10 Oct 2008 |title=Apple Confirms Failing Nvidia Graphics Cards in MacBook Pros, Offers Free Repairs and Refunds |url=https://gizmodo.com/apple-confirms-failing-nvidia-graphics-cards-in-macbook-5061605 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref> However, after doing their own investigation, Apple had found that the processors actually were defective. Because of this, Apple offered extended repair coverage adding up to four years from the date of original purchase, and refunded customers who already paid to repair systems affected by this defect.<ref>{{Cite web |last=Apple Support |date=18 Nov 2014 |title=MacBook Pro: Distorted video or no video issues |url=http://support.apple.com/en-us/HT203254 |url-status=dead |archive-url=https://web.archive.org/web/20141202230527/http://support.apple.com/en-us/HT203254 |archive-date=2 Dec 2014 |access-date=7 Jun 2025 |website=Apple}}</ref>

====Nvidia's Response - Inquirer Accusations and SEC Report====

Line 56:

Line 57:

- Marvin Burkett, Nvidia Chief Financial Officer, Form 8-K report to SEC.<ref name=":10">{{Cite web |last=Burkett |first=Marvin |last2=United States Securities and Exchange Commission |date=2 Jul 2008 |title=Form 8-K |url=https://www.sec.gov/Archives/edgar/data/1045810/000119312508145974/d8k.htm |url-status=live |access-date=8 Jun 2025 |website=SEC}}</ref></blockquote>Nvidia processors were not the only ones affected by the Bumpgate defect (i.e., the Xbox 360's ATI Xenos GPU), but they seem to have been the most heavily impacted. There were a wide variety of Nvidia graphics processors across multiple architectures that had this defect, but according to the class action lawsuit settlement,<ref name=":16" /> the earliest confirmed system with the defect appears to have been manufactured in December 2005, and the latest systems were manufactured in late February 2010.

The defects were being noticed broadly amongst consumers around July 2008, particularly when ''The Inquirer'' published reports that drew attention to the problems.<ref>{{Cite web |last=Buchanan |first=Matt |date=3 Jul 2008 |title=Lots of Nvidia Laptop Graphics Cards Are Overheating, Dying |url=https://gizmodo.com/lots-of-nvidia-laptop-graphics-cards-are-overheating-d-5021713 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref~~><ref name=":5" /~~> Charlie Demerjian, writer for ''The Inquirer'', firmly presented claims and evidence that every G84 and G86 GPU was defective- including desktop GPUs- even accusing Nvidia of attempting to cover up the problems.

The defects were being noticed broadly amongst consumers around July 2008, particularly when ''The Inquirer'' published reports that drew attention to the problems.<ref name=":5" /><ref>{{Cite web |last=Buchanan |first=Matt |date=3 Jul 2008 |title=Lots of Nvidia Laptop Graphics Cards Are Overheating, Dying |url=https://gizmodo.com/lots-of-nvidia-laptop-graphics-cards-are-overheating-d-5021713 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref> Charlie Demerjian, a writer for ''The Inquirer'' at the time, firmly presented claims and evidence that every G84 and G86 GPU was defective- including desktop GPUs- even accusing Nvidia of attempting to cover up the problems.

On July 2nd, 2008- a few days before Demerjian's article was published- Nvidia filed a report with the Securities and Exchange Commission (SEC).<ref name=":10" /> The report explained that the corporation would pay a $150-200 million one-time charge to cover customer warranties, repairs, returns, replacements, and other notable expenses caused by poor packaging material in some of their media and communications processors (MCPs) and GPUs exclusively used in laptops. This report also confirmed that all of their newly manufactured products from that point forward would have a more suitable material set.

As Joel Hruska from Ars Technica explained, if Nvidia ''was'' trying to cover up the defect- as Demerjian claimed- with this report to the SEC, they not only attempted to avoid responsibility and accused their suppliers of causing the problem, they also committed financial fraud by intentionally lowballing their expected financial losses. This is a major accusation that could have had severe consequences for Nvidia.<ref name=":11">{{Cite web |last=Hruska |first=Joel |date=16 Jul 2008 |title=NVIDIA denies rumors of faulty chips, mass GPU failures |url=https://arstechnica.com/gadgets/2008/07/nvidia-denies-rumors-of-mass-gpu-failures/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref> However, it is difficult to verify if Nvidia was lying or simply not fully aware of the scale of Bumpgate. Nvidia's public acknowledgement of the defect in the SEC report is consistent with when ~~Sony switched the PlayStation 3 to the non-defective 65nm RSX (based on an Nvidia chipset),~~<ref name=":6" /> and ~~it also seems to be consistent with when Dell~~<ref name=":8" /> ~~and HP~~<ref name=":7" /> ~~discovered the problem.~~ The only company it does not appear consistent with is Apple, who discovered the defect in their Macbook Pro systems after their own investigation in September 2008.<ref name=":9" /> Even so, it is possible that Nvidia did not know that the GeForce 8600M GT GPUs in the 2007-2008 Macbook Pro were impacted yet when Apple asked them about it, because the situation was still developing.

Joel Hruska from Ars Technica explained that if Nvidia ''was'' trying to cover up the defect- as Demerjian claimed- with this report to the SEC, they not only attempted to avoid responsibility and accused their suppliers of causing the problem, they also committed financial fraud by intentionally lowballing their expected financial losses. This is a major accusation that could have had severe consequences for Nvidia, and could have been dangerous for the company.<ref name=":11">{{Cite web |last=Hruska |first=Joel |date=16 Jul 2008 |title=NVIDIA denies rumors of faulty chips, mass GPU failures |url=https://arstechnica.com/gadgets/2008/07/nvidia-denies-rumors-of-mass-gpu-failures/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref> However, it is difficult to verify if Nvidia was lying or simply not fully aware of the scale of Bumpgate. Nvidia's public acknowledgement of the defect in the SEC report is consistent with when Dell<ref name=":8" /> and HP<ref name=":7" /> discovered the problem. Although Sony never made a statement on the "Yellow Light of Death", this is even consistent with when they switched the PlayStation 3 to the non-defective 65nm RSX.<ref name=":6" /> The only company it does not appear consistent with is Apple, who discovered the defect in their Macbook Pro systems after their own investigation in September 2008.<ref name=":9" /> Even so, it is possible that Nvidia did not know that the GeForce 8600M GT GPUs in the 2007-2008 Macbook Pro were impacted yet when Apple asked them about it, because the situation was still developing.

Regardless of if Nvidia was truthful in their report or not, they denied the claims that individuals like Demerjian were making- that all of their GPUs were defective and failing en masse.<ref name=":11" /> However, by 2010, consumers' trust in Nvidia had eroded to the point that a class action lawsuit was filed because of the defect.

Line 91:

Line 92:

===Xbox 360/Microsoft Consumer response===

At first, consumers were angry at Microsoft. During the months that the company would not acknowledge the widespread "Red Ring of Death", many consumers felt as if they'd been tricked and made a bad investment when they purchased an Xbox 360. However, when Microsoft extended the warranty on Xbox 360s experiencing an E74 error to three years after purchase, consumer sentiment improved. After Microsoft's explanation and confirmation of the exact issue that caused the "Red Ring of Death" in ''Power On: The Story of Xbox,''<ref name=":3" /> many consumers who remembered dealing with this issue felt further validated, restoring some trust in Microsoft and the Xbox brand. The release of this information also helped enthusiasts learn more about how to fix the issue not only in early Xbox 360s, but even in Sony's early PlayStation 3 systems- as this helped to elucidate the true cause of the early PS3s' problems.

Although most Xbox 360 consoles affected by Bumpgate were repaired by Microsoft as part of their extended warranty program, there were some that managed to slip through the cracks, so consumers today still need to be informed. It is generally recommended by retro console enthusiasts to purchase Xbox 360 consoles manufactured after May 2008 (or marked "Q2 2008") and avoid consoles manufactured before this point, but the Tonasket (AKA "Jasper Kronos" or "Jasper V2") motherboard revision is generally considered to be the most reliable of the original "phat" model Xbox 360 consoles.<ref>{{Cite web |last=Nadaman |last2=et al. |date=8 Jun 2025 |title=Xbox 360 - Buying Guide |url=https://consolemods.org/wiki/Xbox_360:Buying_Guide |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref>

===PlayStation 3/Sony Consumer Response===

@@ Line 14: / Line 14: @@
 ==Companies involved and responses==
-Bumpgate was a worldwide issue for any consumer that purchased these defective graphics processors. However, it's not fully clear who was the most responsible for the incident. Building a GPU is a specialized process that requires it to go through multiple partner companies before ultimately ending up with the company that sells the unit (i.e., Microsoft, Sony, Nvidia, etc.). With this in mind, it is still important to note the response of each of the companies that were the public faces involved in this incident.
+Bumpgate was a worldwide, almost industry-wide issue that impacted multiple GPUs from Nvidia and ATI. Therefore, it's unclear what company was the most responsible for the incident. Building a GPU is a specialized process that requires it to go through multiple partner companies before ultimately ending up with the company that sells the unit or the system it's contained in (i.e., Microsoft, Sony, Nvidia, etc.). However, it is still important to note the response of each of the companies that were the public faces involved in this incident.
 ====Microsoft's Response - The "Red Ring of Death"====
 [[File:GPU early.jpg|alt=An image of a 90 nanometer graphics processing unit from a Microsoft Xbox 360. The die is in the center of the green square, and the eDRAM is located to the left of it. The die has dark greenish low Tg underfill under it, indicating that it is defective.|thumb|200x200px|A ''defective'' 90nm "Xenos" GPU from an '''early''' Xbox 360 (Xenon revision). Note the large die in the center of the chip, and the dark greenish underfill. The color of the underfill is one way to tell if the chip has the low T<sub>g</sub> underfill.]]<blockquote>''"The breakthrough came when we understood that the connections that were being broken were not located on the motherboard, but they were actually located inside the components."''
-- Leo Del Castillo, member of Xbox's hardware engineering group; ''Power On: The Story of Xbox (2021)''<ref name=":3">{{Cite web |last=Xbox |date=13 Dec 2021 |title=Power On: The Story of Xbox {{!}} Chapter 5: The Red Ring of Death |url=https://www.youtube.com/watch?v=z2d6IMBS8oY |url-status=live |archive-url=https://archive.org/details/power-on-the-story-of-xbox/The+Story+of+the+Xbox+-+Chapter+5/Power+On+-+The+Story+of+Xbox+-+Chapter+5+-+The+Red+Ring+of+Death.mp4 |archive-date=13 Dec 2021 |access-date=4 Jun 2025 |website=YouTube}}</ref></blockquote>In November 2005, Microsoft released the Xbox 360 with the ATI Xenos GPU. According to leaked internal Microsoft documents from the time, 1.2 million 360s shipped out to consumers by November 30th, 2005. 3% of customers had some type of issue with their system. Out of that 3%, 19% had three flashing red rings, and 24% had freezing problems.<ref name=":2" /> <!-- I could not find the leaked documents, and I'm not totally sure if citing a leak is okay anyway (even if the info is old), so I chose to just cite Felix's video. -V -->
+- Leo Del Castillo, member of Xbox's hardware engineering group; ''Power On: The Story of Xbox (2021)''<ref name=":3">{{Cite web |last=Xbox |date=13 Dec 2021 |title=Power On: The Story of Xbox {{!}} Chapter 5: The Red Ring of Death |url=https://www.youtube.com/watch?v=z2d6IMBS8oY |url-status=live |archive-url=https://archive.org/details/power-on-the-story-of-xbox/The+Story+of+the+Xbox+-+Chapter+5/Power+On+-+The+Story+of+Xbox+-+Chapter+5+-+The+Red+Ring+of+Death.mp4 |archive-date=13 Dec 2021 |access-date=4 Jun 2025 |website=YouTube}}</ref></blockquote>In November 2005, Microsoft released the Xbox 360 with the ATI Xenos GPU. According to leaked internal Microsoft documents from the time, 1.2 million 360s shipped out to consumers by November 30th, 2005. 3% of customers had some type of issue with their system. Out of that 3%, 19% had three flashing red rings, and 24% had freezing problems.<ref name=":2" /> This is notable because this means shortly after launch, 43% of consumers had consoles showing symptoms of the now-infamous "Red Ring of Death"- which is what consumers around the world called the Xbox 360's confirmed Bumpgate-related fault.<ref name=":3" /> <!-- I could not find the leaked documents, and I'm not totally sure if citing a leak is okay anyway (even if the info is old), so I chose to just cite Felix's video. -V -->
-Therefore, 43% of consumers shortly after launch had these familiar symptoms to retro console enthusiasts: the "Red Ring of Death"- which is what consumers around the world called the Xbox 360's Bumpgate-related fault. However, "three flashing red rings" on the Xbox 360 simply means "core digital error"- in other words, a general hardware failure. It takes multiple power-on cycles to cause a failure in the solder bumps, so it is unlikely that these systems were failing specifically because of the Bumpgate defect. 56% of systems worked on the first try, and after component reworks, that number improved to 71%. Only 200,000 consoles went to what Microsoft termed "the bonepile", a collection of broken consoles that still did not work after a component rework. However, it is also worth noting that some owners discovered that some afflicted Xbox 360s will work again after a "reflow"- which is effectively redoing all of the components on the motherboard at once. In addition, Microsoft wasn't aware that the "Red Ring of Death" was a specific widespread problem yet, so they would not have been taking major note of consoles with a GPU problem. At the height of the Bumpgate-related defect, approximately 600,000 to 1,000,000 Xbox 360s were suffering from the "Red Ring of Death".
+"Three flashing red rings" on the Xbox 360 simply means "core digital error"- or, a general hardware failure. This can mean a variety of things, including a GPU failure. However, it takes multiple power-on cycles to cause a failure in the solder bumps. Depending on how many power cycle tests the consoles may have went through prior to being shipped out, it is possible that some or even all 43% of those defective consoles could have had GPU failures. Only 200,000 Xbox 360s were in what Microsoft termed "the bonepile" at launch- non-functioning Xbox 360s that they decided to repair and ship out later. 56% of systems worked on the first try after manufacture, and that number improved to 71% after component reworks. At the height of the "Red Ring of Death" crisis, some consumers discovered that if they reflowed the motherboard- which is similar to what Microsoft may have done to improve their yield of working Xbox 360s- their console may start functioning again for a limited, varying amount of time.<ref name=":2" />
 [[File:GPU late.jpg|alt=An image of a 65 nanometer graphics processing unit from a Microsoft Xbox 360. The die is in the center of the green square, and the eDRAM is located to the left of it. The die has a light, whitish underfill- indicating that it is not one of the defective units.|thumb|204x204px|A ''non-defective'' 65nm "Xenos" GPU from a later revision of Xbox 360 (Jasper V2 on "Kronos 1" package). Note the smaller die and the light, whitish underfill.]]
-For several months, Microsoft had consumers pay to repair their consoles. However, in 2007, they chose to extend the warranty for Xbox 360 consoles displaying an E74 error (an on-screen error also associated with "Red Ring of Death") from one year from date of purchase, to three years from date of purchase. This allowed most consumers who had consoles with the issue to get their consoles refurbished. In addition, they refunded any consumers who had paid to have their afflicted systems repaired.<ref>{{Cite web |last=Moore |first=Peter |date=2007 |title=Open Letter From Peter Moore |url=http://xbox.com/en-ca/support/petermooreletter.htm |url-status=dead |archive-url=https://web.archive.org/web/20071023004948/http://xbox.com/en-ca/support/petermooreletter.htm |archive-date=23 Oct 2007 |access-date=4 Jun 2025 |website=Xbox}}</ref>
+At the height of the Bumpgate-related defect, approximately 600,000 to 1,000,000 Xbox 360s were suffering from the "Red Ring of Death". For several months, Microsoft had consumers pay to repair their consoles. However, in 2007, they chose to extend the warranty for Xbox 360 consoles displaying an E74 error (an on-screen error also associated with "Red Ring of Death") from one year from date of purchase, to three years from date of purchase. This allowed most consumers who had consoles with the issue to get their consoles refurbished. In addition, they refunded any consumers who had previously paid to have their afflicted systems repaired.<ref>{{Cite web |last=Moore |first=Peter |date=2007 |title=Open Letter From Peter Moore |url=http://xbox.com/en-ca/support/petermooreletter.htm |url-status=dead |archive-url=https://web.archive.org/web/20071023004948/http://xbox.com/en-ca/support/petermooreletter.htm |archive-date=23 Oct 2007 |access-date=4 Jun 2025 |website=Xbox}}</ref> By mid-2008, the cause of the issue was confirmed to be "within the components"- the low T<sub>g</sub> underfill. ATI and Microsoft completely fixed the issue in Xbox 360s made after this point.
 Microsoft primarily seemed to have done this to protect the Xbox brand. The Xbox 360 was only their second console, and the original Xbox hadn't done as well as they'd hoped it would. Microsoft confirmed this in Chapter 5 of their 2021 documentary, ''Power On: The Story of Xbox''.<ref name=":3" />
-By mid-2008, the cause of the issue was confirmed to be "within the components"- the low T<sub>g</sub> underfill. ATI and Microsoft completely fixed the issue in Xbox 360s made after this point. Generally, it is recommended by retro console enthusiasts to purchase consoles manufactured after May 2008 (or marked "Q2 2008") and avoid consoles manufactured before this point, but the Tonasket (AKA "Jasper Kronos" or "Jasper V2") motherboard revision is generally considered to be the most reliable of the original "phat" model Xbox 360 consoles.<ref>{{Cite web |last=Nadaman |last2=et al. |date=8 Jun 2025 |title=Xbox 360 - Buying Guide |url=https://consolemods.org/wiki/Xbox_360:Buying_Guide |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref>
 ====Sony's Response - The "Yellow Light of Death"====
 <blockquote>''"We entirely refute the suggestion that PS3 consoles have an inherent defect or other design issue which is akin to any warranty issue experienced by another console manufacturer. [...] We think it is highly unfair to suggest that from an installed base of 2.5 million that the numbers you mention somehow are evidence of a 'manufacturing defect'..."''
-- Ray Maguire, managing director and senior vice president of Sony Computer Entertainment Europe in 2009; in a letter responding to a BBC Watchdog segment covering the "Yellow Light of Death".<ref name=":12">{{Cite web |last=BBC |date=18 Sep 2009 |title=Sony rebuts BBC PlayStation claim |url=http://news.bbc.co.uk/2/hi/technology/8263063.stm |url-status=live |archive-url=https://web.archive.org/web/20250219154020/http://news.bbc.co.uk/2/hi/technology/8263063.stm |archive-date=19 Feb 2025 |access-date=4 Jun 2025 |website=BBC NEWS}}</ref><ref name=":13">{{Cite web |last=Martin |first=Matt |date=17 Sep 2009 |title=Sony tackles BBC over 'PS3 failure' report |url=https://www.gamesindustry.biz/sony-tackles-bbc-over-ps3-failure-report |url-status=live |access-date=10 Jun 2025 |website=Gamesindustry.biz}}</ref></blockquote>In November 2006, Sony released the PlayStation 3. Like the Xbox 360, the early models of PlayStation 3 had what consumers believe to be Bumpgate-related issues with its Nvidia-based RSX GPU. Many consumers who had bought launch models- what are now commonly known as "PlayStation 2 backwards compatible" models- found that their systems were malfunctioning. PlayStation 3 systems that were exhibiting the issue may freeze suddenly during gameplay and shut off, but all users who dealt with the defect had a common experience: when attempting to turn their PlayStation 3 on, the LED power indicator would turn green for a moment, then the system would beep three times, very briefly flash to a yellow light, then it would continuously blink red without booting the system. This was coined by consumers as the "Yellow Light of Death".
+- Ray Maguire, managing director and senior vice president of Sony Computer Entertainment Europe in 2009; in a letter responding to a BBC Watchdog segment covering the "Yellow Light of Death".<ref name=":12">{{Cite web |last=BBC |date=18 Sep 2009 |title=Sony rebuts BBC PlayStation claim |url=http://news.bbc.co.uk/2/hi/technology/8263063.stm |url-status=live |archive-url=https://web.archive.org/web/20250219154020/http://news.bbc.co.uk/2/hi/technology/8263063.stm |archive-date=19 Feb 2025 |access-date=4 Jun 2025 |website=BBC NEWS}}</ref><ref name=":13">{{Cite web |last=Martin |first=Matt |date=17 Sep 2009 |title=Sony tackles BBC over 'PS3 failure' report |url=https://www.gamesindustry.biz/sony-tackles-bbc-over-ps3-failure-report |url-status=live |access-date=10 Jun 2025 |website=Gamesindustry.biz}}</ref></blockquote>In November 2006, Sony released the PlayStation 3. Like the Xbox 360, the early models of PlayStation 3 had what consumers believe to be Bumpgate-related issues with its Nvidia-based Reality Synthesizer (RSX) GPU. Many consumers who had bought early models with a 90nm GPU- what are now commonly known as "phat" models- found that their systems were malfunctioning. PlayStation 3 systems that were exhibiting the issue may freeze suddenly during gameplay and shut off, but all users who dealt with the defect had a common experience: when attempting to turn their PlayStation 3 on, the LED power indicator would turn green for a moment, then the system would beep three times, very briefly flash to a yellow light, then it would continuously blink red without booting the system. This was coined by consumers as the "Yellow Light of Death".
-BBC Watchdog aired a segment in 2009 covering the "Yellow Light of Death".<ref name=":1">{{Cite web |last=HelpForPS3 (Reuploader) |last2=BBC |date=17 Dec 2009 |title=Sony PS3 Yellow Light of Death - BBC |url=https://www.youtube.com/watch?v=E_ef8bDQktI |url-status=live |access-date=3 Jun 2025 |website=YouTube}}</ref> The hosts stated that when viewers called Sony because their console was malfunctioning, Sony told them that it could have been for a variety of reasons, and they couldn't determine exactly what the problem was without disassembling the console having the issue. While all of this is true- the LED indicators do simply indicate a general hardware failure that requires troubleshooting by connecting to the System Controller (Syscon) and checking for error codes- it is worth noting that by August 2008, Sony was building consoles with the 65nm RSX<ref name=":6">{{Cite web |last=Miller |first=R. |date=26 Jun 2008 |title=PS3 graphics chip going 65nm this Fall |url=https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |url-status=live |archive-url=https://web.archive.org/web/20210924101930/https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |archive-date=24 Sep 2021 |access-date=3 Jun 2025 |website=Engadget}}</ref><ref>{{Cite web |title=NVIDIA Playstation 3 GPU 65nm Specs |url=https://www.techpowerup.com/gpu-specs/playstation-3-gpu-65nm.c1682 |url-status=live |access-date=3 Jun 2025 |website=TechPowerUp GPU Database}}</ref>, which has been confirmed by enthusiasts to not suffer from the theoretically Bumpgate-related fault.<ref name=":2">{{Cite web |last=RIP Felix |date=15 Jan 2024 |title=A 360 Story - The RED Ring of Death & the 7th Generation Console War |url=https://www.youtube.com/watch?v=3qKtS_uxdcU |url-status=live |access-date=2 Jun 2025 |website=YouTube}}</ref><ref name=":14" />
+BBC Watchdog aired a segment in 2009 covering the "Yellow Light of Death".<ref name=":1">{{Cite web |last=HelpForPS3 (Reuploader) |last2=BBC |date=17 Dec 2009 |title=Sony PS3 Yellow Light of Death - BBC |url=https://www.youtube.com/watch?v=E_ef8bDQktI |url-status=live |access-date=3 Jun 2025 |website=YouTube}}</ref> The hosts stated that when viewers called Sony because their console was malfunctioning, Sony told them that it could have been for a variety of reasons, and they couldn't determine exactly what the problem was without disassembling the console having the issue. While all of this is true- the LED indicators do simply indicate a general hardware failure that requires troubleshooting by connecting to the System Controller (Syscon) and checking for error codes- it is worth noting that by August 2008, Sony was building consoles with the 65nm RSX<ref name=":6">{{Cite web |last=Miller |first=R. |date=26 Jun 2008 |title=PS3 graphics chip going 65nm this Fall |url=https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |url-status=live |archive-url=https://web.archive.org/web/20210924101930/https://www.engadget.com/2008-06-26-ps3-graphics-chip-going-65nm-this-fall.html |archive-date=24 Sep 2021 |access-date=3 Jun 2025 |website=Engadget}}</ref><ref>{{Cite web |title=NVIDIA Playstation 3 GPU 65nm Specs |url=https://www.techpowerup.com/gpu-specs/playstation-3-gpu-65nm.c1682 |url-status=live |access-date=3 Jun 2025 |website=TechPowerUp GPU Database}}</ref>, which has been confirmed by enthusiasts to not suffer from the theoretically Bumpgate-related fault.<ref name=":2">{{Cite web |last=RIP Felix |date=15 Jan 2024 |title=A 360 Story - The RED Ring of Death & the 7th Generation Console War |url=https://www.youtube.com/watch?v=3qKtS_uxdcU |url-status=live |access-date=2 Jun 2025 |website=YouTube}}</ref><ref name=":14">{{Cite web |last=RIP Felix |date=9 Jun 2025 |title=A PS3 Story 2: Defending BumpGate Theory |url=https://www.youtube.com/watch?v=vpjtRjGPLhI |url-status=live |access-date=10 Jun 2025 |website=YouTube}}</ref>
-Sony never issued a recall or extended warranty for these systems; all consumers had to pay out of their own pocket if they wanted their consoles repaired, unless the system failed during the standard one-year warranty period. However, that was rare; the PS3's fan table accommodated better for the temperature changes than the Xbox 360 did, so it took longer for the defect to break the console. Depending on how frequently the console was used, some consumers could have had their console for a few years before it displayed symptoms. However, for a console that was advertised to still be relevant "ten years [from release]", a few years was not an acceptable lifespan. <!-- Needs citation for the "ten years from release" quote. -V -->
+According to one of the individuals interviewed in the BBC Watchdog segment, if the system was outside of its one year warranty period, consumers would have to pay £128 (~$173) to get the system fixed, and Sony would only provide customers with a three-month post-repair warranty. If it failed again after that point, they would have to pay out of pocket again. Keeping in mind that the fault was very likely caused by a GPU defect, this possibility was very likely unless Sony's repair technicians replaced the defective 90nm GPU with a non-defective one- such as a 65nm or 45nm GPU, which they were able to do for some consoles.<ref name=":17">{{Cite web |last=Icferrum |date=2 Feb 2020 |title=Frankenstein PHAT PS3: CECHA with 40nm RSX |url=https://www.psx-place.com/threads/frankenstein-phat-ps3-cecha-with-40nm-rsx.28069/ |url-status=live |access-date=14 Jun 2025 |website=PSX-Place}}</ref><ref>{{Cite web |last=Mystic |date=9 Apr 2025 |title=Sony's PS3 Upgrade They Never Told You About: Official 40nm RSX Frankenstein Console From Sony |url=https://www.youtube.com/watch?v=2abnrOADoCc |url-status=live |access-date=14 Jun 2025 |website=YouTube}}</ref> In addition, the console would also be reset during the repair, meaning that the owner would lose all data that was not backed up prior to the failure, such as game saves.<ref name=":1" />
-According to one of the individuals interviewed in BBC's Watchdog segment, if the system was outside of its one year warranty period, they would have to pay £128 (~$173) to get the system fixed, and they would only provide customers with a three-month post-repair warranty. If it failed again after that point, they would have to pay out of pocket again. Keeping in mind that the fault was very likely caused by a GPU defect, this possibility was very likely unless Sony's repair technicians replaced the defective 90nm GPU with a non-defective one, which they were able to do for some consoles.<ref name=":17">{{Cite web |last=Icferrum |date=2 Feb 2020 |title=Frankenstein PHAT PS3: CECHA with 40nm RSX |url=https://www.psx-place.com/threads/frankenstein-phat-ps3-cecha-with-40nm-rsx.28069/ |url-status=live |access-date=14 Jun 2025 |website=PSX-Place}}</ref><ref>{{Cite web |last=Mystic |date=9 Apr 2025 |title=Sony's PS3 Upgrade They Never Told You About: Official 40nm RSX Frankenstein Console From Sony |url=https://www.youtube.com/watch?v=2abnrOADoCc |url-status=live |access-date=14 Jun 2025 |website=YouTube}}</ref> In addition, the console would also be reset during the repair, meaning that the owner would lose all data that was not backed up prior to the failure, such as game saves.<ref name=":1" />
+Sony never issued a recall or extended warranty for these systems; all consumers had to pay if they wanted their consoles repaired, unless the system failed during the standard one-year warranty period. However, that was rare; the PS3's fan table accommodated better for the temperature changes than the Xbox 360 did, so it took longer for the defect to break the console. Depending on how frequently the console was used, some consumers could have had their console for a few years before it displayed symptoms.
-Instead of admitting that there was a defect and issuing an extended warranty to consumers (like Microsoft did) Sony simply quietly fixed the defect around the same time that Microsoft did for the Xbox 360, so PS3 "slim" revisions and newer were not affected. Specifically, it was only 90nm GPUs that appeared to have low T<sub>g</sub> underfill- and hence, the defect. As of 2025, Sony has still never made a statement confirming that "Yellow Light of Death", their theoretically Bumpgate-related issue, was a widespread problem in early PlayStation 3 models. The only reason that consumers know that the RSX was likely afflicted by Bumpgate is thanks to console repair and modding enthusiasts- who had to do extensive research to find out the true cause of the problem. It was clear from the timeline of what systems have been observed to be reliable or unreliable revisions,<ref name=":4" /><ref name=":18">{{Cite web |last=Derf |last2=Nadaman |last3=et al. |date=14 Jun 2025 |title=PlayStation 3 - Buying Guide |url=https://consolemods.org/wiki/PS3:Buying_Guide#PlayStation_3_%22Fat/Phat%22_(2006-2009) |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref> as well as tests performed by console repair and modding enthusiasts,<ref name=":14">{{Cite web |last=RIP Felix |date=9 Jun 2025 |title=A PS3 Story 2: Defending BumpGate Theory |url=https://www.youtube.com/watch?v=vpjtRjGPLhI |url-status=live |access-date=10 Jun 2025 |website=YouTube}}</ref> that this was a Bumpgate-related defect.
+By the time the 65nm RSX was released in Fall 2008,<ref name=":6" /> the defect was no longer present- so PS3 "slim" revisions and newer were not affected. The timing of this led some consumers<ref name=":4" /> to suspect that Sony simply quietly fixed the defect around the same time that Microsoft did for the Xbox 360, as well as while Nvidia was being confronted for the same defect in their G84 and G86 GPUs.
+The RSX is a modified version of Nvidia's 256MB GeForce 7800 GTX.<ref>{{Cite web |last=Shimpi |first=Anand |last2=Wilson |first2=Derek |date=24 Jun 2005 |title=Microsoft's Xbox 360, Sony's PS3 - A Hardware Discussion |url=https://www.anandtech.com/show/1719/9 |url-status=live |access-date=16 Jun 2025 |website=AnandTech}}</ref> The GeForce 7 series does have some defective graphics cards, but it's unclear if the 7800 GTX is among them. None of the notebook laptops covered by the Nvidia class action lawsuit settlement<ref name=":16" /> seem to have the 7800 GTX GPU (or a mobile version of it), and no sources have been found showing consumers complaining about problems with this GPU. However, that doesn't necessarily mean that Sony did not know there was a defect with the 90nm RSX. This also does not mean that the 90nm RSX wasn't affected by Bumpgate. Console repair and modding enthusiasts have done extensive research<ref name=":4" /><ref name=":18">{{Cite web |last=Derf |last2=Nadaman |last3=et al. |date=14 Jun 2025 |title=PlayStation 3 - Buying Guide |url=https://consolemods.org/wiki/PS3:Buying_Guide#PlayStation_3_%22Fat/Phat%22_(2006-2009) |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref> and testing<ref name=":14" /> to find the true cause of the problem so that consumers can fix impacted systems, and it has been determined that the "Yellow Light of Death" is extremely likely to be Bumpgate-related.
+As of 2025, Sony has still never made a statement confirming that "Yellow Light of Death", their theoretically Bumpgate-related issue, was a widespread problem in early PlayStation 3 models.
 ====Dell's and HP (HP-Compaq)'s Responses - BIOS Updates and Free Repairs====
 There were a variety of Dell and HP-Compaq notebook laptops that were affected by the Bumpgate defect, as evidenced by the Nvidia class action lawsuit.<ref name=":16" /> Upon being informed of the defect by Nvidia in 2008, both companies distributed BIOS updates for affected systems with Nvidia GPUs that according to The Inquirer, "[ran] the fan all the time".<ref name=":5" /> The purpose of this was to attempt to prevent the problem from occurring so that consumers wouldn't have to get their systems repaired. However, both companies also provided free repairs for systems already exhibiting symptoms of a failing GPU, such as no video output to the monitor or the computer failing to boot. It's implied in an SEC report that Nvidia filed in 2008 that the companies were compensated for providing this service.<ref name=":10" />
@@ Line 48: / Line 49: @@
 ====Apple's Response - Macbook Pro, May 2007 - September 2008====
-In May 2007, Apple released a version of the aluminum Macbook Pro that used the Nvidia GeForce 8600M GT GPU, and manufactured the computers with this GPU until September 2008. They stopped manufacturing them with this GPU because they discovered it was one of the models affected by Bumpgate. Unlike the issues with the PlayStation 3 and Xbox 360 where the system wouldn't even boot, consumers ran into distorted video or no video output on their devices. Nvidia had assured Apple that the graphics processors were not defective, so Apple initially ignored reports expressing that possibility.<ref name=":9">{{Cite web |last=Foresman |first=Chris |date=10 Oct 2008 |title=Apple: NVIDIA chips to blame for MacBook Pro video problems |url=https://arstechnica.com/gadgets/2008/10/apple-nvidia-chips-to-blame-for-macbook-pro-video-problems/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref><ref>{{Cite web |last=Buchanan |first=Matt |date=10 Oct 2008 |title=Apple Confirms Failing Nvidia Graphics Cards in MacBook Pros, Offers Free Repairs and Refunds |url=https://gizmodo.com/apple-confirms-failing-nvidia-graphics-cards-in-macbook-5061605 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref> However, after doing their own investigation, Apple had found that the processors were indeed defective. Because of this, Apple offered extended repair coverage adding up to four years from the date of original purchase, and refunded customers who already paid to repair systems affected by this defect.<ref>{{Cite web |last=Apple Support |date=18 Nov 2014 |title=MacBook Pro: Distorted video or no video issues |url=http://support.apple.com/en-us/HT203254 |url-status=dead |archive-url=https://web.archive.org/web/20141202230527/http://support.apple.com/en-us/HT203254 |archive-date=2 Dec 2014 |access-date=7 Jun 2025 |website=Apple}}</ref>
+In May 2007, Apple released a version of the aluminum Macbook Pro that used the Nvidia GeForce 8600M GT GPU, and manufactured the computers with this GPU until September 2008. They stopped manufacturing them with this GPU because they discovered it was one of the models affected by Bumpgate. Unlike the issues with the PlayStation 3 and Xbox 360 where the system wouldn't even boot, consumers ran into distorted video or no video output on their devices. Nvidia had assured Apple that the graphics processors were not defective, so Apple initially ignored reports expressing that possibility.<ref name=":9">{{Cite web |last=Foresman |first=Chris |date=10 Oct 2008 |title=Apple: NVIDIA chips to blame for MacBook Pro video problems |url=https://arstechnica.com/gadgets/2008/10/apple-nvidia-chips-to-blame-for-macbook-pro-video-problems/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref><ref>{{Cite web |last=Buchanan |first=Matt |date=10 Oct 2008 |title=Apple Confirms Failing Nvidia Graphics Cards in MacBook Pros, Offers Free Repairs and Refunds |url=https://gizmodo.com/apple-confirms-failing-nvidia-graphics-cards-in-macbook-5061605 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref> However, after doing their own investigation, Apple had found that the processors actually were defective. Because of this, Apple offered extended repair coverage adding up to four years from the date of original purchase, and refunded customers who already paid to repair systems affected by this defect.<ref>{{Cite web |last=Apple Support |date=18 Nov 2014 |title=MacBook Pro: Distorted video or no video issues |url=http://support.apple.com/en-us/HT203254 |url-status=dead |archive-url=https://web.archive.org/web/20141202230527/http://support.apple.com/en-us/HT203254 |archive-date=2 Dec 2014 |access-date=7 Jun 2025 |website=Apple}}</ref>
 ====Nvidia's Response - Inquirer Accusations and SEC Report====
@@ Line 56: / Line 57: @@
 - Marvin Burkett, Nvidia Chief Financial Officer, Form 8-K report to SEC.<ref name=":10">{{Cite web |last=Burkett |first=Marvin |last2=United States Securities and Exchange Commission |date=2 Jul 2008 |title=Form 8-K |url=https://www.sec.gov/Archives/edgar/data/1045810/000119312508145974/d8k.htm |url-status=live |access-date=8 Jun 2025 |website=SEC}}</ref></blockquote>Nvidia processors were not the only ones affected by the Bumpgate defect (i.e., the Xbox 360's ATI Xenos GPU), but they seem to have been the most heavily impacted. There were a wide variety of Nvidia graphics processors across multiple architectures that had this defect, but according to the class action lawsuit settlement,<ref name=":16" /> the earliest confirmed system with the defect appears to have been manufactured in December 2005, and the latest systems were manufactured in late February 2010.
-The defects were being noticed broadly amongst consumers around July 2008, particularly when ''The Inquirer'' published reports that drew attention to the problems.<ref>{{Cite web |last=Buchanan |first=Matt |date=3 Jul 2008 |title=Lots of Nvidia Laptop Graphics Cards Are Overheating, Dying |url=https://gizmodo.com/lots-of-nvidia-laptop-graphics-cards-are-overheating-d-5021713 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref><ref name=":5" /> Charlie Demerjian, writer for ''The Inquirer'', firmly presented claims and evidence that every G84 and G86 GPU was defective- including desktop GPUs- even accusing Nvidia of attempting to cover up the problems.
+The defects were being noticed broadly amongst consumers around July 2008, particularly when ''The Inquirer'' published reports that drew attention to the problems.<ref name=":5" /><ref>{{Cite web |last=Buchanan |first=Matt |date=3 Jul 2008 |title=Lots of Nvidia Laptop Graphics Cards Are Overheating, Dying |url=https://gizmodo.com/lots-of-nvidia-laptop-graphics-cards-are-overheating-d-5021713 |url-status=live |access-date=7 Jun 2025 |website=Gizmodo}}</ref> Charlie Demerjian, a writer for ''The Inquirer'' at the time, firmly presented claims and evidence that every G84 and G86 GPU was defective- including desktop GPUs- even accusing Nvidia of attempting to cover up the problems.
 On July 2nd, 2008- a few days before Demerjian's article was published- Nvidia filed a report with the Securities and Exchange Commission (SEC).<ref name=":10" /> The report explained that the corporation would pay a $150-200 million one-time charge to cover customer warranties, repairs, returns, replacements, and other notable expenses caused by poor packaging material in some of their media and communications processors (MCPs) and GPUs exclusively used in laptops. This report also confirmed that all of their newly manufactured products from that point forward would have a more suitable material set.
-As Joel Hruska from Ars Technica explained, if Nvidia ''was'' trying to cover up the defect- as Demerjian claimed- with this report to the SEC, they not only attempted to avoid responsibility and accused their suppliers of causing the problem, they also committed financial fraud by intentionally lowballing their expected financial losses. This is a major accusation that could have had severe consequences for Nvidia.<ref name=":11">{{Cite web |last=Hruska |first=Joel |date=16 Jul 2008 |title=NVIDIA denies rumors of faulty chips, mass GPU failures |url=https://arstechnica.com/gadgets/2008/07/nvidia-denies-rumors-of-mass-gpu-failures/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref> However, it is difficult to verify if Nvidia was lying or simply not fully aware of the scale of Bumpgate. Nvidia's public acknowledgement of the defect in the SEC report is consistent with when Sony switched the PlayStation 3 to the non-defective 65nm RSX (based on an Nvidia chipset),<ref name=":6" /> and it also seems to be consistent with when Dell<ref name=":8" /> and HP<ref name=":7" /> discovered the problem. The only company it does not appear consistent with is Apple, who discovered the defect in their Macbook Pro systems after their own investigation in September 2008.<ref name=":9" /> Even so, it is possible that Nvidia did not know that the GeForce 8600M GT GPUs in the 2007-2008 Macbook Pro were impacted yet when Apple asked them about it, because the situation was still developing.
+Joel Hruska from Ars Technica explained that if Nvidia ''was'' trying to cover up the defect- as Demerjian claimed- with this report to the SEC, they not only attempted to avoid responsibility and accused their suppliers of causing the problem, they also committed financial fraud by intentionally lowballing their expected financial losses. This is a major accusation that could have had severe consequences for Nvidia, and could have been dangerous for the company.<ref name=":11">{{Cite web |last=Hruska |first=Joel |date=16 Jul 2008 |title=NVIDIA denies rumors of faulty chips, mass GPU failures |url=https://arstechnica.com/gadgets/2008/07/nvidia-denies-rumors-of-mass-gpu-failures/ |url-status=live |access-date=8 Jun 2025 |website=Ars Technica}}</ref> However, it is difficult to verify if Nvidia was lying or simply not fully aware of the scale of Bumpgate. Nvidia's public acknowledgement of the defect in the SEC report is consistent with when Dell<ref name=":8" /> and HP<ref name=":7" /> discovered the problem. Although Sony never made a statement on the "Yellow Light of Death", this is even consistent with when they switched the PlayStation 3 to the non-defective 65nm RSX.<ref name=":6" /> The only company it does not appear consistent with is Apple, who discovered the defect in their Macbook Pro systems after their own investigation in September 2008.<ref name=":9" /> Even so, it is possible that Nvidia did not know that the GeForce 8600M GT GPUs in the 2007-2008 Macbook Pro were impacted yet when Apple asked them about it, because the situation was still developing.
 Regardless of if Nvidia was truthful in their report or not, they denied the claims that individuals like Demerjian were making- that all of their GPUs were defective and failing en masse.<ref name=":11" /> However, by 2010, consumers' trust in Nvidia had eroded to the point that a class action lawsuit was filed because of the defect.
@@ Line 91: / Line 92: @@
 ===Xbox 360/Microsoft Consumer response===
 At first, consumers were angry at Microsoft. During the months that the company would not acknowledge the widespread "Red Ring of Death", many consumers felt as if they'd been tricked and made a bad investment when they purchased an Xbox 360. However, when Microsoft extended the warranty on Xbox 360s experiencing an E74 error to three years after purchase, consumer sentiment improved. After Microsoft's explanation and confirmation of the exact issue that caused the "Red Ring of Death" in ''Power On: The Story of Xbox,''<ref name=":3" /> many consumers who remembered dealing with this issue felt further validated, restoring some trust in Microsoft and the Xbox brand. The release of this information also helped enthusiasts learn more about how to fix the issue not only in early Xbox 360s, but even in Sony's early PlayStation 3 systems- as this helped to elucidate the true cause of the early PS3s' problems.
+Although most Xbox 360 consoles affected by Bumpgate were repaired by Microsoft as part of their extended warranty program, there were some that managed to slip through the cracks, so consumers today still need to be informed. It is generally recommended by retro console enthusiasts to purchase Xbox 360 consoles manufactured after May 2008 (or marked "Q2 2008") and avoid consoles manufactured before this point, but the Tonasket (AKA "Jasper Kronos" or "Jasper V2") motherboard revision is generally considered to be the most reliable of the original "phat" model Xbox 360 consoles.<ref>{{Cite web |last=Nadaman |last2=et al. |date=8 Jun 2025 |title=Xbox 360 - Buying Guide |url=https://consolemods.org/wiki/Xbox_360:Buying_Guide |url-status=live |access-date=14 Jun 2025 |website=ConsoleMods Wiki}}</ref>
 ===PlayStation 3/Sony Consumer Response===