X9DRH-7TF PCIe errors
These are notes on a stability (instability) issue with a Supermicro X9DRH-7TF motherboard with NAS4Free. I can reliabily crash the motherboard by copying the entire ZFS pool ('zfs send -R tank@01 | zfs receive -Fdvu dozer').
Prior to this the following issues have been investgated:
- power supply
- memory errors
- BIOS upgrades
- IPMI firmware
- disable the onboard LSI 2208
- use a i350-T4 adapter instead of the onboard dual port x540
The following has been observed:
- the machine crashes without any observed messsages (I tried a serial console for a while)
- the system event log (accessable via IPMI) shows errors of the form 'PCI PERR'
- the pciconf tool shows 'Correctable Error Detected' and 'Unsupported Request Detected' messages
event log messages
The system event log has many messages (including very old messages relating to a bad RAM module). I suspect the issues have been going on for longer than reported, but they have just been logged since June 2014. The lastest messages include:
63015 2014/06/15 19:09:04 Bus00(DevFn12) Critical Interrupt PCI PERR - Asserted 63016 2014/06/15 19:09:08 Bus02(DevFn00) Critical Interrupt PCI PERR - Asserted 63017 2014/06/15 19:09:08 Bus00(DevFn10) Critical Interrupt PCI PERR - Asserted 63018 2014/06/15 19:09:09 Bus03(DevFn00) Critical Interrupt PCI PERR - Asserted 63019 2014/06/15 19:09:09 Bus00(DevFn12) Critical Interrupt PCI PERR - Asserted 63020 2014/06/15 19:09:30 Bus02(DevFn00) Critical Interrupt PCI PERR - Asserted 63021 2014/06/15 19:09:31 Bus00(DevFn10) Critical Interrupt PCI PERR - Asserted 63022 2014/06/15 19:09:31 Bus03(DevFn00) Critical Interrupt PCI PERR - Asserted 63023 2014/06/15 19:09:32 Bus00(DevFn12) Critical Interrupt PCI PERR - Asserted 63024 2014/06/15 19:09:33 Bus02(DevFn00) Critical Interrupt PCI PERR - Asserted 63025 2014/06/15 19:09:34 Bus00(DevFn10) Critical Interrupt PCI PERR - Asserted 63026 2014/06/15 19:09:44 Bus02(DevFn00) Critical Interrupt PCI PERR - Asserted 63027 2014/06/15 19:09:45 Bus00(DevFn10) Critical Interrupt PCI PERR - Asserted 63028 2014/06/15 19:09:45 Bus03(DevFn00) Critical Interrupt PCI PERR - Asserted 63029 2014/06/15 19:09:46 Bus00(DevFn12) Critical Interrupt PCI PERR - Asserted 63030 2014/06/15 19:10:05 Bus02(DevFn00) Critical Interrupt PCI PERR - Asserted 63031 2014/06/15 19:10:06 Bus00(DevFn10) Critical Interrupt PCI PERR - Asserted 63032 2014/06/15 19:10:06 Bus03(DevFn00) Critical Interrupt PCI PERR - Asserted 63033 2014/06/15 19:10:07 Bus00(DevFn12) Critical Interrupt PCI PERR - Asserted
pci info
Running 'pciinfo -lve' shows errors on the external PCIe buses.
mps0@pci0:2:0:0: class=0x010700 card=0x30201000 chip=0x00721000 rev=0x03 hdr=0x00 vendor = 'LSI Logic / Symbios Logic' device = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]' class = mass storage subclass = SAS PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error mps1@pci0:3:0:0: class=0x010700 card=0x30201000 chip=0x00721000 rev=0x03 hdr=0x00 vendor = 'LSI Logic / Symbios Logic' device = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]' class = mass storage subclass = SAS PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb0@pci0:4:0:0: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb1@pci0:4:0:1: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb2@pci0:4:0:2: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb3@pci0:4:0:3: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error ix0@pci0:6:0:0: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Controller 10 Gigabit X540-AT2' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error ix1@pci0:6:0:1: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Controller 10 Gigabit X540-AT2' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error isci0@pci0:8:0:0: class=0x010700 card=0x1d6b8086 chip=0x1d6b8086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg 4-Port SATA Storage Control Unit' class = mass storage subclass = SAS PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error
Links
- http://www.freebsd.org/cgi/man.cgi?pciconf(8)
- https://github.com/freebsd/freebsd-head/blob/master/usr.sbin/pciconf/err.c
- https://www.kernel.org/doc/Documentation/PCI/pcieaer-howto.txt
Appendices
bios configuration
The following options are enabled:
- PERR# Generation
- SERR# Generation
pciconf
# pciconf -lve hostb0@pci0:0:0:0: class=0x060000 card=0x3c008086 chip=0x3c008086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMI2' class = bridge subclass = HOST-PCI pcib1@pci0:0:1:0: class=0x060400 card=0x3c028086 chip=0x3c028086 rev=0x07 hdr=0x01 vendor = 'Intel Corporation' device = 'Sandy Bridge IIO PCI Express Root Port 1a' class = bridge subclass = PCI-PCI pcib2@pci0:0:2:0: class=0x060400 card=0x3c048086 chip=0x3c048086 rev=0x07 hdr=0x01 vendor = 'Intel Corporation' device = 'Sandy Bridge IIO PCI Express Root Port 2a' class = bridge subclass = PCI-PCI pcib3@pci0:0:2:2: class=0x060400 card=0x3c068086 chip=0x3c068086 rev=0x07 hdr=0x01 vendor = 'Intel Corporation' device = 'Sandy Bridge IIO PCI Express Root Port 2c' class = bridge subclass = PCI-PCI pcib4@pci0:0:3:0: class=0x060400 card=0x3c088086 chip=0x3c088086 rev=0x07 hdr=0x01 vendor = 'Intel Corporation' device = 'Sandy Bridge IIO PCI Express Root Port 3a in PCI Express Mode' class = bridge subclass = PCI-PCI pcib5@pci0:0:3:2: class=0x060400 card=0x3c0a8086 chip=0x3c0a8086 rev=0x07 hdr=0x01 vendor = 'Intel Corporation' device = 'Sandy Bridge IIO PCI Express Root Port 3c' class = bridge subclass = PCI-PCI none0@pci0:0:4:0: class=0x088000 card=0x3c208086 chip=0x3c208086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 0' class = base peripheral none1@pci0:0:4:1: class=0x088000 card=0x3c218086 chip=0x3c218086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 1' class = base peripheral none2@pci0:0:4:2: class=0x088000 card=0x3c228086 chip=0x3c228086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 2' class = base peripheral none3@pci0:0:4:3: class=0x088000 card=0x3c238086 chip=0x3c238086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 3' class = base peripheral none4@pci0:0:4:4: class=0x088000 card=0x3c248086 chip=0x3c248086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 4' class = base peripheral none5@pci0:0:4:5: class=0x088000 card=0x3c258086 chip=0x3c258086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 5' class = base peripheral none6@pci0:0:4:6: class=0x088000 card=0x3c268086 chip=0x3c268086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 6' class = base peripheral none7@pci0:0:4:7: class=0x088000 card=0x3c278086 chip=0x3c278086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DMA Channel 7' class = base peripheral none8@pci0:0:5:0: class=0x088000 card=0x3c288086 chip=0x3c288086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Address Map, VTd_Misc, System Management' class = base peripheral none9@pci0:0:5:2: class=0x088000 card=0x3c2a8086 chip=0x3c2a8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Control Status and Global Errors' class = base peripheral ioapic0@pci0:0:5:4: class=0x080020 card=0x3c2c8086 chip=0x3c2c8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge I/O APIC' class = base peripheral subclass = interrupt controller pcib6@pci0:0:17:0: class=0x060400 card=0x00008086 chip=0x1d3e8086 rev=0x06 hdr=0x01 vendor = 'Intel Corporation' device = 'Patsburg PCI Express Virtual Root Port' class = bridge subclass = PCI-PCI none10@pci0:0:22:0: class=0x078000 card=0x066415d9 chip=0x1d3a8086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg MEI Controller' class = simple comms none11@pci0:0:22:1: class=0x078000 card=0x066415d9 chip=0x1d3b8086 rev=0x05 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg MEI Controller' class = simple comms ehci0@pci0:0:26:0: class=0x0c0320 card=0x066415d9 chip=0x1d2d8086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg USB2 Enhanced Host Controller' class = serial bus subclass = USB ehci1@pci0:0:29:0: class=0x0c0320 card=0x066415d9 chip=0x1d268086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg USB2 Enhanced Host Controller' class = serial bus subclass = USB pcib7@pci0:0:30:0: class=0x060401 card=0x066415d9 chip=0x244e8086 rev=0xa6 hdr=0x01 vendor = 'Intel Corporation' device = '82801 PCI Bridge' class = bridge subclass = PCI-PCI isab0@pci0:0:31:0: class=0x060100 card=0x066415d9 chip=0x1d418086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg LPC Controller' class = bridge subclass = PCI-ISA ahci0@pci0:0:31:2: class=0x010601 card=0x066415d9 chip=0x1d028086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg 6-Port SATA AHCI Controller' class = mass storage subclass = SATA none12@pci0:0:31:3: class=0x0c0500 card=0x066415d9 chip=0x1d228086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg SMBus Host Controller' class = serial bus subclass = SMBus none13@pci0:0:31:6: class=0x118000 card=0x066415d9 chip=0x1d248086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg Thermal Management Controller' class = dasp mps0@pci0:2:0:0: class=0x010700 card=0x30201000 chip=0x00721000 rev=0x03 hdr=0x00 vendor = 'LSI Logic / Symbios Logic' device = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]' class = mass storage subclass = SAS PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error mps1@pci0:3:0:0: class=0x010700 card=0x30201000 chip=0x00721000 rev=0x03 hdr=0x00 vendor = 'LSI Logic / Symbios Logic' device = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]' class = mass storage subclass = SAS PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb0@pci0:4:0:0: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb1@pci0:4:0:1: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb2@pci0:4:0:2: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error igb3@pci0:4:0:3: class=0x020000 card=0x00018086 chip=0x15218086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'I350 Gigabit Network Connection' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error ix0@pci0:6:0:0: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Controller 10 Gigabit X540-AT2' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error ix1@pci0:6:0:1: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Controller 10 Gigabit X540-AT2' class = network subclass = ethernet PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error isci0@pci0:8:0:0: class=0x010700 card=0x1d6b8086 chip=0x1d6b8086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg 4-Port SATA Storage Control Unit' class = mass storage subclass = SAS PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error none14@pci0:8:0:3: class=0x0c0500 card=0x1d708086 chip=0x1d708086 rev=0x06 hdr=0x00 vendor = 'Intel Corporation' device = 'Patsburg SMBus Controller 0' class = serial bus subclass = SMBus vgapci0@pci0:9:3:0: class=0x030000 card=0x066415d9 chip=0x0532102b rev=0x0a hdr=0x00 vendor = 'Matrox Graphics, Inc.' device = 'MGA G200eW WPCM450' class = display subclass = VGA none15@pci0:255:8:0: class=0x088000 card=0x00008086 chip=0x3c808086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge QPI Link 0' class = base peripheral none16@pci0:255:8:3: class=0x088000 card=0x00008086 chip=0x3c838086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge QPI Link Reut 0' class = base peripheral none17@pci0:255:8:4: class=0x088000 card=0x00008086 chip=0x3c848086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge QPI Link Reut 0' class = base peripheral none18@pci0:255:9:0: class=0x088000 card=0x00008086 chip=0x3c908086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge QPI Link 1' class = base peripheral none19@pci0:255:9:3: class=0x088000 card=0x00008086 chip=0x3c938086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge QPI Link Reut 1' class = base peripheral none20@pci0:255:9:4: class=0x088000 card=0x00008086 chip=0x3c948086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge QPI Link Reut 1' class = base peripheral none21@pci0:255:10:0: class=0x088000 card=0x00008086 chip=0x3cc08086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Power Control Unit 0' class = base peripheral none22@pci0:255:10:1: class=0x088000 card=0x00008086 chip=0x3cc18086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Power Control Unit 1' class = base peripheral none23@pci0:255:10:2: class=0x088000 card=0x00008086 chip=0x3cc28086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Power Control Unit 2' class = base peripheral none24@pci0:255:10:3: class=0x088000 card=0x00008086 chip=0x3cd08086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Power Control Unit 3' class = base peripheral none25@pci0:255:11:0: class=0x088000 card=0x00008086 chip=0x3ce08086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Interrupt Control Registers' class = base peripheral none26@pci0:255:11:3: class=0x088000 card=0x00008086 chip=0x3ce38086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Semaphore and Scratchpad Configuration Registers' class = base peripheral none27@pci0:255:12:0: class=0x088000 card=0x00008086 chip=0x3ce88086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Unicast Register 0' class = base peripheral none28@pci0:255:12:1: class=0x088000 card=0x00008086 chip=0x3ce88086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Unicast Register 0' class = base peripheral none29@pci0:255:12:6: class=0x088000 card=0x00008086 chip=0x3cf48086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller System Address Decoder 0' class = base peripheral none30@pci0:255:12:7: class=0x088000 card=0x00008086 chip=0x3cf68086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge System Address Decoder' class = base peripheral none31@pci0:255:13:0: class=0x088000 card=0x00008086 chip=0x3ce88086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Unicast Register 0' class = base peripheral none32@pci0:255:13:1: class=0x088000 card=0x00008086 chip=0x3ce88086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Unicast Register 0' class = base peripheral none33@pci0:255:13:6: class=0x088000 card=0x00008086 chip=0x3cf58086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller System Address Decoder 1' class = base peripheral none34@pci0:255:14:0: class=0x088000 card=0x00000000 chip=0x3ca08086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Processor Home Agent' class = base peripheral none35@pci0:255:14:1: class=0x110100 card=0x066415d9 chip=0x3c468086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Processor Home Agent Performance Monitoring' class = dasp none36@pci0:255:15:0: class=0x088000 card=0x00008086 chip=0x3ca88086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Registers' class = base peripheral none37@pci0:255:15:1: class=0x088000 card=0x00008086 chip=0x3c718086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller RAS Registers' class = base peripheral none38@pci0:255:15:2: class=0x088000 card=0x00008086 chip=0x3caa8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Target Address Decoder 0' class = base peripheral none39@pci0:255:15:3: class=0x088000 card=0x00008086 chip=0x3cab8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Target Address Decoder 1' class = base peripheral none40@pci0:255:15:4: class=0x088000 card=0x00008086 chip=0x3cac8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Target Address Decoder 2' class = base peripheral none41@pci0:255:15:5: class=0x088000 card=0x00008086 chip=0x3cad8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Target Address Decoder 3' class = base peripheral none42@pci0:255:15:6: class=0x088000 card=0x00008086 chip=0x3cae8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Target Address Decoder 4' class = base peripheral none43@pci0:255:16:0: class=0x088000 card=0x00008086 chip=0x3cb08086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Channel 0-3 Thermal Control 0' class = base peripheral none44@pci0:255:16:1: class=0x088000 card=0x00008086 chip=0x3cb18086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Channel 0-3 Thermal Control 1' class = base peripheral none45@pci0:255:16:2: class=0x088000 card=0x00008086 chip=0x3cb28086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller ERROR Registers 0' class = base peripheral none46@pci0:255:16:3: class=0x088000 card=0x00008086 chip=0x3cb38086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller ERROR Registers 1' class = base peripheral none47@pci0:255:16:4: class=0x088000 card=0x00008086 chip=0x3cb48086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Channel 0-3 Thermal Control 2' class = base peripheral none48@pci0:255:16:5: class=0x088000 card=0x00008086 chip=0x3cb58086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller Channel 0-3 Thermal Control 3' class = base peripheral none49@pci0:255:16:6: class=0x088000 card=0x00008086 chip=0x3cb68086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller ERROR Registers 2' class = base peripheral none50@pci0:255:16:7: class=0x088000 card=0x00008086 chip=0x3cb78086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Integrated Memory Controller ERROR Registers 3' class = base peripheral none51@pci0:255:17:0: class=0x088000 card=0x00008086 chip=0x3cb88086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge DDRIO' class = base peripheral none52@pci0:255:19:0: class=0x088000 card=0x00008086 chip=0x3ce48086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge R2PCIe' class = base peripheral none53@pci0:255:19:1: class=0x110100 card=0x00008086 chip=0x3c438086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Ring to PCI Express Performance Monitor' class = dasp none54@pci0:255:19:4: class=0x110100 card=0x00008086 chip=0x3ce68086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge QuickPath Interconnect Agent Ring Registers' class = dasp none55@pci0:255:19:5: class=0x110100 card=0x00008086 chip=0x3c448086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Ring to QuickPath Interconnect Link 0 Performance Monitor' class = dasp none56@pci0:255:19:6: class=0x088000 card=0x00008086 chip=0x3c458086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sandy Bridge Ring to QuickPath Interconnect Link 1 Performance Monitor' class = base peripheral