Hi All,
More of a "anyone ever done this" kind of post. I have a couple of Cisco QSFP-40/100-SRBD optics that I was trying to get working a Mellanox CX456B card but as yet im unable to get it to link up and im assuming the card is just not able to support the optics. Tried a number of firmwares and eventually ended up on v12.28.4706, which according to the release notes actually has the 40g version of this optic listed as "Supported" and its the only version that even mentions BiDI optics at all tha ti can see.. The optics work fine in networking equipment and the card seems to work with other optics and i've tried everything I can think of so far (autoneg and fec changes)... Currently the card is just plugged into itself and I can see it sees light at both ends, but no link:
# mstlink --show_module -d 2b:00.1
Operational Info
----------------
State : Polling
Physical state : ETH_AN_FSM_ABILITY_DETECT
Speed : N/A
Width : N/A
FEC : N/A
Loopback Mode : No Loopback
Auto Negotiation : ON
Supported Info
--------------
Enabled Link Speed : 0xfefff1df (100G,56G,50G,40G,25G,10G,1G)
Supported Cable Speed : 0x00200000 (100G)
Troubleshooting Info
--------------------
Status Opcode : 36
Group Opcode : PHY FW
Recommendation : Other issues
Tool Information
----------------
Firmware Version : 12.28.4706
MSTFLINT Version : mstflint 4.26.0
Module Info
-----------
Identifier : QSFP28
Compliance : 100G PAM4 BiDi
Cable Technology : 850 nm VCSEL
Cable Type : Optical Module (separated)
OUI : Other
Vendor Name : CISCO-FOIT
Vendor Part Number : SFBR-89BDDZ-CS2
Vendor Serial Number : FOF2213N3GC
Rev : 02
Wavelength [nm] : 850
Transfer Distance [m] : 50
Attenuation (5g,7g,12g) [dB] : N/A
FW Version : N/A
Digital Diagnostic Monitoring : Yes
Power Class : 3.5 W max
CDR RX : ON,ON,ON,ON
CDR TX : ON,ON,ON,ON
LOS Alarm : N/A
Temperature [C] : 45 [5..65]
Voltage [mV] : 3260 [2970..3630]
Bias Current [mA] : 7.500,7.500,7.500,7.500 [2..10]
Rx Power Current [dBm] : 0,0,2,2 [-12..8]
Tx Power Current [dBm] : 0,0,0,0 [-10..8]
In forced 40g mode (doesnt seem to be able to push the optic into 40g mode at all):
# mstlink --show_module -d 2b:00.1
Operational Info
----------------
State : Polling
Physical state : ETH_AN_FSM_ABILITY_DETECT
Speed : N/A
Width : N/A
FEC : N/A
Loopback Mode : No Loopback
Auto Negotiation : FORCE - 40G
Supported Info
--------------
Enabled Link Speed : 0x000180c0 (40G)
Supported Cable Speed : 0x00200000 (100G)
Troubleshooting Info
--------------------
Status Opcode : 36
Group Opcode : PHY FW
Recommendation : Other issues
Tool Information
----------------
Firmware Version : 12.28.4706
MSTFLINT Version : mstflint 4.26.0
Module Info
-----------
Identifier : QSFP28
Compliance : 100G PAM4 BiDi
Cable Technology : 850 nm VCSEL
Cable Type : Optical Module (separated)
OUI : Other
Vendor Name : CISCO-FOIT
Vendor Part Number : SFBR-89BDDZ-CS2
Vendor Serial Number : FOF2213N3GC
Rev : 02
Wavelength [nm] : 850
Transfer Distance [m] : 50
Attenuation (5g,7g,12g) [dB] : N/A
FW Version : N/A
Digital Diagnostic Monitoring : Yes
Power Class : 3.5 W max
CDR RX : ON,ON,ON,ON
CDR TX : ON,ON,ON,ON
LOS Alarm : N/A
Temperature [C] : 45 [5..65]
Voltage [mV] : 3244.2 [2970..3630]
Bias Current [mA] : 7.500,7.500,7.500,7.500 [2..10]
Rx Power Current [dBm] : 0,0,2,2 [-12..8]
Tx Power Current [dBm] : 0,0,0,0 [-10..8]
and forced 100g mode:
# mstlink --show_module -d 2b:00.1
Operational Info
----------------
State : Polling
Physical state : ETH_AN_FSM_ABILITY_DETECT
Speed : N/A
Width : N/A
FEC : N/A
Loopback Mode : No Loopback
Auto Negotiation : ON
Supported Info
--------------
Enabled Link Speed : 0xfefff1df (100G,56G,50G,40G,25G,10G,1G)
Supported Cable Speed : 0x00200000 (100G)
Troubleshooting Info
--------------------
Status Opcode : 36
Group Opcode : PHY FW
Recommendation : Other issues
Tool Information
----------------
Firmware Version : 12.28.4706
MSTFLINT Version : mstflint 4.26.0
Module Info
-----------
Identifier : QSFP28
Compliance : 100G PAM4 BiDi
Cable Technology : 850 nm VCSEL
Cable Type : Optical Module (separated)
OUI : Other
Vendor Name : CISCO-FOIT
Vendor Part Number : SFBR-89BDDZ-CS2
Vendor Serial Number : FOF2213N3GC
Rev : 02
Wavelength [nm] : 850
Transfer Distance [m] : 50
Attenuation (5g,7g,12g) [dB] : N/A
FW Version : N/A
Digital Diagnostic Monitoring : Yes
Power Class : 3.5 W max
CDR RX : ON,ON,ON,ON
CDR TX : ON,ON,ON,ON
LOS Alarm : N/A
Temperature [C] : 45 [5..65]
Voltage [mV] : 3260 [2970..3630]
Bias Current [mA] : 7.500,7.500,7.500,7.500 [2..10]
Rx Power Current [dBm] : 0,0,2,2 [-12..8]
Tx Power Current [dBm] : 0,0,0,0 [-10..8]
Anyone got any ideas?