What’s the ‘freakiest’ event or situation you’ve experienced in production?

  • Disaster@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Having to literally build my own network to work off of because the organization’s network is locked down to un-usability for anything. I also now hate T-mobile’s CGNAT with a passion that I never thought I could feel over a networking architecture decision.

    • manifex@sh.itjust.worksOPM
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Look into VPN-based network overlays if you’re stuck behind a DNS or NAT based protective network.

      It’s why I always have my hotspot on me.

      • Disaster@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I was looking at getting a wireguard up with policy based routing, but apparently they have something in there which messes that up too, leading a bunch of folks to try using openVPN in https mode. At some point you just have to stop jumping through hoops and ask why you’re giving business to an organization which simply doesn’t deliver the bare minimum for no discernable good reason.

        Also the tower reception is flapping all over the place from the hotspot in my location, so I’m a very unhappy bunny.

        • manifex@sh.itjust.worksOPM
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I hear ya. I had a VeloCloud engineer told me they don’t support wildcard domain names. smacks head

  • [email protected]@lemmy.ca
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    My first job at a university working in the data centre. Came across one of our water cooled super computers spewing water all over the cluster. It’s amazing how frequently water sneaks into data centers.

  • PCChipsM922U@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    1
    ·
    1 year ago

    Once one of the backbone Zyxels stopped working, so we went to the floor on which it was located. We look in the rack, as expected no blinking lights.

    We didn’t have a spare and I’m into electronics, so in order to keep things going, I decided to take a look at it. Open it up… jeus fucking christ 😲… a swarm of roaches rushes in all directions! I just rushed out and told the cleaning ladies to get a vacuum cleaner in there ASAP. They did and got most of them, but eventually we did have a minor roach infestation in the office and had to disinsect a few times.

    After the storm was over, I took a look at it… apparently, they laid eggs underneath the PSU and when the eggs started hatching, they short circuited it. The PSU was fried. Luckily, the output voltage of the PSU was marked on the PCB - 12V. So, I just modded an ATX to power the switch. Still works like that to this day, lol 😂.