How do you monitor your server containers, disks, load…?

Do you use an easy-to-use web interface? Do you do everything via SSH? Or maybe you’ve got a more complicated setup?

I want to change my setup and I’m looking for new ideas, I’ve been using Cockpit for some years and some of the plugins are really outdated (ZFS for example) and others are completely broken (docker-compose).

  • zaphod@lemmy.ca
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    2
    ·
    5 months ago

    “Huh weird, I tried to use <insert service here> and it’s not working. Welp, guess I better fix it…”

    • fatboy93@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 months ago

      This has the same energy as my spouse yelling at me because jellyfin went down

      • Passerby6497@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        5 months ago

        Or my partners greeting me in the morning “Home assistant went down again, so the lights are all manual”

        Thankfully that one is mostly solved.

  • aksdb@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 months ago

    My own server? YOLO

    At work? Grafana, KOBS, Victoria Metrics, Jaeger, OpsGenie, …

    • summerof69@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 months ago

      My own server? YOLO

      I can’t figure out whether there’s a monitoring tool called YOLO or you don’t monitor anything.

      • aksdb@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        5 months ago

        Now I am intrigued to develop one that is called YOLO.

        But just in case: no, I don’t monitor my server. If I notice something not working, I ssh into the machine and check what’s up. I don’t want to deal with another zoo of services for the monitoring part.

  • rambos@lemm.ee
    link
    fedilink
    English
    arrow-up
    3
    ·
    5 months ago

    I just use homepage as my homepage :D

    I can see simple CPU/RAM/storage stats and got widgets for almost all services, one of them is portainer so I can see if any service is stopped (most of them are running in docker). Also few services send notification on error or update

    I know its not really a monitoring tool, but it works well enough for me

  • Dran@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 months ago

    How has nobody in this thread said check_mk yet?

    It’s free, you host it yourself. It’s built off of nagios, compatible with nagios plugins, supports snmp or agent based checks. It can email, SMS, slack or discord you when something breaks, you can write your own custom checks in any language that can output to a local console… I could never imagine even looking for something else.

    • corsicanguppy@lemmy.ca
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      5 months ago

      +1 for check_mk.

      It’s got a scriptable config file that begs for automation like mgmtConfig and it does SNMP. For me, that’s it. SNMP->MQTT->SNMP next year.

    • Toribor@corndog.social
      link
      fedilink
      English
      arrow-up
      1
      ·
      5 months ago

      I started using Checkmk recently after it was mentioned here and I really like it. I’d used Zabbix a bit but was annoyed at how much work it took to get it to do what I want. Checkmk was a lot better right out of the box.

  • Concave1142@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 months ago

    Zabbix for agent / snmp based statistics.

    Uptime Kuma for up/down states with a webhook notification into Discord so I get instant alerts on my phone when one goes down.

  • sysadmin420@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    5 months ago

    I’ve been using uptime Kuma recently and it’s great but works better outside of docker.

    Inside docker I’d get a lot of false down positives from I assume docker throttling the checks.

    Plus it works with email, telegram, and matrix chat alerts. I monitor all my clients sites with it, and it’s bullet proof behind caddy.

    • thirdBreakfast@lemmy.world
      link
      fedilink
      English
      arrow-up
      0
      ·
      5 months ago

      For light touch monitoring this is my approach too. I have one instance in my network, and another on fly.io for the VPSs (my most common outage is my home internet). To make it a tiny bit stronger, I wrote a Go endpoint that exposes the disk and memory usage of a server including with mem_okay and disk_okay keywords, and I have Kuma checking those.

      I even have the two Kuma instances checking each other by making a status page and adding checks for each other’s ‘degraded’ state. I have ntfy set up on both so I get the Kuma change notifications on my iPhone. I love ntfy so much I donate to it.

      For my VPSs, this is probably not enough, so I am considering the more complicated solutions (I’ve started wanting to know things like an influx of fali2ban bans etc.)

      • sysadmin420@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        5 months ago

        I just do web hosting for clients sites and use Kuma to monitor uptime and SSL certificates.

        Ive got multiple Kuma’s running as well.

  • its_me_gb@feddit.uk
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    5 months ago

    Node exporter on hosts, OpenTelemetry collector to scrape metrics and collect logs, shipping them to Prometheus and Loki, visualising with Grafana.

    Day job is for an observability platform where we heavily encourage the use of (and also contribute) to the OpenTelemetry collector project, hence my use of it.

  • CronyAkatsuki@lemmy.cronyakatsuki.xyz
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    4 months ago

    Used to not monitor at all, but after setting up crowdsec I got completeky into prometheus + grafana system resource and security monitiring on my dedicated hetzner server.

    I also keep uptime kuma on another cheap vps to monitor the states of websites directly for issues and I have seted up watchtower to send ntfy notifications on updates so I can know an update is the one fucking everything up.

    Recently also setup restuc backups so I made it so I also get backup health check logs as ntfy notifications on my phone, which really helps me keep everything runnig.

    What I really need to also do is create prometheus/grafana alerts for additional things to get notifications on my phone for them also ( like when crowdsec starts to randomly not get any more acqusitions, so I have to restart it. Once passed over a week before I looked at grafana and caught that ).

    Note: this is all a hoby, I also don’t host anything at home out of a couple reasons, most important being internet and hardware is expensive af here so it’s simply cheaper for me to play around with vps’s and hetzner dedicated servers.

  • Decronym@lemmy.decronym.xyzB
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    4 months ago

    Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:

    Fewer Letters More Letters
    MQTT Message Queue Telemetry Transport point-to-point networking
    SSH Secure Shell for remote terminal access
    SSL Secure Sockets Layer, for transparent encryption
    TLS Transport Layer Security, supersedes SSL
    VPS Virtual Private Server (opposed to shared hosting)

    5 acronyms in this thread; the most compressed thread commented on today has 16 acronyms.

    [Thread #521 for this sub, first seen 17th Feb 2024, 17:25] [FAQ] [Full list] [Contact] [Source code]