Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

influxdb and telegraf crashing after 1/27/23 update #12

Open
m-bongio opened this issue Jan 27, 2023 · 19 comments
Open

influxdb and telegraf crashing after 1/27/23 update #12

m-bongio opened this issue Jan 27, 2023 · 19 comments

Comments

@m-bongio
Copy link

Good morning,

Overall, huge shout out and thank you for creating this...I love the visual view into how the server to doing, and how easy this container made it to setup. After updating this morning, I noticed that it isn't displaying any data (it was fine moments before I updated it), and then noticed that it appears that influxdb and telegraf crashing. Any suggestions on how to fix this? Below is the log.

text error warn system array login

[info] Initialisation started...
[info] influxdb fixed.
[info] loki fixed.
[info] telegraf fixed.
[info] promtail fixed.
[info] grafana fixed.
[info] Initialisation complete

[info] Runing apps...
[info] Run influxdb as service on port 8086
Executable /usr/bin/influxd does not exist!
[info] Run loki as daemon on port 3100
[info] Run telegraf as service
[info] Run promtail as daemon on port 9086
[info] Run grafana as service on port 3006

  • Starting Grafana Server
    ...done.
    [info] All done

[error] influxdb crashed!
[info] loki PID: 60
[info] Skip hddtemp due to USE_HDDTEMP set to no
[error] telegraf crashed!
[info] promtail PID: 75
[info] grafana PID: 91

[info] Initialisation started...
[info] influxdb fixed.
[info] loki fixed.
[info] telegraf fixed.
[info] promtail fixed.
[info] grafana fixed.
[info] Initialisation complete

[info] Runing apps...
[info] Run influxdb as service on port 8086
Executable /usr/bin/influxd does not exist!
[info] Run loki as daemon on port 3100
[info] Run telegraf as service
[info] Run promtail as daemon on port 9086
[info] Run grafana as service on port 3006

  • Starting Grafana Server
    ...done.
    [info] All done

[error] influxdb crashed!
[info] loki PID: 60
[info] Skip hddtemp due to USE_HDDTEMP set to no
[error] telegraf crashed!
[info] promtail PID: 81
[info] grafana PID: 104_

@rhcp011235
Copy link

Getting the same here

@skyn3t1337
Copy link

Seems to be a general problem. Will there be a fix? Thanks and best regards!

@ZoXx
Copy link

ZoXx commented Jan 28, 2023

Same problem here. Hope, that there will be soon a fix?

@m-bongio
Copy link
Author

Looks like there was another update this morning, but influxes and telegraf still crashed. I just rolled back to testdasi/grafana-unraid-stack:s230122 which is working fine for me.

@juan11perez
Copy link

I report the same problem

@P6g9YHK6
Copy link

P6g9YHK6 commented Jan 29, 2023

Same here...

I suppose that it is time to build the stack myself out of all the components...

@SebaGnich
Copy link

Same here...

I suppose that it is time to build the stack myself out of all the components...

Don't think that will help you really, because then you need to keep track of all the version compatibility yourself. It's a bummer you can't really see a Changelog in Unraid for any updates (can you?)..

@rhcp011235
Copy link

another update today and it still crashes

@bubba925
Copy link

Same issue. Reverted to s230122 as previously mentioned and I am good to go now.

@yorch
Copy link

yorch commented Mar 22, 2023

Tried latest from March 14 and still crashed. Reverting to s230122 did the trick.

@bobbo489
Copy link

bobbo489 commented Apr 3, 2023

I put a PR up with the fix, the cert for InfluxData changed. It just needs a merge.

@yorch
Copy link

yorch commented Apr 3, 2023

@bobbo489 can you please put the link to the PR?

@bobbo489
Copy link

bobbo489 commented Apr 5, 2023

I updated it in the static-ubuntu package, since this one everything is marked in the deprecated folder.

testdasi/static-ubuntu#1

@fapo85
Copy link

fapo85 commented Apr 10, 2023

same error with a clean install here.

[info] Run influxdb as service on port 8086
Executable /usr/bin/influxd does not exist!

@aslcmowmaejfo
Copy link

Reverting to s230122 work!

@Flummi
Copy link

Flummi commented Apr 28, 2023

where merge? :\

@SebaGnich
Copy link

I reverted to s230122 but after some time (and also clean install) again everything broke..

@dlchamp
Copy link

dlchamp commented Jun 24, 2023

Adding to this. Not entirely sure when it broke. It's been a a week or so since I last looked at my dashboard, but last night I noticed it wouldn't connect and when I looked at the logs I saw the same error:

Tried multiple versions, all broken.

  • latest
  • s230324
  • s230312
  • even s230122

Clean installing the container didn't help either. Feels like data is corrupted maybe, but I really don't want to have to recreate 4 dashboards by doing a proper clean install so I'm going to attempt to restore a a backup from last week and try again.

Edit:
Restoring a previous backup did not help.

@stefan-matic
Copy link

stefan-matic commented Apr 30, 2024

Managed to get it up and running after deleting the entire appdata.

What I noticed is that there were a bunch of files for healthcheck-failure (more than 100.000 files).
image

I couldn't even run ls inside the Grafana-Unraid-Stack directory.

Maybe these healthcheck files need to be periodically cleaned or refactored so that this doesn't happen in the future?

Edit: It seems to be creating them again every minute

image

probably related to PR#1 which needs to be merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests