Community Packages

Please read this before reporting a bug:
https://wiki.archlinux.org/title/Bug_reporting_guidelines

Do NOT report bugs when a package is just outdated, or it is in the AUR. Use the 'flag out of date' link on the package page, or the Mailing List.

REPEAT: Do NOT report bugs for outdated packages!
Tasklist

FS#78285 - [promtail] Journal logs no longer being sent

Attached to Project: Community Packages
Opened by bgh (bgh) - Saturday, 22 April 2023, 11:29 GMT
Last edited by Toolybird (Toolybird) - Wednesday, 26 April 2023, 21:21 GMT
Task Type Bug Report
Category Packages
Status Closed
Assigned To Jelle van der Waa (jelly)
Daurnimator (daurnimator)
Architecture All
Severity Medium
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 1
Private No

Details

Description:
Promtail instances with the journal source enabled are no longer sending journal entries to Loki. This issue appears to have first surfaced around the time the promtail package was updated to version 2.8.0.

The below warning is observed in the journal for the promtail service
`WARNING!!! Journal target was configured but support for reading the systemd journal is not compiled into this build of promtail!`

The Loki 2.8.0 upgrade guide makes note of the introduction of a new build tag called `promtail_journal_enabled` that must be passed to include journal support in the promtail binary.
https://github.com/grafana/loki/blob/release-2.8.x/docs/sources/upgrading/_index.md#the-go-build-tag-promtail_journal_enabled-was-introduced

To restore the behaviour prior to Promtail 2.8.0, it would now be necessary to set this build option.

Related issue on GitHub about the upstream binaries themselves missing the new build option. Grafana are planning to add back journal support with their next official binary release of Promtail version 2.8.1 coming soon.
https://github.com/grafana/loki/issues/9060

Additional info:
* promtail 2.8.0-1
* promtail.yaml config on sending machines includes

```yml
scrape_configs:
- job_name: journal
journal:
json: true
labels:
job: journal
```

Steps to reproduce:

* Install promtail
* In promtail.yaml, configure a Loki target to push logs to (clients: - uri:) and the journal source - https://grafana.com/docs/loki/latest/clients/promtail/configuration/#journal
* Start promtail service
* The journal stream is never received by target Loki instance and messages are displayed in journal about the promtail build lacking journal support as above
This task depends upon

Closed by  Toolybird (Toolybird)
Wednesday, 26 April 2023, 21:21 GMT
Reason for closing:  Fixed
Additional comments about closing:  promtail 2.8.1-1
Comment by bgh (bgh) - Wednesday, 26 April 2023, 11:04 GMT
Resolved after updating promtail package to 2.8.1-1. Thank you Daurnimator!

Loading...