refactor: refactor to `spdlog-rs` instead of `tracing` #538

NotEvenANeko · 2025-09-05T07:17:07Z

Refactor tracing to spdlog-rs for logging, which is behind the spdlog-rs feature flag, and tracing codes should be removed before this PR gets merged.

The original tracing logger is behind the tracing feature flag now.

Haven't written comments yet...

And blocked by SpriteOvO/spdlog-rs#93 .

This closes #486 .

cc @SpriteOvO

eatradish · 2025-09-05T07:21:55Z

Initially it looks good, but what I'm wondering is whether we should just replace the tracing family directly with spdlog instead of optional?

NotEvenANeko · 2025-09-05T07:24:32Z

Yeah we should replace tracing with spdlog, current codes is just convenient for debugging. I'll delete the tracing codes after spdlog parts are good to go.

SpriteOvO

Just a brief look and most of it seems to be fine. I'll probably merge SpriteOvO/spdlog-rs#93 in the next couple days. In the meantime, you can try removing the use of tracing from oma entirely.

SpriteOvO · 2025-09-06T23:06:59Z

src/main.rs

+    let rotating_sink = if let Ok(log_file) = &log_file {
+        Some(
+            AsyncPoolSink::builder()
+                .sink(Arc::new(
+                    RotatingFileSink::builder()
+                        .base_path(&log_file)
+                        .formatter(formatter.clone())
+                        .rotation_policy(RotationPolicy::Hourly)
+                        .build()
+                        .unwrap(),
+                ))
+                .overflow_policy(spdlog::sink::OverflowPolicy::DropIncoming)
+                .build()
+                .unwrap(),
+        )
+    } else {
+        None
+    };


The RotatingFileSink should not rotate hourly as oma did not do so. Could try RotationPolicy::FileSize(u64::MAX) and set max_files(config.save_log_count()).

Fixed, file size is set to 10MB.

SpriteOvO · 2025-09-09T20:25:00Z

src/main.rs

+            .join("oma")
+    };
+
+    let log_file = create_log_file(&log_dir);


Creating variants for filenames has been done internally by spdlog-rs, so oma no longer needs to create names manually.

SpriteOvO · 2025-09-17T04:04:24Z

FYI, SpriteOvO/spdlog-rs#93 is merged.

NotEvenANeko · 2025-09-17T04:52:13Z

I'll work on this PR tomorrow.

NotEvenANeko · 2025-09-19T07:58:43Z

spdlog-rs is set to main-dev branch now.

SpriteOvO · 2025-09-21T16:34:28Z

oma-console/src/print.rs

+///     StdStreamSink::builder().formatter(Box::new(OmaLayer::default())).build().unwrap()
+/// )).build().unwrap();


It is preferred that unwrap() not be used inside an example, and some of the error handling components be hidden if they make the example too difficult to follow.

Quote from https://doc.rust-lang.org/rustdoc/write-documentation/what-to-include.html?highlight=unwrap#examples

SpriteOvO · 2025-09-21T16:39:47Z

oma-console/src/print.rs

+            dest.write_str(&console::strip_ansi_codes(record.payload()))?;
+        }
+
+        dest.write_char('\n')?;


Also, we should write out the key-values of the record here.

Where we place the KV data? Just append it to the end of the log? 🤔

And it looks messy if we output the KV data in stdout.

oma/oma-console/src/print.rs

Lines 210 to 269 in 24424a1

let mut visitor = OmaRecorder(BTreeMap::new());

event.record(&mut visitor);

for (k, v) in visitor.0 {

if k == "message" {

if self.with_ansi {

self.writer.writeln(&prefix, &v).ok();

} else {

self.writer

.writeln(&prefix, &console::strip_ansi_codes(&v))

.ok();

}

}

}

}

}

/// OmaRecorder

/// `OmaRecorder` is used for recording oma-style logs.

///

/// # Example:

/// ```ignore

/// let mut visitor = OmaRecorder(BTreeMap::new());

/// event.record(&mut visitor);

/// for (k, v) in visitor.0 {

/// if k == "message" {

/// self.writer.writeln(&prefix, &v).ok();

/// }

/// }

/// ```

struct OmaRecorder<'a>(BTreeMap<&'a str, String>);

impl tracing::field::Visit for OmaRecorder<'_> {

fn record_f64(&mut self, field: &Field, value: f64) {

self.0.insert(field.name(), value.to_string());

}

fn record_i64(&mut self, field: &Field, value: i64) {

self.0.insert(field.name(), value.to_string());

}

fn record_u64(&mut self, field: &Field, value: u64) {

self.0.insert(field.name(), value.to_string());

}

fn record_bool(&mut self, field: &Field, value: bool) {

self.0.insert(field.name(), value.to_string());

}

fn record_str(&mut self, field: &Field, value: &str) {

self.0.insert(field.name(), value.to_string());

}

fn record_error(&mut self, field: &Field, value: &(dyn std::error::Error + 'static)) {

self.0.insert(field.name(), format!("{value:#?}"));

}

fn record_debug(&mut self, field: &Field, value: &dyn std::fmt::Debug) {

self.0.insert(field.name(), format!("{value:#?}"));

}

}

Since before this PR, oma is already used OmaRecorder to write KV to the end of a log record, I think keeping the behavior should be fine.

Some dep crates may completely use KV to recording variables instead of formatting into the payload.

~~Oops, seems I understand it incorrectly, oma only cares value with "message" as the key.~~

~~My bad, let's just keep the old behavior. You can use KeyValues::get method to get value with "message" as the key.~~

EDIT: NVM, tracing uses "message" KV to store payload, the current code works the same as before already, so looks good to me.

I'll leave the original implementation here, which is not to print KV

The with_kv field is added to formatter but unused if we need to print KV later.

SpriteOvO · 2025-09-21T16:45:06Z

src/main.rs

+// FIXME: `spdlog::error` is conflict with `mod error`
+use spdlog::{
+    Level, LevelFilter, Logger, debug, default_logger, error as error2, info, set_default_logger,


Yes, this is definitely a mistake in spdlog-rs, I haven't figure out the right way to fix it. For now, we can import the error! macro from spdlog::prelude::error.

use spdlog:prelude:error has the same issue

Hmm, so it's not a conflict between spdlog::error mod and spdlog::error! macro? So, if not, then it's probably should not consider as a mistake from spdlog-rs.

Okay, let's just keep the alias here. I'll suggest another name error as err.

SpriteOvO · 2025-09-21T16:48:33Z

src/main.rs

+    .to_string_lossy()
+    .to_string();


Hmm, since spdlog-rs accepts a path type instead of a string type, I think we should place the conversion to the end of the function.

SpriteOvO · 2025-09-21T16:51:25Z

src/main.rs

+        let level_filter = LevelFilter::MoreSevereEqual(Level::Info);

-    if !debug && !dry_run {
-        let no_i18n_embd: EnvFilter = "i18n_embed=off,info".parse().unwrap();


Looks like we have not setup the log crate proxy in this PR. The logs from log crate will only be available after we set it up via spdlog::init_log_crate_proxy().

And we really should migrate env filters, but spdlog-rs currently does not support filter logs from log crate, we will probably support this feature in the next minor release.

For now, is it acceptable for not migrate this at the moment? @eatradish

Looks like we have not setup the log crate proxy in this PR. The logs from log crate will only be available after we set it up via spdlog::init_log_crate_proxy().

And we really should migrate env filters, but spdlog-rs currently does not support filter logs from log crate, we will probably support this feature in the next minor release.

For now, is it acceptable for not migrate this at the moment? @eatradish

Yes, but subsequent releases may include this feature as a breaking

init_log_crate_proxy() added.

SpriteOvO · 2025-10-02T20:33:37Z

FYI, we have just released spdlog-rs v0.5.0. You could target the dependency spdlog-rs in this PR to the crates.io registry now.

NotEvenANeko · 2025-10-02T21:37:42Z

Updated to v0.5.0

SpriteOvO reviewed Sep 9, 2025

View reviewed changes

NotEvenANeko force-pushed the refactor/spdlog branch from 3ef6995 to 95052c9 Compare September 19, 2025 08:13

SpriteOvO reviewed Sep 21, 2025

View reviewed changes

NotEvenANeko force-pushed the refactor/spdlog branch from 95052c9 to c0266fb Compare October 2, 2025 21:35

refactor: refactor to spdlog-rs instead of tracing

73ba4d9

NotEvenANeko added 5 commits October 3, 2025 05:37

refactor: remove tracing codes

b0a04ef

refactor: update rotation policy for logger

16f1060

chore: upgrade to spdlog-rs 0.5.0

fe135c8

refactor: add log proxy, and with_kv field to OmaFormatter

2bcdd31

refactor: simplify init_logger return type

c0266fb

		/// StdStreamSink::builder().formatter(Box::new(OmaLayer::default())).build().unwrap()
		/// )).build().unwrap();

	let mut visitor = OmaRecorder(BTreeMap::new());
	event.record(&mut visitor);

	for (k, v) in visitor.0 {
	if k == "message" {
	if self.with_ansi {
	self.writer.writeln(&prefix, &v).ok();
	} else {
	self.writer
	.writeln(&prefix, &console::strip_ansi_codes(&v))
	.ok();
	}
	}
	}
	}
	}
	/// OmaRecorder
	/// `OmaRecorder` is used for recording oma-style logs.
	///
	/// # Example:
	/// ```ignore
	/// let mut visitor = OmaRecorder(BTreeMap::new());
	/// event.record(&mut visitor);
	/// for (k, v) in visitor.0 {
	/// if k == "message" {
	/// self.writer.writeln(&prefix, &v).ok();
	/// }
	/// }
	/// ```
	struct OmaRecorder<'a>(BTreeMap<&'a str, String>);

	impl tracing::field::Visit for OmaRecorder<'_> {
	fn record_f64(&mut self, field: &Field, value: f64) {
	self.0.insert(field.name(), value.to_string());
	}

	fn record_i64(&mut self, field: &Field, value: i64) {
	self.0.insert(field.name(), value.to_string());
	}

	fn record_u64(&mut self, field: &Field, value: u64) {
	self.0.insert(field.name(), value.to_string());
	}

	fn record_bool(&mut self, field: &Field, value: bool) {
	self.0.insert(field.name(), value.to_string());
	}

	fn record_str(&mut self, field: &Field, value: &str) {
	self.0.insert(field.name(), value.to_string());
	}

	fn record_error(&mut self, field: &Field, value: &(dyn std::error::Error + 'static)) {
	self.0.insert(field.name(), format!("{value:#?}"));
	}

	fn record_debug(&mut self, field: &Field, value: &dyn std::fmt::Debug) {
	self.0.insert(field.name(), format!("{value:#?}"));
	}
	}

refactor: refactor to spdlog-rs instead of tracing #538

Are you sure you want to change the base?

refactor: refactor to spdlog-rs instead of tracing #538

Uh oh!

Conversation

NotEvenANeko commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eatradish commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

NotEvenANeko commented Sep 5, 2025

Uh oh!

SpriteOvO left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

SpriteOvO commented Sep 17, 2025

Uh oh!

NotEvenANeko commented Sep 17, 2025

Uh oh!

NotEvenANeko commented Sep 19, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

SpriteOvO Oct 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

SpriteOvO Oct 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

SpriteOvO Oct 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

SpriteOvO commented Oct 2, 2025

Uh oh!

NotEvenANeko commented Oct 2, 2025

Uh oh!

Uh oh!

refactor: refactor to `spdlog-rs` instead of `tracing` #538

refactor: refactor to `spdlog-rs` instead of `tracing` #538

NotEvenANeko commented Sep 5, 2025 •

edited

Loading

eatradish commented Sep 5, 2025 •

edited

Loading

SpriteOvO Oct 2, 2025 •

edited

Loading

SpriteOvO Oct 2, 2025 •

edited

Loading

SpriteOvO Oct 2, 2025 •

edited

Loading