MQTT: No content available at /docs/integrate

[amotl]

Documentation feedback

Integrations

• Page title: Integrations with CrateDB
• Page URL: https://cratedb.com/docs/guide/integrate/
• Source: https://github.com/crate/cratedb-guide/blob/main/docs/integrate/index.md

Metrics and Telemetry (new location)

• Page title: Monitoring and Metrics with CrateDB
• Page URL: https://cratedb.com/docs/guide/integrate/metrics/
• Source: https://github.com/crate/cratedb-guide/blob/main/docs/integrate/metrics/index.md

Metrics and Telemetry (previous location)

• Page title: Monitoring and Metrics with CrateDB
• Page URL: https://cratedb.com/docs/crate/clients-tools/en/latest/integrate/metrics.html
• Source: https://github.com/crate/crate-clients-tools/blob/main/docs/integrate/metrics.md

---

Problem

Other than a very spurious spot on the pages referenced above, the documentation currently does not include any tangible content about how to integrate well with MQTT at all. This dearly needs to be changed, and we are running relevant tracking tickets about it quite a while already.

• https://github.com/crate/ecosystem/issues/10
• https://github.com/crate/ecosystem/issues/30
• https://github.com/crate/devrel/issues/53

Trivia

Did you know CrateDB included an ingest framework, specifically because MQTT, which was removed later again? It's so sad that we haven't been able to unlock the MQTT topic more properly up to day.

History

@amotl said on Feb 2, 2024 at https://github.com/crate/ecosystem/issues/30:

There is not much support and love for MQTT at Crate.io. The relationship needs a renovation.

[amotl]

Update 2025-08

Problem

We know some partnership work has been done with @hivemq, but other than an article contributed by @wierdvanderhaar the other day, we didn't receive much news about the topic, and not much else was done to otherwise fill the gap.

Please tell us about any sensible resources you can discover about CrateDB+MQTT in case we are missing them -- thanks!

Thoughts

We are receiving elevated interests about unlocking MQTT with CrateDB, which we appreciate very much. 💯
Now that we dearly want to fill the gap(s), what can be done quickly?

One immediate tangible proposal would be to derive any quick ad hoc data nozzle program written in Python from existing resources that relays telemetry data packets in JSON format into the database, received from an MQTT topic subscription, without many bells and whistles, right?

Kotori

We've mentioned Kotori on a few occasions...

• https://github.com/crate/ecosystem/issues/3
• https://github.com/crate/tech-content/issues/144
• https://github.com/crate/ecosystem/issues/30

... where there is a patch pending to unlock CrateDB.

• [CrateDB] Add support for data acquisition and data export daq-tools/kotori#148

MQTT tools

We are a member of @mqtt-tools together with the main author of Eclipse Mosquitto, Roger Light. Over there, we are maintaining a few applications where CrateDB could also be spotlighted, or derive ideas about its MQTT presentation from. @simonprickett to the rescue! ;]

[amotl]

Now that we dearly want to fill the gap(s), what can be done quickly?

LorryStream to the rescue?

One immediate tangible proposal would be to derive any quick ad hoc data nozzle program written in Python from existing resources that relays telemetry data packets in JSON format into the database, received from an MQTT topic subscription, without many bells and whistles, right?

Oh, it looks like LorryStream can do that already. If that works well, we might be lucky, and would be able to select that as the most generic yet polished interface, so what is left would be to improve documentation around it. Is anyone up for user-testing this guy?

• https://lorrystream.readthedocs.io/source/mqtt.html

Kotori to the rescue?

For more specialized use cases around telemetry data brokerage, we can unlock Kotori for CrateDB in one of the next iterations, as proposed above.

• [CrateDB] Add support for data acquisition and data export daq-tools/kotori#148

[amotl]

LorryStream to the rescue?

It works!

• Integrate/MQTT: Add entry point page, micro tutorial, and category item #247

[amotl]

Information about MQTT exists now.

• https://cratedb.com/docs/guide/integrate/mqtt/