Add example migrate data from influxdb v1

[ne-ray]

My example for transform data for export from influx to victoria-metrics.
Mayb write with example to readme. What do you think about it?

1. Download victoria-metrics-utils for you platform from https://github.com/VictoriaMetrics/VictoriaMetrics/releases (search release with assets files by match
   vmutils-{os}-{arch}-v{version}.tar.gz

2. unarchive file and cd to folder

3. open Chronograf and create new bucket in influxdb (for example haas)

4. run transformate data to new bucket with new measurement

from(bucket: "homeassistant/autogen")
  |> range(start: 0)
  |> map(fn: (r) => ({ r with unit_of_measurement: r._measurement, _measurement: r.domain + "." + r.entity_id }))
  |> to(bucket: "haas/autogen")

5. run copy data from new bucket to victoria-metrics

INFLUX_ADDR="http://192.168.0.2:8086"
INFLUX_USER="user"
INFLUX_PWD="password"
INFLUX_DB="haas"
VM_ADDR="http://192.168.0.2:8428"
ARG_VM_USER=""
# if you set basic auth for vm
# ARG_VM_USER="--vm-user $VM_USER"
ARG_VM_PWD=""
# if you set basic auth for vm
# ARG_VM_USER="--vm-password $VW_PWD"


./vmctl-prod influx --influx-addr $INFLUX_ADDR --influx-user $INFLUX_USER --influx-password $INFLUX_PWD --influx-database $INFLUX_DB --vm-addr $VM_ADDR $ARG_VM_USER $ARG_VM_PWD --influx-concurrency 10 --vm-concurrency 10

[denisgolius]

@ne-ray would you mind to send a PR with this guide by adding a paragraph to the README.md file? Or add a new folder "guides" and add put this guide there. WDYT?

[ne-ray]

This is well idea

[ne-ray]

okay, i will do this in week

[emign]

This helped a lot. Thank you.
For everyone doing this: Attention, this can take a LOT of time. My HA-Influxdb is about 5 years old and it is running for hours.

EDIT: to slightly increase the speed, you can concurrently read and write from/to influx/victoria using --influx-concurrency 10 --vm-concurrency 10 flags

For example with this command:

./vmctl-prod influx --influx-addr http://influx.local:8086 --influx-user influxUsername --influx-password PWPWPWPW --influx-database haDatabase --vm-addr http://victoria.local:8428 --influx-concurrency 10 --vm-concurrency 10 "" ""

[denisgolius]

@ne-ray @emign fyi: I've converted the issue to a discussion.

[emign]

Great. I am waiting for @ne-ray to make a PR. If he doesnt want, I can do it.
btw still importing :)

[ne-ray]

@emign flux command worked fast?

[emign]

No. it took ages. And I am still not sure if everything was properly migrated. Have to check that tomorrow

[ne-ray]

@emign hi. Did you check integrity data?

[emign]

It finished now.
But I cannot see any of the migrated data. Is there a away to somehow list all entries?

[ne-ray]

@emign

1. go to extensions > victoria metrics > web-interface
2. You will see VM UI
3. open Explore > Explore Cardinality
4. choose date, when have data (on selector in right top)
5. Do will you see data?

[emign]

There are a lot of (I activated the integration in homeassistant already).
But I cannot find any of the migrated data as it seems

[ne-ray]

Are you change bucket name to haDatabase?

from(bucket: "haDatabase/autogen")
  |> range(start: 0)
  |> map(fn: (r) => ({ r with unit_of_measurement: r._measurement, _measurement: r.domain + "." + r.entity_id }))
  |> to(bucket: "haas/autogen")

[ne-ray]

@emign hi. Did you move db?

[emign]

Btw. I cannot run

Why?

Sorry. I had some time off and did not check github.

I have NOT moved the DB. The code:

from(bucket: "homeassistant/autogen")
  |> range(start: 0)
  |> map(fn: (r) => ({ r with unit_of_measurement: r._measurement, _measurement: r.domain + "." + r.entity_id }))
  |> to(bucket: "toExport/autogen")

Gives me an error : error calling function "to": function "to" is not implemented. So I cannot run it.

[ne-ray]

@emign What version of influxdb do you have?

[emign]

It is this addon: https://github.com/hassio-addons/addon-influxdb
using V 1.8.10