Detected ES 8.x or above: document type will not be used #1049
Description
Problem
I am using the latest version of fluentd, fluent-plugin-elasticsearch and ES (8.14.0). I see the below error for all the logs
[debug]: #0 Detected ES 8.x or above: document type will not be used.
Please help as I couldn't find the solution yet for this
Steps to replicate
Upgrade to 8.14.0 failed
Provide example config and message
Expected Behavior or What you need to ask
... It should parse the logs and send to elasticsearch
Using Fluentd and ES plugin versions
- OS version - Latest Debain
- Bare Metal or within Docker or Kubernetes or others? Kubernetes
- Fluentd v0.12 or v0.14/v1.0 - fluentd 1.17.0
- ES plugin 3.x.y/2.x.y or 1.x.y -
NFO[0039] Running: [/bin/sh -c fluent-gem list]
abbrev (default: 0.1.1)
addressable (2.8.7)
async (1.31.0)
async-http (0.60.2)
async-io (1.43.2)
async-pool (0.6.1)
base64 (0.2.0, default: 0.1.1)
benchmark (default: 0.2.1)
bigdecimal (default: 3.1.3)
bundler (default: 2.4.19)
cgi (default: 0.3.6)
concurrent-ruby (1.3.3, 1.3.1)
console (1.25.2)
cool.io (1.8.1)
csv (default: 3.2.6)
date (default: 3.3.3)
debug (1.7.1)
delegate (default: 0.3.0)
did_you_mean (default: 1.6.3)
digest (default: 3.1.1)
domain_name (0.6.20240107)
drb (2.2.1, default: 2.1.1)
elastic-transport (8.3.2)
elasticsearch (8.14.0)
elasticsearch-api (8.14.0)
english (default: 0.7.2)
erb (default: 4.0.2)
error_highlight (default: 0.5.1)
etc (default: 1.4.2)
excon (0.110.0)
faraday (2.9.2)
faraday-excon (2.1.0)
faraday-net_http (3.1.0)
fcntl (default: 1.0.2)
ffi (1.17.0 x86_64-linux-gnu)
ffi-compiler (1.3.2)
fiber-annotation (0.2.0)
fiber-local (1.1.0)
fiber-storage (0.1.1)
fiddle (default: 1.1.1)
fileutils (default: 1.7.0)
find (default: 0.1.1)
fluent-plugin-elasticsearch (5.4.3)
fluent-plugin-grafana-loki (1.2.20)
fluent-plugin-kubernetes_metadata_filter (3.5.0)
fluent-plugin-multi-format-parser (1.1.0)
fluentd (1.17.0)
forwardable (default: 1.3.3)
getoptlong (default: 0.2.0)
http (5.2.0)
http-accept (1.7.0)
http-cookie (1.0.6)
http-form_data (2.3.0)
http_parser.rb (0.8.0)
io-console (default: 0.6.0)
io-nonblock (default: 0.2.0)
io-wait (default: 0.3.0)
ipaddr (default: 1.2.5)
irb (default: 1.6.2)
json (2.6.3)
jsonpath (1.1.5)
kubeclient (4.12.0)
llhttp-ffi (0.5.0)
logger (default: 1.5.3)
lru_redux (1.1.0)
matrix (0.4.2)
mime-types (3.5.2)
mime-types-data (3.2024.0604)
minitest (5.16.3)
msgpack (1.7.2)
multi_json (1.15.0)
mutex_m (default: 0.1.2)
net-ftp (0.2.1)
net-http (default: 0.4.1)
net-imap (0.3.4.1)
net-pop (0.1.2)
net-protocol (default: 0.2.1)
net-smtp (0.3.4)
netrc (0.11.0)
nio4r (2.7.3)
nkf (default: 0.1.2)
observer (default: 0.1.1)
oj (3.16.1)
open-uri (default: 0.3.0)
open3 (default: 0.1.2)
openssl (default: 3.1.0)
optparse (default: 0.3.1)
ostruct (default: 0.5.5)
pathname (default: 0.2.1)
power_assert (2.0.3)
pp (default: 0.4.0)
prettyprint (default: 0.1.1)
prime (0.1.2)
protocol-hpack (1.4.3)
protocol-http (0.24.7)
protocol-http1 (0.15.1)
protocol-http2 (0.15.1)
pstore (default: 0.1.2)
psych (default: 5.0.1)
public_suffix (6.0.0)
racc (default: 1.6.2)
rake (13.2.1, 13.0.6)
rbs (2.8.2)
rdoc (default: 6.5.1.1)
readline (default: 0.0.3)
readline-ext (default: 0.1.5)
recursive-open-struct (1.2.2)
reline (default: 0.3.2)
resolv (default: 0.2.2)
resolv-replace (default: 0.1.1)
rest-client (2.1.0)
rexml (3.2.6, 3.2.5)
rinda (default: 0.1.1)
rss (0.2.9)
ruby2_keywords (default: 0.0.5)
securerandom (default: 0.2.2)
serverengine (2.3.2)
set (default: 1.0.3)
shellwords (default: 0.1.0)
sigdump (0.2.5)
singleton (default: 0.1.1)
stringio (default: 3.0.4)
strptime (0.2.5)
strscan (default: 3.0.5)
syntax_suggest (default: 1.1.0)
syslog (default: 0.1.1)
tempfile (default: 0.1.3)
test-unit (3.5.7)
time (default: 0.2.2)
timeout (default: 0.3.1)
timers (4.3.5)
tmpdir (default: 0.1.3)
traces (0.11.1)
tsort (default: 0.1.1)
typeprof (0.21.3)
tzinfo (2.0.6)
tzinfo-data (1.2024.1)
un (default: 0.2.1)
uri (default: 0.12.2)
weakref (default: 0.1.2)
webrick (1.8.1)
yajl-ruby (1.4.3)
yaml (default: 0.2.1)
zlib (default: 3.0.0) - ES version (optional) - 8.14.0
- ES template(s) (optional)