Skip to content

Commit dda1193

Browse files
Kord CampbellKord Campbell
Kord Campbell
authored and
Kord Campbell
committed
updating to v3.30.0 output
1 parent e280803 commit dda1193

File tree

3 files changed

+50
-35
lines changed

3 files changed

+50
-35
lines changed

‎docker-cluster/README.md

+18-11
Original file line numberDiff line numberDiff line change
@@ -173,18 +173,25 @@ kord@bob featurebase $ idk/molecula-consumer-csv \
173173
--auto-generate \
174174
--index=allyourbase \
175175
--files=sample.csv
176-
Molecula Consumer v3.26.0-9-g14f19300, build time 2022-12-12T20:44:21+0000
177-
2022-12-13T14:21:33.516988Z INFO: Serving Prometheus metrics with namespace "ingester_csv" at localhost:9093/metrics
178-
2022-12-13T14:21:33.519780Z INFO: start ingester 0
179-
2022-12-13T14:21:33.520360Z INFO: processFile: sample.csv
180-
2022-12-13T14:21:33.520437Z INFO: new schema: []idk.Field{idk.StringField{NameVal:"asset_tag", DestNameVal:"asset_tag", Mutex:false, Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}, idk.RecordTimeField{NameVal:"fan_time", DestNameVal:"fan_time", Layout:"2006-01-02", Epoch:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Unit:""}, idk.StringField{NameVal:"fan_val", DestNameVal:"fan_val", Mutex:false, Quantum:"YMD", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}}
181-
2022-12-13T14:21:33.530045Z INFO: Listening for /debug/pprof/ and /debug/fgprof on 'localhost:6062'
182-
2022-12-13T14:21:33.564520Z INFO: translating batch of 1 took: 42.707875ms
183-
2022-12-13T14:21:33.564819Z INFO: making fragments for batch of 1 took 303.708µs
176+
Molecula Consumer v3.30.0, build time 2023-02-01T21:16:21+0000
177+
2023-02-02T21:13:32.576720Z INFO: Listening for /debug/pprof/ and /debug/fgprof on 'localhost:6062'
178+
2023-02-02T21:13:32.577056Z INFO: Serving Prometheus metrics with namespace "ingester_csv" at localhost:9093/metrics
179+
2023-02-02T21:13:32.581356Z INFO: start ingester 0
180+
2023-02-02T21:13:32.581754Z INFO: processFile: sample.csv
181+
2023-02-02T21:13:32.583601Z INFO: new schema: []idk.Field{idk.StringField{NameVal:"asset_tag", DestNameVal:"asset_tag", Mutex:false, Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}, idk.RecordTimeField{NameVal:"fan_time", DestNameVal:"fan_time", Layout:"2006-01-02", Epoch:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Unit:""}, idk.StringField{NameVal:"fan_val", DestNameVal:"fan_val", Mutex:false, Quantum:"YMD", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}}
182+
2023-02-02T21:13:32.643970Z INFO: translating batch of 1 took: 58.24325ms
183+
2023-02-02T21:13:32.644260Z INFO: making fragments for batch of 1 took 293.833µs
184+
2023-02-02T21:13:32.646288Z INFO: importing fragments took 2.025417ms
185+
2023-02-02T21:13:32.646561Z INFO: records processed 0-> (1)
186+
2023-02-02T21:13:32.704294Z INFO: translating batch of 1 took: 57.537417ms
187+
2023-02-02T21:13:32.704325Z INFO: making fragments for batch of 1 took 35.208µs
188+
2023-02-02T21:13:32.704853Z INFO: importing fragments took 527µs
184189
<snip>
185-
2022-12-13T14:21:33.975317Z INFO: importing fragments took 305.542µs
186-
2022-12-13T14:21:33.975485Z INFO: records processed 0-> (10)
187-
2022-12-13T14:21:33.975493Z INFO: metrics: import=454.011583ms
190+
2023-02-02T21:13:33.111711Z INFO: translating batch of 1 took: 79.584916ms
191+
2023-02-02T21:13:33.111754Z INFO: making fragments for batch of 1 took 48.375µs
192+
2023-02-02T21:13:33.112176Z INFO: importing fragments took 417.209µs
193+
2023-02-02T21:13:33.112434Z INFO: records processed 0-> (8)
194+
2023-02-02T21:13:33.112443Z INFO: metrics: import=527.292666ms
188195
```
189196

190197
## Tear It Down

‎docker-consumer/README.md

+14-13
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ kord@Bob docker-simple $ docker network create fbnet
2424
```
2525

2626
## Start the Services
27-
Start the services using `docker-compose`:
27+
Start a FeatureBase instance the services using `docker-compose`:
2828

2929
```
3030
docker compose up
@@ -34,9 +34,10 @@ docker compose up
3434

3535

3636
## Run the Consumer Container
37-
The `sample.csv` will be copied into the container and then used to insert the data into FeatureBase using the CSV consumer:
37+
The `sample.csv` in the `featurebase-examples/docker-consumer` directory will be copied into the container and used to insert the data into FeatureBase via the CSV consumer:
3838

3939
```
40+
cd ../docker-consumer/
4041
docker compose up
4142
```
4243

@@ -46,17 +47,17 @@ docker compose up
4647
⠿ Volume "docker-consumer_featurebase-consumer" Created 0.0s
4748
⠿ Container docker-consumer-csv-consumer-1 Created 0.8s
4849
Attaching to docker-consumer-csv-consumer-1
49-
docker-consumer-csv-consumer-1 | Molecula Consumer v3.26.0-9-g14f19300, build time 2022-12-12T20:47:21+0000
50-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.092373Z INFO: Serving Prometheus metrics with namespace "ingester_csv" at localhost:9093/metrics
51-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.097076Z INFO: Listening for /debug/pprof/ and /debug/fgprof on 'localhost:6062'
52-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.157372Z INFO: start ingester 0
53-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.161222Z INFO: processFile: /featurebase/sample.csv
54-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.166669Z INFO: new schema: []idk.Field{idk.StringField{NameVal:"asset_tag", DestNameVal:"asset_tag", Mutex:false, Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}, idk.RecordTimeField{NameVal:"fan_time", DestNameVal:"fan_time", Layout:"2006-01-02", Epoch:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Unit:""}, idk.StringField{NameVal:"fan_val", DestNameVal:"fan_val", Mutex:false, Quantum:"YMD", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}}
55-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.191663Z INFO: translating batch of 10 took: 7.399375ms
56-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.193293Z INFO: making fragments for batch of 10 took 1.823208ms
57-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.213174Z INFO: importing fragments took 19.883ms
58-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.247539Z INFO: 1 records processed 0-> (10)
59-
docker-consumer-csv-consumer-1 | 2022-12-21T22:23:40.247732Z INFO: metrics: import=67.754083ms
50+
docker-consumer-csv-consumer-1 | Molecula Consumer v3.30.0, build time 2023-02-01T21:19:58+0000
51+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.730887Z INFO: Serving Prometheus metrics with namespace "ingester_csv" at localhost:9093/metrics
52+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.739919Z INFO: Listening for /debug/pprof/ and /debug/fgprof on 'localhost:6062'
53+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.780440Z INFO: start ingester 0
54+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.784378Z INFO: processFile: /featurebase/sample.csv
55+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.788048Z INFO: new schema: []idk.Field{idk.IDField{NameVal:"id", DestNameVal:"id", Mutex:false, Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}, idk.StringArrayField{NameVal:"draw", DestNameVal:"draw", Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}, idk.IDField{NameVal:"draw_size", DestNameVal:"draw_size", Mutex:false, Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}}
56+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.837135Z INFO: translating batch of 9 took: 10.757166ms
57+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.838490Z INFO: making fragments for batch of 9 took 1.522584ms
58+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.948296Z INFO: importing fragments took 109.795833ms
59+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.950797Z INFO: 1 records processed 0-> (10)
60+
docker-consumer-csv-consumer-1 | 2023-02-01T22:53:27.950963Z INFO: metrics: import=131.721333ms
6061
```
6162

6263
**NOTE**:

‎docker-simple/README.md

+18-11
Original file line numberDiff line numberDiff line change
@@ -116,18 +116,25 @@ kord@bob featurebase $ idk/molecula-consumer-csv \
116116
--auto-generate \
117117
--index=allyourbase \
118118
--files=sample.csv
119-
Molecula Consumer v3.26.0-9-g14f19300, build time 2022-12-12T20:44:21+0000
120-
2022-12-13T14:21:33.516988Z INFO: Serving Prometheus metrics with namespace "ingester_csv" at localhost:9093/metrics
121-
2022-12-13T14:21:33.519780Z INFO: start ingester 0
122-
2022-12-13T14:21:33.520360Z INFO: processFile: sample.csv
123-
2022-12-13T14:21:33.520437Z INFO: new schema: []idk.Field{idk.StringField{NameVal:"asset_tag", DestNameVal:"asset_tag", Mutex:false, Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}, idk.RecordTimeField{NameVal:"fan_time", DestNameVal:"fan_time", Layout:"2006-01-02", Epoch:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Unit:""}, idk.StringField{NameVal:"fan_val", DestNameVal:"fan_val", Mutex:false, Quantum:"YMD", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}}
124-
2022-12-13T14:21:33.530045Z INFO: Listening for /debug/pprof/ and /debug/fgprof on 'localhost:6062'
125-
2022-12-13T14:21:33.564520Z INFO: translating batch of 1 took: 42.707875ms
126-
2022-12-13T14:21:33.564819Z INFO: making fragments for batch of 1 took 303.708µs
119+
Molecula Consumer v3.30.0, build time 2023-02-01T21:16:21+0000
120+
2023-02-02T21:13:32.576720Z INFO: Listening for /debug/pprof/ and /debug/fgprof on 'localhost:6062'
121+
2023-02-02T21:13:32.577056Z INFO: Serving Prometheus metrics with namespace "ingester_csv" at localhost:9093/metrics
122+
2023-02-02T21:13:32.581356Z INFO: start ingester 0
123+
2023-02-02T21:13:32.581754Z INFO: processFile: sample.csv
124+
2023-02-02T21:13:32.583601Z INFO: new schema: []idk.Field{idk.StringField{NameVal:"asset_tag", DestNameVal:"asset_tag", Mutex:false, Quantum:"", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}, idk.RecordTimeField{NameVal:"fan_time", DestNameVal:"fan_time", Layout:"2006-01-02", Epoch:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), Unit:""}, idk.StringField{NameVal:"fan_val", DestNameVal:"fan_val", Mutex:false, Quantum:"YMD", TTL:"", CacheConfig:(*idk.CacheConfig)(nil)}}
125+
2023-02-02T21:13:32.643970Z INFO: translating batch of 1 took: 58.24325ms
126+
2023-02-02T21:13:32.644260Z INFO: making fragments for batch of 1 took 293.833µs
127+
2023-02-02T21:13:32.646288Z INFO: importing fragments took 2.025417ms
128+
2023-02-02T21:13:32.646561Z INFO: records processed 0-> (1)
129+
2023-02-02T21:13:32.704294Z INFO: translating batch of 1 took: 57.537417ms
130+
2023-02-02T21:13:32.704325Z INFO: making fragments for batch of 1 took 35.208µs
131+
2023-02-02T21:13:32.704853Z INFO: importing fragments took 527µs
127132
<snip>
128-
2022-12-13T14:21:33.975317Z INFO: importing fragments took 305.542µs
129-
2022-12-13T14:21:33.975485Z INFO: records processed 0-> (10)
130-
2022-12-13T14:21:33.975493Z INFO: metrics: import=454.011583ms
133+
2023-02-02T21:13:33.111711Z INFO: translating batch of 1 took: 79.584916ms
134+
2023-02-02T21:13:33.111754Z INFO: making fragments for batch of 1 took 48.375µs
135+
2023-02-02T21:13:33.112176Z INFO: importing fragments took 417.209µs
136+
2023-02-02T21:13:33.112434Z INFO: records processed 0-> (8)
137+
2023-02-02T21:13:33.112443Z INFO: metrics: import=527.292666ms
131138
```
132139

133140
## Tear It Down

0 commit comments

Comments
 (0)