Mainflux.mainflux/consumers/writers/influxdb
Sammy Kerata Oina 83ff4e12ea
MF-512 - Change service default ports (#1737)
* Change service Default ports

Updated ports:
- auth http 9000
- auth grpc 7000
- provision http 9001
- things http 9002
- things auth http 9003
- things auth grpc 7001
- twins http 9004
- users http 9005
- bootstrap http 9006
- cassandra-reader http 9007
- cassandra-writer http 9008
- influxdb-reader http 9009
- influxdb-writer http 9010
- lora http 9011
- mongodb reader http 9012
- mongodb writer http 9013
- postgres-reader http 9014
- postgrs-writer http 9015
- smpp-notifier http 9016
- smtp-notifier http 9017
- timescale-reader http 9018
- timescale-writer http 9019

Signed-off-by: SammyOina <sammyoina@gmail.com>

* change default service ports on env and sh

Signed-off-by: SammyOina <sammyoina@gmail.com>

* change things url default port

Signed-off-by: SammyOina <sammyoina@gmail.com>

* change default ports order by importance
- auth http 9000
- auth grpc 7000
- things http 9001
- things auth http 9002
- things auth grpc 7001
- users http 9003
- cassandra-reader http 9004
- cassandra-writer http 9005
- influxdb-reader http 9006
- influxdb-writer http 9007
- mongodb reader http 9008
- mongodb writer http 9009
- postgres-reader http 9010
- postgres-writer http 9011
- timescale-reader http 9012
- timescale-writer http 9013
- bootstrap http 9014
- smpp-notifier http 9015
- smtp-notifier http 9016
- provision http 9017
- lora http 9018
- twins http 9019

Signed-off-by: SammyOina <sammyoina@gmail.com>

* lower port number in auth service

Signed-off-by: SammyOina <sammyoina@gmail.com>

* change things and users port
- things 9000
- things auth 9001
- things auth grpc 7000
- users 9002

Signed-off-by: SammyOina <sammyoina@gmail.com>

* update documentaton to new port numbers

Signed-off-by: SammyOina <sammyoina@gmail.com>

* update test and metrics

Signed-off-by: SammyOina <sammyoina@gmail.com>

* update host on metrics

Signed-off-by: SammyOina <sammyoina@gmail.com>

* resolving conflics

Signed-off-by: SammyOina <sammyoina@gmail.com>

* set http adapter port to :80

Signed-off-by: SammyOina <sammyoina@gmail.com>

* reassign http port on metrics to :80

Signed-off-by: SammyOina <sammyoina@gmail.com>

* reassign http adapter port

Signed-off-by: SammyOina <sammyoina@gmail.com>

* set http adapter port to 8008

Signed-off-by: SammyOina <sammyoina@gmail.com>

* document http adapter default port

Signed-off-by: SammyOina <sammyoina@gmail.com>

---------

Signed-off-by: SammyOina <sammyoina@gmail.com>
2023-03-23 21:55:11 +01:00
..
README.md MF-512 - Change service default ports (#1737) 2023-03-23 21:55:11 +01:00
consumer.go MF-1584 - Upgrade InfluxDB from 1.x to 2.x (#1709) 2023-03-16 02:36:14 +01:00
consumer_test.go MF-1584 - Upgrade InfluxDB from 1.x to 2.x (#1709) 2023-03-16 02:36:14 +01:00
doc.go NOISSUE - Switch to Consumers interface (#1316) 2021-01-11 23:55:34 +01:00
fields.go MF-1580 - Influxdb Writer changes format of update-time to string (#1581) 2022-03-23 13:19:59 +01:00
setup_test.go MF-1584 - Upgrade InfluxDB from 1.x to 2.x (#1709) 2023-03-16 02:36:14 +01:00
tags.go NOISSUE - Switch to Consumers interface (#1316) 2021-01-11 23:55:34 +01:00

README.md

InfluxDB writer

InfluxDB writer provides message repository implementation for InfluxDB.

Configuration

The service is configured using the environment variables presented in the following table. Note that any unset variables will be replaced with their default values.

Variable Description Default
MF_BROKER_URL Message broker instance URL nats://localhost:4222
MF_INFLUX_WRITER_LOG_LEVEL Log level for InfluxDB writer (debug, info, warn, error) info
MF_INFLUX_WRITER_PORT Service HTTP port 9006
MF_INFLUX_WRITER_DB_HOST InfluxDB host localhost
MF_INFLUXDB_PORT Default port of InfluxDB database 8086
MF_INFLUXDB_ADMIN_USER Default user of InfluxDB database mainflux
MF_INFLUXDB_ADMIN_PASSWORD Default password of InfluxDB user mainflux
MF_INFLUXDB_DB InfluxDB database name mainflux
MF_INFLUXDB_HOST InfluxDB host name mainflux-influxdb
MF_INFLUXDB_PROTOCOL InfluxDB protocol http
MF_INFLUXDB_TIMEOUT InfluxDB client connection readiness timeout 1s
MF_INFLUXDB_ORG InfluxDB organization name mainflux
MF_INFLUXDB_BUCKET InfluxDB bucket name mainflux-bucket
MF_INFLUXDB_TOKEN InfluxDB API token mainflux-token
MF_INFLUXDB_HTTP_ENABLED InfluxDB http enabled status true
MF_INFLUXDB_INIT_MODE InfluxDB initialization mode setup
MF_INFLUX_WRITER_CONFIG_PATH Config file path with message broker subjects list, payload type and content-type /configs.toml

Deployment

The service itself is distributed as Docker container. Check the influxdb-writer service section in docker-compose to see how service is deployed.

To start the service, execute the following shell script:

# download the latest version of the service
git clone https://github.com/mainflux/mainflux

cd mainflux

# compile the influxdb
make influxdb

# copy binary to bin
make install

# Set the environment variables and run the service
MF_BROKER_URL=[Message broker instance URL] \
MF_INFLUX_WRITER_LOG_LEVEL=[Influx writer log level] \
MF_INFLUX_WRITER_PORT=[Service HTTP port] \
MF_INFLUXDB_DB=[InfluxDB database name] \
MF_INFLUXDB_HOST=[InfluxDB database host] \
MF_INFLUXDB_PORT=[InfluxDB database port] \
MF_INFLUXDB_ADMIN_USER=[InfluxDB admin user] \
MF_INFLUXDB_ADMIN_PASSWORD=[InfluxDB admin password] \
MF_INFLUXDB_PROTOCOL=[InfluxDB protocol] \
MF_INFLUXDB_TIMEOUT=[InfluxDB timeout] \
MF_INFLUXDB_ORG=[InfluxDB org] \
MF_INFLUXDB_BUCKET=[InfluxDB bucket] \
MF_INFLUXDB_TOKEN=[InfluxDB token] \
MF_INFLUXDB_HTTP_ENABLED=[InfluxDB http enabled] \
MF_INFLUXDB_INIT_MODE=[InfluxDB init mode] \
MF_INFLUX_WRITER_CONFIG_PATH=[Config file path with Message broker subjects list, payload type and content-type] \
$GOBIN/mainflux-influxdb

Using docker-compose

This service can be deployed using docker containers. Docker compose file is available in <project_root>/docker/addons/influxdb-writer/docker-compose.yml. Besides database and writer service, it contains InfluxData Web Admin Interface which can be used for database exploration and data visualization and analytics. In order to run Mainflux InfluxDB writer, execute the following command:

docker-compose -f docker/addons/influxdb-writer/docker-compose.yml up -d

And, to use the default .env file, execute the following command:

docker-compose -f docker/addons/influxdb-writer/docker-compose.yml up --env-file docker/.env -d

Please note that you need to start core services before the additional ones.

Usage

Starting service will start consuming normalized messages in SenML format.

Official docs can be found here.