Mainflux.mainflux/consumers/writers/timescale
JohnC 864ad144e6
MF-1478 - TimescaleDB writer and reader add-on (#1542)
* MF-1478 - TimescaleDb Reader/Writer Add-on

Signed-off-by: John Cleasby <john.cleasby@gmail.com>

* pull request 1542 change requests

Signed-off-by: corp0529 <john.cleasby@gmail.com>

* pull request 1542 change requests 2

Signed-off-by: corp0529 <john.cleasby@gmail.com>

* removed unused separator const from timescale reader and writer cmd

Signed-off-by: corp0529 <john.cleasby@gmail.com>

* Fixed naming of timescaleRepo instance

Signed-off-by: corp0529 <john.cleasby@gmail.com>

* Fixed indentation and renamed repo to tr

Signed-off-by: corp0529 <john.cleasby@gmail.com>
2022-01-18 12:08:54 +01:00
..
README.md MF-1478 - TimescaleDB writer and reader add-on (#1542) 2022-01-18 12:08:54 +01:00
consumer.go MF-1478 - TimescaleDB writer and reader add-on (#1542) 2022-01-18 12:08:54 +01:00
consumer_test.go MF-1478 - TimescaleDB writer and reader add-on (#1542) 2022-01-18 12:08:54 +01:00
doc.go MF-1478 - TimescaleDB writer and reader add-on (#1542) 2022-01-18 12:08:54 +01:00
init.go MF-1478 - TimescaleDB writer and reader add-on (#1542) 2022-01-18 12:08:54 +01:00
setup_test.go MF-1478 - TimescaleDB writer and reader add-on (#1542) 2022-01-18 12:08:54 +01:00

README.md

Timescale writer

Timescale writer provides message repository implementation for Timescale.

Configuration

The service is configured using the environment variables presented in the following table. Note that any unset variables will be replaced with their default values.

Variable Description Default
MF_NATS_URL NATS instance URL nats://localhost:4222
MF_TIMESCALE_WRITER_LOG_LEVEL Service log level error
MF_TIMESCALE_WRITER_PORT Service HTTP port 9104
MF_TIMESCALE_WRITER_DB_HOST Timescale DB host timescale
MF_TIMESCALE_WRITER_DB_PORT Timescale DB port 5432
MF_TIMESCALE_WRITER_DB_USER Timescale user mainflux
MF_TIMESCALE_WRITER_DB_PASS Timescale password mainflux
MF_TIMESCALE_WRITER_DB Timescale database name messages
MF_TIMESCALE_WRITER_DB_SSL_MODE Timescale SSL mode disabled
MF_TIMESCALE_WRITER_DB_SSL_CERT Timescale SSL certificate path ""
MF_TIMESCALE_WRITER_DB_SSL_KEY Timescale SSL key ""
MF_TIMESCALE_WRITER_DB_SSL_ROOT_CERT Timescale SSL root certificate path ""
MF_TIMESCALE_WRITER_CONFIG_PATH Configuration file path with NATS subjects list /config.toml

Deployment

The service itself is distributed as Docker container. Check the timescale-writer service section in docker-compose to see how service is deployed.

To start the service, execute the following shell script:

# download the latest version of the service
git clone https://github.com/mainflux/mainflux

cd mainflux

# compile the timescale writer
make timescale-writer

# copy binary to bin
make install

# Set the environment variables and run the service
MF_NATS_URL=[NATS instance URL] \
MF_TIMESCALE_WRITER_LOG_LEVEL=[Service log level] \
MF_TIMESCALE_WRITER_PORT=[Service HTTP port] \
MF_TIMESCALE_WRITER_DB_HOST=[Timescale host] \
MF_TIMESCALE_WRITER_DB_PORT=[Timescale port] \
MF_TIMESCALE_WRITER_DB_USER=[Timescale user] \
MF_TIMESCALE_WRITER_DB_PASS=[Timescale password] \
MF_TIMESCALE_WRITER_DB=[Timescale database name] \
MF_TIMESCALE_WRITER_DB_SSL_MODE=[Timescale SSL mode] \
MF_TIMESCALE_WRITER_DB_SSL_CERT=[Timescale SSL cert] \
MF_TIMESCALE_WRITER_DB_SSL_KEY=[Timescale SSL key] \
MF_TIMESCALE_WRITER_DB_SSL_ROOT_CERT=[Timescale SSL Root cert] \
MF_TIMESCALE_WRITER_CONFIG_PATH=[Configuration file path with NATS subjects list] \
MF_TIMESCALE_WRITER_TRANSFORMER=[Message transformer type] \
$GOBIN/mainflux-timescale-writer

Usage

Starting service will start consuming normalized messages in SenML format.