History

13621160019@163.com 23412c2817 added docker image immigration to readme		2022-01-03 22:56:45 +08:00
..
.gitignore	udpated gitignore files	2021-02-20 20:18:31 +08:00
Dockerfile	updated Dockerfiles	2022-01-02 19:30:01 +08:00
LICENSE	merged myems-cleaning	2021-02-19 12:11:42 +08:00
README.md	added docker image immigration to readme	2022-01-03 22:56:45 +08:00
clean_analog_value.py	fixed omissioin mistakes in myems-cleaning	2021-03-26 16:58:57 +08:00
clean_digital_value.py	fixed omissioin mistakes in myems-cleaning	2021-03-26 16:58:57 +08:00
clean_energy_value.py	fixed NoneType error in myems-cleaning service	2021-10-27 18:49:56 +08:00
config.py	updated config files	2021-12-19 07:58:01 +08:00
example.env	renamed example.env files and fixed typos in config	2021-10-15 13:32:43 +08:00
main.py	merged myems-cleaning	2021-02-19 12:11:42 +08:00
myems-cleaning.service	merged myems-cleaning	2021-02-19 12:11:42 +08:00
requirements.txt	updated config.py files to move all variables to .env files via Python Decouple	2021-10-12 18:39:42 +08:00
run.sh	mask out all clear password into encrypted ones for myems-cleaning.	2021-10-01 19:02:50 +08:00

README.md

myems-cleaning

MyEMS Cleaning Service

MyEMS 数据清洗服务

Introduction

This service is a component of MyEMS. It cleans the historical data.

Prerequisites

mysql-connector-python

schedule

python-decouple

Quick Run for Development

cd myems/myems-cleaning
pip install -r requirements.txt
cp example.env .env
chmod +x run.sh
./run.sh

Installation

Option 1: Install myems-cleaning on Docker

In this section, you will install myems-cleaning on Docker.

Copy example.env file to .env file and modify the .env file

cd myems/myems-cleaning
cp example.env .env

Build a Docker image

docker build -t myems/myems-cleaning .

Run a Docker container

docker run -d --restart always --name myems-cleaning myems/myems-cleaning

-d Run container in background and print container ID

--restart Restart policy to apply when a container exits

--name Assign a name to the container

If you want to immigrate the image to another computer,

Export image to tarball file

docker save --output myems-cleaning.tar myems/myems-cleaning

Copy the tarball file to another computer, and then load image from tarball file

docker load --input .\myems-cleaning.tar

Option 2: Install myems-cleaning on Ubuntu Server (bare-metal or virtual machine)

In this section, you will install myems-cleaning on Ubuntu Server.

Download and install MySQL Connector:

cd ~/tools
wget https://cdn.mysql.com/archives/mysql-connector-python-8.0/mysql-connector-python-8.0.23.tar.gz
tar xzf mysql-connector-python-8.0.23.tar.gz
cd ~/tools/mysql-connector-python-8.0.23
python3 setup.py install

Download and install Schedule

cd ~/tools
git clone https://github.com/dbader/schedule.git
cd ~/tools/schedule
python3 setup.py install

Download and install Python Decouple

cd ~/tools
git clone https://github.com/henriquebastos/python-decouple.git
cd ~/tools/python-decouple
python3 setup.py  install

Install myems-cleaning service

cp -R myems/myems-cleaning /myems-cleaning

Copy file example.env to .env and edit the .env file:

cp /myems-cleaning/example.env /myems-cleaning/.env
nano /myems-cleaning/.env

Setup systemd service:

cp myems-cleaning.service /lib/systemd/system/

Enable the service:

systemctl enable myems-cleaning.service

Start the service:

systemctl start myems-cleaning.service

Monitor the service:

systemctl status myems-cleaning.service

View the log:

cat /myems-cleaning.log