myems/myems-normalization
13621160019@163.com b97c16fbb9 updated config.py files to move all variables to .env files via Python Decouple 2021-10-12 18:39:42 +08:00
..
.env.example updated config.py files to move all variables to .env files via Python Decouple 2021-10-12 18:39:42 +08:00
.gitignore udpated gitignore files 2021-02-20 20:18:31 +08:00
Dockerfile added trusted-host to Dockerfiles 2021-09-01 15:35:13 +08:00
LICENSE merged myems-normalization 2021-02-19 12:31:01 +08:00
README.md updated config.py files to move all variables to .env files via Python Decouple 2021-10-12 18:39:42 +08:00
config.py updated config.py files to move all variables to .env files via Python Decouple 2021-10-12 18:39:42 +08:00
main.py implemented virtual point calculating in myems-normalization service 2021-05-08 13:37:17 +08:00
meter.py merged myems-normalization 2021-02-19 12:31:01 +08:00
myems-normalization.service merged myems-normalization 2021-02-19 12:31:01 +08:00
offline_meter_data.xlsx merged myems-normalization 2021-02-19 12:31:01 +08:00
offlinemeter.py changed float datatype to Decimal datatype for offline meter normalization 2021-03-15 19:07:49 +08:00
requirements.txt updated config.py files to move all variables to .env files via Python Decouple 2021-10-12 18:39:42 +08:00
run.sh mask out all clear password into encrypted ones for myems-normalization. 2021-10-01 19:08:43 +08:00
virtualmeter.py implemented virtual point calculating in myems-normalization service 2021-05-08 13:37:17 +08:00
virtualpoint.py implemented virtual point calculating in myems-normalization service 2021-05-08 13:37:17 +08:00

README.md

MyEMS Normalization Service 数据规范化服务

Introduction

This service is a component of MyEMS and it normalizes energy data in historical database.

MyEMS Meter Normalization

Prerequisites

mysql-connector-python

openpyxl

sympy

python-decouple

Quick Run for Development

pip install -r requirements.txt
chmod +x run.sh
run.sh

Installation

Download and install MySQL Connector:

cd ~/tools
wget https://dev.mysql.com/get/Downloads/Connector-Python/mysql-connector-python-8.0.20.tar.gz
tar xzf mysql-connector-python-8.0.20.tar.gz
cd ~/tools/mysql-connector-python-8.0.20
python3 setup.py install

Download and install mpmath

cd ~/tools
git clone https://github.com/fredrik-johansson/mpmath.git
cd ~/tools/mpmath
python3 setup.py install

Download and install SymPy

cd ~/tools
git clone https://github.com/sympy/sympy.git
cd ~/tools/sympy
python3 setupegg.py develop

Download and install openpyxl

cd ~/tools

Get the latest version of et_xmlfile from https://foss.heptapod.net/openpyxl/et_xmlfile/

wget https://foss.heptapod.net/openpyxl/et_xmlfile/-/archive/1.1/et_xmlfile-1.1.tar.gz
tar xzf et_xmlfile-1.1.tar.gz

Get jdcal

git clone https://github.com/phn/jdcal.git

Get the latest version of openpyxl from https://foss.heptapod.net/openpyxl/openpyxl

wget https://foss.heptapod.net/openpyxl/openpyxl/-/archive/3.0.7/openpyxl-3.0.7.tar.gz
tar xzf openpyxl-3.0.7.tar.gz
cd ~/tools/et_xmlfile-1.1
python3 setup.py install
cd ~/tools/jdcal
python3 setup.py install
cd ~/tools/openpyxl-3.0.7
python3 setup.py install

Install myems-normalization service:

cd ~
git clone https://github.com/MyEMS/myems.git
cd myems
git checkout master (or the latest release tag)
cp -r ~/myems/myems-normalization /myems-normalization

Create .env file based on .env.example and edit the .env file if needed:

cp /myems-normalization/.env.example /myems-cleaning/.env
nano /myems-normalization/.env

Setup systemd service:

cp myems-normalization.service /lib/systemd/system/

Enable the service:

systemctl enable myems-normalization.service

Start the service:

systemctl start myems-normalization.service

Monitor the service:

systemctl status myems-normalization.service

View the log:

cat /myems-normalization.log

References

  1. https://myems.io
  2. https://dev.mysql.com/doc/connector-python/en/
  3. https://github.com/sympy/sympy
  4. https://openpyxl.readthedocs.io