longtsing/nmc_met_io
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 1 Wiki Activity

Release 0.1.9.1 version.

Browse Source
This commit is contained in:
NMC-DAVE 2022-02-26 10:29:32 +08:00
parent 8f60007048
commit d5169f2483
4 changed files with 19 additions and 8 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -38,6 +38,9 @@ Using the fellowing command to install packages:
* 若需要使用将标准雷达格式转化为pyart格式程序`standard_data_to_pyart`, 请安装: * 若需要使用将标准雷达格式转化为pyart格式程序`standard_data_to_pyart`, 请安装:
- [arm_pyart](http://arm-doe.github.io/pyart/), `conda install -c conda-forge arm_pyart` - [arm_pyart](http://arm-doe.github.io/pyart/), `conda install -c conda-forge arm_pyart`
* 若需要对Cassandra集群数据库进行访问, 请安装:
- [cassandra-driver](https://pypi.org/project/cassandra-driver/), 'pip install cassandra-driver'
## 设置配置文件 ## 设置配置文件
若要访问CMADaaS(大数据云), MICAPS服务器等, 需在配置文件中设置地址和用户信息(若不需要, 则相应项无需配置). 若要访问CMADaaS(大数据云), MICAPS服务器等, 需在配置文件中设置地址和用户信息(若不需要, 则相应项无需配置).

2
nmc_met_io/__init__.py
View File

@ -4,4 +4,4 @@ from various data sources.
""" """
__author__ = "The R & D Center for Weather Forecasting Technology in NMC, CMA" __author__ = "The R & D Center for Weather Forecasting Technology in NMC, CMA"
__version__ = '0.1.9.0' __version__ = '0.1.9.1'

19
nmc_met_io/retrieve_cassandraDB.py
View File

@ -4,19 +4,23 @@
# Distributed under the terms of the GPL V3 License. # Distributed under the terms of the GPL V3 License.
""" """
Concat me with e-mail:songofsongs@vip.qq.com This is the retrieve module which get data from cassandra DB
This is the retrieve module which get data from cassandra DB
with Python Cassandra driver API. with Python Cassandra driver API.
The API is same as the retrieve_micaps_cassandra The API is same as the retrieve_micaps_cassandra
Change Log:
- Created by 王清龙/湖北/宜昌, 2022/2/26, e-mail:songofsongs@vip.qq.com
""" """
import sys
import warnings import warnings
from glob import glob from glob import glob
import re import re
import pickle import pickle
import bz2 import bz2
import zlib import zlib
import gzip
from io import BytesIO from io import BytesIO
from datetime import datetime, timedelta from datetime import datetime, timedelta
import numpy as np import numpy as np
@ -25,9 +29,14 @@ import pandas as pd
from tqdm import tqdm from tqdm import tqdm
import nmc_met_io.config as CONFIG import nmc_met_io.config as CONFIG
from nmc_met_io.read_radar import StandardData from nmc_met_io.read_radar import StandardData
from cassandra.cluster import Cluster
from cassandra.auth import PlainTextAuthProvider try:
import gzip from cassandra.cluster import Cluster
from cassandra.auth import PlainTextAuthProvider
except ImportError:
print("cassandra-driver is not installed (pip install cassandra-driver)")
sys.exit(1)
_db_client={ _db_client={
"ClusterIPAddresses":CONFIG.CONFIG['Cassandra']['ClusterIPAddresses'].split(","), "ClusterIPAddresses":CONFIG.CONFIG['Cassandra']['ClusterIPAddresses'].split(","),

3
setup.py
View File

@ -63,8 +63,7 @@ setup(
'protobuf>=3.12.0', 'protobuf>=3.12.0',
'urllib3>=1.25.9', 'urllib3>=1.25.9',
'tqdm>=4.47.0', 'tqdm>=4.47.0',
'python-dateutil>=2.8.1', 'python-dateutil>=2.8.1']
'cassandra-driver>=3.18.0']
) )
# development mode (DOS command): # development mode (DOS command):