Managing memory usage
Dask is a great tool for managing memory usage when processing datasets. Here are few tips on how to utilize dask in python to maximize the compute resource. Check your…
Climatology
How climatological statistics are defined and computed: https://climate.usu.edu/people/yoshi/pyclm101/monthly.html#anomalies-and-climatology
python: logging
While one can use if-else statements, the use of logging and raising errors (raise) can be a better way to handle errors and warnings in complex projects for the following…
How to install miniconda on MacOS
source: https://docs.anaconda.com/free/miniconda/ # create parent directory miniconda3 mkdir -p ~/miniconda3 # download curl https://repo.anaconda.com/miniconda/Miniconda3-latest-MacOSX-arm64.sh -o ~/miniconda3/miniconda.sh # execute installation and updates bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3 # remove setup…
Conda cheatsheet
# CREATE CONDA ENVIRONMENT conda create -n [MY_ENV_NAME] # create conda environment conda create --name [MY_ENV_NAME] python=3.5 # create conda env with py version conda conda create -f env.yaml #…
How to access metadata using NetCDF4 python package
import netCDF4 as ncfn = '/path/to/file.nc4'ds = nc.Dataset(fn) # import Dataset from netCDF4 from netCDF4 import Dataset # open nc file and save to nc ds = Dataset('myfile.nc') # print…
Metadata guideline for crs in netcdf files
source: https://cfconventions.org/Data/cf-conventions/cf-conventions-1.7/build/ch05s06.html https://wiki.esipfed.org/Attribute_Convention_for_Data_Discovery_1-3 In this article, we will summarize few useful metadata standards (CF and ACDD) to describe coordinate reference systems and mapping for netcdf files. Additionally, few examples with…