Welcome, Guest. | Login | Create Account
Reanalysis for MIPs
You are at the ESGF.NCCS.NASA.GOV node
 

Ana4MIPs Software

Features Concatenate data.

If you have downloaded 34 files for the entire time period of the reanalysis. How do you put them together into one file?

One issue with the 3-dimensional (latitude, longitude, height) data is that to obtain and use the entire record the files come from ESGF as one file per year.

Several utilities will do this for you:
1. CDO: https://code.zmaw.de/projects/cdo
2. UV-CDAT: http://uv-cdat.org/ (using cdscan) http://www2-pcmdi.llnl.gov/cdat/tutorials/training/cdat_2004/08-cdscan-and-cdtime.pdf/view
3. NCO: http://nco.sourceforge.net/
4. GrADS: http://www.iges.org/grads/downloads.html

These all can be installed on your computer.
UV-CDAT (cdscan) and GrADS do not copy the data to a new file but rather use a small file that contains all the information about the file list. Both CDO and NCO create a new file containing the concatenated files.

Example:
UV-CDAT – using cdscan
From a list of files obtained from ESGF through the CoG site:
hus_Amon_reanalysis_IFS-Cy31r2_197901-197912.nc
hus_Amon_reanalysis_IFS-Cy31r2_198001-198012.nc
hus_Amon_reanalysis_IFS-Cy31r2_198101-198112.nc
hus_Amon_reanalysis_IFS-Cy31r2_198201-198212.nc
hus_Amon_reanalysis_IFS-Cy31r2_198301-198312.nc
hus_Amon_reanalysis_IFS-Cy31r2_198401-198412.nc
hus_Amon_reanalysis_IFS-Cy31r2_198501-198512.nc
hus_Amon_reanalysis_IFS-Cy31r2_198601-198612.nc
.
.
.

To concatenate:

cdscan -x hus.xml hus_Amon*
A file hux.xml will be created and then it treated as a netCDF file by UV-CDAT (cdat)

To make a GrADS template file see: http://www.iges.org/grads/gadoc/templates.html

NCO
For example this command will create netcdf4(-4) file with compression level2(-L 2). The -h argument is to turn off the "appending to history" attribute.
ncrcat -4 -h -L 2 * aggregate_all_files.nc
Browse Projects
 
 
 
 
Start typing, or use the 'Delete' key to show all available tags.
Ana4MIPs Tags: None