Author Topic: SMOS Data  (Read 5941 times)

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
SMOS Data
« on: September 09, 2014, 12:52:49 PM »
Hi all,
I am trying to download SMOS L2 soil moisture data for India through two sources.
1) Their FTP server
2) Eoli-sa software
Both have issues, through FTP, the download speeds are very slow and also I have no option but to download for entire globe which is a constraint for me storage wise.
Through Eoli-sa (though I can download of India), I can download only 100 swath records at a time which will end up like 4000 5000 times for the total time period I need.

Can anyone pl let me know a better way of getting this data?

Thank you.

Sat Kumar Tomer

  • Administrator
  • Team sea
  • ***
  • Karma: +116/-0
    • View Profile
    • ambhas
  • Institute : IISc
  • Programming language : R, Python and Matlab
Re: SMOS Data
« Reply #1 on: September 09, 2014, 01:09:59 PM »
Which software are you using to download from FTP?

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
Re: SMOS Data
« Reply #2 on: September 09, 2014, 01:22:02 PM »
I am using FileZilla

Sat Kumar Tomer

  • Administrator
  • Team sea
  • ***
  • Karma: +116/-0
    • View Profile
    • ambhas
  • Institute : IISc
  • Programming language : R, Python and Matlab
Re: SMOS Data
« Reply #3 on: September 09, 2014, 02:23:56 PM »
You can download upto 10 files in Filezilla at a time. This might help a bit in increasing the speed.

You can use nco to cut the downloaded file over some region. See section, "Subsetting a region or time, and decimating" of the link http://jisao.washington.edu/data/nco/#example10.

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
Re: SMOS Data
« Reply #4 on: September 09, 2014, 08:11:38 PM »
Yes 10 simultaneous downloads is doing better job. Thank you.
These are actually zip files which contain two files .DBL and .HDR file. But the link you have sent has commands that deal with .nc files as input (syntax is indicating that). So, will these work on the above file formats I have mentioned?
I am attaching the files for reference.

Sat Kumar Tomer

  • Administrator
  • Team sea
  • ***
  • Karma: +116/-0
    • View Profile
    • ambhas
  • Institute : IISc
  • Programming language : R, Python and Matlab
Re: SMOS Data
« Reply #5 on: September 09, 2014, 08:14:35 PM »
Don't worry! .DBL files are actually .nc files.

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
Re: SMOS Data
« Reply #6 on: September 09, 2014, 08:20:11 PM »
Sorry unable to upload them.
Okay I will use those commands and extract necessary region from .dbl files.

Sat Kumar Tomer

  • Administrator
  • Team sea
  • ***
  • Karma: +116/-0
    • View Profile
    • ambhas
  • Institute : IISc
  • Programming language : R, Python and Matlab
Re: SMOS Data
« Reply #7 on: September 09, 2014, 08:28:24 PM »
No need to upload them.
I work in SMOS team, so I know the files.

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
Re: SMOS Data
« Reply #8 on: September 15, 2014, 06:29:47 PM »
Dear Sat Kumar,
I have tried using subsetting command from the link you have sent.
It could not read .DBL file as it gave error: 'not a NetCDF file'.
I have renamed .DBL to .nc and it still gave the same error.
How to rectify this error?

Sat Kumar Tomer

  • Administrator
  • Team sea
  • ***
  • Karma: +116/-0
    • View Profile
    • ambhas
  • Institute : IISc
  • Programming language : R, Python and Matlab
Re: SMOS Data
« Reply #9 on: September 15, 2014, 07:03:25 PM »
Are you on Linux or Windows?

Can you send me the output of following command:
Code: [Select]
ncdump -h filename.DBL

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
Re: SMOS Data
« Reply #10 on: September 15, 2014, 07:34:10 PM »
Iam getting following error
Code: [Select]
kar@kar:~$ ncdump -h /home/kar/Desktop/SM_REPR_MIR_SMUDP2_20100112T144216_20100112T150532_551_001_1.DBL
ncdump: /home/kar/Desktop/SM_REPR_MIR_SMUDP2_20100112T144216_20100112T150532_551_001_1.DBL: NetCDF: Unknown file format

Sat Kumar Tomer

  • Administrator
  • Team sea
  • ***
  • Karma: +116/-0
    • View Profile
    • ambhas
  • Institute : IISc
  • Programming language : R, Python and Matlab
Re: SMOS Data
« Reply #11 on: September 15, 2014, 08:14:34 PM »
Try for few files just to make sure that there is no error due to incomplete downloaded.

 

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
Re: SMOS Data
« Reply #12 on: September 15, 2014, 08:29:48 PM »
No I am still getting the same error tries some more files. Actually they have provided zip files where each contain one .HDR and one .DBL files. I could unzip these files successfully so I think the download is complete.

Sat Kumar Tomer

  • Administrator
  • Team sea
  • ***
  • Karma: +116/-0
    • View Profile
    • ambhas
  • Institute : IISc
  • Programming language : R, Python and Matlab
Re: SMOS Data
« Reply #13 on: September 16, 2014, 02:04:53 PM »
Send me the data (2-3 files) in zip format.
Maybe you can send through Dropbox.

Karthikeyan L

  • Administrator
  • Team river
  • ***
  • Karma: +34/-0
  • Research Scholar
    • View Profile
  • Institute : Indian Institute of Science, Bangalore
  • Programming language : Matlab, R
Re: SMOS Data
« Reply #14 on: September 16, 2014, 03:04:49 PM »
I have shared a folder via google drive. It contain 4 zip files.
https://drive.google.com/folderview?id=0B9kaiKpUxhA-RVNkMmYwR2htLU0&usp=sharing
« Last Edit: September 16, 2014, 03:06:26 PM by Karthikeyan L »