Presentation is loading. Please wait.

Presentation is loading. Please wait.

The status of data server for MICS Asia project Qizhong Wu, Zifa Wang, Zhe Wang, et al. 2014-02-21 5 th international Workshop on Atmospheric Modeling.

Published byLoreen Knight Modified over 8 years ago

Similar presentations

Presentation on theme: "The status of data server for MICS Asia project Qizhong Wu, Zifa Wang, Zhe Wang, et al. 2014-02-21 5 th international Workshop on Atmospheric Modeling."— Presentation transcript:

1 The status of data server for MICS Asia project Qizhong Wu, Zifa Wang, Zhe Wang, et al. 2014-02-21 5 th international Workshop on Atmospheric Modeling Research in East Asia, Xiamen

2  Data server: naqpms.iap.ac.cn  IP: 159.226.119.102  FTP service: the followed user is just for FTP access.  User name: guestuser  Password: 12345678  ESGF service  HTTP: support chrome, firefox, safari, but not IE  Windows, Linux, MacOS  But, download file one by one.  wget script  Linux, MacOS(may windows+cgywin, but not sure)  The required files, support to continue downloading  In the next year, try to support OpenDAP access for grads/ncl or other tools? Outline

3  Data tree  Some Emission and Meteorology have been published in Mics Asia data server.  All published misc asia data have been re-mount into FTP server.  Any FTP tools  Right fig: FTP access in Mac OS. FTP access

4  Data tree  Some Emission and Meteorology have been published in Mics Asia data server.  All published misc asia data have been re-mount into FTP server.  Any FTP tools  Right fig: FTP access in Mac OS. FTP access The WRF results in 2010

5  Demo I: download a small file  Demo II: download a bigger file  Demo III: dowload one WRF result FTP download demo

6 The directory/data tree  More, you can upload the datasets to this mics asia data server though FTP. Upload your dataset into upload/ IAP or… Emis, wrf, cmaq… One specie, one file? Create fold Put the dataset

7  Allow anonymous FTP? No  The guestuser is just public user for beta, anyone need the account need to apply.  Max clients=10, max_per_ip=5  Allow ssh or other access into mics asia data server? No, in order to system secuity, this user is a ftpuser.  One person, one account? or?  Need user list FTP User/passwd

8  Need openid(username) and password  https://naqpms.iap.ac.cn/esgf-idp/openid/guestuser https://naqpms.iap.ac.cn/esgf-idp/openid/guestuser  Password: 12345678  At present, only netcdf can be shared though ESGF services.  HTTP: the followed two links point to the same dataset  https://naqpma.iap.ac.cn https://naqpma.iap.ac.cn  http://esg.bnu.edu.cn/esgf-web-fe/live http://esg.bnu.edu.cn/esgf-web-fe/live  wget script  How to generate?  How to run? ESGF services download demo

9  Visit https://naqpms.iap.ac.cn, and it will point to https://naqpms.iap.ac.cn/esgf-node-manager/https://naqpms.iap.ac.cn ESGF services download demo I --HTTP website

10  Visit https://naqpms.iap.ac.cn, and it will point to https://naqpms.iap.ac.cn/esgf-node-manager/https://naqpms.iap.ac.cn ESGF services download demo I --HTTP website Choose any dataset you want to download

11  Visit https://naqpms.iap.ac.cn, and it will point to https://naqpms.iap.ac.cn/esgf-node-manager/https://naqpms.iap.ac.cn ESGF services download demo I --HTTP website Choose any dataset you want to download

12  Visit https://naqpms.iap.ac.cn, and it will point to https://naqpms.iap.ac.cn/esgf-node-manager/https://naqpms.iap.ac.cn ESGF services download demo I --HTTP website Choose any dataset you want to download

13  Visit https://naqpms.iap.ac.cn, and it will point to https://naqpms.iap.ac.cn/esgf-node-manager/https://naqpms.iap.ac.cn ESGF services download demo I --HTTP website Choose any dataset you want to download The first time you call for the data will need openid and passwd, it will not need again before the browser has been closed.

14  Visit https://naqpms.iap.ac.cn, and it will point to https://naqpms.iap.ac.cn/esgf-node-manager/https://naqpms.iap.ac.cn ESGF services download demo I --HTTP website Choose any dataset you want to download The passwd of guestuser is 12345678 ^_^

15  Visit https://naqpms.iap.ac.cn, and it will point to https://naqpms.iap.ac.cn/esgf-node-manager/https://naqpms.iap.ac.cn ESGF services download demo I --HTTP website Choose any dataset you want to download The passwd of guestuser is 12345678 ^_^ Date: 2014-02-20 Download the dataset at this meeting room, the speed is 2.4M/s

16  Visit esg.bnu.edu.cn, and it will point to http://esg.bnu.edu.cn/esgf-web-fe/ ESGF services download demo II --HTTP website

17  Visit esg.bnu.edu.cn, and it will point to http://esg.bnu.edu.cn/esgf-web-fe/ ESGF services download demo II --HTTP website The published model will list here.

18  Visit esg.bnu.edu.cn, and it will point to http://esg.bnu.edu.cn/esgf-web-fe/ ESGF services download demo II --HTTP website The published model will list here.

19  Visit esg.bnu.edu.cn, and it will point to http://esg.bnu.edu.cn/esgf-web-fe/ ESGF services download demo II --HTTP website The published model will list here.

20  Visit esg.bnu.edu.cn, and it will point to http://esg.bnu.edu.cn/esgf-web-fe/ ESGF services download demo II --HTTP website The published model will list here.

21 ESGF services download demo II --HTTP website

22  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate? Put this url in your browser address bar, and “enter”  http://esg.bnu.edu.cn/esg- search/wget/?shards=esg.bnu.edu.cn:8983/solr&limit=2000&model=wrf&e xperiment=wrf201001 ESGF services download demo III --wget scripts And it will download one wget scripts file named wget- 20140220113636.sh

23  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate? Put this url in your browser address bar, and “enter”  http://esg.bnu.edu.cn/esg- search/wget/?shards=esg.bnu.edu.cn:8983/solr&limit=2000&model=wrf&e xperiment=wrf201001 ESGF services download demo III --wget scripts And it will download one wget scripts file named wget- 20140220113636.sh It include the all wrf201001 files for downloading.

24  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate?  How to run? ESGF services download demo III --wget scripts Run the generated wget scripts file: wget- 20140220113636.sh Demo run it in mac os(with wget and openssl-0.9.8y), also can be run Linux(need wget and openssl, version 0.9.8 is better).

25  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate?  How to run? ESGF services download demo III --wget scripts Run the generated wget scripts file: wget- 20140220113636.sh Demo run it in mac os(with wget and openssl-0.9.8y), also can be run Linux(need wget and openssl, version 0.9.8 is better). Begin downloading

26  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate?  How to run? ESGF services download demo III --wget scripts Run the generated wget scripts file: wget- 20140220113636.sh Demo run it in mac os(with wget and openssl-0.9.8y), also can be run Linux(need wget and openssl, version 0.9.8 is better). Download one by one

27  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate?  How to run? ESGF services download demo III --wget scripts Run the generated wget scripts file: wget- 20140220113636.sh Demo run it in mac os(with wget and openssl-0.9.8y), also can be run Linux(need wget and openssl, version 0.9.8 is better). Interrupt and continue downloading Ctrl+C to interrupt it here Re-run and begin downloading here

28  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate? Put this url in your browser address bar  http://esg.bnu.edu.cn/esg- search/wget/?shards=esg.bnu.edu.cn:8983/solr&limit=2000&model=wrf&e xperiment=wrf201001 http://esg.bnu.edu.cn/esg- search/wget/?shards=esg.bnu.edu.cn:8983/solr&limit=2000&model=wrf&e xperiment=wrf201001  In this url,  limit=2000 means the max number for downloading file is 2000, the defaults is 1000.  model=wrf, which model dataset you want, the defaults is all, and we need the model list in MICS Asia project  experiment=wrf201001, which experiment dataset you want  More, you can add institute=IAP and so on in this search url, the keyword can be found in the website. ESGF services download demo III --wget scripts

29  Besides, you can use wget scripts to chose dataset and download dataset.  How to generate? Put this url in your browser address bar  http://esg.bnu.edu.cn/esg- search/wget/?shards=esg.bnu.edu.cn:8983/solr&limit=2000&model=wrf&e xperiment=wrf201001 http://esg.bnu.edu.cn/esg- search/wget/?shards=esg.bnu.edu.cn:8983/solr&limit=2000&model=wrf&e xperiment=wrf201001  In this url,  limit=2000 means the max number for downloading file is 2000, the defaults is 1000.  model=wrf, which model dataset you want, the defaults is all, and we need the model list in MICS Asia project  experiment=wrf201001, which experiment dataset you want  More, you can add institute=IAP and so on in this search url, the keyword can be found in the website. ESGF services download demo III --wget scripts The keyword you can find here.

30  More, you can generate the wget script from website, but the defaults number of downloading file is 1000. ESGF services download demo IV --wget scripts Both can generate the wget scripts

31

Download ppt "The status of data server for MICS Asia project Qizhong Wu, Zifa Wang, Zhe Wang, et al. 2014-02-21 5 th international Workshop on Atmospheric Modeling."

Similar presentations

WordPress Installation for Beginners Sheila Bergman

WordPress Installation for Beginners Sheila Bergman
The Internet.

The Internet.
Safer, Speedier and Sexier Surfing with Safari. Which Web Browser?

Safer, Speedier and Sexier Surfing with Safari. Which Web Browser?
CS1203 Uploading homework to be graded. C Click Here.

CS1203 Uploading homework to be graded. C Click Here.
1 Configuring Internet- related services (April 22, 2015) © Abdou Illia, Spring 2015.

1 Configuring Internet- related services (April 22, 2015) © Abdou Illia, Spring 2015.
Surfing the Net. Surfing the net Browsers – Internet Explorer, Firefox, others Dissecting URLs Some web page definitions Browser navigation Bookmarks.

Surfing the Net. Surfing the net Browsers – Internet Explorer, Firefox, others Dissecting URLs Some web page definitions Browser navigation Bookmarks.
OAAIS Enterprise Information Security Security Awareness, Training & Education (SATE) Program or 415.514-3333 UCSF Campus VPN.

OAAIS Enterprise Information Security Security Awareness, Training & Education (SATE) Program or UCSF Campus VPN.
Hosting Your Web site Guide to Accessing Student Web Space (for most up-to-date information)

Hosting Your Web site Guide to Accessing Student Web Space (for most up-to-date information)
1 Configuring Web services (Week 15, Monday 4/17/2006) © Abdou Illia, Spring 2006.

1 Configuring Web services (Week 15, Monday 4/17/2006) © Abdou Illia, Spring 2006.
Building Web Pages With Microsoft Office. Introduction This tutorial is for the beginning web builder. It utilizes software that you already have, Microsoft.

Building Web Pages With Microsoft Office. Introduction This tutorial is for the beginning web builder. It utilizes software that you already have, Microsoft.
Exploring the Internet Creating and setting up your website 91.113-021 Instructor: Michael Krolak 91.113-031 Instructor: Patrick Krolak See also

Exploring the Internet Creating and setting up your website Instructor: Michael Krolak Instructor: Patrick Krolak See also
Exploring the Internet Creating and setting up your website 91.113-021 Instructor: Michael Krolak 91.113-031 Instructor: Patrick Krolak See also

Exploring the Internet Creating and setting up your website Instructor: Michael Krolak Instructor: Patrick Krolak See also
Managing references : Mendeley

Managing references : Mendeley
Where’s my Family Search? PART 2 10/12/13 Pamela Brigham.

Where’s my Family Search? PART 2 10/12/13 Pamela Brigham.
Procedure for preparation of BOE by uploading Item Details using MS Excel Create a BOE through SEZ online system. Enter details under ‘BOE Details’ and.

Procedure for preparation of BOE by uploading Item Details using MS Excel Create a BOE through SEZ online system. Enter details under ‘BOE Details’ and.
Web Design Terms and Concepts Ms. Scales. Q. What is a Server? A. A server is a computer that stores information many people can access. It runs special.

Web Design Terms and Concepts Ms. Scales. Q. What is a Server? A. A server is a computer that stores information many people can access. It runs special.
Squid Proxy CentOS 6.4 Prepared by : Mr. Sopheap Position : IT Support Location : Deam Computer Date : 24/July/2013.

Squid Proxy CentOS 6.4 Prepared by : Mr. Sopheap Position : IT Support Location : Deam Computer Date : 24/July/2013.
Eucalyptus Virtual Machines Running Maven, Tomcat, and Mysql.

Eucalyptus Virtual Machines Running Maven, Tomcat, and Mysql.
 Internet vs WWW  Pages vs Sites  How the Internet Works  Getting a Web Presence.

 Internet vs WWW  Pages vs Sites  How the Internet Works  Getting a Web Presence.
Computer Learning Ph.D. Candidate Department of Electrical and Computing Engineering University of Delaware Instructor: Jonghyun Kim 5 (Beginning Level)

Computer Learning Ph.D. Candidate Department of Electrical and Computing Engineering University of Delaware Instructor: Jonghyun Kim 5 (Beginning Level)

Similar presentations

Ads by Google