{"id":364,"date":"2018-05-03T14:34:42","date_gmt":"2018-05-03T12:34:42","guid":{"rendered":"https:\/\/blogs.fu-berlin.de\/reseda\/?page_id=364"},"modified":"2018-09-25T11:06:00","modified_gmt":"2018-09-25T09:06:00","slug":"esa-scihub","status":"publish","type":"page","link":"https:\/\/blogs.fu-berlin.de\/reseda\/esa-scihub\/","title":{"rendered":"Sentinel \/ SciHUB"},"content":{"rendered":"<p>You will get to know an online platform that lets you search and download Sentinel 1 and 2 data &#8211; the ESA SciHUB portal. Again, there are ways to download a lot of data automatically &#8211; Have a look at the <a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/sentinel-big-data-download\/\">section for BIG DATA downloading<\/a> and test your knowledge of this section with an exercise!<\/p>\n<div style=\"background-color:#f1f1f1;padding:18px 30px 1px\">\n<h1>Section in a Box<\/h1>\n<p>In this section, the following content awaits you:<\/p>\n<p><a href=\"#1\"><strong>1 ESA SciHUB User Interface<\/strong><\/a><br \/>\n\u2013 visiting ESA SciHUB for the first time<br \/>\n<a href=\"#2\"><strong>2 Registration<\/strong><\/a><br \/>\n\u2013 do a registration in order to be allowed to search and download products<br \/>\n<a href=\"#3\"><strong>3 Perform a Search<\/strong><\/a><br \/>\n\u2013 create a search query to get products from the database<br \/>\n<a href=\"#4\"><strong>4 Download one or several Datasets<\/strong><\/a><br \/>\n\u2013 download Sentinel 1 and 2 products<br \/>\n<a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/esa-scihub-exercise\/\"><strong>EXERCISE<\/strong><\/a>\n<\/div>\n<p><\/br><a name=\"1\"><\/a><\/p>\n<h1>1 ESA SciHUB User Interface<\/h1>\n<p>The ESA Open Access Hub, or SciHUB, provides complete, free and open access to Sentinel-1, Sentinel-2 and Sentinel-3 user products. Sentinels products are available at no cost for anybody, provided you accept the <a href=\"https:\/\/sentinels.copernicus.eu\/documents\/247904\/690755\/Sentinel_Data_Legal_Notice\" target=\"_blank\">Legal Notice<\/a> on the use of Copernicus Sentinel Data and Service Information. You get to the ESA SciHUB via the following URL using any web browser (Firefox in our RESEDA VM):<\/p>\n<p><a href=\"https:\/\/scihub.copernicus.eu\/dhus\/#\/home\" target=\"_blank\">https:\/\/scihub.copernicus.eu\/dhus\/#\/home<\/a><\/p>\n<p>Once loaded, the main SciHUB graphical user interface (GUI) should be visible, which is composed of several key elements:<\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_001.png\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_001.png\" alt=\"\" width=\"1920\" height=\"953\" class=\"aligncenter size-full wp-image-1354\" srcset=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_001.png 1920w, https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_001-300x149.png 300w, https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_001-768x381.png 768w, https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_001-1024x508.png 1024w, https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_001-1200x596.png 1200w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">ESA SciHUB user interface <\/span><\/div>\n<ul>\n<li><strong><font color=\"#6b9e1f\">1 Search Panel<\/font><\/strong>: provides a full text search, an advanced search option and a save search tool<\/li>\n<li><strong><font color=\"#6b9e1f\">2 Header Menu Bar<\/font><\/strong>: contains sign up, login and help functionalities<\/li>\n<li><strong><font color=\"#6b9e1f\">3 Select Map Layer<\/font><\/strong>: choose image data for visualization in the Image View (<em>Terrain+Overlay<\/em>, <em>Open Street Map<\/em> or <em>Sentinel 2 images<\/em>)<\/li>\n<li><strong><font color=\"#6b9e1f\">4 Image View<\/font><\/strong>: embedded map to visualize search results<\/li>\n<li><strong><font color=\"#6b9e1f\">5 Drawing Tools and Coordinates<\/font><\/strong>: shows geographical coordinates in longitute and latitute of current coursor position and allows drawing the area of interest (AOI) on the map:\n<ul>\n<li><strong>Pan<\/strong>: moving the map layer <\/li>\n<li><strong>Box<\/strong>: defining a rectangle area of interest  <\/li>\n<li><strong>Polygon<\/strong>: defining an area of interest enclosed by a polygon shape  <\/li>\n<li><strong>Clear<\/strong>: deleting the area of interests active on map  <\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><\/br><a name=\"2\"><\/a><\/p>\n<h1>2 Registration<\/h1>\n<p>First of all, same as with USGS EarthExplorer, you need to register in order to fully use the services by clicking on the SIGN UP button in the Header Menu Bar (2) and proceed through the user registration. The registration grants access rights for searching and downloading Sentinels products:<\/p>\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-9\" class=\"h5p-iframe\" data-content-id=\"9\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"ESA_reigstration\"><\/iframe><\/div>\n<p>Once you have completed the registration, you should get an email on your given email address to confirm your account. After confirmation you will be redirected to the main ESA Sentinel website. Click on &#8220;Open Hub&#8221; on this page to be sent to the SciHub portal and log in with your user data. You have successfully logged in if you recognize your username in the upper right area:<\/p>\n<div class=\"h5p-iframe-wrapper\"><iframe id=\"h5p-iframe-10\" class=\"h5p-iframe\" data-content-id=\"10\" style=\"height:1px\" src=\"about:blank\" frameBorder=\"0\" scrolling=\"no\" title=\"ESA_login\"><\/iframe><\/div>\n<p><\/br><a name=\"3\"><\/a><\/p>\n<h1>3 Perform a Search<\/h1>\n<p>Let us use an example to explore the search function of the ESA SciHUB: We are looking for all Sentinel 2 scenes (Level-1) that depict Berlin in summer 2017 (June, July &amp; August) and have a maximum cloud cover of 10 %!<\/p>\n<p>Unlike <a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/usgs-earth-explorer\/\" target=\"_blank\">EarthExplorer<\/a>, SciHub does not support Google Maps search. Therefore, the most straightforward way to define your area of interest is to use the <strong>Polygon Tool<\/strong> in the <font color=\"#6b9e1f\"><strong>5 Drawing Tools and Coordinates<\/strong><\/font> elements to mark your study area. So zoom to Berlin and click on the Polygon-Tool. You can define a polygon by successively defining the vertices by a single left click. The polygon will not be finalized until you click on the first point again, which fills it yellow, as shown in the picture:<\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_009.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_009.png\" class=\"aligncenter\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Drawing an AOI with the Polygon Tool (bottom)<\/span><\/div>\n<p>It makes sense to filter the results using the advanced search settings icon <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_011.png\" width=\"19\" height=\"21\" class=\"alignnone size-full wp-image-1378\" \/>, which can be found in the left area of the <strong><font color=\"#6b9e1f\">1 Search Panel<\/font><\/strong>. <\/p>\n<ul>\n<li><strong>Sort by<\/strong>: sort results by sensing date, ingestion date or cloud coverage<\/li>\n<li><strong>Order by<\/strong>: sort results ascending or descending<\/li>\n<li><strong>Sensing Period<\/strong>: returns all the products whose sensing dates are included in the defined period<\/li>\n<li><strong>Ingestion Period<\/strong>: returns all the products whose publication dates on the Data Hub are included in the defined period<\/li>\n<\/ul>\n<p>Sentinel 2 provides the following settings (for more information have a look at <a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/sentinel-2\/\" target=\"_blank\">chapter Sentinel 2<\/a>:<\/p>\n<ul>\n<li><strong>Satellite Platform<\/strong>: include Sentinel 2-A or Sentinel 2-B; leave blank for both (recommended)<\/li>\n<li><strong>Product Type<\/strong>: choose S2MSI1C for Level-1 data or S2MSI2Ap for Level-2 data<\/li>\n<li><strong>Relative Orbit Number<\/strong>: specify relative orbit (more information <a href=\"https:\/\/sentinel.esa.int\/web\/sentinel\/missions\/sentinel-2\/satellite-description\/orbit\" target=\"_blank\">here<\/a>)<\/li>\n<li><strong>Cloud Cover %<\/strong>: specify cloud cover allowed; use brackets for a query, for example allow 0 to 10% cloud cover within scene: &#8220;[0 TO 10]&#8221;<\/li>\n<\/ul>\n<p>Take the query for Sentinel 2 Level-1 products as follows:<\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_010.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_010.png\" class=\"aligncenter\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Advanced Search Tools<\/span><\/div>\n<p>Press the lens icon <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_015.png\" alt=\"\" width=\"30\" height=\"32\" class=\"alignnone size-full wp-image-1384\" \/> to start the query. The Search results list provides all the products matching the submitted search query. Each result consists of thumbnail, the product name, a download-link, the sensing date, the instrument name, the imaging mode, the satellite name and the size of the file in MB. In the upper part of the result window, the current query can be obtained in text form. You can copy this text to the <strong><font color=\"#6b9e1f\">1 Search Panel<\/font><\/strong> to reproduce the identical query later on.  <\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_012.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_012.png\" class=\"aligncenter\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Query results<\/span><\/div>\n<p>There are the several options for each product when hovering over it with the mouse coursor: <\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_013.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_013.png\" class=\"aligncenter\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Query results<\/span><\/div>\n<ul>\n<li><strong><font color=\"#6b9e1f\">1<\/font> Select Product<\/strong>: select items in order to add them to the cart<\/li>\n<li><strong><font color=\"#6b9e1f\">2<\/font> Zoom to Product<\/strong>: zoom to product in map view<\/li>\n<li><strong><font color=\"#6b9e1f\">3<\/font> View Product Details<\/strong>: show detailed metadata for product<\/li>\n<li><strong><font color=\"#6b9e1f\">4<\/font> Add Product to Cart<\/strong>: adding porducts to cart in order to download products<\/li>\n<li><strong><font color=\"#6b9e1f\">5<\/font> Download Product<\/strong>: directly download product<\/li>\n<\/ul>\n<p><\/br><a name=\"4\"><\/a><\/p>\n<h1>4 Download one or several Datasets<\/h1>\n<p>In order to download a single Sentinel scene simply click on the download icon <img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_014.png\" alt=\"\" width=\"26\" height=\"25\" class=\"alignnone size-full wp-image-1383\" \/> and pick a location on your hard drive.<\/p>\n<p>If you want to download multiple datasets, choose <strong>Add Product to Cart<\/strong>. The shopping cart can be viewed in your user profile in the <strong><font color=\"#6b9e1f\">2 Header Menu Bar<\/font><\/strong>:<\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_016.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_016.png\" class=\"aligncenter\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Open Cart<\/span><\/div>\n<p>When you examine your shopping cart, it is possible to select just some of them or to bulk download all of the products in the Cart by clicking on <img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_018.png\" width=\"100\" class=\"alignnone size-full wp-image-1388\" \/>. A download window will pop up, asking you confirmation to save a &#8220;.meta4&#8221;-file, containing all the metalinks of the products in the Cart.<\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_017.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_017.png\" class=\"aligncenter\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Open Cart<\/span><\/div>\n<p>To make use of such a meta4-file, a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Comparison_of_download_managers\" target=\"_blank\">download manager<\/a> is required. For this purpose, we will use the <a href=\"https:\/\/aria2.github.io\/\" target=\"_blank\">aria2 <\/a>download utility, which is already installed in our VM. First of all, open the linux terminal &#8211; it is linked in the taskbar of our VM:<\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/USGS_036.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/USGS_036.png\" class=\"aligncenter size-full wp-image-1280\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Linux terminal shortcut in taskbar<\/span><\/div>\n<p>Type the following command into the terminal, but you need to replace your username (instead of <span class=\"crayon-inline theme:Amityresedaterminal\">user123<\/span>), your password (instead of <span class=\"crayon-inline theme:Amityresedaterminal\">password123<\/span>) and the path to your .meta4-file (instead of <span class=\"crayon-inline theme:amityresedaterminal\">\/media\/sf_exchange\/products.meta4<\/span>) before executing. Pay special attention to the quotes containing the username and password, because they must be preserved!<\/p>\n<pre class=\"theme:amityresedaterminal nums:false\">\r\naria2c --max-concurrent-downloads=2 -d \/media\/sf_exchange --http-user='user123' --http-passwd='password123' -M \/media\/sf_exchange\/products.meta4\r\n<\/pre>\n<p>Explanation: The download utility is addressed by <span class=\"crayon-inline theme:amityresedaterminal\">aria2c<\/span>. The max concurrent downloads are limited by ESA to two parallel downloads, so we set it to two (because its better than one&#8230;) via <span class=\"crayon-inline theme:amityresedaterminal\">&#8211;max-concurrent-downloads=2<\/span>. The output directory is set to the exchange directory by <span class=\"crayon-inline theme:amityresedaterminal\">-d \/media\/sf_exchange<\/span>. You could change this directory to your liking. <\/p>\n<p><a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_019.png\"><img decoding=\"async\" src=\"https:\/\/blogs.fu-berlin.de\/reseda\/files\/2018\/05\/ESA_019.png\" class=\"aligncenter\" \/><\/a><\/p>\n<div style=\"margin: -30px 0 20px 0;text-align: center\"><span style=\"color: #686868;font-size: small\">Terminal command for bulk downloading Sentinel 1 \/ 2 data based on meta4-file<\/span><\/div>\n<p><\/br><\/br><\/p>\n<hr style=\"height:4px;background-color:#6b9e1f\">\n<a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/sentinel-big-data-download\/\"><br \/>\n<button style=\"width:100%;text-align:right;padding: 10 0;background-color:white;margin:-55px 0 0 0\"><\/p>\n<div style=\"font-family: 'Noto Sans',sans-serif;line-height: 1.2\">\n<span style=\"font-size: 12px;color:#bfbfbf\"><strong><em>NEXT<\/em><\/strong><\/span><br \/>\n<span style=\"font-size: 30px;color:#6b9e1f\"><strong><em>Sentinel BIG DATA<\/em><\/strong><\/span>\n<\/div>\n<p><\/button><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>You will get to know an online platform that lets you search and download Sentinel 1 and 2 data &#8211; the ESA SciHUB portal. Again, there are ways to download a lot of data automatically &#8211; Have a look at the section for BIG DATA downloading and test your knowledge of this section with an &hellip; <a href=\"https:\/\/blogs.fu-berlin.de\/reseda\/esa-scihub\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Sentinel \/ SciHUB&#8221;<\/span><\/a><\/p>\n","protected":false},"author":3237,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-364","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/pages\/364","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/users\/3237"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/comments?post=364"}],"version-history":[{"count":45,"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/pages\/364\/revisions"}],"predecessor-version":[{"id":2496,"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/pages\/364\/revisions\/2496"}],"wp:attachment":[{"href":"https:\/\/blogs.fu-berlin.de\/reseda\/wp-json\/wp\/v2\/media?parent=364"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}