Import Data - SCIHUB Legacy Sentinel-1 Download

<< Click to Display Table of Contents >>

Navigation:  Help Content > Import Data  > Download >

Import Data - SCIHUB Legacy Sentinel-1 Download

Previous pageReturn to chapter overviewNext page

Purpose

 

This tool allows one to perform a query and download Sentinel-1 data from the ESA scientific Hub (https://scihub.copernicus.eu/dhus/). An account with login credentials is required.

Please note: The account credentials are different from the ones set on the Sentinel-1 Multidownloader tool.

 

Technical Note

 

This tool performs a search for Sentinel-1 data according to the query built through the input parameters. According to today's ESA policies, a maximum of two concurrent downloads per account are allowed. The downloaded data has to be decompressed and imported using the proper SARscape tools for further processing.

 

When started from the SARscape graphical user interface (under Import Data->Sentinel Data Download), the downloader is executed as a stand-alone, detached window. In this way, the downloading process does not depend on ENVI: you can even close ENVI while the downloader will continue to run. Under Linux, we use the "xterm" application to spawn the downloader into a stand-alone terminal: please make sure that this application is already installed on the machine where you are using SARscape. Xterm is usually available by default on most of the available Linux distributions or can be easily installed through the various distribution repositories (e.g., under RHEL/CentOS, simply run "yum install xterm" as administrator to install it). However, it is not possible to start the download while another process is running on the same working directory. If this happens, the first process will be killed and has to be resumed again.

 

Progress File

When at least one full data is downloaded, a Progress File named as defined in the output field is created in the output directory. This file can be used to skip already downloaded files which match the query. This file contains a list of all the data which are completely downloaded and the MD5 match the one provided by ESA. When a second request is preformed using the Sentinel-1 Data Download tool, it is possible to set an already existing Progress File in the Progress File field. The software makes the following steps

creates a list of needed files which fulfill the query created by the user using the provided parameters

check if files in this this list are already present in the Progress File (if provided). If they are present, the files are not downloaded (again) and are skipped

If a file is already downloaded, present in the output directory and the list of needed files but not in the Progress File, the software performs a MD5 check with the file present on ESA servers and if they match, the Progress file is actualized with this acquisition.

This functionality is helpful when an archive has to be updated with new files.

 

IMPORTANT: never use the same Progress File when using two concurrent downloads!

 

Concurrent downloads

One account allows a maximum of two concurrent download. Two different download can be launched with this tool but it is imperative to use two different progress files.

 

Please note: According to the connection speed the download of a single image can take up to several hours.

 

Please note: SciHubGet also deals with data provided through the Long Term Archive (LTA) by automatically triggering and monitoring the acquisition of files no longer available in the online storage.

 

Please note: Precisoe/restituted orbit files are not included in the downloaded file and have to be downloaded separately using the proper SARscape tool. More information can be found here.

 

Preview Mode

Small previews will be downloaded in the output folder instead of the full size SAR data. Note: Preview mode is supported for Sentinel-1 SLC, RAW and GRD images. Each preview is composed by a .png file containing the quick view image and a .kml file, which contains the footprint polygon and the quick view .png draped. By clicking on the footprint polygon, the following information are displayed: Satellite ID, Acquisition mode, Polarization, Orbit Direction, Absolute Orbit, Relative Orbit and filename. This is helpful in case only one track has to be downloaded but the relative orbit is not known a priori. Defining a region of interest and entering in the Preview Mode allows the user to have an overview of all the acquisitions on the interested area. Afterwards, based on these new acquired information, the search parameters can be adapted in order to match the desired request and the preview mode can be disabled (Preview Only = FALSE) in order to download the SAR data.

 

In the example below, the preview .kml, displayed in Google Earth, of two tracks on the same area of interest is shown. Clicking of the preview footprint polygon a balloon displaying acquisition information is shown.

 

The following color code is used for the footprint polygons:

 

Yellow                SLC

Red                RAW

Carmine        GRD

Blue                S2MSI1C        

White                other

 

 

Preview

 

 

 

 

Input Files

 

Optional Input Files

Input file(s) name of the image to be used as geographic reference for the search query. These files are mandatory if no shapefile or coordinate box is given as a reference. These files can be geocoded files, slant range or ground range files. However, the data type of the whole list has to be the same.

 

Optional Files

 

Geographical region

A vector file (.shp), or a Google Earth file (.kml or .kmz) can be upload to specify a region of interest. All acquisitions inside or intersecting this polygon are returned. The shapefile must be in GEO-GLOBAL cartographic system.

 

Parameters - Principal Parameters

 

Geographic Region

Box coordinates. All acquisitions inside or intersecting this box are returned. These fields have to be left empty if a shapefile is used as spatial reference. Co-ordinate decimal values must be entered using the dot (e.g. 29.30) and not the comma (e.g. 29,30) character.

 

 West

 The Westernmost cartographic co-ordinate (in decimal degrees).

 

 North

 The Northernmost cartographic co-ordinate (in decimal degrees).

 

 East

 The Easternmost cartographic co-ordinate (in decimal degrees).

 

 South

 The Southernmost cartographic co-ordinate (in decimal degrees).

 

From

Sensing period start date (day-MONTH-year), dd-MMM-yyyy, (01-JAN-1970).

 

To

Sensing period stop date (day-MONTH-year), dd-MMM-yyyy, (01-JAN-1970).

 

Preview Only

With this flag on, the Sentinel-1 Downloader is entering in Preview Mode. More information in the technical notes.

Note: Preview will be downloaded only for SLC and GRD data (Sentinel-1).

 

Unzip Files

With this flag on, the downloaded files will be unzipped. to the directory selected in the Output Files.

 

Orbit Direction

Filter for orbit direction (Ascending, Descending, ALL). This parameter is optional.

 

Product Type

Filter for product type (GRD, SLC, RAW, ALL). This parameter is optional.

 

Acquisition Mode

Filter for acquisition mode (IW, SM, EW, ALL). This parameter is optional.

 

Relative Orbit

Filter for relative orbit (e.g. 1, 2, 3... ). This parameter is optional.

 

Polarization Mode

Filter for polarization mode (VV VH, VV, HH HV, HH, ALL). This parameter is optional.

 

Wait For Completion

It allows to close the panel ones the process is completed.

 

Login - USERNAME

Username of Sentinel Scientific Hub login credentials. This field is mandatory.

 

Login - PASSWORD

Password of Sentinel Scientific Hub login credentials. This field is mandatory.

 

Proxy - URL

If a proxy server is being used for accessing the external network, write here the server address.This field is optional.

 

Proxy - USERNAME

If the proxy server requires a username put it here.This field is optional.

 

Proxy - PASSWORD

If the proxy server requires a password, put it here.This field is optional.

 

Fiirst name

Write here your personal given name.

 

Last name

Write here your family name.

 

E-mail

Write here your e-mail address.

 

Parameters - Global

 

It brings to the general section of the Preferences parameters. Any modified value will be used and stored for further processing sessions.

 

Parameters - ESA SciHub Service

 

Base URL

It allows setting the ESA Scientific Hub web API entry point (https://scihub.copernicus.eu/dhus/) to perform queries.

 

Search URL

Subdirectory appended to the base_url address for performing search operations.

Data URL

Subdirectory appended to the base_url address for performing data downloading operations.

Connection timeout

The number of seconds SciHubGet will wait before considering a pending connection failed.

Download timeout

The number of seconds SciHubGet will wait to download at least the number of bytes specified in the download_speed field before considering a pending download failed.

Download Speed

A threshold value, in byte, of data that must be downloaded within the specified download time out, otherwise the connection is considered lost and an error is triggered.

Download Directory

The output directory where content is downloaded.

 

Parameters - ESA SciHub Account

 

Login - USERNAME

Username of Sentinel Scientific Hub login credentials. This field is mandatory.

 

Login - PASSWORD

Password of Sentinel Scientific Hub login credentials. This field is mandatory. Please be aware that this password is stored in clear in the configuration file!

 

Proxy - URL

If needed, this is the URL of the proxy that SciHubGet must use to access the web. Leave it empty if not used.

Proxy - USERNAME

If the proxy requires a username put it here. Leave it empty, otherwise.

 

Proxy - PASSWORD

If the proxy requires a password, put it here.Leave it, empty otherwise.

 

Fiirst name

Write here your personal given name.

 

Last name

Write here your family name.

 

E-mail

Write here your e-mail address.

 

Parameters - Other Parameters

 

It brings to the general section of the Preferences parameters. Any modified value will be used and stored for further processing sessions.

 

Output Files

 

Progress File Name

Name of the progress file. All the files found will be downloaded in this directory. More information in the technical notes.

 

In case the Preview Mode is active, no SAR data is downloaded. Instead, following files will be created for each acquisition:

 

*.png

Quicklook image file of the acquisition.

 

*.kml

Kml file, which can be opened in Google Earth, ArcGIS Earth (or similar). This file contains a footprint polygon and will drape the *.png image

 

*.safe

This file which contains the general product information of the acquisition in XML format. The original file is called manifest.safe. It will be automatically renamed during download in order to have several different manifest.safe in the same folder. More information here https://sentinel.esa.int/web/sentinel/user-guides/sentinel-1-sar/data-formats/safe-specification

 

*.dat (with .hdr)

Image quicklook file and corresponding hdr file readable in any GIS software.

 

Unzip files to this directory

All the downloaded files are unzipped in this directory.

 

 

General Functions

 

Exec

The processing step is executed.

 

Store Batch        

The processing step is stored in the batch list. The Batch Browser button allows to load the batch processing list.

 

Close        

The window will be closed.

 

Help

Specific help document section.

 

 

Specific Function(s)

 

None.

 

References

 

None.