Initial PoC

geotekne-argentina · Oct 26, 2022 · f17c328 · f17c328
1 parent d3551b1
commit f17c328
Show file tree

Hide file tree

Showing 342 changed files with 8,365 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -1 +1,5 @@
-# ncep-weather-geoserver
+# ncep-weather-geoserver
+
+Initial notes:
+- Check Geoserver at port 8080 (username GEOSERVER_ADMIN_USER with password geoserver)
+- Check Sample webapp at port 80
diff --git a/conf/ncep-weather-worker/config.sh b/conf/ncep-weather-worker/config.sh
@@ -0,0 +1,22 @@
+#!/bin/sh
+# WEATHER VARIABLES
+# atmos variables
+C_varatmos="lev_10_m_above_ground=on&lev_10_m_above_mean_sea_level=on&lev_500_mb=on&lev_entire_atmosphere=on&lev_mean_sea_level=on&lev_surface=on&var_APCP=on&var_GUST=on&var_HGT=on&var_PRMSL=on&var_TCDC=on&var_TMP=on&var_UGRD=on&var_VGRD=on"
+# wave variables 
+C_varwave="var_HTSGW=on&var_WVDIR=on&var_WVPER=on"
+
+# REGION OF INTEREST
+# note: it's required to keep subregions separated since 
+# wave GFS service is not cutting by subregion as atmos GFS service is doing (each grade in lon = 4 pixels). 
+# differences between layers/bands size in rows/columns triggered errors while reading files
+C_atmossubregion="subregion=&leftlon=-10&rightlon=28&toplat=45&bottomlat=32"
+C_wavesubregion="subregion=&leftlon=-10&rightlon=27.75&toplat=45&bottomlat=32"
+
+# TIMEFRAME
+# Forecast files goes from f000 to f384 (1hs-to-1hs and 3hs-to-3hs depending on service/date)
+# NOAA allows, first 5 days = 1to1 (120 requests), next days = 3to3
+# Example: 0,6,12,18,24,30,36,42,48,60,72,84,96,108,120
+# so mapping the example it would be requesting data from these files: f000,f006,f012,f018,f024,f030,f036,f042,f048,f060,f072,f084,f096,f108,f120
+# then cycle all the elements on list (and finally concatenate all downloaded files)
+# for the purpose of historical info, we only need to get the f000 file with stats (since it's the current status for the date/time)
+C_predictionslist="f000 f006 f012 f018 f024 f030 f036 f042 f048 f060 f072 f084 f096 f108 f120"
diff --git a/conf/pgadmin/servers.json b/conf/pgadmin/servers.json
@@ -0,0 +1,13 @@
+{
+    "Servers": {
+        "1": {
+            "Name": "Postgres server",
+            "Group": "Postgres",
+            "Port": 5432,
+            "Username": "docker",
+            "Host": "weatherdb",
+            "SSLMode": "prefer",
+            "MaintenanceDB": "weather"
+        }
+    }
+}
diff --git a/data/geoserver/datadir/.gitignore b/data/geoserver/datadir/.gitignore
@@ -0,0 +1,2 @@
+cluster
+gwc-layers
diff --git a/data/geoserver/datadir/.placeholder b/data/geoserver/datadir/.placeholder
diff --git a/data/geoserver/datadir/.updatepassword.lock b/data/geoserver/datadir/.updatepassword.lock
diff --git a/data/geoserver/datadir/README.rst b/data/geoserver/datadir/README.rst
@@ -0,0 +1,79 @@
+Included Data
+=============
+
+This directory provides a GeoServer data directory packaged as part of our product downloads:
+
+* http://geoserver.org/display/GEOS/Download
+
+The data directory includes the following sets of information:
+
+* arc_sample
+* img_sample
+* mosaic_sample
+* nyc (giant polygon, poi, poly landmark, tiger roads)
+* sf (archsites,bugsites,restricted,roads,streams, sfdem)
+* shapefiles(states)
+* taz_shapes( cities, roads, state boundaries, water bodies)
+
+ARC Sample
+----------
+
+Data was provided by GeoSolutions with redistribution rights.
+
+IMG Sample
+----------
+
+Data was provided by GeoSolutions with redistribution rights.
+
+MOASIC Sample
+-------------
+
+Data was provided by GeoSolutions with redistribution rights.
+
+New York City
+-------------
+
+Data was provided by the Open Planning Project, processed from United States Census Bureau's Topologically Integrated Geographic Encoding and Referencing (TIGER) dataset.
+
+Spearfish
+---------
+
+Spearfish sample data has been provided by GRASS.
+
+* http://grass.osgeo.org/download/sample-data/
+
+To quote from the http://grass.osgeo.org/uploads/grass/sampledata/spearDB.pdf ::
+
+    A majority of this spearfish database was initially provided to USACERL by the EROS Data Center
+    (EDC) in Sioux Falls, SD. The GRASS Development staff expresses acknowledgement and thanks to: the
+    U.S. Geological Survey (USGS) and EROS Data Center for allowing us to distribute this data with our
+    release of GRASS software; and to the U.S. Census Bureau for their samples of TIGER/Line data and the
+    STF1 data which were used in the development of the TIGER programs and tutorials. Thanks also to
+    SPOT Image Corporation for providing multispectral and panchromatic satellite imagery for a portion of
+    the spearfish data set and for allowing us to distribute this imagery with GRASS software. In addition to
+    the data provided by the EDC and SPOT, researchers at USACERL have developed several new layers, thus
+    enhancing the spearfish data set.
+
+States
+------
+
+Coming from GeoTools sample data, simplified. The GeoTools file (statepop.shp) comes from Census data (by memory of people that imported it)
+
+Tasmania
+--------
+
+The data is derived from the <Digital Chart of the World `http://en.wikipedia.org/wiki/Digital_Chart_of_the_World`> , which according to wikipedia is "is freely available as of 2006".
+
+Referenced Copyright Statement:
+http://en.wikipedia.org/wiki/Vector_map#Copyrights
+
+
+The U.S. government has released the data into public domain, with the following conditions imposed (quotation from VMAP0 Copyright Statement)::
+
+    As an agency of the United States government, NIMA makes no copyright claim under Title 17 of the United States Code with respect to any copyrightable material compiled in these products, nor requires compensation for their use.
+    When incorporating the NIMA maps into your product, please include the following:
+    a. "this product was developed using materials from the United States National Imagery and Mapping Agency and are reproduced with permission",
+    b. "this product has neither been endorsed nor authorized by the United States National Imagery and Mapping Agency or the United States Department of Defense".
+
+    With respect to any advertising, promoting or publicizing of this product, NIMA requires that you refrain from using the agency's name, seal, or initials. 
+
diff --git a/data/geoserver/datadir/controlflow.properties b/data/geoserver/datadir/controlflow.properties
@@ -0,0 +1,7 @@
+timeout=60
+ows.global=100
+ows.wms.getmap=10
+ows.wfs.getfeature.application/msexcel=4
+user=6
+ows.gwc=16
+user.ows.wps.execute=1000/d;30s
diff --git a/data/geoserver/datadir/csw.xml b/data/geoserver/datadir/csw.xml
@@ -0,0 +1,27 @@
+<csw>
+  <id>csw</id>
+  <enabled>true</enabled>
+  <name>My GeoServer CSW</name>
+  <title>My GeoServer CSW</title>
+  <maintainer>http://geoserver.org/comm</maintainer>
+  <abstrct>
+This is a description of your Catalog Services For The Web.
+   </abstrct>
+  <accessConstraints>NONE</accessConstraints>
+  <fees>NONE</fees>
+  <versions>
+    <org.geotools.util.Version>
+      <version>2.0.2</version>
+    </org.geotools.util.Version>
+  </versions>
+  <keywords>
+    <string>CSW</string>
+    <string>Catalog Services For The Web</string>
+    <string>GEOSERVER</string>
+  </keywords>
+  <citeCompliant>false</citeCompliant>
+  <onlineResource>http://geoserver.org</onlineResource>
+  <schemaBaseURL>http://schemas.opengis.net</schemaBaseURL>
+  <verbose>false</verbose>
+  <canonicalSchemaLocation>false</canonicalSchemaLocation>
+</csw>
diff --git a/data/geoserver/datadir/csw/Record.properties b/data/geoserver/datadir/csw/Record.properties
@@ -0,0 +1,18 @@
+@identifier.value=if_then_else(isNull(prefixedName), name, prefixedName)
+title.value=if_then_else(isNull(title), name, title)
+creator.value='GeoServer Catalog'
+subject.value=keywords
+abstract.value=abstract
+description.value=description
+date.value="metadata.date"
+type.value='http://purl.org/dc/dcmitype/Dataset'
+references.scheme='OGC:WMS'
+references.value=strConcat('${url.wms}?service=WMS&request=GetMap&layers=', prefixedName)
+#publisher.value=
+#format.value=
+#language.value=
+#coverage.value=
+#source.value=
+#relation.value=
+#rights.value=
+#contributor.value=
diff --git a/data/geoserver/datadir/data/.gitignore b/data/geoserver/datadir/data/.gitignore
@@ -0,0 +1 @@
+osm-lowres.gpkg
diff --git a/data/geoserver/datadir/data/nomads_ncep_noaa/.gitignore b/data/geoserver/datadir/data/nomads_ncep_noaa/.gitignore
@@ -0,0 +1 @@
+images
diff --git a/data/geoserver/datadir/data/nomads_ncep_noaa/_auxiliary.xml b/data/geoserver/datadir/data/nomads_ncep_noaa/_auxiliary.xml
@@ -0,0 +1,53 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<Indexer>
+    <coverages>
+        <coverage>
+            <name>Total_cloud_cover_entire_atmosphere</name>
+        </coverage>
+        <coverage>
+            <name>Direction_of_wind_waves_surface</name>
+        </coverage>
+        <coverage>
+            <name>Temperature_isobaric</name>
+        </coverage>
+        <coverage>
+            <name>Temperature_surface</name>
+        </coverage>
+        <coverage>
+            <name>Mean_period_of_wind_waves_surface</name>
+        </coverage>
+        <coverage>
+            <name>v-component_of_wind_isobaric</name>
+        </coverage>
+        <coverage>
+            <name>Pressure_reduced_to_MSL_msl</name>
+        </coverage>
+        <coverage>
+            <name>Total_cloud_cover_isobaric</name>
+        </coverage>
+        <coverage>
+            <name>u-component_of_wind_height_above_ground</name>
+        </coverage>
+        <coverage>
+            <name>v-component_of_wind_height_above_ground</name>
+        </coverage>
+        <coverage>
+            <name>Geopotential_height_surface</name>
+        </coverage>
+        <coverage>
+            <name>u-component_of_wind_isobaric</name>
+        </coverage>
+        <coverage>
+            <name>Wind_speed_gust_surface</name>
+        </coverage>
+        <coverage>
+            <name>Geopotential_height_isobaric</name>
+        </coverage>
+        <coverage>
+            <name>Significant_height_of_combined_wind_waves_and_swell_surface</name>
+        </coverage>
+    </coverages>
+    <parameters>
+        <parameter name="uniqueTimeAttribute" value="true"/>
+    </parameters>
+</Indexer> 
diff --git a/data/geoserver/datadir/data/nomads_ncep_noaa/datastore.properties b/data/geoserver/datadir/data/nomads_ncep_noaa/datastore.properties
@@ -0,0 +1,18 @@
+#SPI = org.geotools.data.h2.H2DataStoreFactory
+#database = weather
+#user = dummy
+#passwd = dummy
+
+SPI=org.geotools.data.postgis.PostgisNGDataStoreFactory
+host=weatherdb
+port=5432
+database=weather
+schema=public
+user=docker
+passwd=docker
+Loose\ bbox=true
+Estimated\ extends=false
+validate\ connections=true
+Connection\ timeout=10
+preparedStatements=true
+
diff --git a/data/geoserver/datadir/data/nomads_ncep_noaa/indexer.xml b/data/geoserver/datadir/data/nomads_ncep_noaa/indexer.xml
@@ -0,0 +1,132 @@
+<?xml version="1.0" encoding="UTF-8"?>
+<Indexer>
+<domains>
+        <domain name="time">
+            <attributes>
+                <attribute>time</attribute>
+            </attributes>
+        </domain>
+    </domains>
+<schemas>
+	<schema name="default">
+             <attributes>the_geom:Polygon,location:String,imageindex:Integer,time:java.util.Date</attributes>
+        </schema>
+	<schema name="default_plus_height_above_ground">
+	     <attributes>the_geom:Polygon,location:String,imageindex:Integer,time:java.util.Date,height_above_ground:java.lang.Float</attributes>
+        </schema>
+	<schema name="default_plus_isobaric">
+	      <attributes>the_geom:Polygon,location:String,imageindex:Integer,time:java.util.Date,isobaric:java.lang.Float</attributes>
+        </schema>
+</schemas>
+    <coverages>
+	<coverage>
+            <name>Total_cloud_cover_entire_atmosphere</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Direction_of_wind_waves_surface</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Temperature_isobaric</name>
+	    <schema ref="default_plus_isobaric" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Temperature_surface</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+	<coverage>
+            <name>Mean_period_of_wind_waves_surface</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Geopotential_height_surface</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>u-component_of_wind_isobaric</name>
+	    <schema ref="default_plus_isobaric" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>v-component_of_wind_isobaric</name>
+	    <schema ref="default_plus_isobaric" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Pressure_reduced_to_MSL_msl</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Total_cloud_cover_isobaric</name>
+	    <schema ref="default_plus_isobaric" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>u-component_of_wind_height_above_ground</name>
+	    <schema ref="default_plus_height_above_ground" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>v-component_of_wind_height_above_ground</name>
+	    <schema ref="default_plus_height_above_ground" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Wind_speed_gust_surface</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+        <coverage>
+            <name>Geopotential_height_isobaric</name>
+	    <schema ref="default_plus_isobaric" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+	<coverage>
+            <name>Significant_height_of_combined_wind_waves_and_swell_surface</name>
+	    <schema ref="default" />
+	    <domains>
+               	<domain ref="time"/>
+	    </domains>
+        </coverage>
+    </coverages>
+    <parameters>
+        <parameter name="AuxiliaryFile" value="_auxiliary.xml"/>
+        <parameter name="AbsolutePath" value="true"/>
+    </parameters>
+</Indexer>