GeoStor More Data & Updates

The following data has been added or updated throughout the GeoStor System. We appreciate all those willing to coordinate and distribute information via GeoStor- Thank You!

Additions:
These orthos have not been added to the High resolution ortho service. We are still working on our long term strategy to handle the high resolution orthos in an timely manner.
* 2009 Benton and Washington County orthos- Provided by Benton & Washington County
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_01/2009/NWARPC/

* 2008-2009 orthos for select lakes- Provided by Army Corps of Engineers
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_01/2009/USCOE/

Updates:
* All High & Medium Resolution National Hydrology datasets- Provided by USGS with assistance from ADEQ
http://www.geostor.arkansas.gov/G6/Home.html?q=NHD

* City Boundaries- Provided by Arkansas Highway & Transportation Department http://bit.ly/Zpa0i
NHD & City Boundary updates will be reflected in WFS. Basemap cache will be updated in the coming weeks.

* Ortho Footprint for Files on GeoStor FTP updated with ortho additions above
http://bit.ly/4z6TDm

* Inland Electronic Navigation Charts (off site)- Provided by U.S. Army Corps of Engineers
http://crunch.tec.army.mil/enc/echarts/IENCShapeFileRequest.cfm

Posted from Geostor Blog

GeoStor Updates

Whew. What can I say, been really busy as usual and haven't posted any updates in awhile. So without further ado, here they are:

• Upgraded ArcGIS Server to 9.3.1 and converted all our services over to the new MSD format. They are very fast! I should have done this a long time ago!
  
• Our services should be accessible from anywhere or any application now.
  
• We have setup a geometry service, check it out: http://www.geostor.arkansas.gov/ArcGIS/rest/services/Geometry/GeometryServer. This mostly for developers and applications but it is a very useful service.
  
• VMware ESXi has been upgraded to 4.0, this is the software we use to virtualize our servers.
  
• The production servers have been migrated to bigger, badder and faster hardware and I am going to use the old servers to build a SQL Server 2008 cluster.
  
• You can now search the dynamic layers on the GeoStor viewer. Go to http://maps.arkansas.gov and click on the Search widget, there are examples for each layer to search by.
  
• Our latest blog posts display on GeoStor now
  

Coming Up

• Upgrade FME Server from 2009 to 2010, need to test in development first though.
  
• Possible Image Server implementation?
  
• Migrate FTP server off old hardware to virtual machine
  

Gotta get back to work now J

Glen

GeoStor Blog: http://geostor.blogspot.com/

ArcGIS Image Server Extension- Discussion

AGIO staff have been discussing the addition of the Image Server Extension to the GeoStor infrastructure. We would like to hear your thoughts.

Why
Several cities and/or counties in the state of Arkansas have acquired 1 foot and six inch ortho photography. They are interested in making the data publicly available via GeoStor (thank you). AGIO staff believe this will be a growing trend and want to be prepared to distribute the data in a useful and timely manner.

Issue
1) The data is provided in multiple projections and coordinate systems. While this is perfectly acceptable, it proves to be a challenge on several fronts when creating/combining services and providing the data as a clip, zip, ship

2) File sizes for the 1 foot and 6 inch data are large. Several have had issues downloading the data from the ftp site. The increased resolution generates a clip that generally exceeds the 2GB limit. Though other formats do support larger file sizes, there is still the download issue (discussed above).

3) Currently, a number of ortho data sets are stored in multiple locations (SDE/FTP). This results in duplicative (actually more due pyramids) disk requirements. Side note- disk isn't cheap regardless of what has been said in the past. GeoStor currently host roughly 10TB of imagery (SDE/FTP combined). This number is excpected to grow by X with the additional of more high resolution data.

4) The current process to get the data published to all the various services is time intensive (often even months). Bench mark test in other states have demonstrated processing times are dramatically reduced from months to days.

Possible Solution
ArcGIS Image Server has been implemented successfully in several other states. The product would provide the ability for the data to be stored in a single location on the FTP. Image services would actually be generated from the files on the FTP disk. This would provide for the opportunity to provide additional image services for historic ortho imagery.

Known Impact
The following are a list of impacts that we thought of. We feel sure there are likely others and are interested in hearing from you.
1) All current image service URLS would change. This would require those with saved connections to reconnect.

2) GeoStor Staff would have to change paths in a number of applications. We can live with that if we move forward.

3) Capability to download high resolution orthos via clip, zip, ship would discontinue. 1-meter statewide orthos remain available for clip, zip, ship. Users can obtain a significant area of 1-meter data.

We would like to hear from you. Have you used image server? Would changing the url paths greatly hammper your work? Other thoughts or questions?

GeoStor adds High Resolution Orthos- ArcGIS Map Service & WMS

High resolution orthos for Faulkner County, Pulaski County, Saline County and the City of Van Buren were released last week. These files are large and several have experienced problems downloading them due to the file size. AGIO staff have generated a WMS and ArcGIS map service. Users are welcome to connect to this service in lieu of downloading. Plans are in the works to generate a map cache for this data once a couple more counties are added (no eta at this time).You can visit http://www.geostor.arkansas.gov/G6/files/GeoStor_Tutorial_MS_WMS.pdf to learn how to connect to the ArcGIS map service or WMS.

Posted from http://geostor.blogspot.com/

Attention: Outage

Many of you noticed an issue with connecting to various services and ftp on Tuesday. The issues were resolved with a quick fix. We will be taking GeoStor off-line Friday (9/17) at 5pm and working to fully resolve the issues. We plan to have GeoStor back on-line by late Sunday night.

Please contact geostor@arkansas.gov if you have any questions.

Posted from http://geostor.blogspot.com

More GeoStor Data / Apps / Updates

This update includes a number of additions to the GeoStor Platform. We appreciate all those willing to coordinate and distribute information via GeoStor- Thank You!
Data
* Geologic Data - provided by the Arkansas Geological Survey * Pdf and Footprint for available files (with ftp link) * http://www.geostor.arkansas.gov/G6/Home.html?q=digital+geology

High Resolution Orthos http://bit.ly/2RdELw

2008 City of Van Buren- provided by City of Van Buren
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/CITY_OF_VAN_BUREN_2008/

* 2009 Faulkner County- provided by City of Conway, Conway Development Corporation and Faulkner County
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/2009/Faulkner/

* 2009 Pulaski County- provided by Pulaski Area GIS (PAgis) member agencies and USGS FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/2009/Pulaski/

* 2009 Saline County- provided by Saline County Assessor Office
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/2009/Saline/

Application
* State Network Status Map http://bit.ly/pDwCt
* State Methamphetamine Statistics Map http://bit.ly/Kgof4
* ADEQ EnviroView (previously announced) http://bit.ly/cHwlA
* Saline County Assessor Viewer (previously announced) http://bit.ly/eatP3
* Crawford County Assessor Viewer (previously announced) http://bit.ly/vsAuv

Updates
* GeoStor Tutorial and Metadata updated with WMS & WFS (url & capabilities): http://bit.ly/3O8WMS
* Ortho Footprint for Files on GeoStor FTP (http://bit.ly/DZAbZ) updated with ortho additions abovenet

GeoStor Download Issues

The download issues should be resolved now. They were unrelated to the FTP outage, it was one of those "I'm going to do this to fix this issue but then it broke something else" things. If you got a failure or nothing at all, please resubmit your download.

Glen

GeoStor Blog: http://geostor.blogspot.com/

GeoStor Outage Resolved

The file system repair has completed and as far as I can tell everything is functioning properly again. Unfortunately, if you submitted any downloads today you will have to resubmit the job. Let me know if you run into any issues that may be related to this outage.

Glen

GeoStor Blog: http://geostor.blogspot.com/

GeoStor Outage

Our FTP server has experienced some data corruption and I am attempting to repair it, however this means that Downloads are down as well. I expect the repair process to continue though the evening since the disk being repaired is 2TB in size. I have posted a notice on the GeoStor home page and I will do another blog post when everything is resolved.

Glen

GeoStor Blog: http://geostor.blogspot.com/

GeoStor WMS Services Take 2

I have edited the previous blog post to reflect the URLs to the WMS services that actually work. Sorry for any inconviences this may have caused.

http://geostor.blogspot.com/2009/09/geostor-wms-services.html

Glen

http://geostor.blogspot.com

GeoStor WMS Services

It has come to my attention that we never published the URLs to our WMS services. So without further ado, here they are:

http://www.geostor.arkansas.gov/ArcGIS/services/BASEMAP/MapServer/WMSServer

http://www.geostor.arkansas.gov/ArcGIS/services/ORTHO2006-WMS/MapServer/WMSServer

http://www.geostor.arkansas.gov/ArcGIS/services/DRG_24K-WMS/MapServer/WMSServer

http://www.geostor.arkansas.gov/ArcGIS/services/DRG_24K_HSHADE-WMS/MapServer/WMSServer

Capabilities Links:

http://www.geostor.arkansas.gov/ArcGIS/services/BASEMAP/MapServer/WMSServer?request=GetCapabilities&service=WMS

http://www.geostor.arkansas.gov/ArcGIS/services/ORTHO2006-WMS/MapServer/WMSServer?request=GetCapabilities&service=WMS

http://www.geostor.arkansas.gov/ArcGIS/services/DRG_24K-WMS/MapServer/WMSServer?request=GetCapabilities&service=WMS

http://www.geostor.arkansas.gov/ArcGIS/services/DRG_24K_HSHADE-WMS/MapServer/WMSServer?request=GetCapabilities&service=WMS

Glen

Blog: http://geostor.blogspot.com/