This blog is maintained by GeoStor staff from the AGIO

Tuesday, December 22, 2009

WGS84 Conversion

I have been working on converting all web map services to WGS84 and it is becoming a long and laborious project so I want to know if people even want to convert to WGS84. If no one wants it I'll just leave everything as is and move on to something else.

Pros:

  • It's a standard projection, so it makes mashups A LOT easier
  • GPS points would work (they have to be converted to UTM now)
  • Our services would be compatible with just about everyone else
  • You can still use the services in your map documents

Cons:

  • It's a pain to have to re-project the data every time
  • The cached services in WGS84 will not re-project on the fly
  • You will get a warning about different projections in map documents

There will be a poll on our blog, please select your preference there.

http://geostor.blogspot.com/

Glen


 

Wednesday, December 9, 2009

GeoStor Update

So many things going on! Brief summary:

  • There were some issues with raster downloads, these should be fixed now
    • You also shouldn't be able to download a raster data set in incompatible formats now
  • BIG NEWS!!!!
    • Most of our storage hardware will be out of warranty in a few months and you know what happens when stuff goes out of warranty…
    • We petitioned for funds to replace that old hardware and it was approved!
      • So, hopefully, during the holiday season we will be upgrading our storage hardware.
      • This will cause some outages unfortunately so be prepared for it over the holidays.
  • Image Server
    • The migration is on-going, we have it installed and are building the service definitions
    • We will be migrating during the holiday season hopefully
      • This will affect anyone using our raster caches unfortunately, there will be more on this later
  • WGS84 Migration
    • We are migrating all our web services to WGS84 to be compatible with everyone else, bring on the mashups!
    • This will also allow the use of standard GPS coordinates to be used on the map viewers
  • SQL Server 2008 Migration
    • Information about the new SQL Server installation
      • Everything will be 64bit
        • Windows 2008 x64
        • SQL Server 2008 x64
        • ArcSDE x64 (Yes they have a 64 bit version of SDE. I know, right?)
      • It will be clustered using MSCS
      • All new hardware
        • 3Ghz Dual Quad Core Processors
        • 8GB RAM
        • REALLY fast storage - 2TB RAID 10
      • Spatial Changes
        • We will be using the new SDE data type ST_GEOMETRY which is almost twice as fast as the one we're currently using in Oracle
        • We will have SQL Server 2008 Spatial
    • Status:
      • The cluster has been built
      • SQL Server has been installed
      • I am working with ESRI to get SDE working because there are some strange issues going on

Glen

Visit our blog: http://geostor.blogspot.com/

Friday, November 13, 2009

Data & Metadata Updates

Izard and Calhoun County have been added to the Arkansas Road Centerline File http://bit.ly/4juvmq Press release available on AGIO Blog http://agioar.wordpress.com/

Various Statewide Datasets are being exported to the FTP site (weekly) for use by a number of users. http://bit.ly/3rXKcb

White County has been added to the cadastral layers http://bit.ly/ak3cQ

Connections to WMS (http://bit.ly/2wQMH0)/ WFS (http://bit.ly/2wQMH0) have been added to each metadata file

Tuesday, November 3, 2009

GeoStor Outage & Download Issue

DIS will be having a power outage this weekend so GeoStor will be offline for part of Saturday and all of Sunday. I expect that GeoStor will be back online Monday morning at the latest. We are also having some issues with downloads and are working to resolve them.


 

Glen

GeoStor Blog: http://geostor.blogspot.com/

Tuesday, October 20, 2009

GeoStor FTP Server Issue

It looks like the FTP server issues have been resolved (for now anyway). Let us know if you have any issues. Also, we are really close to migrating to a new FTP server, hopefully within the next week or so. Hopefully that will resolve all the issues we have been having with the old FTP server.

Glen

GeoStor Blog: http://geostor.blogspot.com/

Monday, October 19, 2009

GeoStor Outage

Our FTP server has experienced some data corruption (again) and I am attempting to repair it, however this means that Downloads are down as well. I expect the repair process to continue though the evening since the disk being repaired is 2TB in size. I have posted a notice on the GeoStor home page and I will do another blog post when everything is resolved.

Glen

GeoStor Blog: http://geostor.blogspot.com/

Friday, October 16, 2009

GeoStor Updates and Outages

Outages

We are currently experiencing issues with our FTP server so if you are unable to get to an FTP link that worked previously that is probably why. I expect to have this resolved by Monday but there are no guarantees unfortunately. On to happier things…

Updates

We have added some pretty cool features and fixed some more bugs as usual. We also have some exciting things that are up and coming as well.

  • You can now save your download preferences for email, format and projection. Just click the checkbox where it says and click submit. If you want to change your preferences, just click the checkbox again and submit your download.
    • CAVEAT: You have to have cookies enabled in your browser to use this feature!
  • I have developed a widget that allows you to search GeoStor from your own website, pretty sweet huh? See the next bullet for more information.
  • I have been working hard on documenting the GeoStor API so people can start using our services and have it pretty much finished. Just click the Developers link at the top of the home page. I will also be posting some more of our code at some point in the future as well. If you are going to the AR GIS User's Forum conference in Eureka you will get to see almost all of it on my poster. J
  • PLEASE NOTE!!! Not all these changes have been pushed out to production yet but should be there by Monday.

Up and Coming

  • We are migrating from web map caches to ArcGIS Image Server, there are some advantages and disadvantages to this move but it will benefit everyone in the long run.
    • Advantages
      • Using AIS will reduce our storage needs for raster by half if not more.
      • It will drastically reduce the amount of time we spend working on raster data.
      • It is faster in ArcGIS products than the map cache for some odd reason.
      • We will be able to offer any imagery we have as a service with very little overhead (think archived rasters…).
    • Disadvantages
      • All links to our imagery will change, unfortunately.
      • I'm not sure what the impact will be to our servers resource-wise as I am unable to reproduce the production load in my development environment.
      • AIS looks slower in web applications than a map cache although it isn't much slower in total load time.
  • I am finishing the FTP Server migration next week so we will be on all new hardware and this is a step in the process to migrate to AIS as well.
  • We are migrating to SQL Server 2008 as soon as I can get it installed and move everything over.

Sorry this was such a long post but it has been awhile since I've posted on the blog and had a lot to cover!

Glen

GeoStor Blog: http://geostor.blogspot.com/

Tuesday, September 29, 2009

GeoStor More Data & Updates

The following data has been added or updated throughout the GeoStor System. We appreciate all those willing to coordinate and distribute information via GeoStor- Thank You!

Additions:
These orthos have not been added to the High resolution ortho service. We are still working on our long term strategy to handle the high resolution orthos in an timely manner.
* 2009 Benton and Washington County orthos- Provided by Benton & Washington County
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_01/2009/NWARPC/

* 2008-2009 orthos for select lakes- Provided by Army Corps of Engineers
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_01/2009/USCOE/

Updates:
* All High & Medium Resolution National Hydrology datasets- Provided by USGS with assistance from ADEQ
http://www.geostor.arkansas.gov/G6/Home.html?q=NHD

* City Boundaries- Provided by Arkansas Highway & Transportation Department http://bit.ly/Zpa0i
NHD & City Boundary updates will be reflected in WFS. Basemap cache will be updated in the coming weeks.

* Ortho Footprint for Files on GeoStor FTP updated with ortho additions above
http://bit.ly/4z6TDm

* Inland Electronic Navigation Charts (off site)- Provided by U.S. Army Corps of Engineers
http://crunch.tec.army.mil/enc/echarts/IENCShapeFileRequest.cfm

Posted from Geostor Blog

Tuesday, September 22, 2009

GeoStor Updates

Whew. What can I say, been really busy as usual and haven't posted any updates in awhile. So without further ado, here they are:

  • Upgraded ArcGIS Server to 9.3.1 and converted all our services over to the new MSD format. They are very fast! I should have done this a long time ago!
  • Our services should be accessible from anywhere or any application now.
  • We have setup a geometry service, check it out: http://www.geostor.arkansas.gov/ArcGIS/rest/services/Geometry/GeometryServer. This mostly for developers and applications but it is a very useful service.
  • VMware ESXi has been upgraded to 4.0, this is the software we use to virtualize our servers.
  • The production servers have been migrated to bigger, badder and faster hardware and I am going to use the old servers to build a SQL Server 2008 cluster.
  • You can now search the dynamic layers on the GeoStor viewer. Go to http://maps.arkansas.gov and click on the Search widget, there are examples for each layer to search by.
  • Our latest blog posts display on GeoStor now

Coming Up

  • Upgrade FME Server from 2009 to 2010, need to test in development first though.
  • Possible Image Server implementation?
  • Migrate FTP server off old hardware to virtual machine

Gotta get back to work now J

Glen

GeoStor Blog: http://geostor.blogspot.com/

ArcGIS Image Server Extension- Discussion

AGIO staff have been discussing the addition of the Image Server Extension to the GeoStor infrastructure. We would like to hear your thoughts.

Why
Several cities and/or counties in the state of Arkansas have acquired 1 foot and six inch ortho photography. They are interested in making the data publicly available via GeoStor (thank you). AGIO staff believe this will be a growing trend and want to be prepared to distribute the data in a useful and timely manner.

Issue
1) The data is provided in multiple projections and coordinate systems. While this is perfectly acceptable, it proves to be a challenge on several fronts when creating/combining services and providing the data as a clip, zip, ship

2) File sizes for the 1 foot and 6 inch data are large. Several have had issues downloading the data from the ftp site. The increased resolution generates a clip that generally exceeds the 2GB limit. Though other formats do support larger file sizes, there is still the download issue (discussed above).

3) Currently, a number of ortho data sets are stored in multiple locations (SDE/FTP). This results in duplicative (actually more due pyramids) disk requirements. Side note- disk isn't cheap regardless of what has been said in the past. GeoStor currently host roughly 10TB of imagery (SDE/FTP combined). This number is excpected to grow by X with the additional of more high resolution data.

4) The current process to get the data published to all the various services is time intensive (often even months). Bench mark test in other states have demonstrated processing times are dramatically reduced from months to days.

Possible Solution
ArcGIS Image Server has been implemented successfully in several other states. The product would provide the ability for the data to be stored in a single location on the FTP. Image services would actually be generated from the files on the FTP disk. This would provide for the opportunity to provide additional image services for historic ortho imagery.

Known Impact
The following are a list of impacts that we thought of. We feel sure there are likely others and are interested in hearing from you.
1) All current image service URLS would change. This would require those with saved connections to reconnect.

2) GeoStor Staff would have to change paths in a number of applications. We can live with that if we move forward.

3) Capability to download high resolution orthos via clip, zip, ship would discontinue. 1-meter statewide orthos remain available for clip, zip, ship. Users can obtain a significant area of 1-meter data.

We would like to hear from you. Have you used image server? Would changing the url paths greatly hammper your work? Other thoughts or questions?

Monday, September 21, 2009

GeoStor adds High Resolution Orthos- ArcGIS Map Service & WMS

High resolution orthos for Faulkner County, Pulaski County, Saline County and the City of Van Buren were released last week. These files are large and several have experienced problems downloading them due to the file size. AGIO staff have generated a WMS and ArcGIS map service. Users are welcome to connect to this service in lieu of downloading. Plans are in the works to generate a map cache for this data once a couple more counties are added (no eta at this time).You can visit http://www.geostor.arkansas.gov/G6/files/GeoStor_Tutorial_MS_WMS.pdf to learn how to connect to the ArcGIS map service or WMS.

Posted from http://geostor.blogspot.com/

Thursday, September 17, 2009

Attention: Outage

Many of you noticed an issue with connecting to various services and ftp on Tuesday. The issues were resolved with a quick fix. We will be taking GeoStor off-line Friday (9/17) at 5pm and working to fully resolve the issues. We plan to have GeoStor back on-line by late Sunday night.

Please contact geostor@arkansas.gov if you have any questions.

Posted from http://geostor.blogspot.com

Wednesday, September 16, 2009

More GeoStor Data / Apps / Updates

This update includes a number of additions to the GeoStor Platform. We appreciate all those willing to coordinate and distribute information via GeoStor- Thank You!
Data
* Geologic Data - provided by the Arkansas Geological Survey * Pdf and Footprint for available files (with ftp link) * http://www.geostor.arkansas.gov/G6/Home.html?q=digital+geology

High Resolution Orthos http://bit.ly/2RdELw

2008 City of Van Buren- provided by City of Van Buren
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/CITY_OF_VAN_BUREN_2008/

* 2009 Faulkner County- provided by City of Conway, Conway Development Corporation and Faulkner County
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/2009/Faulkner/

* 2009 Pulaski County- provided by Pulaski Area GIS (PAgis) member agencies and USGS FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/2009/Pulaski/

* 2009 Saline County- provided by Saline County Assessor Office
FTP- ftp://ftp.geostor.arkansas.gov/geostor_raster_02/2009/Saline/

Application
* State Network Status Map http://bit.ly/pDwCt
* State Methamphetamine Statistics Map http://bit.ly/Kgof4
* ADEQ EnviroView (previously announced) http://bit.ly/cHwlA
* Saline County Assessor Viewer (previously announced) http://bit.ly/eatP3
* Crawford County Assessor Viewer (previously announced) http://bit.ly/vsAuv

Updates
* GeoStor Tutorial and Metadata updated with WMS & WFS (url & capabilities): http://bit.ly/3O8WMS
* Ortho Footprint for Files on GeoStor FTP (http://bit.ly/DZAbZ) updated with ortho additions abovenet

Friday, September 11, 2009

GeoStor Download Issues

The download issues should be resolved now. They were unrelated to the FTP outage, it was one of those "I'm going to do this to fix this issue but then it broke something else" things. If you got a failure or nothing at all, please resubmit your download.

Glen

GeoStor Blog: http://geostor.blogspot.com/

Thursday, September 10, 2009

GeoStor Outage Resolved

The file system repair has completed and as far as I can tell everything is functioning properly again. Unfortunately, if you submitted any downloads today you will have to resubmit the job. Let me know if you run into any issues that may be related to this outage.

Glen

GeoStor Blog: http://geostor.blogspot.com/

GeoStor Outage

Our FTP server has experienced some data corruption and I am attempting to repair it, however this means that Downloads are down as well. I expect the repair process to continue though the evening since the disk being repaired is 2TB in size. I have posted a notice on the GeoStor home page and I will do another blog post when everything is resolved.

Glen

GeoStor Blog: http://geostor.blogspot.com/

Friday, September 4, 2009

GeoStor WMS Services Take 2

I have edited the previous blog post to reflect the URLs to the WMS services that actually work. Sorry for any inconviences this may have caused.

http://geostor.blogspot.com/2009/09/geostor-wms-services.html

Glen

http://geostor.blogspot.com

Monday, August 17, 2009

GeoStor Notice

1. Written GeoStor Tutorial is now available. A link to the tutorial has been added to the menu bar (Help)

2. A vector footprint representing all of the ortho data on the GeoStor FTP site is now available for download. We were tired of searching through the ftp to determine all of the vintages of data that might be available for a location and thought you might be as well. The file includes year, name and a direct link to the location on the ftp site.

3. Bug Fix- Ever search for soil or soils on GeoStor? Previously, no results would have been returned. This bug has been resolved. Thanks to actGeoSpatial for bringing this to our attention.

Thursday, August 13, 2009

GeoStor Enhancements

We have been rolling out a number of enhancements for the past two weeks. The remaining enhancements rolled out last night.
1. View Thumbnail column returned with your search results.
2. Full listing of all metadata records with Thumbnails available at http://www.geostor.arkansas.gov/metadata/
3. Persistent unique ID added to metadata records that can be used if you need to link directly to a single result
4. Updated homepage template to align with Arkansas.gov
5. Access to additional historic data on the ftp site via additional metadata records added

On the whiteboard
1. Ability to add search results to the viewer on the fly
2. A single vector foot print that includes the name and and ftp link to all orthos available on the GeoStor ftp site
3. Written GeoStor tutorial is still on the list

Friday, August 7, 2009

Full Interaction with GeoStor Feature Services

This issue was brought to our attention by several users
Issue: Successful connections can be made to GeoStor WMS/WFS following previously provided instructions, but the user can not change the symblogoy, query, download, etc.

The following solution is based on our quick research of the problem. It took a little digging and you may have other suggestions.

ESRI has changed the way WFS are handled with AGS Server
Caveats:
· You must have ArGIS 9.3 or greater. We are still testing 9.2
· You must have the interoperability extension installed
· GEOSTOR_ALL_FEATURE_LAYERS times out

Go here to read the setup instructions for connecting http://webhelp.esri.com/arcgisdesktop/9.3/index.cfm?TopicName=How_to_work_with_WFS_using_ArcGIS_Desktop

You will need the urls below to connect to GeoStor Feature Services
GEOSTOR_ADMIN http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_ADMIN/MapServer/WFSServer
GEOSTOR_CADAS http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_CADAS/MapServer/WFSServer
GEOSTOR_CULTU http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_CULTU/MapServer/WFSServer
GEOSTOR_ENVIR http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_ENVIR/MapServer/WFSServer
GEOSTOR_HEALT http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_HEALT/MapServer/WFSServer
GEOSTOR_STRUCT http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_STRUCT/MapServer/WFSServer
GEOSTOR_TRASP http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_TRANSP/MapServer/WFSServer
GEOSTOR_UTILIT http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_UTILIT/MapServer/WFSServer
GEOSTOR_WATER http://www.geostor.arkansas.gov/arcgis/services/FEATURE_SERVICES/GEOSTOR_WATER/MapServer/WFSServer

Monday, August 3, 2009

GeoStor Additions

We have heard from several of you and are working to incorporate your suggestions.
The following is now in production
* A hyperlink that automatically generates the search for files on the FTP site has been added
to the homepage
* Pagination is now enabled if your search returns more than 20 results
* More data becoming available, look for announcements

We are still working on features previously mentioned
  • Ability to see the metadata thumbnails in the search result
  • Ability to add search results to the viewer on the fly

Several tutorials are available on YouTube. We are working on a written pdf tutorial that several of you have requested.

How are those AGS services working?

Friday, July 24, 2009

GeoStor Updates

I know it has been quite some time since my last update on the blog/forum and I apologize for that. It means that I have been REALLY busy working on it, in fact if I don't document my changes I forget most of them. Also, my trip to the ESRI UC was great, I learned a lot, visited with friends, met new friends, and enjoyed some down time in the California sun. If you are an ESRI user and are able to go, I highly suggest it.

Change log:

  • Updated the map cache for ACF and the aerials, I have included the 1 foot county aerials where possible in the cache
    • It has been rendered and will be added to the servers this weekend
  • Many, many bug fixes on the website, thanks for all your help finding the bugs!
  • Added features:
    • Add a bookmark for a search (Home page only)
    • Get a direct link for search results, you can click it and see it in the address or right click and Copy Shortcut (Home page only)
    • Many new help contexts and more visible help
    • We have added some new dynamic layers in the viewer
      • Sections, Townships, and Quads
      • NHD Hydrology
      • Legislative Districts
      • Census Tracts and Blocks
      • County Seats
    • The viewer automatically opens the Live Maps & Overview widgets
    • Added the AGIO logo to the banner (looks good up there doesn't it :))
    • The notifications will stay up longer so it will be easier to read them
    • All the beta addresses will be redirected to the production address automagically
      • CAVEAT:
        If you are direct connecting with ArcCatalog you will need to change the address yourself unfortunately, this includes any map documents that used the AGS services

Coming Soon™*

  • Ability to see the metadata thumbnails in the search results
  • Pagination in the search results
  • Ability to add search results to the viewer on the fly (cool huh?)
  • Suggestions?

Check our blog out: http://geostor.blogspot.com/

* Coming Soon™ means when I get time and we all know how much free time I have… (that's sarcasm by the way ;))

Glen

Friday, July 10, 2009

Address Change

Since we have been forced to go production with the new site we need all users to quit using the beta address as well as all the addresses below.

apps.geostor.arkansas.gov

beta.geostor.arkansas.gov

and http://maps.arkansas.gov now redirects you to http://www.geostor.arkansas.gov/G6/viewer/index.html

I have added redirects in my web application so people using the website with a browser should be ok, however anyone using ArcGIS Server connections will have to change to the new address:

http://www.geostor.arkansas.gov/arcgis/services

Please see the tutorial on how to connect to AGS:

http://geostor.blogspot.com/2009/04/geostor-60-connecting-to-arcgis.html


 

Glen

Monday, July 6, 2009

GeoStor Bugs

GeoStor staff have worked diligently to resolve a number of bugs that were identified. We believe the following have been resolved:

  • Raster projection issues- Big thanks to Safe Software for quickly resolving the FME Server bug
  • Downloads via Firefox, Mozilla, ect
  • Delivery of metadata

Please drop us a note if you identify additional bugs geostor@arkansas.gov

Posted from the GeoStor Blog

Friday, June 26, 2009

Raster Projection Issues

It has come to our attention rasters are not projecting properly. GeoStor staff have been in communication with Safe Software for two days and they have identified a bug in FME 2009 and FME 2010. Safe Software has elevated this to their top priority and will provide a fix as soon as possible.

All users should make note of this raster projection issue. We will post a notice as soon as the issue is resolved.

Apologies for cross-postings, you will receive a similar note if you have downloaded rasters from GeoStor this week.

posted from the GeoStor Blog http://geostor.blogspot.com/

Monday, June 22, 2009

GeoStor Issues

We are experiencing some serious issues with Apache Tomcat right now so the entire GeoStor 5.0 site is down. I have redirected all the traffic to the new site so please use that until we can determine what is causing Tomcat to crash within minutes of starting up.

http://www.geostor.arkansas.gov

Glen

http://geostor.blogspot.com

Wednesday, June 10, 2009

3 Bugs found during Beta Testing

Thank you to those who have been testing the GeoStor 6.0 currently in beta. Three bugs have been brought to our attention. We have 're-opened' access to GeoStor 5.0 "Find Data" for downloading until we can get the issues resolved at which time we will resume testing.

Summary of Bugs:
1. Raster downloads fail to submit the requested file and perform requested actions (format, projection)
2. Vector downloads fail to submit the requested file and perform requested actions (format, projection)
3. DRG are being delievered with null values related to black

We will be working to resolve these issues as quickly as possible.

http://geostor.blogspot.com/

Friday, June 5, 2009

New Data on Beta Site

We are pleased to announce the availability of Public Water Systems & Electric Service Territories via http://www.geostor.arkansas.gov.

Public Water Systems was developed by the Arkansas Department of Health. Work is still underway but a significant amount of progress has been made.
http://www.geostor.arkansas.gov/G6/Home.html?q=Public+Water+Systems

Electric Service Territories was developed by a number of electric service providers. AGIO staff compiled their work into a single file. This file is also still under development, but a significant amount of the state has been covered.
http://www.geostor.arkansas.gov/G6/Home.html?q=Electric+Service+Territories

Look for more updates in the coming months.

http://geostor.blogspot.com/

Thursday, June 4, 2009

Exciting Times

GeoStor 6.0 was released as beta on April 13, 2009. We have learned a lot the past few weeks. Our original intent was for GeoStor 5.0 to go dark on June 20, 2009. We are still moving toward that goal, but will be doing so in a ‘slower’ manner.

In the coming weeks you will begin to notice links to GeoStor 5.0 will redirect you to the beta version. Do not be alarmed. This is only intended to assist in additional beta testing. Dates to be aware of:
June 8, 2009: Various links on the GeoStor 5.0 Homepage will redirect to GeoStor 6.0
June 17, 2009: Various ArcIMS Services will be stopped. Ones we plan to keep will be accessible via http://www.geostor.arkansas.gov/arcgis/services (click here to learn how to connect)
BASEMAP
ELEVA_DEM_HSHADE_ASPECT
GEOSTOR_ALL_FEATURE_LAYERS
IMAGE_DRGIMAGE_LULC
IMAGE_ORTHO
IMAGE_THEMATIC_MAPPER

Our intent is to leave the geostor.arkansas.gov DNS in place and redirect it to beta.geostor.arkansas.gov when the final transition is completed. We believe this will prevent you from having to reconnect to the various services when GeoStor 6.0 goes to full production. We are still investigating this and apologize for any inconvenience.

We are continuing to work with the application custodians and hope to have their applications transitioned and fully functional by the end of the month. We also anticipate the addition of some more data by the end of the month. Watch for updates.

As always, please drop a note if you have problems.
http://geostor.blogspot.com/

Friday, May 29, 2009

GeoStor 6.0 Updates

I'm about to head out the door on vacation so I'm going to make this quick J. I will be out of town the week after that for the FME User Conference in Canada (going to Canada, eh!) but I should be available in between sessions while I'm there.

  • Flex Viewer Fixes
    • I have modified the code for the default viewer to fix some issues that I've previously blogged about, the source code and instructions are available if anyone wants them.
      • When you select the Satellite, Topo or Relief map, the road layer will be overlaid at the same time
      • The Topo or Relief layers were not cached beyond 1:6000 so you would just get a blank window, you will now see the Basemap layer instead
      • BE SURE YOU CLEAR YOUR BROWSER CACHE OR YOU WILL NOT SEE THE CHANGES!
  • FME Server
    • We are now running a distributed and redundant setup of FME Server, setup the same way our AGS servers are
    • The FME Servers are sharing a database so we have a single place to go for job history, configuration and so forth
    • I have an architecture diagram on the beta site: http://www.geostor.arkansas.gov/G6/files/new_environment.pdf
  • Lessons Learned
    • I had a pretty major setback last week, this is one of the reasons I haven't posted to the blog, I've been busy trying to recover from it
      • As they almost always are, this boo-boo was my fault, I was attempting to migrate the FME Servers to the setup described above
      • I was low on disk space so I decided to delete some of the virtual machine snapshots that I have taken to be able to revert back to a good configuration if something went south
      • Unfortunately I didn't shut down the virtual machines prior to doing this and it irrevocably corrupted them beyond repair, I won't repeat some of the things that came out of my mouth at that point…
      • So, one AGS machine and BOTH
        FME Servers were offline and not coming back any time soon L
      • Luckily the new architecture that I have been struggling to get working saved my butt at least for the website and AGS services but all downloads were offline
      • I was also lucky in the fact that I had an older copy of one of the FME Server virtual machines on my development boxes so I brought it back up to snuff and then cloned it, I had the production FME Server online within a day and the development one a day later
      • I wasn't as lucky for the AGS machine that I crashed, I had to rebuild it from scratch which took me a couple days from start to end
      • I am happy to report that (as far as I know) everything is back up to where it should be and better than it was before
      • So whatever you do, DO NOT DELETE YOUR SNAPSHOTS WITHOUT TAKING YOUR VM OFFLINE FIRST!

So much for a quick post! Hopefully everything will stay working while I'm on vacation but sadly that isn't the way things work. You know how it is, when Daddy is away, crap breaks…

Glen (gone on vacation) Rhea

http://geostor.blogspot.com

Friday, May 15, 2009

GeoStor 6.0 Updates

It has been awhile since I have posted any updates, mainly because I have been so busy working on them! Now that we have gotten our AGS services stabilized (hopefully…) I have been able to move ahead with other projects that are dependent upon AGS. I will outline what we are rolling out with this latest update below. If you find any issues (and I know you will) please let us know via the GIS Users Forum listserv, this blog, or our email address.

  • GeoCortex Essentials is now working for all the application map viewers
  • The Advanced Search page UI has been updated:
    • Checking or unchecking the clip by map viewer control will:
      • Enable/disable the map controls and make it opaque or visible
      • Change the download dialog box appropriately
      • Change the text above the map viewer
      • You can check this box on the fly and change your download, after you have already searched or beforehand
    • This change is to address some confusion about what the map is for on the advanced search page, hopefully this will clear that up
  • Our main map viewer has been replaced by the ESRI Flex Viewer, hopefully you will like this map viewer better
    • This should address some of the JavaScript issues and browser compatibility issues we have seen
    • CAVEATS:

      • You have to clear your browser cache if there have been any updates of the Flex Viewer otherwise you will never see them, also do this if you have any issues with the Viewer

      • In order to see the Hybrid map you have to click Live Maps under the Map icon and enable it, I haven't found away to show two services at once in the default Viewer without doing it this way
    • We will be putting out a tutorial on how to use the new Viewer shortly
  • Last and not least, I am putting a beta Geocoder online for people to use. We are also using it in the Flex Viewer (go to Tools and Locate)
    • This is a composite Geocoder that consists of the following Locators:
      • Address points (for counties that have them)
      • Arkansas Centerline File
      • Streamline Zip9
    • Issues:
      • The Flex Viewer lookup doesn't seem to honor the match sensitivity for some reason, so the inputted addresses need to be pretty close spelling and format-wise to match
      • The Reverse Geocoder hasn't been tested very much, I used a known X,Y and it returned an address, other than that I haven't used it.
    • CAVEATS:
      • This Geocoder could go away or get changed at any time so please do not use it in any production applications
      • Please do not do any big batch geocoding jobs against it for right now, I will disable that feature if necessary


 

GeoStor 6.0 Blog:

http://geostor.blogspot.com

Monday, May 11, 2009

GeoStor 6.0 AGS & ArcCatalog Connections

I worked with ESRI last week to get this issue resolve and it appears to be working finally. Please see my previous post on how to connect and let me know if you have any issues.

The issue was with the virtual directory settings in AGS, since we are using what is considered a "web farm" you need to use the DNS name (the public facing address) for all the virtual directory settings. Once we figured that out, everything started working great. I have also fixed a few small issues that we discovered along the way.

Glen

http://geostor.blogspot.com

Tuesday, May 5, 2009

Lawrence County Parcel Points

Lawrence County Parcel (pt) data is now available of GeoStor (http://www.geostor.arkansas.gov/G6/Home.html?q=parcel+centroid+dl).

http://geostor.blogspot.com/

You can have your GIS data searchable in GeoStor

GeoStor 6.0 (currently in beta) enables users to find and link to GIS data that is not distributed for download by GeoStor. You can see the 'off site publishers' currently available at the following link http://www.geostor.arkansas.gov/G6/Home.html?q=offsite.

We would like to add your data for Arkansas. Please send us a link to your GIS data on ftp sites, webs sites, web services and/or map viewers. geostor@arkansas.gov

http://geostor.blogspot.com/

Wednesday, April 29, 2009

Issues Connecting to GeoStor 6.0 ArcGIS Services

Second Response to Issue Below
Thank you for making us aware of this issue. The GeoStor 6.0 Architecture includes two identical ArcGIS Server setups that are accessed via a CISCO Switch. The switch provides some load balancing and redundancy (ie- if one server is down, the other one will receive all of the traffic). We have determined the ArcGIS services are not functioning properly on one of the servers. This is why the service works sometimes and fails others. We are continuing to work on a resolution. We truly appreciate the feedback during the beta phase. This will help ensure a smooth transition. We will post an update when this issue is resolved so further testing can be done by the user community.

Issue: We are getting mixed results here with the Beta GeoStor Ortho 2006 map service. We cannot get any results in the ArcCatalog preview pane. I have dropped the map service on existing map documents and at times it works. Mostly it does not. When it did work, we pan around and the image is not rendered properly. Eventually the image stops all rendering.

We are running Arc 9.2 Sp6.

http://geostor.blogspot.com/

Friday, April 24, 2009

GeoStor 6.0 & Connecting to ArcGIS Services

I have gotten quite a few questions regarding how to connect to ArcGIS Services, especially with ArcCatalog, even though there is a tutorial on YouTube (http://www.youtube.com/watch?v=zQ_h9UFFC88).

Here are the quick and dirty instructions:

  1. Open ArcCatalog (You must be using 9.2 SP6 at a minimum, 9.3 is preferred)
  2. Expand "GIS Servers"
  3. Click add ArcGIS Server
  4. Click Next
  5. Put this URL in for the Server URL: http://www.geostor.arkansas.gov/arcgis/services
  6. Click Finish

Setting this up will allow you to use all our new services such as the cached basemap, 1M statewide ortho, hybrid, and DRGs which are SIGNIFICANTLY faster than the dynamic services.

For you web developers out there, if you didn't already know, you can access the REST API at the URL below:

http://www.geostor.arkansas.gov/arcgis/rest/services/

You can also view this post on our blog: http://geostor.blogspot.com

Glen

GeoStor 6.0 Updates

Well, I have been busy the past week or so fixing the bugs that folks have submitted as well as ones that we have found along the way. These are the things that I have changed since the last update:

Bugs

  • The proper metadata is being attached with downloads now (it wasn't being modified to the downloader's specifications before)
  • All the big selection lists are hard coded in the html rather than being pulled from the webservice, they load much faster now
  • The validation for the Township/Range & Quad selection lists on the download dialog has been fixed
  • Downloads of Watershed, Township/Range & Quad clips all work now
  • Took off the UI block for all ajax operations, kinda defeated the purpose of the asynchronous communications
  • The map viewer should work all the time now, but IE7 users will have to clear their browser cache occasionally for some odd reason
  • Miscellaneous bug fixes in the code and some improvements in performance
  • Changed all the fonts to be the same
  • Fixed the flash of unstyled content before the javascript is completely loaded

Added Features

  • Switched to the jQuery plugin jGrowl for all the informational and warning notifications (the little boxes that pop up in the top right corner)
  • Changed the formatting for the output results to be easier to read
  • Updated the Watershed HUC8 dataset in GeoStor
  • Users are informed of the submission of a download as well as the success of that submission

TODO

  • Finish setting up GeoCortex Essentials
  • The map viewer still has some quirks regarding navigating with the mouse


 

Glen

Tuesday, April 21, 2009

GeoStor: New Data Available

The Arkansas Highway & Transportation Department has provided a revised layer that consists of township, range and section layer. The Arkansas 1:24000 Township, Range and Section layers were digitized and attributed utilizing information from the 1:24000 USGS Topographic Maps, General Land Office Maps, State of Arkansas Land Commission, State Surveyors Office, and several county assessors’ offices. Other resources such as the ADOP Photography and the National Hydrography Dataset were also used to complete the project. All line work was digitized in CAD and then transferred to a GIS for attribution and quality control. The project took approximately 6 years to complete. Please refer to the layer's metadata for additional information. The data can be downloaded for no fee at the link below.
http://www.geostor.arkansas.gov/G6/Home.html?q=Section

Friday, April 17, 2009

GeoStor: Tornado Imagery Available

Mena imagery captured on April 11, 2009 around Mena, AR is now available on GeoStor.
http://www.geostor.arkansas.gov/G6/Home.html?q=tornado

The data has been provided to the Polk County Assessor Office and local officials.

The imagery was acquired by Eagle Forestry Services, Inc (http://www.efsgeotech.com/) and purchased by the AGIO. The imagery is publically accessible and available for no fee.

Thursday, April 16, 2009

GeoStor 6.0 Update

Tutorials on YouTube
* GeoStor Beta Tutorial http://www.geostor.arkansas.gov/G6/Home.html?q=geostor+tutorial

* How to connect to GeoStor ArcGIS Serverhttp://www.geostor.arkansas.gov/G6/Home.html?q=connect
These are a test to see if it is useful. Let us know via the blog or email (GeoStor@arkansas.gov)

Connect to information not on GeoStor. Below are a few examples. Additional ones can be found using the keywords Offsite Publisher (OFF). We are intrested in linking to any GIS information in AR. Let us know if you are intrested in helping populate this with your GIS information (website, ftp, application, etc.)
City of Fortsmith Online Mapshttp://www.geostor.arkansas.gov/G6/Home.html?q=online+maps
Benton County Basemap Viewerhttp://www.geostor.arkansas.gov/G6/Home.html?q=benton+viewer
Advanced Hydrologic Prediction Servicehttp://www.geostor.arkansas.gov/G6/Home.html?q=Advanced+Hydrologic

Monday, April 13, 2009

GeoStor 6.0 Bug Fixes & Feature Requests

I want to post our current progress on bug fixes and feature requests on this blog to keep everyone informed about what is going on. If you find a bug that is NOT on this list please comment here or email it to geostor@arkansas.gov and I will add it to the list. The bug is listed first with the technology/issue and status below it, it is the same for the feature requests. If you have any suggestions on something to try or solutions to any of these comment here or send it to me in an email to the address above.

Glen

Bugs

  • Drop down lists in reverse
    • I pull the results from a DB that is accessed via a web service. All the returned data is in JSON which is then converted to a JS object. The selection list is populated via a jQuery plugin and it goes though inserting each new one in the selection list.
  • Map viewer isn't lined up right in IE7
    • Using a DIV for layout, works in FF & Chrome, I have tried resizing the DIV without any result in the map rendered by IE7.
  • Don't change data in info/warn DIV until fade is complete
    • Haven't started on this one
  • The unordered list in the info/warn boxes isn't left justifying in IE7
    • I have tried using CSS and classic HTML to left justify them and neither made a difference
  • The email address validator was incorrectly blocking valid email addresses
    • FIXED
  • Clipping by watersheds does not work
    • FIXED
  • Pressing enter does not submit the search on certain browsers
    • FIXED
  • When you drag to zoom in on the viewer the dragged extent box doesn't show up properly, if at all
    • Working on this one
  • On the services page you can't collapse the current item
    • FIXED


 

Feature Requests

  • A "Working" animation
    • ADDED
  • Results pagination or sorting
    • Checked into it, required quite a bit more coding so we decided to just show the top results only if there are too many results
  • Toggle the column description popup
    • I tried this at first but using the jQuery toggle function seems to toggle everything on the page when you use it
  • Document how to use the map viewers (viewer and advanced search)
    • Coming
  • Document what the map is used for on the adv search
    • Coming

I also changed some layout and font issues that were identified.

FOR IMMEDIATE RELEASE:
April 13, 2009
Little Rock, Arkansas


GeoStor 6.0 Invitation for Beta Testing and User Feedback

The Arkansas Geographic Information Office (AGIO) has developed an updated version of GeoStor. This is an invitation for users to participate in beta testing of GeoStor 6.0 Beta and to provide feedback.
GeoStor 6.0 Action Plan Dates
April 13th - GeoStor 6.0 released as beta
April 15th - GeoStor 6.0 Webex session provided by GeoStor staff
April 16th - Call for Application XML metadata
June 20th- GeoStor 5.0 goes dark
June 22nd - All beta URL's changed to the www.geostor.arkansas.gov
June 22nd- GeoStor 6.0 is in production
June 29th- Detailed GeoStor 6.0 documentation

GeoStor 6.0 is now available for beta testing and the AGIO is soliciting users to test the new system and provide feedback.

The Beta version is incomplete, likely contains bugs and should NOT be used for any production purposes. We recognize that visitors have various operating systems and Internet browsers. Although we want every visitor to have the best possible experience from GeoStor, it is impossible to provide web pages that work identically, efficiently, and effectively with all browsers and settings.

This site has been designed to function with the following Internet browser software:
Internet Explorer 7.0
Mozilla Firefox 3.0
Google Chrome 2.0
Safari 3.1

These browsers were selected based on statistics generated by GeoStor 5.0 users over the past two years. Please accept our sincerest apologies if GeoStor does not function properly in older browsers.

We encourage users to test the following:
· Search and Advanced Search
· GIS Data Downloads
o Various Formats
o Various Projections
o Clip (city, county, state, defined area, etc)
· Web Map Services (beta.geostor.arkansas.gov)
o Connect to web map services using various desktop / web software
o Connect to web feature services using various desktop / web software
o ESRI users should test should test ArcGIS Server connections as well
· Applications
o General testing

We encourage testers to report bugs via an interactive web forum on April 15th, via the GeoStor blog or by email to geostor@arkansas.gov. Please be specific when reporting issues.

GeoStor staff will be providing an interactive web forum presentation on April 15th. This presentation will highlight the functions of GeoStor 6.0 and include time for questions, answers and feedback on identified bugs.

Topic: GeoStor 6.0 Beta Review Date: Wednesday, April 15, 2009 Time: 1:00 pm, Central Daylight TimeMeeting Number: 590 441 890 Meeting Password: geostor Dial in information: 1-866-800-8622 passcode = 6822767#

Please click the link below to see more information, or to join the meeting.

---------------------------------- To join the online meeting ----------------------------------- 1. Go to https://thedataport.webex.com/thedataport/j.php?ED=115800352&UID=1046519792&PW=f3838582640b0e0919180404

2. Enter your name and email address.

3. Enter the meeting password: geostor

4. Click "Join Now". For assistance

------------------------------------------------------- For Support-----------------------------1. Go to https://thedataport.webex.com/thedataport/mc

2. On the left navigation bar, click "Support".

END RELEASE