You are here: > ESRI Forums > arcgis desktop discussion forums > Thread Replies

ArcGIS Desktop Discussion Forums

ArcGIS Desktop - Performance forum

Improve performance on network drives   Michael Stjernholm Sep 05, 2007
Re: Improve performance on network drives   Michael Knight Sep 05, 2007
Re: Improve performance on network drives   Michael Stjernholm Sep 06, 2007
Re: Improve performance on network drives   Michael Stjernholm Sep 06, 2007
Re: Improve performance on network drives   Michael Stjernholm Sep 07, 2007
Re: Improve performance on network drives   David Sousa Sep 13, 2007
Re: Improve performance on network drives   Michael Stjernholm Sep 14, 2007
Re: Improve performance on network drives   David Sousa Sep 20, 2007
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Improve performance on network drives 
Author Michael Stjernholm 
Date Sep 05, 2007 
Message Hi
We are as many others confronted with performance problems when we use ArcGIS 9.2 SP3 on our network and using File Geodatabase or shape files

We have run some tests which illustrate the problems using a 140.000 records file selecting 90.000 recs by attribute and calculating a field:

a) doing this on our network drive (100 MBit connnection):
selecting the records take 3 minutes
calculating the field 10-15 minutes

b) doing it on local drive:
selecting 2- 3 seconds
calulating the field 15-17 seconds

c) using Arcview 3.2 (shape files) on network the selection takes 6-8 seconds

d) a simple copy of the data base using Arccatalog also only take 6-8 seconds

The speed in the networks speed seems thus not to be the main obstruction.

My IT-people suggest that the pakage size used by ArcMap when querieng the data file is THE BIG PERFORMANCE bottleneck. A too small packet size give to much overhead in the communication though the various parts of the network.

My questions are thus:
- Have anybody found the ways to detects the packet size used by ArcMAP ?
-Are the ways to triggger ArcMAP to use other packet sizes ?

- Are there ways to convince ESRI that this is an issue (almost a bug, at least inefficient programming) which should have far more focus as ist impacts a large part of the ArcGIS community

regards

Michael


 
   
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Re: Improve performance on network drives 
Author Michael Knight 
Date Sep 05, 2007 
Message Here's one possible reason:

http://support.esri.com/index.cfm?fa=knowledgebase.techarticles.articleShow&d=22509 
  Michael Knight
GIS Solutions Architect
Contract Land Staff, LLC
Stafford, Texas

http://www.contractlandstaff.com

 
   
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Re: Improve performance on network drives 
Author Michael Stjernholm 
Date Sep 06, 2007 
Message Hi Michael

We are using XP Pro 2002 with SP2 on a Novell Network.

I'm a bit sceptical whether this will solve the problem as the performance is not equally bad when we use ArcView 3.2; copy the database using ArcCatalog or nor other operating system access to the files.

regards

Michael 
   
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Re: Improve performance on network drives 
Author Michael Stjernholm 
Date Sep 06, 2007 
Message Hi Michael

You may actually have pointed us in the right direction.

My IT-manager colleagues informed me the Oportunistic Lock has been disabled by a Novell service pack. They will now analyse the pro et con for the enabling.

The solution will also require changes in workstation configuration settings

I will return later when we have performed new tests

Regards

Michael 
   
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Re: Improve performance on network drives 
Author Michael Stjernholm 
Date Sep 07, 2007 
Message Hi Michael

We have now run the test on a Novell server:

The search of ~90.000 records out of 140.000 by attribute:

with OpLocks = off the result is 85 seconds
with Oplocks = On and Level 2 selected the time is 6 seconds.

See more about oplocks on Novell Netware on:
http://www.netware-server.de/download/tipps/netware-faq/HTML/tids/10095627.htm

Thanks

Michael
 
   
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Re: Improve performance on network drives 
Author David Sousa 
Date Sep 13, 2007 
Message Hi Michael,

Network file I/O on Windows is slow. It has little to do with how application programs such as ArcMap are written - it is Windows.

Your IT people are barking up the wrong tree. It may well be the case that a too small packet size can cause a bottleneck, but ArcGIS has nothing to do with that. ArcGIS is just using the file system, making calls to the Win32 file I/O routines. ArcGIS has no control whatsoever on packet sizes or any other aspect of how the file I/O across the network behaves.

If there is a bug or inefficient programming, it is not ESRI you need to convince - it is Microsoft.

-David Sousa
 
   
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Re: Improve performance on network drives 
Author Michael Stjernholm 
Date Sep 14, 2007 
Message Hi David

Thanks for your input.
The desciption of problem and suspicions on cause were written at a time where we had no good clue on the cause.

As you can see above we were able to improve the performance dramatically by setting the Oplock on the Novell !

You can also see that without the Oplock set there is a very dramatic difference between the perfomance in ArcView 3.2 and ArcGIS 9.2

It is thus not straight forward to point the cause of poor performance to one specific piece of software but rather to the relation/interdependency of each piece:
Microsoft clients vs. Novell network
ArcGIS possible preference towards MS networking procedures
..

regards Michael
 
   
Report Inappropriate Content • Top • Print • This Forum is closed for replies.    
Subject Re: Improve performance on network drives 
Author David Sousa 
Date Sep 20, 2007 
Message Hi Michael,

That's good that you found a way to improve the network I/O speed.

I just wanted to mention something with regard to this:

"Microsoft clients vs. Novell network
ArcGIS possible preference towards MS networking procedures"

I am sure that there are differences in performance of different network protocols, but again, this is totally independent of how an application like ArcGIS is written. ArcGIS does not have a preference towards MS networking procedures. We are just using the generic C runtime and Win32 File I/O API's which do not expose anything related to networks. Everything to do with networks is completely abstracted away from how file I/O is done. ArcGIS has no idea which network protocols are in use, and does not work directly with them in any case.

-David