The British Caving Association

Any views expressed are not necessarily those of the BCA
It is currently Fri 22 Feb 2019 17:19

All times are UTC [ DST ]




Post new topic Reply to topic  [ 18 posts ]  Go to page Previous  1, 2
Author Message
PostPosted: Tue 30 Jul 2013 19:58 
Offline

Joined: Tue 25 May 2010 20:04
Posts: 25
David Gibson wrote:
Well, obviously it depends on what youre doing. For your 'specialised' uses it may not work, but its fine for lots of other things where you are just
fetching data - e.g. scans of publications, photos, e.g. http://bcra.org.uk/pub/candks/catalogue.html


But all these pieces of data, deserve and will get the special treatment

try

https://views.scraperwiki.com/run/cave_ ... 20-%202005

(prototype, so a bit buggy) yes it is currently running on different machines, so it is possible, but it just adds an administrative burden, and complicates it for the geek and none geek user alike.

David Gibson wrote:
Hmmm. What happens to the data is a "management" issue, I think; not concerned with where it is stored.


Totally agree, however, single point makes that management easier. In the end it is a compromise, the BCA is cloud then there is other cloud storage, my arguement is make things easy (and at a reasonable cost) for people and it is more like to be used.
Archive properly on the BCA seems to fit today's technology, compromise along the way may need to happen.....

_________________
Andrew
Cave Registry Data Archive, Cave Surveying Group, MCRA, UBSS


Top
 Profile  
 
PostPosted: Tue 30 Jul 2013 20:16 
Offline

Joined: Tue 25 May 2010 20:04
Posts: 25
David Cooke wrote:
The figures are different to what I was told also the maths doesn't seem to add up. Can we be more precise?


I do not have direct access to the china svn server that the data is coming. so sorry no. Best figure I have is that it is 5.6Gb on disk with 2500 odd change sets, and this is only one of the servers, there is more on another one (but I believe a magnitude less).

cave-registry has about 8Gb free and at about change set 1800 I got and out of memory error. cpanel was showing almost full, cannot remember exact figures.

I am told the Matienzo dataset is 5Gb, that is not a transfer, so it should start at being that small

To try to get an idea CheddarCatchment is 132Mb on server with 194 changes. on my machine it is 115.5Mb. So managed correctly not much of an overhead.

_________________
Andrew
Cave Registry Data Archive, Cave Surveying Group, MCRA, UBSS


Last edited by David Gibson on Tue 30 Jul 2013 20:43, edited 1 time in total.
corrected attribution of quotation


Top
 Profile  
 
PostPosted: Mon 30 Sep 2013 13:48 
Offline
Site Admin

Joined: Thu 29 Dec 2005 23:22
Posts: 296
Location: Axbridge, Somerset, UK
Update: As of 23rd Sept. I've organised it so the total space is now 20GB.

_________________
Dave Cooke
BCA Webmaster, BCA Web Services, National Cave Registry Co-ordinator, CSCC Treasurer


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 18 posts ]  Go to page Previous  1, 2

All times are UTC [ DST ]


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB® Forum Software © phpBB Group