Page 1 of 1
We hit 80,000 APs
Posted: Tue Oct 27, 2009 8:01 pm
by ACalcutt
With my latest scans to waltham and back we hit the 80,000 marker in the WiFiDB (
http://www.vistumbler.net/wifidb).
we are now at 82,616 APs! So i guess the next marker is 90,000
Re: We hit 80,000 APs
Posted: Tue Oct 27, 2009 9:09 pm
by mysticvirgo67
wooot! ANd Vistumbler D/L numbers??
Re: We hit 80,000 APs
Posted: Tue Oct 27, 2009 10:50 pm
by ACalcutt
Vistumbler is getting around 400 downloads a day from sourceforge .... plus theres autoupdate and the places you posted.
Re: We hit 80,000 APs
Posted: Wed Oct 28, 2009 11:11 am
by mysticvirgo67
oh? you are getting d-loads from those places?
Re: We hit 80,000 APs
Posted: Thu Oct 29, 2009 1:49 pm
by pferland
Hey andrew, you bastard.
You where supposed to put it over
here with the other landmarks that WiFiDB has made.
/me waves fist
Other then that, I'm surprised that its gotten this big,
I thought I was going to have to re design the way it stores the APs data long before 80K
lol
Re: We hit 80,000 APs
Posted: Fri Oct 30, 2009 12:05 am
by mysticvirgo67
I agree... I hope you have plenty of server space left. I prophosise ( f'd the spelling up) the database to start growing exponentially
Re: We hit 80,000 APs
Posted: Sat Oct 31, 2009 9:52 pm
by pferland
The only things that take up the most space are exports, graphs, and uploaded VS1 files.
The database files are about 2GB or so (minus the forum and Andrews Plone Database stuff).
About 83K lines in the pointers table
About 166K tables in The storage db
Aprox 2,448,240 rows in all tabels in the Storage DB (that and it took nearly 3 hrs for MySQL to count all those)
The filestructure footprint of WiFiDB is about 3.3GB
190 Files, 3.29GB is /wifidb/out/daemon/
147 Files, 1.52MB is /wifidb/out/KMZ/
418 Files, 105MB is /wifidb/import/up/
So in total WiFiDB is about 5.4GB right now
Re: We hit 80,000 APs
Posted: Sun Nov 01, 2009 12:35 pm
by mysticvirgo67
Hmm.... So storge is NOT an issue, currently. Kewlness.
Re: We hit 80,000 APs
Posted: Sun Nov 01, 2009 12:49 pm
by pferland
No, not as of now, but I can see once we cross 400K or 500K APs we would start to run into issues, and maybe some DB performance issues too. may need to start making a cluster. But we'll see when we get there, should take some time.
Re: We hit 80,000 APs
Posted: Tue Feb 16, 2010 7:57 pm
by pferland
I just did a full export of the database to a raw SQL file, and its about 800MB with 86K APs
I ended up making my own export script because the mysqldump tool with mysql was taking about 2 days to dump.
The script I made dumps the same data in ~50min.
Re: We hit 80,000 APs
Posted: Fri Feb 19, 2010 11:21 pm
by pferland
So I upgraded my computer this week, went DDR3 and got a HD5770.
but the thing is, with the same CPU (its an Athlon II X4 620 AM2/AM3) running Google Earth with the full db KMZ file, with the DDR2 setup earth would tend to stop responding for about 10 seconds when it needs to render the blob of APs in Massachusetts. Going DDR3 seemed to have eliminated this issue, at least it was very short in loss of responsiveness, only for a second or less not anything like it was on the DDR2 setup.