We hit 80,000 APs

A place to talk about wardriving
Post Reply
User avatar
ACalcutt
Vistumbler / TechIdiots Admin
Vistumbler / TechIdiots Admin
Posts: 1302
Joined: Sun Oct 21, 2007 6:50 pm
Location: Rutland, MA
Contact:

We hit 80,000 APs

Post by ACalcutt »

With my latest scans to waltham and back we hit the 80,000 marker in the WiFiDB (http://www.vistumbler.net/wifidb).

we are now at 82,616 APs! So i guess the next marker is 90,000
mysticvirgo67
Mad Poster / Moderator / Promoter
Mad Poster / Moderator / Promoter
Posts: 424
Joined: Sun Jun 28, 2009 4:52 pm

Re: We hit 80,000 APs

Post by mysticvirgo67 »

wooot! ANd Vistumbler D/L numbers??
"People don't need restore. They just need recovery...and the occasional hard boot"
"The maximum acceleration of a PC is limited only by the amount of explosives used"
User avatar
ACalcutt
Vistumbler / TechIdiots Admin
Vistumbler / TechIdiots Admin
Posts: 1302
Joined: Sun Oct 21, 2007 6:50 pm
Location: Rutland, MA
Contact:

Re: We hit 80,000 APs

Post by ACalcutt »

Vistumbler is getting around 400 downloads a day from sourceforge .... plus theres autoupdate and the places you posted.
mysticvirgo67
Mad Poster / Moderator / Promoter
Mad Poster / Moderator / Promoter
Posts: 424
Joined: Sun Jun 28, 2009 4:52 pm

Re: We hit 80,000 APs

Post by mysticvirgo67 »

oh? you are getting d-loads from those places?
"People don't need restore. They just need recovery...and the occasional hard boot"
"The maximum acceleration of a PC is limited only by the amount of explosives used"
User avatar
pferland
Contributor
Contributor
Posts: 406
Joined: Mon Oct 22, 2007 8:38 am
Location: The Universe
Contact:

Re: We hit 80,000 APs

Post by pferland »

Hey andrew, you bastard.
You where supposed to put it over here with the other landmarks that WiFiDB has made.
/me waves fist

Other then that, I'm surprised that its gotten this big,
I thought I was going to have to re design the way it stores the APs data long before 80K :oops: lol
The best acceleration you can get on a Mac is 9.8ms^2
mysticvirgo67
Mad Poster / Moderator / Promoter
Mad Poster / Moderator / Promoter
Posts: 424
Joined: Sun Jun 28, 2009 4:52 pm

Re: We hit 80,000 APs

Post by mysticvirgo67 »

I agree... I hope you have plenty of server space left. I prophosise ( f'd the spelling up) the database to start growing exponentially
"People don't need restore. They just need recovery...and the occasional hard boot"
"The maximum acceleration of a PC is limited only by the amount of explosives used"
User avatar
pferland
Contributor
Contributor
Posts: 406
Joined: Mon Oct 22, 2007 8:38 am
Location: The Universe
Contact:

Re: We hit 80,000 APs

Post by pferland »

The only things that take up the most space are exports, graphs, and uploaded VS1 files.

The database files are about 2GB or so (minus the forum and Andrews Plone Database stuff).
About 83K lines in the pointers table
About 166K tables in The storage db
Aprox 2,448,240 rows in all tabels in the Storage DB (that and it took nearly 3 hrs for MySQL to count all those)

The filestructure footprint of WiFiDB is about 3.3GB
190 Files, 3.29GB is /wifidb/out/daemon/
147 Files, 1.52MB is /wifidb/out/KMZ/
418 Files, 105MB is /wifidb/import/up/

So in total WiFiDB is about 5.4GB right now
The best acceleration you can get on a Mac is 9.8ms^2
mysticvirgo67
Mad Poster / Moderator / Promoter
Mad Poster / Moderator / Promoter
Posts: 424
Joined: Sun Jun 28, 2009 4:52 pm

Re: We hit 80,000 APs

Post by mysticvirgo67 »

Hmm.... So storge is NOT an issue, currently. Kewlness.
"People don't need restore. They just need recovery...and the occasional hard boot"
"The maximum acceleration of a PC is limited only by the amount of explosives used"
User avatar
pferland
Contributor
Contributor
Posts: 406
Joined: Mon Oct 22, 2007 8:38 am
Location: The Universe
Contact:

Re: We hit 80,000 APs

Post by pferland »

No, not as of now, but I can see once we cross 400K or 500K APs we would start to run into issues, and maybe some DB performance issues too. may need to start making a cluster. But we'll see when we get there, should take some time. :cry:
The best acceleration you can get on a Mac is 9.8ms^2
User avatar
pferland
Contributor
Contributor
Posts: 406
Joined: Mon Oct 22, 2007 8:38 am
Location: The Universe
Contact:

Re: We hit 80,000 APs

Post by pferland »

I just did a full export of the database to a raw SQL file, and its about 800MB with 86K APs
I ended up making my own export script because the mysqldump tool with mysql was taking about 2 days to dump.
The script I made dumps the same data in ~50min.
The best acceleration you can get on a Mac is 9.8ms^2
User avatar
pferland
Contributor
Contributor
Posts: 406
Joined: Mon Oct 22, 2007 8:38 am
Location: The Universe
Contact:

Re: We hit 80,000 APs

Post by pferland »

So I upgraded my computer this week, went DDR3 and got a HD5770.
but the thing is, with the same CPU (its an Athlon II X4 620 AM2/AM3) running Google Earth with the full db KMZ file, with the DDR2 setup earth would tend to stop responding for about 10 seconds when it needs to render the blob of APs in Massachusetts. Going DDR3 seemed to have eliminated this issue, at least it was very short in loss of responsiveness, only for a second or less not anything like it was on the DDR2 setup.
The best acceleration you can get on a Mac is 9.8ms^2
Post Reply