Suggestions for Stats

[Tattysnuc]

Hi,

I'm looking for ideas for Stats SPECIFIC to Hexus. at 5pm on Saturday (10th July) I downloaded the file from F@H with all the users points which is located here with a view to doing a weekly download and then some analysis in Access, which I'll then post up. If this takes off I'll see if I can put it all online and build an engine to query it - I've been meaning to learn how to do it, and this seems as good a reason as any.

So far Extreme Overclocking has done a very comprehensive first go at this, but I feel that there could be a bit more on there, such as:

1. Most points in a period (ie ranked by highest contributor during that time frame)
2. Points per month/Week/Day
3. Time to get to Nth place

Do any of you have any suggestions? Maybe Extreme overclocking already does this, but I've not sussed out how to see it yet...

Also, if anyone can suggest how to automate downloading the file from Stanford so that I don't have to remember to do it, then that would be a great help.

Cheers!

Tattysnuc

[shbris]

sounds like a great excuse to do some learning, great if you can do it!

[Tattysnuc]

I've downloaded 2 set of data a week apart now, so I'll have a play witht he data the next night I've got "free", which will probably be Thursday. Once I've got the base model built I'll start publishing some stats. Anyone thought of anything that they'd like to see?

[Queelis]

Maybe the things you've mentioned, and then also something for going up the most places in a month or so, and passing some point mark, e.g. 100k, 250k, 500k, 1M etc. etc.?

[Tattysnuc]

I've been downloading the stat files intermittently for the past few weeks, which will allow me to work out a rate per day, and to calcualte the date when certain landmarks were passed, so once I've got my microsoft certification exams done (on Friday 13th!!! arrrrggggghhhhh!) I'll start looking at building/learning and then workign toward my SQL server exams

I've just checked out my stats on extreme overclocking, and I'm the 547th highest PPD producer 24hr AVERAGE. I can only guess that I'm getting some sort of bonusses from running the SMP client with passkey also!

Fold on!

[Tattysnuc]

Next weekend I'm going to produce a table which contains

1. Ranking - Top 10 producers overall
2. Ranking - Top 10 producers for that month
3. Ranking - Top 10 active producers
4. Ranking - Most improved producer that period (probably a %'age based on prior month or some sort of weighted average - not quite sure yet how)

with a table for each month. Can anyone else think of anything else worth adding

I'm still struggling to get ontop of my work commitments and pc rebuilds, so I keep putting the learning/development work back, so I'm just going to do this from ExtremeOverclocking's stat's pages until I get my own little project up and running.

As there are only a couple of dozen people active for Hexus I don't think that this will be too time consuming to do.

[Tattysnuc]

Apologies -missed that deadline I set myself. Going to have a go thursday night now. Sorry folks

[Rob_B]

what file type do the stats come down as? Wonder if I should pop it into some tables on our mainframe to crunch through in seconds?

[Tattysnuc]

It's just a text file of the points at that particlar juncture in time, cumulative. The first line being the date/time stamp. I cannot find a way to automate downloading them and am struggling to remember to download them regularly. I've got about a dozen off now, but i've been too busy to do anything with the files apart from a little light reading at lunchtimes.

I've been looking at the stats on extreme overclocking and he allows you to interface with his db, which might be a simpler way of doing this. It does mean that I dont get to build my own sql db though which was part of my motivation as I'd like to go for my microsoft certification for sql server at some point.

[1stRaven]

If its an FTP download, you can schedule a batch file to run to grab it.

[Tattysnuc]

If its an FTP download, you can schedule a batch file to run to grab it.

How?

It's not an FTP page it's simply a web page or a file (depending on which link you follow)

located here for the link to the file or here for the text file/web page

I've been looking at downloading the file as this has the date/time stamp as the first line, but I don't know how to set up a job to go to a web page, grab a file, and then save it as a specific file name, which is a function of the first line in the file.

I've read about chron-jobs but I don;t really want to have to go down the linux route if possible.