Benchmark tools forum?

[atatut]

Hi everyone,

I wonder if it's not the time to create a new forum called:

Benchmark tools

having a tree structure like the one below and gathering in a single place, tools, scripts, how tos and tips related with benchmarking your system:

-Benchmark tools forum:
----Package (ex: net-dns/bind)
---------version (ex: 9.4.1_p1)
-------------arch (ex: x86)
-----------------benchmark tools
---------------------benchmark results per CFLAGS (to be able to see the difference between a PIII and a Xeon or and AMD)

The structure requires being strict when adding something to this forum wich will more likely look like a knowledge repository for those who seek a serious way to benchmark their system than a classical discussion forum. Nevertheless, the benchmark tools "sub-forum" can be the place for theses kind of discussions, where people can discuss about the efficiency of such or such benchmark tool while leaving the rest of the tree clean of comments, leaving the user with clean and comparable data, where doubt doesn't exist.

Here's how it could look like:

Gentoo General Benchmark Tools forum

-full portage using this format: net-dns/bind
-----versions (all the versions of the package available in Gentoo from Jesus Christ to nowadays)
---------arch (obviously those you can install Gentoo on)
-------------benchmark tools (THE PLACE WHERE PEOPLE CAN DISCUSS ABOUT THE BENCHMARK TOOLS, their efficiency, etc.. while making sure they only refer to a specific package, having a specific version, running on a specific arch, and NOT the blabla mess you can find with classical benchmark tools where you don't know what is the version of the package the benchmark tool is made for, where people add their contribution at the same place but talking about different arches, that makes the benchmarking a hell of a mess for the system admins that just want to know exactly what they can expect from their system even before they inserted the minimal install CD in their drive, not hear about how clever this developer is or stuff like this that makes benchmark tools websites or forums unreadable because 99% of the text is "I'm the best...").
-----------------benchmark tools version and the how to use the benchmark tool specific per version
---------------------CFLAGS (same benchmark tool benchmarking a package compile with different CFLAGS will give different reults)
-------------------------results per CFLAGS


I know there's no way all packages require benchmarking tools, or should I say, most system administrators won't give a f... having a tool to benchmark an obscure package they ignore the use, but developers may find this useful while coding new versions of a package or of its benchmark tool. So don't only think at your immediate needs if you wish to leave a comment about this Benchmark forum idea but also to the rest of the Gentoo users thay may find this really interesting.

Don't hesitate to comment, I'd like to know if there's an interest in having such knowledge base available for everyone.

[no_hope]

I like your idea.

The tree structure seems a bit complicated though. I think it would be better to have a moderated thread per package where people would post their CFLAGS, hardware, package version and benchmarks. The first post in the thread could summarize available tools to benchmark that package.

Until you convince the forums bosses, you could get started on http://gentoo-wiki.com/