[Opendnssec-develop] Test the new sorter
Rick Zijlker
rick.zijlker at sidn.nl
Mon Feb 1 11:10:01 UTC 2010
Hey,
I tested the new sorter with the unsorted nl zone. Here is a comparison:
[root at signer1 rick]# time /usr/local/libexec/opendnssec/sorter -f ./nl -w ./nl.sorted2 -m 3600 -t 3600 -o nl.
Number of records sorted: 8446249
real 5m24.859s
user 5m5.311s
sys 0m18.056s
[root at signer1 rick]# time ./quicksorter -f ./nl -w ./nl.sorted -m 3600 -t 3600 -o nl.
Killed
real 5m14.711s
user 0m10.172s
sys 2m23.606s
The quicksorter keeps getting killed which results in an incomplete sorted zone:
-rw-rw-r-- 1 rick rick 226143877 Nov 17 16:46 nl
-rw-r--r-- 1 root root 0 Feb 1 11:28 nl.sorted
-rw-r--r-- 1 root root 396950529 Feb 1 11:00 nl.sorted2
Also I don’t see improvement in performance. Even though the sorter is not even the bottleneck. The processing is what takes 45-50 minutes.
Cheers,
Rick
From: opendnssec-develop-bounces at lists.opendnssec.org [mailto:opendnssec-develop-bounces at lists.opendnssec.org] On Behalf Of Rickard Bellgrim
Sent: woensdag 27 januari 2010 16:47
To: Opendnssec-develop at lists.opendnssec.org
Subject: [Opendnssec-develop] Test the new sorter
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Hi
There is a new sorter available in our SVN. Could you test it if you had any performance issues, e.g. SIDN? Solves some part of the problem.
wget http://trac.opendnssec.org/export/2729/home/bjst/quicksorter.c
gcc -Wall quicksorter.c -o quicksorter
time ./quicksorter -f <Unsorted zone file> -w <Sorted zone file> -m <SOA minimum> -t <DNSKEY ttl> -o <Zone origin>
Compare the result with
time /usr/local/libexec/opendnssec/sorter -f <Unsorted zone file> -w <Sorted zone file> -m <SOA minimum> -t <DNSKEY ttl> -o <Zone origin>
It is 10 times faster for me.
// Rickard
-----BEGIN PGP SIGNATURE-----
Version: 9.8.3 (Build 4028)
Charset: utf-8
wsBVAwUBS2Bf9uCjgaNTdVjaAQiOEQf/QtwEZINZKNPmApEKsXCDFTP+8Jz6UOAq
5AmkcNDjaz47hrdv+/voBPNu+CFws1Hw200gKysXk/rnkU848v+29o0iLv2p0TW5
9GAGVYJM5CQHcXRCQDB6B0/bb8IARbeokWHv2IGoGbk+ALcr+Dh4010mfuFGh7C8
nV57pYGNvf/rnpnmryEFP0xPqSBac5PsblVjABg/Hr6o0cKpPC1tR5tVqwjxoEDj
pVzvQxz2v7oq8bl0OkpAlqZ0xT/cp6KZG+hBdrh4wxzbY1LdyoicLIGYg7G11NpW
3IYdr46p/ZYVY+E+TC6C1AIjZU8sZBBL15qJ0YBgglK0dObR55PyEA==
=d0Ce
-----END PGP SIGNATURE-----
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opendnssec.org/pipermail/opendnssec-develop/attachments/20100201/fdf3ed19/attachment.htm>
More information about the Opendnssec-develop
mailing list