[Opendnssec-develop] too many open files

[Patrik Wallström]

On Sep 30, 2010, at 7:08 PM, Patrik Wallström wrote:
> 
> I am testing performance on a better machine now, with fast disks and a quad core xeon processor. Performance is much better. I seem to get 5000 signed domains without too much hassle.
> 
> First, create 5000 domains, adding them using no-xml (with mysql), and exporting the xml zonelist. First problem here, the first three lines is not xml, it's the mysql config. Remove this by hand. HUP the enforcer, and the enforcer creates signer configs reasonable fast. The signer acts a little strange, so after restarting the signer, it signs all domains without too much problem.
> 
> Add another 5000 domains, that one is a little bit slower with the enforcer. Export and HUP, and it creates signer configs. Here somewhere (had some dinner), the signer loops with this:
> 
> Sep 30 18:53:21 dnslab ods-signerd: command handler accept error: Too many open files
> 
> So this problem do still exist. It might be that the enforcer grabs all file descriptors, I don't know. But maybe the signer should be more resilient about it. So, we still have to find the file descriptor leak.
> 
> But it looks better and better, performance wise.


And after putting the kids to sleep, I just tried to start ods again.

Lots of these, of course, but look at the end.

Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1908more.org.state for reading: No such file or directory
Sep 30 21:00:50 dnslab ods-signerd: On Thu Sep 30 19:04:42 2010 I will sign zone 1909many.org
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1909more.org.state for reading: No such file or directory
Sep 30 21:00:50 dnslab ods-signerd: On Thu Sep 30 19:04:42 2010 I will sign zone 190many.org
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 190more.org.state for reading: No such file or directory
Sep 30 21:00:50 dnslab ods-signerd: On Thu Sep 30 19:04:42 2010 I will sign zone 1910many.org
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1910more.org.state for reading: No such file or directory
Sep 30 21:00:50 dnslab ods-signerd: On Thu Sep 30 19:04:42 2010 I will sign zone 1911many.org
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1911more.org.state for reading: No such file or directory
Sep 30 21:00:50 dnslab ods-signerd: On Thu Sep 30 19:04:42 2010 I will sign zone 1912many.org
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1912more.org.state for reading: No such file or directory
Sep 30 21:00:50 dnslab ods-signerd: On Thu Sep 30 19:04:42 2010 I will sign zone 1913many.org
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1913more.org.state for reading: No such file or directory
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1914many.org.unsorted for reading: Too many open files
Sep 30 21:00:50 dnslab ods-signerd: error reading zone 1914many.org from file 1914many.org.unsorted
Sep 30 21:00:50 dnslab ods-signerd: unable to recover unsorted zone from file 1914many.org.unsorted: parse error
Sep 30 21:00:50 dnslab ods-signerd: unable to open file 1914many.org.task for reading: Too many open files
Sep 30 21:00:50 dnslab kernel: [23674.642930] ods-signerd[16728]: segfault at 0 ip 0000000000416f80 sp 00007fffbb5a05f0 error 6 in ods-signerd[400000+33000]

-- 
Patrik Wallström
Project Manager, R&D
.SE (Stiftelsen för Internetinfrastruktur)
E-mail: patrik.wallstrom at iis.se
Web: http://www.iis.se/