develooper Front page | perl.ldap | Postings from August 2017

Re: Searching without retaining all results

Thread Previous | Thread Next
From:
Kevin Aires
Date:
August 3, 2017 22:29
Subject:
Re: Searching without retaining all results
Message ID:
OF0101FD55.AF584731-ON00258171.007B7CDA-00258171.007B7CDF@notes.na.collabserv.com
<font face="Verdana,Arial,Helvetica,sans-serif" size="2"><div>Why am I on this list. &nbsp;I don't even remotely understand what this is about! &nbsp;Please could someone remove me.<br>Best regards,<br><br>Kevin Aires<br>European Lead<br>IBM Digital Video Services<br><br><a href="mailto:aires@us.ibm.com">aires@us.ibm.com</a> (Based in UK)<br>+44 (0) 7771 366388</div><br><br><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2" color="#000000"><font color="#990099">-----Chris Ridd &lt;<a href="mailto:chrisridd@mac.com" target="_blank">chrisridd@mac.com</a>&gt; wrote: -----</font><div class="iNotesHistory" style="padding-left:5px;"><div style="padding-right:0px;padding-left:5px;border-left:solid black 2px;">To: <a href="mailto:perl-ldap@perl.org" target="_blank">perl-ldap@perl.org</a><br>From: Chris Ridd &lt;<a href="mailto:chrisridd@mac.com" target="_blank">chrisridd@mac.com</a>&gt;<br>Date: 03/08/2017 17:00<br>Subject: Searching without retaining all results<br><br><div><font face="Courier New,Courier,monospace" size="2">I had a requirement to extract 30+ million entries from an ldap server, and naively thought that using callbacks would be useful.<br><br>While they are useful in getting me each result quickly, I didn't realise that Search still captures each result in self. So after reading several million entries Linux's oom killer kindly killed a) the ldap server and then b) my script to try and get back some memory!<br><br>I ended up patching Search.pm to avoid capturing each result when using callbacks. Is there a better way to do this?<br><br>Cheers,<br><br>Chris<br></font></div></div></div></font></font><BR>

Thread Previous | Thread Next


nntp.perl.org: Perl Programming lists via nntp and http.
Comments to Ask Bjørn Hansen at ask@perl.org | Group listing | About