| Author |
Message |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Tue Feb 05, 2008 3:31 am Post subject: eMail Verifier running verrry slow... |
|
|
| Reading the documentation and product overview page, it is stated that this program is supposed to verify emails at about 10 emails per second. I have been running the program now for over 10 hours and am only averaging 0.5 emails per second. Quite a discrepancy. I have a fast computer and fast ISP, so I am not understanding why this is going so slow. I have used the settings the program came with. Can anyone please advise me on how I can speed this up to where it should be? If this is actually how slow the program goes, it is very false advertising. Thank you. |
|
| Back to top |
|
 |
stanbusk Site Admin
Joined: 28 Dec 2005 Posts: 2175
|
Posted: Tue Feb 05, 2008 11:05 am Post subject: |
|
|
| How many addresses do you have on your list? Are you using a PC or a Mac? If you are suing a PC, have you tried to deactivate the anti-virus function that checks port 25 ? |
|
| Back to top |
|
 |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Tue Feb 05, 2008 4:00 pm Post subject: |
|
|
| stanbusk wrote: | | How many addresses do you have on your list? Are you using a PC or a Mac? If you are suing a PC, have you tried to deactivate the anti-virus function that checks port 25 ? |
I have about 130,000 emails in the list. I am using a PC and have deactivated the anti-virus function you eluded to. It is still going just as slow. I did do a check (by doing the test in the FAQ) to see if in fact I was blocked from port 25 by my ISP and I am, but the program still seems to be working fine and doing the job, it is just really slow. Any other ideas? I really appreciate the help. |
|
| Back to top |
|
 |
stanbusk Site Admin
Joined: 28 Dec 2005 Posts: 2175
|
Posted: Tue Feb 05, 2008 6:57 pm Post subject: |
|
|
| The problem is the DNS lookups the program have to performed first. Once done it will go much faster. Try a smaller list and you will see. |
|
| Back to top |
|
 |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Tue Feb 05, 2008 7:18 pm Post subject: |
|
|
| stanbusk wrote: | | The problem is the DNS lookups the program have to performed first. Once done it will go much faster. Try a smaller list and you will see. |
I tried a smaller list (about 5,000 emails) and it still only goes at about 1 email per second. Are there optimal settings I should be using to get the best performance other than the factory settings, or is this the typical output I can expect from this program? Thanks. |
|
| Back to top |
|
 |
stanbusk Site Admin
Joined: 28 Dec 2005 Posts: 2175
|
Posted: Wed Feb 06, 2008 11:03 am Post subject: |
|
|
| Have you waited for the DNS lookups do be done? It is the slowest part actually. Are you using default 10 threads? Have you added 2 DNS server addresses to the preferences? Is the VRFY command deactivated? You can also increase the group parameter to 25. |
|
| Back to top |
|
 |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Wed Feb 06, 2008 9:07 pm Post subject: |
|
|
Yes, I have done all of those things. It is a little faster (maybe 1.5 emails per second), but still not up to the claim of 10 per second. I also have my retries set to 3, timeout set to 15, "Use Mail Exchanger with highest priority only" box checked, and the "Send RSET command" box checked. Should I change any of these? Will setting the group parameter higher than 25 speed it up at all? And is there any way to speed up the DNS lookups?
Maybe it's just me, but it seems like if you are going to put out a product like this, it should be able to handle emails in a very fast manner, especially if you claim it can handle over 10 emails per second. Most people who want to verify their email addresses have rather large email lists. The program should be made to handle this. |
|
| Back to top |
|
 |
stanbusk Site Admin
Joined: 28 Dec 2005 Posts: 2175
|
Posted: Thu Feb 07, 2008 11:12 am Post subject: |
|
|
10 addresses per second is the fastest speed we got here. Now, speed not depends on eMail Verifier, it depends on your connection, on the DNS server response time, on the MTAs load and so on. As a result it will not go at the same speed all day. It depends. The best you can do is to launch the process by night. It is usually when Internet has less traffic, MTAs are not that busy. You will then get a connection faster and a faster response to commands. During the day you can get big MTAs connection lags, just multiply that with 5000 addresses to check. (A MTA is a SMTP server). Just try MaxBUlk Mailer with your server(s) at different time and you will see what I am talking about.
Also note that the presence of an anti-virus or a strong firewall can also slowdown the checking process.
To speed up DNS lookups you can try to install a DNS server on your computer. |
|
| Back to top |
|
 |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Tue Feb 12, 2008 4:27 am Post subject: |
|
|
I understand that it won't go at the same speed all the time, but there is a pretty big difference between 1 email per second and the over 10 emails per second that this program is claimed to be able to do.
I would also like to know a few other things:
1) Will setting the group parameter higher than 25 make a difference?
2) What does it mean when the result column says "Scanning"? Does that have to do with anti-virus software?
3) Will shutting down my firewall and anti-virus program speed things up? If so, there should be a way to work around this, as leaving your computer unprotected is not good.
4) Why does the checking of the servers only stay just a little bit ahead of the actual results of the email addresses? I know you said this is the slowest part, but it never gets very far ahead of the checking of the addresses.
I appreciate your help in answering my questions. Like I said before, though, I don't understand how a program can go this slow when its claim is to go so much faster. I understand the different factors involved, but this seems like a program for very small email lists, not for anything very significant. If this can't go faster than 1 email per second (if I'm lucky) on a fast computer with a fast connection, that's very disappointing. |
|
| Back to top |
|
 |
stanbusk Site Admin
Joined: 28 Dec 2005 Posts: 2175
|
Posted: Tue Feb 12, 2008 1:24 pm Post subject: |
|
|
#1 - Don't use a too high number. 25 or lower. In fact it can make a big difference.
#2 - No. It is when eMail Verifier is performing the test.
#3 - Yes, only the part of your anti-virus that checks outgoing messages or that checks port 25 traffic.
#4 - Because DNS lookup takes all resources. Once they are all done, the second part will be much faster.
About your last comment, how do you want eMail Verifier to go faster than the responses it gets from servers? I have tested myself lists of up to 100,000 entries without problems. It can be fast or slow depending on the server it connects to but what is important is the quality of the results not the speed. |
|
| Back to top |
|
 |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Tue Feb 12, 2008 2:20 pm Post subject: |
|
|
Thank you again for answering my questions. I understand you can't do anything about how long it takes to connect to a server, but what is upsetting is how the claim is that this program can do over 10 emails per second. Even when I attempt a list of only 5,000 addresses, I'm lucky if it can get through 1 email per second. For instance, with a list of about 100,000 addresses (which you say you used), I let the program run overnight with all the settings you mentioned and it only managed to go through about 4,000 addresses in a little over 8 hours. That's an average of a measley 0.14 emails per second! That's quite ridiculous given the claim of this program, especially when it's running overnight when the servers aren't as busy. When you say you did a list of 100,000 addresses with no problems, how fast did it go for you and how long did it take to go through a list like that?
I'm sorry I'm sounding upset, but I've tried all the things you have mentioned and the speed stays the same. It seems like there is something that is missing here. I am using a router also, but I wouldn't think that would be the difference. Again I appreciate the help and hope you can help me get this running faster. |
|
| Back to top |
|
 |
stanbusk Site Admin
Joined: 28 Dec 2005 Posts: 2175
|
Posted: Tue Feb 12, 2008 4:41 pm Post subject: |
|
|
If I remember well the last test I made with the 100k list I get around 3 e-mails checked per second. It took a whole night. Resolving 100.000 addresses and connecting to 100.000 servers is a huge task. It is always recommended to split the list into smaller chunks and text only one list per day.
Today I have made another test with a 5k list and I get 2 e-mails checked per second. It took 42 minutes for eMail Verifier to check that 5k list. So for a 100k list it should take 42*20=840=14 hours.
Your timings are in fact very deficient. Right now I don't know the reason. Perhaps your list has a very poor quality and as a result eMail Verifier has more trouble to go thru it.
Right now email Verifier is able to use up to 10 threads. We could try to make 25 available. It might be 2.5 faster. |
|
| Back to top |
|
 |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Tue Feb 12, 2008 5:57 pm Post subject: |
|
|
| Could the problem be that my ISP is Mediacom? They are said to block port 25 and, like I mentioned before, I did the test to see if that port was blocked and it is, but eMail Verifier still seems to work, just very, very slow. Is it actually working, or just acting like it and could this be the problem? Just a thought. |
|
| Back to top |
|
 |
stanbusk Site Admin
Joined: 28 Dec 2005 Posts: 2175
|
Posted: Tue Feb 12, 2008 7:53 pm Post subject: |
|
|
| Actually eMail Verifier is completely unable to work without the port 25 fully open. If port 25 is closed you will be able to lookup domains but all SMTP transactions will timeout one after the other. In fact, that can take forever as the timeout time is set to 10 seconds. Only addresses filtered thru the rules will show a result. Perhaps it is what you are seeing. |
|
| Back to top |
|
 |
vern17
Joined: 05 Feb 2008 Posts: 9
|
Posted: Tue Feb 12, 2008 8:42 pm Post subject: |
|
|
| Port 25 is blocked, but it is still checking the addresses just fine (without timeouts), even the ones that aren't automatically validated by the rules. Not sure how it is doing it, but it is. How can that be? |
|
| Back to top |
|
 |
|