Follow @Openwall on Twitter for new release announcements and other news
[<prev] [next>] [thread-next>] [day] [month] [year] [list]
Message-ID: <3767c141-e627-4989-a7c3-404f66aa5a7e@jeffunit.com>
Date: Mon, 7 Oct 2024 14:59:48 -0700
From: jeff <jeff@...funit.com>
To: john-users@...ts.openwall.com
Subject: slow progress after --restore

On 10/7/2024 14:28, Solar Designer wrote:
> Hi Jeff,
>
> On Sun, Oct 06, 2024 at 07:03:56PM -0700, jeff wrote:
>> I am running john_bleeding_2024_0608.1
>>
>> john.exe --fork=22 --format=NT --verbosity=2 --no-log
>> --wordlist=\pw-crack\dictionaries\found-ntlm_811m.dic --rules=all
>> --dupe=0 \pw-crack\pwn_ntlm.115m.rawest
>>
>> whee found-ntlm_811m.dic is the file with the 811 million passwords I
>> have already cracked
>> and pwn_ntlm.115m.rawest are the 115 million hashes I have yet to crack.
>>
>> It works well.
>> However, on occasion, I need to resume john with the --restore command.
>> When I do so, it works, however for about 8000 seconds, no new hashes
>> are found.
>> After that, I slowly find hashes, and after about 10 hours I am finding
>> roughly 1 hash per second.
>>
>> Based on my observations, it seems that john checkpoints somewhat
>> infrequently, and when it is restored,
>> it starts off and repeats a lot of calculations. It would be nice if
>> there was more fine grained check pointing
>> so that hashes are found much sooner. Waiting 8000 seconds before any
>> new hashes are found seems less than ideal.
>> I don't plan on restarting often, but when I do it seems to take quite a
>> long time to build up to full speed.
> That's a weird observation.  Do you mean "for about 8000 seconds" after
> the start of actual cracking when first per-process status lines have
> already appeared and timestamps have started increasing?  Or is it the
> loading time maybe?  Do you have a large pot file maybe?  You don't show
> you overriding it with --pot.

My pot file has about 16m entries. I mean for about 8000 seconds after 
the process status lines start for each thread.
> We do checkpoint often, once a minute by default (or even more often
> when a lot of passwords get cracked in a minute).
>
> For further occasions, this would have been a fine topic for john-users,
> if you set the Subject line to reflect the topic/problem.
>
> Alexander

I am enclosing a log taken every 1000 seconds of 'wc' run on the pot 
file since john started each thread:

16033964  16383603 808755956 john.pot
  16033964  16383603 808755956 john.pot
  16033964  16383603 808755956 john.pot
  16033964  16383603 808755956 john.pot
  16033964  16383603 808755956 john.pot
  16033964  16383603 808755956 john.pot
  16033964  16383603 808755956 john.pot
  16033964  16383603 808755956 john.pot
  16033968  16383607 808756140 john.pot    # at 9000 seconds, john 
starts finding new hashes
  16033968  16383607 808756140 john.pot
  16033968  16383607 808756140 john.pot
  16033968  16383607 808756140 john.pot
  16033968  16383607 808756140 john.pot
  16033968  16383607 808756140 john.pot
  16033968  16383607 808756140 john.pot
  16034063  16383702 808760934 john.pot
  16034063  16383702 808760934 john.pot
  16034096  16383736 808762546 john.pot
  16034165  16383806 808765882 john.pot
  16034488  16384134 808782570 john.pot
  16034632  16384278 808789684 john.pot    # 20,000 seconds since 
starting, found 144 hashes in the last 1000 seconds
  16035250  16384902 808821616 john.pot
  16035759  16385412 808846458 john.pot
  16036102  16385755 808863334 john.pot
  16036524  16386181 808883801 john.pot
  16037064  16386722 808910430 john.pot
  16037570  16387229 808935056 john.pot
  16038389  16388049 808975009 john.pot
  16039021  16388687 809005727 john.pot
  16039686  16389357 809038061 john.pot
  16040324  16390000 809068929 john.pot
  16040812  16390495 809092774 john.pot
  16041392  16391079 809121144 john.pot
  16041818  16391507 809141837 john.pot
  16042728  16392422 809186478 john.pot
  16043752  16393645 809236790 john.pot
  16044940  16394843 809294820 john.pot
  16046082  16395991 809350697 john.pot
  16047102  16397018 809400804 john.pot
  16048851  16398770 809489529 john.pot
  16050316  16400244 809564156 john.pot    # 40,000 seconds, found 1465 
hashes
  16051521  16401464 809623265 john.pot
  16052624  16402579 809677134 john.pot
  16053735  16403697 809731551 john.pot
  16055185  16405157 809803547 john.pot
  16056686  16406666 809876820 john.pot
  16059199  16409194 810009448 john.pot
  16060384  16410384 810067141 john.pot
  16061670  16411688 810129615 john.pot
  16063200  16413240 810204228 john.pot
  16064300  16414344 810257844 john.pot
  16065767  16415822 810329656 john.pot
  16067050  16417114 810392809 john.pot
  16068215  16418285 810449883 john.pot
  16069438  16419516 810509958 john.pot
  16071110  16421201 810591718 john.pot
  16072609  16422713 810664819 john.pot
  16074117  16424235 810738872 john.pot
  16075460  16425590 810804766 john.pot
  16076916  16427053 810876604 john.pot
  16078520  16428670 810955255 john.pot
  16079839  16429998 811019821 john.pot
  16081532  16431702 811102887 john.pot
  16083495  16433676 811199525 john.pot
  16084874  16435063 811266751 john.pot
  16086110  16436310 811327607 john.pot
  16087615  16437822 811401321 john.pot
  16088987  16439209 811468624 john.pot
  16090223  16440457 811529238 john.pot
  16091329  16441567 811583103 john.pot
  16092796  16443039 811655485 john.pot
  16093898  16444147 811709021 john.pot
  16095087  16445349 811767112 john.pot
  16096566  16446838 811840337 john.pot
  16098120  16448409 811917369 john.pot
  16099714  16450022 811995377 john.pot
  16100984  16451297 812057448 john.pot
  16102126  16452446 812113367 john.pot
  16103415  16453741 812176550 john.pot
  16104522  16454856 812230360 john.pot
  16105905  16456252 812297730 john.pot
  16107530  16457889 812377814 john.pot
  16108943  16459313 812446805 john.pot
  16111742  16464194 812587965 john.pot
  16113148  16465611 812656543 john.pot
  16114654  16467127 812730730 john.pot
  16115910  16468393 812791764 john.pot
  16118582  16471070 812935775 john.pot
  16119897  16472400 812999961 john.pot
  16121236  16473746 813065571 john.pot
  16122710  16475227 813137780 john.pot
  16123973  16476495 813199637 john.pot
  16125470  16477999 813272714 john.pot
  16126998  16479536 813347123 john.pot
  16128655  16481207 813427222 john.pot
  16130784  16483360 813529644 john.pot
  16133229  16485811 813648450 john.pot
  16135442  16488037 813754270 john.pot
  16137582  16490187 813857250 john.pot
  16140651  16493266 814004343 john.pot
  16143414  16496040 814137044 john.pot
  16146334  16498975 814277570 john.pot
  16148384  16501035 814376514 john.pot
  16151515  16504179 814528669 john.pot
  16154814  16507488 814687464 john.pot
  16156843  16509527 814787518 john.pot
  16159385  16512072 814914380 john.pot
  16161418  16514110 815014896 john.pot
  16163351  16516047 815110139 john.pot
  16164926  16517624 815190203 john.pot    # the present, found 1575 
hashes in the last 1000 seconds

jeff




Powered by blists - more mailing lists

Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.