|
Message-ID: <1362107899.52699.YahooMailNeo@web181303.mail.ne1.yahoo.com> Date: Thu, 28 Feb 2013 19:18:19 -0800 (PST) From: wfdawson <wfdawson@...lsouth.net> To: "john-users@...ts.openwall.com" <john-users@...ts.openwall.com> Subject: Re: Fuzzing with regular expressions This has been in my outbox for ~24 hours. AT&T / Yahoo suck. I will be moving my email elsewhere. Bison 2.4.3 is the latest stable version in Gentoo. I can of course enable unstable versions (~2.5.1 ~2.6.5 ~2.7). What I get for using Gentoo / Pentoo, I suppose. I tend to avoid running unstable as a matter of course, but then I have > 260 unstable packages installed, so you could argue that's a failed approach... ________________________________ From: Jan Starke <jan.starke@...ofbed.org> To: john-users@...ts.openwall.com; wfdawson <wfdawson@...lsouth.net> Sent: Thursday, February 28, 2013 4:06 AM Subject: Re: [john-users] Fuzzing with regular expressions Hi, please use a more recent version of bison. I'm using 2.5. I've documented tools and libs that are required under https://code.google.com/p/rexgen/wiki/QuickStart Kind Regards, Jan 2013/2/28 wfdawson <wfdawson@...lsouth.net>: > I also tried compiling on my Pentoo system. Similar errors to what Magnum reported initially: > > $ make > -- The C compiler identification is GNU 4.6.3 > -- The CXX compiler identification is GNU 4.6.3 > -- Check for working C compiler: /usr/bin/gcc > -- Check for working C compiler: /usr/bin/gcc -- works > -- Detecting C compiler ABI info > -- Detecting C compiler ABI info - done > -- Check for working CXX compiler: /usr/bin/c++ > -- Check for working CXX compiler: /usr/bin/c++ -- works > -- Detecting CXX compiler ABI info > -- Detecting CXX compiler ABI info - done > -- Found BISON: /usr/bin/bison (found version "2.4.3") > -- Found FLEX: /usr/bin/flex (found version "2.5.37") > -- Configuring done > -- Generating done > -- Build files have been written to: /home/wdawson/Software/rexgen/src > [FLEX][regexlexer] Building scanner with flex 2.5.37 > [BISON][regexparser] Building parser with bison 2.4.3 > parser/regex_parser.y:162.4: invalid character: `[' > parser/regex_parser.y:162.7: invalid character: `]' > make[2]: *** [librexgen/parser.cpp] Error 1 > make[1]: *** [librexgen/CMakeFiles/rexgen-0.1.0.dir/all] Error 2 > make: *** [all] Error 2 > > > > > > ________________________________ > From: magnum <john.magnum@...hmail.com> > To: john-users@...ts.openwall.com > Sent: Wednesday, February 27, 2013 6:57 PM > Subject: Re: [john-users] Fuzzing with regular expressions > > On 27 Feb, 2013, at 20:47 , Jan Starke <jan.starke@...ofbed.org> wrote: > >> Hi folks, >> >> I'm currently working on a library to create values (e.g. passwords) >> based on regular expressions. One could use this tool together with >> john like this: >> >> $ rexgen -i 'password[0-9]{2,4}' | john -pipe .... > > I really like this idea but I'm concerned it might be too slow. Let's hope I am wrong. > > A list of requirements would be nice. So far I know of cmake, log4cpp, libunistring and lua52. > > After fetching your latest commits I have this problem on OSX: > > [ 5%] [FLEX][regexlexer] Building scanner with flex 2.5.35 > [ 10%] [BISON][regexparser] Building parser with bison 2.3 > parser/regex_parser.y:162.4: invalid character: `[' > parser/regex_parser.y:162.7: invalid character: `]' > parser/regex_parser.y:165.29-30: $3 of `GroupRegex' has no declared type > parser/regex_parser.y:166.20: warning: stray `$' > parser/regex_parser.y:159.3-170.3: warning: unused value: $2 > make[2]: *** [librexgen/parser.cpp] Error 1 > make[1]: *** [librexgen/CMakeFiles/rexgen-0.1.0.dir/all] Error 2 > make: *** [all] Error 2 > > The above looks like bison is too old [the OSX native one] so I tried latest Ubuntu Linux instead of digging into it. But then I got other problems: > > [ 5%] [FLEX][regexlexer] Building scanner with flex 2.5.35 > [ 10%] [BISON][regexparser] Building parser with bison 2.5 > [ 15%] Building CXX object librexgen/CMakeFiles/rexgen-0.1.0.dir/librexgen.cpp.o > /home/magnum/src/rexgen/src/librexgen/librexgen.cpp:46:2: warning: #warning this must be handled with normal syntax error reporting [-Wcpp] > In file included from /home/magnum/src/rexgen/src/librexgen/parser/rexgenparsercontext.h:35:0, > from /home/magnum/src/rexgen/src/librexgen/librexgen.cpp:28: > /home/magnum/src/rexgen/src/librexgen/regex/groupreference.h: In member function ‘virtual const char_type* GroupReference::getXmlTag() const’: > /home/magnum/src/rexgen/src/librexgen/regex/groupreference.h:42:1: warning: cast from type ‘const char32_t*’ to type ‘char_type* {aka unsigned int*}’ casts away qualifiers [-Wcast-qual] > [ 21%] Building CXX object librexgen/CMakeFiles/rexgen-0.1.0.dir/librexgen_lua.cpp.o > [ 26%] Building CXX object librexgen/CMakeFiles/rexgen-0.1.0.dir/debug.cpp.o > [ 31%] Building CXX object librexgen/CMakeFiles/rexgen-0.1.0.dir/regex/compoundregex.cpp.o > In file included from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.h:35:0, > from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:29: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h: In member function ‘void IteratorPermuter<REGEX>::next()’: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:138:9: error: capture of non-variable ‘Iterator::state’ > In file included from /home/magnum/src/rexgen/src/librexgen/regex/regex.h:32:0, > from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.h:32, > from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:29: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iterator.h:58:5: note: ‘Iterator::<anonymous enum> Iterator::state’ declared here > In file included from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.h:35:0, > from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:29: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h: In lambda function: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:138:71: error: ‘this’ was not captured for this lambda function > In file included from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:29:0: > /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.h: In member function ‘virtual const char_type* CompoundRegex::getXmlTag() const’: > /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.h:45:1: warning: cast from type ‘const char32_t*’ to type ‘char_type* {aka unsigned int*}’ casts away qualifiers [-Wcast-qual] > In file included from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:30:0: > /home/magnum/src/rexgen/src/librexgen/regex/terminalregex.h: In constructor ‘TerminalRegex::TerminalRegex()’: > /home/magnum/src/rexgen/src/librexgen/regex/terminalregex.h:9:1: warning: cast from type ‘const char32_t*’ to type ‘char_type* {aka unsigned int*}’ casts away qualifiers [-Wcast-qual] > /home/magnum/src/rexgen/src/librexgen/regex/terminalregex.h: In member function ‘virtual const char_type* TerminalRegex::getXmlTag() const’: > /home/magnum/src/rexgen/src/librexgen/regex/terminalregex.h:19:1: warning: cast from type ‘const char32_t*’ to type ‘char_type* {aka unsigned int*}’ casts away qualifiers [-Wcast-qual] > In file included from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:31:0: > /home/magnum/src/rexgen/src/librexgen/iterator/compoundregexiterator.h: In lambda function: > /home/magnum/src/rexgen/src/librexgen/iterator/compoundregexiterator.h:47:75: warning: deleting object of polymorphic class type ‘Iterator’ which has non-virtual destructor might cause undefined behaviour [-Wdelete-non-virtual-dtor] > /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp: In destructor ‘virtual CompoundRegex::~CompoundRegex()’: > /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:38:13: warning: deleting object of abstract class type ‘Regex’ which has non-virtual destructor will cause undefined behaviour [-Wdelete-non-virtual-dtor] > In file included from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.h:35:0, > from /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:29: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h: In instantiation of ‘IteratorPermuter<REGEX>::initIterators() [with REGEX = Regex]::<lambda(Iterator*)>’: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:173:49: required from ‘struct IteratorPermuter<REGEX>::initIterators() [with REGEX = Regex]::<lambda(class Iterator*)>’ > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:173:3: required from ‘void IteratorPermuter<REGEX>::initIterators() [with REGEX = Regex]’ > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:71:3: required from ‘IteratorPermuter<REGEX>::IteratorPermuter(int, const REGEX*, IteratorState*, unsigned int, unsigned int) [with REGEX = Regex]’ > /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:88:63: required from here > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:173:64: warning: deleting object of polymorphic class type ‘Iterator’ which has non-virtual destructor might cause undefined behaviour [-Wdelete-non-virtual-dtor] > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h: In instantiation of ‘IteratorPermuter<REGEX>::initIterators() [with REGEX = CompoundRegex]::<lambda(Iterator*)>’: > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:173:49: required from ‘struct IteratorPermuter<REGEX>::initIterators() [with REGEX = CompoundRegex]::<lambda(class Iterator*)>’ > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:173:3: required from ‘void IteratorPermuter<REGEX>::initIterators() [with REGEX = CompoundRegex]’ > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:71:3: required from ‘IteratorPermuter<REGEX>::IteratorPermuter(int, const REGEX*, IteratorState*, unsigned int, unsigned int) [with REGEX = CompoundRegex]’ > /home/magnum/src/rexgen/src/librexgen/regex/compoundregex.cpp:96:59: required from here > /home/magnum/src/rexgen/src/librexgen/regex/../iterator/iteratorpermuter.h:173:64: warning: deleting object of polymorphic class type ‘Iterator’ which has non-virtual destructor might cause undefined behaviour [-Wdelete-non-virtual-dtor] > make[2]: *** [librexgen/CMakeFiles/rexgen-0.1.0.dir/regex/compoundregex.cpp.o] Error 1 > make[1]: *** [librexgen/CMakeFiles/rexgen-0.1.0.dir/all] Error 2 > make: *** [all] Error 2 > > > Is this the result of me still missing something? On what platform are you developing this? > > magnum
Powered by blists - more mailing lists
Confused about mailing lists and their use? Read about mailing lists on Wikipedia and check out these guidelines on proper formatting of your messages.