Re: [PATCH 1/7] test: add known broken test for indexing html

Subject: Re: [PATCH 1/7] test: add known broken test for indexing html

Date: Thu, 20 Apr 2017 10:05:51 -0000

To: notmuch@notmuchmail.org

Cc:

From: David Bremner

David Bremner <david@tethera.net> writes:

> 'quite' on IRC reported that notmuch new was grinding to a halt during
> initial indexing, and we eventually narrowed the problem down to some
> html parts with large embedded images. These cause the number of terms
> added to the Xapian database to explode (the first 400 messages
> generated 4.6M unique terms), and of course the resulting terms are
> not much use for searching.
>
> The second test is sanity check for any "improved" indexing of HTML.

pushed the first patch in the series to master.

d

• Previous message (by thread): Re: [PATCH 1/7] test: add known broken test for indexing html

Thread:

• David Bremner—Drop HTML tags when indexing [inbox, unread]
  • David Bremner—[PATCH 1/7] test: add known broken test for indexing html [inbox, notmuch::bug, notmuch::fixed, notmuch::patch, notmuch::pushed, notmuch::test, unread]
    • David Bremner—Re: [PATCH 1/7] test: add known broken test for indexing html [inbox, unread]
    • David Bremner—Re: [PATCH 1/7] test: add known broken test for indexing html [inbox, unread]
  • David Bremner—[PATCH 2/7] lib: add content type argument to uuencode filter. [inbox, notmuch::obsolete, notmuch::patch, unread]
  • David Bremner—[PATCH 3/7] lib/index: Add another layer of indirection in filtering [inbox, notmuch::obsolete, notmuch::patch, unread]
  • David Bremner—[PATCH 4/7] lib/index: separate state table definition from scanner. [inbox, notmuch::obsolete, notmuch::patch, unread]
  • David Bremner—[PATCH 5/7] lib/index: generalize filter name [inbox, notmuch::obsolete, notmuch::patch, unread]
  • David Bremner—[PATCH 6/7] lib/index.cc: generalize filter state machine [inbox, notmuch::obsolete, notmuch::patch, unread]
  • David Bremner—[PATCH 7/7] lib/index: add simple html filter [inbox, notmuch::obsolete, notmuch::patch, unread]
  • Daniel Lublin (quite)—Re: Drop HTML tags when indexing [inbox, unread]
  • David Bremner—Re: Drop HTML tags when indexing [inbox, unread]