Pagelyzer

h2. Summary

h2. Description

{color:#000000}Pagelyzer is a tool which compares two web pages versions and decides if they are similar or not.{color}

{color:#000000}It is based on:{color}
* {color:#000000}a combination of structural and visual comparison methods embedded in a statistical discriminative model,{color}
* {color:#000000}a visual similarity measure designed for Web pages that improves change detection,{color}
* {color:#000000}a supervised feature selection method adapted to Web archiving.{color}





{color:#000000}We train a Support Vector Machine model with vectors of similarity scores between successive versions of pages. The trained model then determines whether two versions, defined by their vector of similarity scores, are similar or not. Experiments on real Web archives validate our approach.{color}

{color:#000000}Installation manual can be found{color} {color:#000000}[here|^installation manual-1-pagealyzer.pdf]{color}{color:#000000} {color}


{color:#000000}{*}{+}How does it work?+{*}{color}

{color:#000000}{*}{+}References:+{*}{color}

{color:#000000}\[1\] D. Cai, S. Yu, J.-R. Wen, and W.-Y. Ma. VIPS: a Vision-based Page Segmentation Algorithm. Technical report, Microsoft Research, 2003.{color}

{color:#000000}\[2\] Saad M.B., Gançarski S., Pehlivan Z.. A Novel Web Archiving Approach based on Visual Pages Analysis. In 9th International Web Archiving Workshop (IWAW), ECDL 2009{color}

{color:#000000}\[3\] Sanoja, Gançarski S. "Yet another Web Page Segmentation Tool". Proceedings iPRES 2012. Toronto. Canada, 2012{color}

{color:#000000}\[4\] D. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60, 2004{color}

{color:#000000}\[5\] Pehlivan Z., Saad M.B. , Gançarski S..Understanding Web Pages Changes.{color} {color:#000000}{_}DEXA (1) 2010: 1-15{_}{color}

{color:#000000}\[6\] M. Teva Law, C. Sureda, N. Thome, S. Gançarski, M. Cord. Structural and Visual Similarity Learning for Web Page Archiving, Workshop CBMI 2012{color}

h2. User Experiences

[SP:SO18 Comparing two web page versions for web archiving]

h3. Activity Feed

{rss:max=7|url=https://github.com/openplanets/pagelyzer/commits/master.atom}

h3. Release Feed