THE PRODUCT COMMENTS DETECTION BENCHMARK SUITE (REVIEWBS) README
================================================================

1.Introduction
==============
Product comment detection is based on extracting product reviews from real webshops. As template detection or content extraction techniques, comment detection needs to be continually tested in order to get new improvements in both, its results and performance. This testing is done using sets of webshops prepared for this purpose. Thus, a benchmark suite is an important requirement to measure the performance of these techniques.

2.How to obtain REVIEWBS 1.0
============================
REVIEWBS 1.0 can be downloaded from the following URL: https://mist.dsic.upv.es/revEx/downloads.html

3.Structure
===========
REVIEWBS 1.0 was created by downloading 195 webpages from several webshops from the Internet. Once all the webpages were downloaded, four different engineers explored the key page and the webpages accessible from it to decide what part of the webpage corresponds to the reviews section.
Using the results of this experiment, each webpage was prepared for comment detection.
All elements belonging to the comment section were included in an HTML class called TECO_mainComments. Therefore, a comment detection tool can easily compare its output to the nodes belonging to this class.

REVIEWBS 1.0 is organized in directories and files. There is a directory called "mixed" which has 75 files and directories inside, a directory of file for each webpage domain. In addition, there is another directory called "fixed" which includes 4 directories for webpages with 2, 3, 4, and 5 comments.

4.How to use REVIEWBS
=====================
The installation is very simple, the zip file has to be extracted into the hard drive, pendrive or other media. Once extracted it will create both directories. It is recommended to extract the file on Linux or OS X systems because Windows based systems do not allow the directory structure used to store the benchmarks.

5.List of webpages
==================
5.1 Mixed webpages
==================
mixed/www.etsy.com/es/listing/1118100665/delantal-de-lona-gris-completo.html
mixed/www.gourmetfoodstore.com/puglia-ricotta-salata-12691.html
mixed/sourceforge.net.html
mixed/www.otto.nl/p/10096444193/lascana-beugelbikini-met-opzij-aangerimpeld-bikinibroekje/index.html
mixed/thejewellershop.com/en/id0035sl.html
mixed/www.lookfantastic.es.html
mixed/www.puzzlemaster.ca/browse/wood/puzzleboxes/15453-cluebox-davy-jones-locker-60-minute-escape-room-in-a-box.html
mixed/www.decathlon.com.html
mixed/www.fernandotorresprobikes.com/bicicletas-cross-country/5282-90413-orbea-alma-h30-2023-8434446276309.html
mixed/www.beechworthhoney.com.au/product/bee-cause-outback-honey/index.html
mixed/www.game.es.html
mixed/snooplay.in/products/mercedes-benz-g-class.html
mixed/cocheselectricosninos.com/es/juegos-y-juguetes/aire-libre-y-jardin/cama-elastica-infantil-ataa-140-ataa.html
mixed/www.woodcraft.com/products/general-tools-digital-moisture-meter-model-mmd4e.html
mixed/www.reloj.es.htm
mixed/www.shopcoffee.co.uk/product/buy-coffee-beans-online/coffee-for-business/espresso-bean-to-cup-coffee-beans/heritage-espresso-coffee-beans/espresso-blend-1kg-coffee-beans-coffee-world.html
mixed/www.pharmabuy.es/blemil-1-plus-forte-800-gramos-52.html
mixed/www.powerplanetonline.com/es/xiaomi-redmi-note-9-pro-6gb-64gb.html
mixed/www.sephora.es.html
mixed/www.jeffbanksstores.co.uk/jeff-banks-grey-marl-texture-regular-fit-travel-suit-jacket-7005.html
mixed/www.nutrimarket.com.html
mixed/www.hofmann.es.html
mixed/parisfashionshops.com/en/women/product/elle-style-miss-maxi-dress-multi-way-in-viscose14.html
mixed/sundae-muse.com/products/hazel-two-piece-set-musk.html
mixed/www.perfumarte.com.html
mixed/www.voromotors.com/products/emove-roadrunner-pro-seated-electric-scooter.html
mixed/www.neobyte.es/kingston-fury-beast-8gb-ddr4-3200mhz-memoria-ram-9896.html
mixed/www.zonadepadel.es/head-padel/5619-head-graphene-360-alpha-pro-2021.html
mixed/juegoyjardin.com/products/juego-para-jardin-mega-4-en-raya.html
mixed/www.farmaciabarata.es/productos-adelgazar/drenaqua-60-caps.html
mixed/www.huntoffice.ie/q-connect-highlighter-pen-assorted-wallet-of-4-kf01116.html
mixed/www.buscalibre.es.html
mixed/www.aftfasteners.com/lavex-industrial-nitrile-6-mil-powder-free-textured-disposable-gloves-extra-large-black-100-box/index.html
mixed/www.bergfreunde.de/on-cloudstratus-runningschuhe/index.html
mixed/de.myprotein.com/sporternahrung/protein-pancake-mix/10867261.html
mixed/www.tcompanyshop.com/producto/te-milky-oolong/173.html
mixed/shop.hashbro.html
mixed/www.tea-and-coffee.com/thyme-tea.html
mixed/www.klarstein.es/Calidad-del-aire/Deshumidificadores/DryFy-Connect-50-Deshumidificador-WiFi-Compresion-50l-d-45-55m-Blanco-50l-24h-Blanco.html
mixed/www.mercadolibre.com.ar.html
mixed/scorer.es/bote-de-3-pelotas-de-padel-head-pro-s-6469.html
mixed/www.dosfarma.com/12342-la-roche-posay-antihelios-bruma-spf50-75ml.html
mixed/be.green/es/p/costilla-de-adan.html
mixed/libros.com.html
mixed/www.tshirtstudio.es/impresión-de-camisetas/diseña-tu-propia-camiseta-de-basket.html
mixed/www.mediamarkt.es.html
mixed/www.goodyear.html
mixed/www.primor.eu.html
mixed/www.hsnstore.eu/brands/essential-series/pea-protein-isolate-2-0.html
mixed/www.averyaustin.com/collections/wedding-dresses/products/trinity-off-the-shoulder-lace-a-line-with-sweetheart-neckline.html
mixed/winechateau.com/collections/champagne-sparkling/products/veuve-clicquot-champagne-brut-yellow-label.html
mixed/watchard.com/suunto-vertical-titanium-solar-canyon-ss050861000-sports-watch.html
mixed/www.majestic.co.uk/sparkling-wines/prosecco-la-gioiosa-et-amarosa-23056.html
mixed/www.waterstones.html
mixed/www.bike-discount.de/en/radon-render-10.0-750.html
mixed/www.coolmod.com/gigabyte-g5-kf5-53es353sd-i5-13500h-rtx-4060-16gb-512gb-15-4-freedos/index.html
mixed/bluschoolsupplies.com/collections/wholesale-backpacks/products/wholesale-15-economy-backpacks-2021.html
mixed/www.urbanoutfitters.com.html
mixed/www.eltallerdelmodelista.com/en/diesel-railcar-class-596-regionales-9-596-002-6-renfe-p-45507.html
mixed/www.druni.es.html
mixed/www.michelin.html
mixed/www.thegourmetbox.in/collections/all-gifts/products/brew-lovers-hamper.html
mixed/www.madridhifi.com/p/vonyx-db5/index.html
mixed/www.lulus.com/products/melora-black-sleeveless-maxi-dress/552622.html
mixed/www.matalan.co.uk/childrens-clothing/boys-2-pack-navy-grey-joggers-9mths-6yrs/14309416.html
mixed/www.amazon.es/Samsung-Galaxy-M23-Smartphone-Almacenamiento/dp/B09RNDTXJX.html
mixed/www.bonprix.es/producto/chaqueton-marinero-2375504000/index.html
mixed/www.musicstore.com/en_US/USD/Almeria-CG-390-Black/art-GIT0046624-000.html
mixed/www.mylittlewardrobe.com.au/collections/boys-tees-tanks-tops/products/mlw-by-design-fkn-clingy-tee-white-or-black.html
mixed/www.overclockers.co.uk/asus-rog-strix-b550-f-gaming-amd-am4-b550-atx-motherboard-mb-6fb-as.html
mixed/comefruta.es/comprar/melocoton-embolsado.html
mixed/www.waitrose.html
mixed/www.next.es/en/style/su071627/488536.html
mixed/www.motoblouz.es.html
mixed/www.autozone.html

5.2 Fixed webpages
==================
fixed/2/www.overclockers.co.uk/msi-mpg-x670e-carbon-wifi-socket-am5-ddr5-atx-motherboard-mb-36r-ms.html
fixed/2/www.thejewellershop.com/en/pk0030.html
fixed/2/www.lulus.com/products/breckenridge-chestnut-suede-faux-fur-platform-ankle-booties/2271556.html
fixed/2/scorer.es/bote-de-3-pelotas-de-padel-head-pro-6z-1591.html
fixed/2/www.next.es/en/g62535s3/784862.html
fixed/2/be.green/es/p/silver-pothos.html
fixed/2/www.powerplanetonline.com/es/xiaomi-redmi-note-10-5g-4gb-128gb-azul.html
fixed/2/www.madridhifi.com/p/native-instruments-power-supply-40w/index.html
fixed/2/de.myprotein.com/sportbekleidung/mp-curve-leggings-mit-hoher-taille-fur-damen-schwarz/13121385.html
fixed/2/www.hsnstore.eu/brands/hsn-packs/protein-pudding-monodoses-sampling-pack.html
fixed/2/comefruta.es/comprar/semillas-de-calabaza-cruda.html
fixed/2/www.gourmetfoodstore.com/mon-sire-goat-s-milk-log-with-ash-buchette-de-chevre-cendree-12801.html
fixed/2/www.thegourmetbox.in/collections/all-gifts/products/tea-time-treats-hamper.html
fixed/2/www.woodcraft.com/products/pfeil-small-curved-head-adze.html
fixed/2/www.puzzlemaster.ca/browse/wood/puzzleboxes/13364-group-special-a-set-of-4-secret-opening-boxes-original.html
fixed/2/www.averyaustin.com/collections/wedding-dresses/products/eden-plunging-a-line-lace-wedding-dress.html
fixed/2/www.bike-discount.de/en/radon-deft-10.0-750-ms.html
fixed/2/www.voromotors.com/collections/all/products/suspension-rubber-for-wolf-warrior-11-wolf-king.html
fixed/2/www.jeffbanksstores.co.uk/jeff-banks-bright-blue-texture-wool-blend-soho-suit-jacket-7001.html
fixed/2/www.bonprix.es/producto/camiseta-2-unidades-de-corte-comodo-1835740167/index.html
fixed/2/www.anthropologie.html
fixed/2/www.dermstore.html
fixed/2/www.totto.html
fixed/2/www.dell.html
fixed/2/www.maccosmetics.html
fixed/2/www.maisonsdumonde.html
fixed/2/www.tesco.html
fixed/2/www.makeupalley.html
fixed/2/www.zappos.html
fixed/2/www.urbanoutfitters.html
fixed/3/www.overclockers.co.uk/asus-rog-strix-x670e-e-gaming-wifi-socket-am5-ddr5-atx-motherboard-mb-6j5-as.html
fixed/3/www.thejewellershop.com/en/pk0010-g.html
fixed/3/www.lulus.com/products/feeling-cheery-black-velvet-long-sleeve-tie-back-romper/2252136.html
fixed/3/scorer.es/zapatillasadidasadiletteaquakblancofucsiaef1748-12431.html
fixed/3/www.next.es/en/g62535s1/525213.html
fixed/3/be.green/es/p/hexagonal-con-cactus.html
fixed/3/www.powerplanetonline.com/es/xiaomi-12t-8gb-128gb-azul.html
fixed/3/www.madridhifi.com/p/magma-rolltop-backpack-ii-mochila-dj/index.html
fixed/3/de.myprotein.com/sport-hosen/mp-curve-leggings-fur-damen-schwarz/12773407.html
fixed/3/www.hsnstore.eu/brands/now-foods/empty-gelatin-capsules-0.html
fixed/3/comefruta.es/comprar/suscripcion-mix-frutas-variedad.html
fixed/3/www.gourmetfoodstore.com/leonidas-leonidas-mixed-white-chocolates-12855.html
fixed/3/www.thegourmetbox.in/collections/all-gifts/products/tea-time-treats-hamper.html
fixed/3/www.woodcraft.com/products/woodriver-coffee-scoop-turning-kit-chrome.html
fixed/3/www.puzzlemaster.ca/browse/wood/otherwood/2917-owl-in-a-cage.html
fixed/3/www.averyaustin.com/collections/wedding-dresses/products/trinity-g-off-the-shoulder-lace-a-line-wedding-dress-with-glitter-tulle.html
fixed/3/www.bike-discount.de/en/radon-render-10.0-750.html
fixed/3/au.voromotors.com/products/dualtron-storm.html
fixed/3/www.jeffbanksstores.co.uk/jeff-banks-light-grey-textured-check-soho-suit-trousers-7009.html
fixed/3/www.bonprix.es/producto/camisa-de-manga-corta-1869197600/index.html
fixed/3/www.anthropologie.html
fixed/3/www.dermstore.html
fixed/3/www.totto.html
fixed/3/www.dell.html
fixed/3/www.maccosmetics.html
fixed/3/www.maisonsdumonde.html
fixed/3/www.tesco.html
fixed/3/www.makeupalley.html
fixed/3/www.zappos.html
fixed/3/www.urbanoutfitters.html
fixed/4/www.overclockers.co.uk/asus-rog-strix-b760-i-gaming-wifi-lga-1700-ddr5-itx-motherboard-mb-6kb-as.html
fixed/4/www.thejewellershop.com/en/pk0060.html
fixed/4/www.lulus.com/products/blissful-ever-after-white-lace-ruched-sleeveless-maxi-dress/2239836.html
fixed/4/scorer.es/Zapatilla_Adidas_AltaSport_CfI-8988.html
fixed/4/www.next.es/en/g62535s3/784862.html
fixed/4/be.green/es/p/reverdeciente-spray-plantas-verdes.html
fixed/4/www.powerplanetonline.com/es/xiaomi-mi-11-lite-5g-ne-8gb-128gb-verde.html
fixed/4/www.madridhifi.com/p/behringer-cmd-dc-1/index.html
fixed/4/de.myprotein.com/sport-hosen/mp-damen-shape-nahtlose-leggings-schwarz/12698532.html
fixed/4/www.hsnstore.eu/brands/now-foods/empty-veg-capsules-700-900mg.html
fixed/4/comefruta.es/comprar/mix-temporada-suscripcion.html
fixed/4/www.gourmetfoodstore.com/leonidas-leonidas-chocolate-truffles-12842.html
fixed/4/www.thegourmetbox.in/collections/all-gifts/products/brew-lovers-hamper.html
fixed/4/www.woodcraft.com/products/woodriver-coffee-scoop-turning-kit-gold.html
fixed/4/www.puzzlemaster.ca/browse/metalpuzzles/metal/1915-cast-medal.html	
fixed/4/www.averyaustin.com/collections/wedding-dresses/products/alice-tulle-and-lace-a-line-wedding-dress-with-long-sleeves.html
fixed/4/www.bike-discount.de/en/radon-render-8.0-625-1.html
fixed/4/au.voromotors.com/collections/electric-scooter-parts/products/14-inner-tube-for-emove-roadrunner.html
fixed/4/www.jeffbanksstores.co.uk/jeff-banks-blue-tectured-regular-fit-suit-jacket-6892.html
fixed/4/www.bonprix.es/producto/pantalon-elastico-de-estilo-ejecutivo-621721363/index.html
fixed/4/www.anthropologie.html
fixed/4/www.dermstore.html
fixed/4/www.totto.html
fixed/4/www.dell.html
fixed/4/www.maccosmetics.html
fixed/4/www.maisonsdumonde.html
fixed/4/www.tesco.html
fixed/4/www.makeupalley.html
fixed/4/www.zappos.html
fixed/4/www.urbanoutfitters.html*/
fixed/5/www.overclockers.co.uk.html
fixed/5/www.thejewellershop.html
fixed/5/www.lulus.html
fixed/5/www.scorer.html
fixed/5/www.next.html
fixed/5/www.be.green.html
fixed/5/www.powerplanetonline.html
fixed/5/www.madridhifi.html
fixed/5/www.de.myprotein.html
fixed/5/www.hsnstore.eu.html
fixed/5/comefruta.es/comprar/mix-temporada-suscripcion.html
fixed/5/www.gourmetfoodstore.html
fixed/5/www.thegourmetbox.in.html
fixed/5/www.woodcraft.html
fixed/5/www.puzzlemaster.ca/browse/metalpuzzles/metal/1915-cast-medal.html	
fixed/5/www.averyaustin.html
fixed/5/www.bike-discount.de.html
fixed/5/www.voromotors.html
fixed/5/www.jeffbanksstores.co.uk/jeff-banks-blue-tectured-regular-fit-suit-jacket-6892.html
fixed/5/www.bonprix.html
fixed/5/www.anthropologie.html
fixed/5/www.dermstore.html
fixed/5/www.totto.html
fixed/5/www.dell.html
fixed/5/www.maccosmetics.html
fixed/5/www.maisonsdumonde.html
fixed/5/www.tesco.html
fixed/5/www.makeupalley.html
fixed/5/www.zappos.html
fixed/5/www.urbanoutfitters.html