THE CONSUMER REVIEWS EXTRACTION BENCHMARK SUITE README ==================================================================== 1.Introduction ============== Consumer reviews extraction techniques are based on extracting information from real web pages. These techniques need to be continually tested in order to get new improvements in their results and also in their performance. This testing is done by using sets of web pages prepared for this purpose. Thus, a benchmarks suite is an important requirement in order to measure the performance of these techniques. 2.How to obtain the suite of benchmarks ======================================= It can be downloaded from the following URL: https://mist.dsic.upv.es/revEx/downloads.html 3.Structure =========== The benchmark suite was created by downloading 50 product web pages from the Internet. Once all the web pages were downloaded, four different engineers explored the key page and the webp ages accessible from it to decide what part of the webpage corresponds to the consumer reviews section. All elements belonging to the consumer reviews section were included in an HTML class called comments_section. Therefore, a content extraction tool can easily compare its output to the nodes belonging to this class. In addition, the main menu of the key page was included in an HTML class called TECO_mainMenu. The benchmark suite is organized in directories inside a directory called pages, there is a directory for each website domain. 4.How it was built ================== The web pages were downloaded using the command wget: wget --convert-links --no-clobber --random-wait -r 1 -p -E -e robots=off -U mozilla http://www.example.org The meaning of the flags is: --convert-links: Converts links so they can work locally. --no-clobber: Do not overwrite any existing file. --random-wait: Random waits between downloads. -r 1: Recursive downloading up to 1 level of links. -p: Downloads everything. -e robots=off: Act as not being a robot. -E: Get the right file extension. -U mozilla: Identify as a Mozilla browser. 5.How to use the suite ====================== The installation is very simple, the zip file has to be extracted into the hard drive, pendrive, or other media. Once extracted it will create a directory called pages. 6.Web pages URL =============== The following paths indicate the path to the key product page of each benchmark: be.green/es/p/costilla-de-adan.html bluschoolsupplies.com/collections/wholesale-backpacks/products/wholesale-15-economy-backpacks-2021.html comefruta.es/comprar/melocoton-embolsado.html de.myprotein.com/sporternahrung/protein-pancake-mix/10867261.html farmaciajimenez.com/nuestras-marcas/skinceuticals/skinceuticals-c-e-ferulic-serum-30-ml.html juegoyjardin.com/products/juego-para-jardin-mega-4-en-raya.html parisfashionshops.com/en/women/product/elle-style-miss-maxi-dress-multi-way-in-viscose14.html scorer.es/bote-de-3-pelotas-de-padel-head-pro-s-6469.html snooplay.in/products/mercedes-benz-g-class.html sundae-muse.com/products/hazel-two-piece-set-musk.html thejewellershop.com/en/id0035sl.html watchard.com/suunto-vertical-titanium-solar-canyon-ss050861000-sports-watch.html winechateau.com/collections/champagne-sparkling/products/veuve-clicquot-champagne-brut-yellow-label.html www.aftfasteners.com/lavex-industrial-nitrile-6-mil-powder-free-textured-disposable-gloves-extra-large-black-100-box/index.html www.amazon.es/Samsung-Galaxy-M23-Smartphone-Almacenamiento/dp/B09RNDTXJX.html www.averyaustin.com/collections/wedding-dresses/products/trinity-off-the-shoulder-lace-a-line-with-sweetheart-neckline.html www.beechworthhoney.com.au/product/bee-cause-outback-honey/index.html www.bergfreunde.de/on-cloudstratus-runningschuhe/index.html www.bike-discount.de/en/radon-render-10.0-750.html www.bonprix.es/producto/chaqueton-marinero-2375504000/index.html www.decathlon.com/collections/back-to-school/products/quechua-nh500-hiking-16-liter-backpack-334520.html www.dosfarma.com/12342-la-roche-posay-antihelios-bruma-spf50-75ml.html www.druni.es/le-beau-jean-paul-gaultier-eau-de-toilette-para-hombre.html www.eltallerdelmodelista.com/en/diesel-railcar-class-596-regionales-9-596-002-6-renfe-p-45507.html www.etsy.com/es/listing/1118100665/delantal-de-lona-gris-completo.html*/ www.gourmetfoodstore.com/puglia-ricotta-salata-12691.html www.hsnstore.eu/brands/essential-series/pea-protein-isolate-2-0.html www.huntoffice.ie/q-connect-highlighter-pen-assorted-wallet-of-4-kf01116.html www.jeffbanksstores.co.uk/jeff-banks-grey-marl-texture-regular-fit-travel-suit-jacket-7005.html www.lulus.com/products/melora-black-sleeveless-maxi-dress/552622.html www.madridhifi.com/p/vonyx-db5/index.html www.majestic.co.uk/sparkling-wines/prosecco-la-gioiosa-et-amarosa-23056.html www.matalan.co.uk/childrens-clothing/boys-2-pack-navy-grey-joggers-9mths-6yrs/14309416.html www.musicstore.com/en_US/USD/Almeria-CG-390-Black/art-GIT0046624-000.html www.mylittlewardrobe.com.au/collections/boys-tees-tanks-tops/products/mlw-by-design-fkn-clingy-tee-white-or-black.html www.neobyte.es/kingston-fury-beast-8gb-ddr4-3200mhz-memoria-ram-9896.html www.next.es/en/style/su071627/488536.html www.otto.nl/p/10096444193/lascana-beugelbikini-met-opzij-aangerimpeld-bikinibroekje/index.html www.overclockers.co.uk/asus-rog-strix-b550-f-gaming-amd-am4-b550-atx-motherboard-mb-6fb-as.html www.pharmabuy.es/blemil-1-plus-forte-800-gramos-52.html www.powerplanetonline.com/es/xiaomi-redmi-note-9-pro-6gb-64gb.html www.puzzlemaster.ca/browse/wood/puzzleboxes/15453-cluebox-davy-jones-locker-60-minute-escape-room-in-a-box.html www.shopcoffee.co.uk/product/buy-coffee-beans-online/coffee-for-business/espresso-bean-to-cup-coffee-beans/heritage-espresso-coffee-beans/espresso-blend-1kg-coffee-beans-coffee-world.html www.tcompanyshop.com/producto/te-milky-oolong/173.html www.tea-and-coffee.com/thyme-tea.html www.thegourmetbox.in/collections/all-gifts/products/brew-lovers-hamper.html www.tshirtstudio.es/impresión-de-camisetas/diseña-tu-propia-camiseta-de-basket.html www.voromotors.com/products/emove-roadrunner-pro-seated-electric-scooter.html www.woodcraft.com/products/general-tools-digital-moisture-meter-model-mmd4e.html www.zonadepadel.es/head-padel/5619-head-graphene-360-alpha-pro-2021.html