مقاله

Data Extraction using Content-Based Handles

دانلود متن کاملرایگان، با حساب کاربری؛ ثبت نام با گوگل چند ثانیه است

چکیده(به انگلیسی؛ چکیده‌ی فارسی در دسترس نیست)

In this paper, we present an approach and a visual tool, called HWrap (Handle Based Wrapper), for creating web wrappers to extract data records from web pages. In our approach, we mainly rely on the visible page content to identify data regions on a web page. In our extraction algorithm, we inspired by the way a human user scans the page content for specific data. In particular, we use text features such as textual delimiters, keywords, constants or text patterns, which we call handles, to construct patterns for the target data regions and data records. We offer a polynomial algorithm, in which these patterns are checked against the page elements in a mixed bottom-up and top-down traverse of the DOM-tree. The extracted data is directly mapped onto a hierarchical XML structure, which forms the output of the wrapper. The wrappers that are generated by this method are robust and independent of the HTML structure. Therefore, they can be adapted to similar websites to gather and integrate information.

نویسندگان و وابستگی سازمانی
  1. A. PouraminiORCID 0000-0002-3652-0935 — Department of Computer Engineering, University of Sirjan Technology, Sirjan, Iran.
  2. S. Khaje Hassani — Department of Computer Engineering, University of Sirjan Technology, Sirjan, Iran.
  3. Sh. Nasiri — Department of Computer Engineering, University of Sirjan Technology, Sirjan, Iran.

شکل‌ها (۳)

  • Figure 1. A sample results page of a website for “camera”.
    Figure 1. A sample results page of a website for “camera”.صفحه‌ی ۲
  • Figure 2. Identifying handles on a web page in our proposed system, HWrap.
    Figure 2. Identifying handles on a web page in our proposed system, HWrap.صفحه‌ی ۳
  • Figure 4. Screenshot of dialog boxes for creating handles (left) and patterns (right).
    Figure 4. Screenshot of dialog boxes for creating handles (left) and patterns (right).صفحه‌ی ۵

شکل‌ها از متن کامل مقاله برداشته شده‌اند و حقوقشان از آنِ نویسندگان و ناشر است. منبع: صفحه‌ی اصلی مقاله