DYNAMIC WEB PAGE CHANGE DETECTION USING DATA

MINING TECHNIQUES

ABSTRACT

Website change detection allows interested parties to be alerted when a website has
changed. A web crawler can periodically scan a website to see if any changes have occurred
since its last visit. Users who visit a web page repeatedly at frequent intervals for various
reasons which includes enhanced automations such as triggering in event-driven programming,
updating dependent automations like screen scraping programs, link rot mitigation, change
trend monitoring and triggering human actions such as analyst classifications, updating
documentation, competitive monitoring, compliance monitoring, enforcement monitoring and
investigation monitoring. Due to the expanded dynamism of web pages, it might make different
to the client on distinguish the progressions manually. This paper proposes an improved model
for identifying progressions in the web pages, which is called Arti-Q based Dynamic Web page
change identification (DWPD). The change detection is micro-managed by introducing web
page segmentation. The web page change detection process is made efficient by having it
perform a dual-step process. The proposed system is designed with net tracker form where the
existing CasePer method and DWPD method is implemented and detect the page change
detection. The result evaluates the total data gathered, varying count, repeated duplicates and
the accuracy level is identified and listed. Here, the user can generate ARFF (Attribute-Relation
File Format) file for weka tool experimental result evaluation. The proposed method reduces
the complexity of the change –detection by focusing only on the segments in which the changes
have occurred. The user-specific personalized change detection is also incorporated in the
proposed model. The model is validated in the open source commodity market rate server. The
experiments conducted on the prototype implementation prove a good accuracy comparing to
existing page crawler techniques.
MODULES DESCRIPTION

1. NET TRACKER:
a. The dynamic web page change detection is implemented in the open source
commodity market server www.kitco.com to detect the commodity rate changes
in Gold, silver, INR, Palladium, Platinum, Rhodium and Crude. The Existing
CasePer method is implemented in this form to detect the rate changes and
identified that the varying count increases rapidly even though the rate remains
the same in various time intervals. The proposed method DWPD method is
implemented in the same form to detect the rate changes and identified there is
distinct filters in the rate changes and the listview updated only if the rate varies.
2. Existing - CasePer Technique :
a. In the existing CasePer Technique, the system receives the kitco server URL as
a parameter to detect the HTML source code and using substring comparison
to filter out the Gold, Silver, INR, Crude, Palladium, Platinum, Rhodium and
Crude. The detected rates is displayed in the listview control and for every
detection, the varying count gets increment the value by 1.
3. Proposed – ArtiQ DWPD Technique:
a. In the proposed ArtiQ DWPD Technique, the proposed system receives the
kitco server URL as a parameter to detect the HTML source code and using
substring comparison to filter out the Gold, Silver, INR, Crude, Palladium,
Platinum, Rhodium and Crude. The detected rates is compared with the lastly
retrieved rate and if there is any change identified between them , it will be
displayed in the listview control and for every change detection, the varying
count gets increment the value by 1.
4. Existing – CasePer – Result
a. In the CasePer Result view form, the total data gathered, varying
count, repeated duplicates and the accuracy level is identified and
listed. Here, the user can generate ARFF (Attribute-Relation File Format)
file for weka tool experimental result evaluation.
5. Proposed - DWPD - Result
a. In the DWPD Result view form, the total data gathered, varying
count, repeated duplicates and the accuracy level is identified and
listed. Here, the user can generate ARFF (Attribute-Relation File Format)
file for weka tool experimental result evaluation.