Implementation of Web Crawling to Search for Spare Parts Prices at PT Asuransi Sinar Mas

  • deddy deddy Universitas Kristen Satya Wacana
Keywords: Web Crawling, Python, Scrapy

Abstract

 The availability of vehicle spare part information is one of the main needs in the business processes run by an insurance company. One insurance company that requires the availability of this information is PT. Sinar Mas Insurance. Required spare part information is obtained from the website available on the internet. However, due to the large amount of vehicle spare parts information needed and due to limited time available a program called web crawler is needed. A web crawler is a program that crawls the entire URL of a website, tracks it one by one, then stores all the information contained in that website. Web crawlers in this study use the Scrapy framework with the Python programming language. The website to be crawled in this study is the website Suzuki.co.id/eparts which is a website that contains data and prices for official spare parts specifically for Suzuki cars. This study aims to produce a web crawling application that will be used in finding Suzuki Suzuki auto parts price data automatically.

References

[1] I. P. Sonya, “ANALISIS WEB SCRAPING UNTUK DATA BENCANA ALAM DENGAN MENGGUNAKAN TEKNIK BREADTH-FIRST,” vol. 21, no. 3, pp. 69–77.
[2] R. T. Shita, “IMPLEMENTASI ALGORITMA BFS ( BREADTH-FIRST SEARCH ) PADA APLIKASI WEB CRAWLER,” vol. 8, no. 2, pp. 127–132, 2016.
[3] A. Overview, K. D. Points, W. Characteristics, C. Crawling, S. Crawling, and E. L. Implementation, “By Christopher Olston and Marc Najork,” vol. 4, no. 3, pp. 175–246, 2010.
[4] R. Hanifah, I. S. Nurhasanah, P. Studi, T. Informatika, and B. Lampung, “IMPLEMENTASI WEB CRAWLING UNTUK MENGUMPULKAN INFORMASI WISATA KULINER DI BANDAR LAMPUNG,” vol. 5, no. 5, 2018.
[5] L. A. B. Prasetya, “ Perbandingan Teknik Web Crawler Untuk Mendukung Sistem Pemerolehan Informasi PMB Menggunakan Model Pemerolehan Boolean” no. 135314094, 2018.
[6] Y. Patil, S. Patil, C. Science, and C. Science, “Review of Web Crawlers with Specification and,” vol. 5, no. 1, pp. 220–223, 2016.
[7] A. Halim, R. D. Nyoto, and N. Safriadi, “Perancangan Aplikasi Web Crawler untuk Menghasilkan Dokumen Teks pada Domain Tertentu,” vol. 5, no. 2, pp. 3–6, 2017.
[8] L. B. Ilmawan, “MEMBANGUN WEB CRAWLER BERBASIS WEB SERVICE UNTUK DATA CRAWLING PADA WEBSITE GOOGLE PLAY STORE,” vol. 10, pp. 215–224, 2018.
[9] I. Ramadhan and H. Sastramihardja, “Pemanfaatan Web Crawler Dalam Mengumpulkan Informasi Melalui Internet,” pp. 8–9, 2018.
[10] E. H. Fernando, H. Sagala, A. E. Budiman, I. N. Husada, and H. Toba, “Ekstraksi dan Analisis Produk di Marketplace Secara Otomatis dengan Memanfaatkan Teknologi Web Crawling,” vol. 5, pp. 350–359, 2019.
Published
2020-12-18