Study of the flow of one-time orders in the long-distance road transport market using automated parsing

Abstract

The paper describes approaches to creating a software product for automated data collection and processing. The paper considers the issues of automating the collection of one-time applications for long-distance freight transport and analysing the demand for transportation. Important definitions for the development of parsing, software quality terms, defects and programme failure are given. The advantages and recommendations for automating the study are considered.

An automated parsing system has been developed that structures web page information and provides it in a form ready for analysis. In this paper, the concept of a parser is understood as a system for automated collection of applications for one-time long-distance freight transportation. It reads and processes information to a state suitable for analysis. The article describes the stages of parser design and identifies the main criteria for selecting applications. The main function of the software product is to read information about one-time orders for freight transport from the della.ua website and place it in file storage media on a local computer. To test the software product's performance and analyse the freight market, the demand for long-distance freight transportation was monitored for one week. As a result, data sets were generated with detailed information about each type of cargo and order structure. The subsequent data had defects, which manifested itself in duplicate orders. To remove this defect and reduce the error in data analysis, duplicate records were deleted.

The development of an automated parsing system allowed us to obtain a matrix of one-time orders at the regional level of Ukraine, which characterises the demand for freight transport in the long-distance freight market. Potential orders were evaluated, market analysed, routes planned, and integrated into the company's business processes related to information processing and analysis.

Keywords: parsing, one-time orders, long-distance communication, demand, automated data retrieval system