doi: 10.3934/dcdss.2019077

Research on regional clustering and two-stage SVM method for container truck recognition

1. 

Container Supply Chain Tech. Engineering Research Center, Shanghai Maritime University, China

2. 

Shanghai Weiguo Port Equipment Company Ltd, China

3. 

Shanghai Abian Smart Technology Company Ltd, China

4. 

Shanghai Haizhu Smart Technology Company Ltd, China

5. 

Institute of Logistics Science & Engineering, Shanghai Maritime University, China

6. 

ISCTE-IUL, Inst Telecomunicacoes, Lisbon, Portugal

* Corresponding author: Chao Mi

Received  June 2017 Revised  December 2017 Published  November 2018

With large-scale, integrated, intelligence for ports, many ports begin to use intelligent detection systems to make their operations more efficient. The container truck recognition and positioning system is also beginning to apply into container quayside to assist the joint operations between quay cranes and container trucks. However, the traditional vehicle detection by using motion region detection cannot recognize the type of moving object, and the traditional pattern recognition method cannot meet the requirements in real-time operation. In order to solve these problems, an algorithm fused by regional clustering and two-stage SVM classifier is proposed in this paper. The method consists of two phases, which are independently executed in two camera systems on quay cranes. In the first stage, a fast motion regional clustering algorithm is used to detect moving image patches as the truck candidate sub-windows. In the second stage, the container trucks will be recognized in these sub-windows by an optimized two-stage SVM classifier. Compared with existing traditional algorithm, experimental results in container terminal show that the fusion algorithm with regional clustering and two-stage SVM has higher efficiency and better truck recognition performance.

Citation: Chao Mi, Jun Wang, Weijian Mi, Youfang Huang, Zhiwei Zhang, Yongsheng Yang, Jun Jiang, Postolache Octavian. Research on regional clustering and two-stage SVM method for container truck recognition. Discrete & Continuous Dynamical Systems - S, doi: 10.3934/dcdss.2019077
References:
[1]

Y. Cai, X. Chen and H. Wang, et al., Deep representation and stereo vision based vehicle detection, IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems IEEE, (2015), 305-310.

[2]

Y. Cao, G. I. Kirilova and M. L. Grunis, Cooperative research projects of master's students (education programs) in the open informational educational environment, Eurasia Journal of Mathematics Science and Technology Education, 13 (2017), 2859.

[3]

F. Garcia, D. Martin and A. D. L. Escalera, et al., Sensor Fusion Methodology for Vehicle Detection. IEEE Intelligent Transportation Systems Magazine, 9 (2017), 123-133.

[4]

I. Iszaidy, A. Alias and R. Ngadiran, et al., Video size comparison for embedded vehicle speed detection & travel time estimation system by using Raspberry Pi, Robotics, Automation and Sciences (ICORAS), (2016), 1-4.

[5]

M. JalalatM. Nejati and A. Majidi, Vehicle detection and speed estimation using cascade classifier and sub-pixel stereo matching, Signal Processing and Intelligent Systems (ICSPIS), (2016), 1-5.

[6]

Q. Jiang, L. Cao and M. Cheng, et al., Deep neural networks-based vehicle detection in satellite images, International Symposium on Bioelectronics and Bioinformatics, (2015), 184-187.

[7]

S. Kamkar and R. Safabakhsh, Vehicle detection, counting and classification in various conditions, IET Intelligent Transport Systems, 10 (2016), 406-413.

[8]

H. Kuang, X. Zhang and Y. J. Li, et al., Nighttime vehicle detection based on bio-inspired image enhancement and weighted score-level feature fusion, IEEE Transactions on Intelligent Transportation Systems, PP (2017), 1-10.

[9]

W. Li, W. Liu and X. Xu, et al., The port service ecosystem research based on the lotkavolterra model[J], Polish Maritime Research, 24 (2017), 86-94.

[10]

B. Li, T. Zhang and T. Xia, Vehicle Detection From 3D Lidar Using Fully Convolutional Network, arXiv preprint, 2016, arXiv: 1608.07916.

[11]

C. Mi, Y. Shen and W. Mi, et al., Ship identification algorithm based on 3d point cloud for automated ship loaders, Journal of Coastal Research, 73 (2015), 28-34.

[12]

C. Mi, Y. Shen and W. Mi, et al., Ship identification algorithm based on 3d point cloud for automated ship loaders, Journal of Coastal Research, 73 (2015), 28-34.

[13]

C. Mi, Z. Zhang and Y. Huang, et al., a fast automated vision system for container corner casting recognition, Journal of Marine Science & Technology, 24 (2016), 54-60.

[14]

J. Mrovlje and D. Vran, Automatic detection of the truck position using stereoscopy, IEEE International Conference on Industrial Technology, (2012), 755-759.

[15]

S A. Nur, M. M. Ibrahim and N. M. Ali, et al., Vehicle detection based on underneath vehicle shadow using edge features, Control System, Computing and Engineering (ICCSCE), (2016), 407-412.

[16]

Y. ShenW. Mi and Z. Zhang, A positioning lockholes of container corner castings method based on image recognition, Polish Maritime Research, 24 (2017), 95-101.

[17]

Y. Shen, N. Zhao and M. Xia, et al., A deep q-learning network for ship stowage planning problem, Polish Maritime Research, 24 (2017), 102-109.

[18]

L. Si and H. Qiao, Performance of Financial Expenditure in China's basic science and math education: Panel data analysis based on CCR model and BBC model, EURASIA Journal of Mathematics Science and Technology Education, 13 (2017), 5217-5224.

[19]

L. W. SommerT. Schuchert and J. Beyerer, A comprehensive study on object proposals methods for vehicle detection in aerial images, Pattern Recogniton in Remote Sensing (PRRS), (2016), 1-6.

[20]

T. Tangkocharoen and A. Srisuphab, Vehicle detection on a pint-sized computer, Knowledge and Smart Technology (KST), (2017), 40-44.

[21]

X. Wang, L. Xu and H. Sun, et al., On-road vehicle detection and tracking using mmw radar and monovision fusion, IEEE Transactions on Intelligent Transportation Systems, 17 (2016), 1-10.

[22]

Q. Wei and B. Yang, Adaptable vehicle detection and speed estimation for changeable urban traffic with anisotropic magnetoresistive sensors, IEEE Sensors Journal, 17 (2017), 2021-2028.

[23]

J. Yuan, W. Cheng and L. Sun, et al., A constructing vehicle intrusion detection algorithm based on BOW presentation model, Signal and Image Processing (ICSIP), (2016), 183-188.

[24]

Z. ZhangC. Xu and W. Feng, Road vehicle detection and classification based on Deep Neural Network, Software Engineering and Service Science (ICSESS), (2016), 675-678.

[25]

Y. Zhang, C. Zhao and J. He, et al., Vehicles detection in complex urban traffic scenes using Gaussian mixture model with confidence measurement, IET Intelligent Transport Systems, 10 (2016), 445-452.

[26]

Z. Zhang, X. Yu and F. You, et al., A front vehicle detection algorithm for intelligent vehicle based on improved gabor filter and SVM, Recent Patents on Computer Science, 8 (2015), 32-40.

[27]

Y. ZhangW. Chen and H. Liu, Design for the competitiveness assessment index system of aviation aerospace manufacture industry on basis of GEMPearsonVC combination method, Journal of Interdisciplinary Mathematics, 20 (2017), 255-268.

[28]

H. Zhu and F. Yu, A cross-correlation technique for vehicle detections in wireless magnetic sensor network, IEEE Sensors Journal, 16 (2016), 1-1.

show all references

References:
[1]

Y. Cai, X. Chen and H. Wang, et al., Deep representation and stereo vision based vehicle detection, IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems IEEE, (2015), 305-310.

[2]

Y. Cao, G. I. Kirilova and M. L. Grunis, Cooperative research projects of master's students (education programs) in the open informational educational environment, Eurasia Journal of Mathematics Science and Technology Education, 13 (2017), 2859.

[3]

F. Garcia, D. Martin and A. D. L. Escalera, et al., Sensor Fusion Methodology for Vehicle Detection. IEEE Intelligent Transportation Systems Magazine, 9 (2017), 123-133.

[4]

I. Iszaidy, A. Alias and R. Ngadiran, et al., Video size comparison for embedded vehicle speed detection & travel time estimation system by using Raspberry Pi, Robotics, Automation and Sciences (ICORAS), (2016), 1-4.

[5]

M. JalalatM. Nejati and A. Majidi, Vehicle detection and speed estimation using cascade classifier and sub-pixel stereo matching, Signal Processing and Intelligent Systems (ICSPIS), (2016), 1-5.

[6]

Q. Jiang, L. Cao and M. Cheng, et al., Deep neural networks-based vehicle detection in satellite images, International Symposium on Bioelectronics and Bioinformatics, (2015), 184-187.

[7]

S. Kamkar and R. Safabakhsh, Vehicle detection, counting and classification in various conditions, IET Intelligent Transport Systems, 10 (2016), 406-413.

[8]

H. Kuang, X. Zhang and Y. J. Li, et al., Nighttime vehicle detection based on bio-inspired image enhancement and weighted score-level feature fusion, IEEE Transactions on Intelligent Transportation Systems, PP (2017), 1-10.

[9]

W. Li, W. Liu and X. Xu, et al., The port service ecosystem research based on the lotkavolterra model[J], Polish Maritime Research, 24 (2017), 86-94.

[10]

B. Li, T. Zhang and T. Xia, Vehicle Detection From 3D Lidar Using Fully Convolutional Network, arXiv preprint, 2016, arXiv: 1608.07916.

[11]

C. Mi, Y. Shen and W. Mi, et al., Ship identification algorithm based on 3d point cloud for automated ship loaders, Journal of Coastal Research, 73 (2015), 28-34.

[12]

C. Mi, Y. Shen and W. Mi, et al., Ship identification algorithm based on 3d point cloud for automated ship loaders, Journal of Coastal Research, 73 (2015), 28-34.

[13]

C. Mi, Z. Zhang and Y. Huang, et al., a fast automated vision system for container corner casting recognition, Journal of Marine Science & Technology, 24 (2016), 54-60.

[14]

J. Mrovlje and D. Vran, Automatic detection of the truck position using stereoscopy, IEEE International Conference on Industrial Technology, (2012), 755-759.

[15]

S A. Nur, M. M. Ibrahim and N. M. Ali, et al., Vehicle detection based on underneath vehicle shadow using edge features, Control System, Computing and Engineering (ICCSCE), (2016), 407-412.

[16]

Y. ShenW. Mi and Z. Zhang, A positioning lockholes of container corner castings method based on image recognition, Polish Maritime Research, 24 (2017), 95-101.

[17]

Y. Shen, N. Zhao and M. Xia, et al., A deep q-learning network for ship stowage planning problem, Polish Maritime Research, 24 (2017), 102-109.

[18]

L. Si and H. Qiao, Performance of Financial Expenditure in China's basic science and math education: Panel data analysis based on CCR model and BBC model, EURASIA Journal of Mathematics Science and Technology Education, 13 (2017), 5217-5224.

[19]

L. W. SommerT. Schuchert and J. Beyerer, A comprehensive study on object proposals methods for vehicle detection in aerial images, Pattern Recogniton in Remote Sensing (PRRS), (2016), 1-6.

[20]

T. Tangkocharoen and A. Srisuphab, Vehicle detection on a pint-sized computer, Knowledge and Smart Technology (KST), (2017), 40-44.

[21]

X. Wang, L. Xu and H. Sun, et al., On-road vehicle detection and tracking using mmw radar and monovision fusion, IEEE Transactions on Intelligent Transportation Systems, 17 (2016), 1-10.

[22]

Q. Wei and B. Yang, Adaptable vehicle detection and speed estimation for changeable urban traffic with anisotropic magnetoresistive sensors, IEEE Sensors Journal, 17 (2017), 2021-2028.

[23]

J. Yuan, W. Cheng and L. Sun, et al., A constructing vehicle intrusion detection algorithm based on BOW presentation model, Signal and Image Processing (ICSIP), (2016), 183-188.

[24]

Z. ZhangC. Xu and W. Feng, Road vehicle detection and classification based on Deep Neural Network, Software Engineering and Service Science (ICSESS), (2016), 675-678.

[25]

Y. Zhang, C. Zhao and J. He, et al., Vehicles detection in complex urban traffic scenes using Gaussian mixture model with confidence measurement, IET Intelligent Transport Systems, 10 (2016), 445-452.

[26]

Z. Zhang, X. Yu and F. You, et al., A front vehicle detection algorithm for intelligent vehicle based on improved gabor filter and SVM, Recent Patents on Computer Science, 8 (2015), 32-40.

[27]

Y. ZhangW. Chen and H. Liu, Design for the competitiveness assessment index system of aviation aerospace manufacture industry on basis of GEMPearsonVC combination method, Journal of Interdisciplinary Mathematics, 20 (2017), 255-268.

[28]

H. Zhu and F. Yu, A cross-correlation technique for vehicle detections in wireless magnetic sensor network, IEEE Sensors Journal, 16 (2016), 1-1.

Figure 1.  A quay crane was unloading container from a truck
Figure 2.  Cameras' positions on the quay crane
Figure 3.  The field installation of the camera
Figure 4.  Truck detection algorithm flowchart
Figure 5.  Schematic illustration of background extraction and update
Figure 6.  The result of background subtraction
Figure 7.  Regional clustering of image patches
Figure 8.  Outer rectangle of the cluster
Figure 9.  Schematic illustration of the HOG descriptor
Figure 10.  The HOG features of trucks in different position
Figure 11.  Schematic illustration of two-stage SVM classifier
Figure 12.  Two-stage SVM algorithm flowchart
Figure 13.  The sample sets of two kinds of truck shape features
Figure 14.  Results fusion
Figure 15.  The experimental results of truck detection
Figure 16.  Comparison of two algorithms about average processing time
Table 1.  Experimental results
The fast truck detection algorithm Traditional SVM
Algorithm time Number TRUE FALSE Accuracy APT
(ms)
TRUE FALSE Accuracy APT
(ms)
Test Set 1 day 50 50 0 100% 185.4 50 0 100% 423.6
Test Set 2 night 50 48 2 96% 135.4 46 2 92% 392.3
Test Set 3 day 50 50 0 100% 133.1 48 5 96% 404.8
Test Set 4 night 50 47 3 94% 107.4 47 1 94% 384.3
Test Set 5 day 50 49 1 98% 236.5 48 6 96% 419.9
Test Set 6 night 50 50 0 100% 201.0 46 2 92% 424.9
Test Set 7 day 50 50 0 100% 125.4 49 6 98% 381.8
Test Set 8 night 50 49 1 98% 103.1 45 4 90% 406.8
Test Set 9 day 50 50 0 100% 124.2 50 1 100% 359.3
Test Set 10 night 50 50 0 100% 105.4 48 3 96% 380.6
Test Set 11 day 50 50 0 100% 113.2 48 30 96% 365.8
Test Set 12 night 50 47 3 94% 245.1 46 4 92% 401.3
Test Set 13 day 50 49 1 98% 135.2 50 0 100% 502.8
Test Set 14 night 50 48 2 96% 116.3 45 5 90% 396.7
Test Set 15 day 50 50 0 100% 127.8 50 0 100% 456.5
Test Set 16 night 50 50 0 100% 156.5 46 4 92% 379.8
Test Set 17 day 50 50 0 100% 195.2 49 1 98% 427.8
Test Set 18 night 50 48 2 96% 188.3 42 8 84% 511.3
Test Set 19 day 50 50 0 100% 152.3 47 3 94% 386.5
Test Set 20 night 50 46 4 92% 164.5 44 6 88% 462.4
sum 1000 981 19 98% 152.565 944 91 94% 413.46
The fast truck detection algorithm Traditional SVM
Algorithm time Number TRUE FALSE Accuracy APT
(ms)
TRUE FALSE Accuracy APT
(ms)
Test Set 1 day 50 50 0 100% 185.4 50 0 100% 423.6
Test Set 2 night 50 48 2 96% 135.4 46 2 92% 392.3
Test Set 3 day 50 50 0 100% 133.1 48 5 96% 404.8
Test Set 4 night 50 47 3 94% 107.4 47 1 94% 384.3
Test Set 5 day 50 49 1 98% 236.5 48 6 96% 419.9
Test Set 6 night 50 50 0 100% 201.0 46 2 92% 424.9
Test Set 7 day 50 50 0 100% 125.4 49 6 98% 381.8
Test Set 8 night 50 49 1 98% 103.1 45 4 90% 406.8
Test Set 9 day 50 50 0 100% 124.2 50 1 100% 359.3
Test Set 10 night 50 50 0 100% 105.4 48 3 96% 380.6
Test Set 11 day 50 50 0 100% 113.2 48 30 96% 365.8
Test Set 12 night 50 47 3 94% 245.1 46 4 92% 401.3
Test Set 13 day 50 49 1 98% 135.2 50 0 100% 502.8
Test Set 14 night 50 48 2 96% 116.3 45 5 90% 396.7
Test Set 15 day 50 50 0 100% 127.8 50 0 100% 456.5
Test Set 16 night 50 50 0 100% 156.5 46 4 92% 379.8
Test Set 17 day 50 50 0 100% 195.2 49 1 98% 427.8
Test Set 18 night 50 48 2 96% 188.3 42 8 84% 511.3
Test Set 19 day 50 50 0 100% 152.3 47 3 94% 386.5
Test Set 20 night 50 46 4 92% 164.5 44 6 88% 462.4
sum 1000 981 19 98% 152.565 944 91 94% 413.46
[1]

Yubo Yuan, Weiguo Fan, Dongmei Pu. Spline function smooth support vector machine for classification. Journal of Industrial & Management Optimization, 2007, 3 (3) : 529-542. doi: 10.3934/jimo.2007.3.529

[2]

Yubo Yuan. Canonical duality solution for alternating support vector machine. Journal of Industrial & Management Optimization, 2012, 8 (3) : 611-621. doi: 10.3934/jimo.2012.8.611

[3]

Jian Luo, Shu-Cherng Fang, Yanqin Bai, Zhibin Deng. Fuzzy quadratic surface support vector machine based on fisher discriminant analysis. Journal of Industrial & Management Optimization, 2016, 12 (1) : 357-373. doi: 10.3934/jimo.2016.12.357

[4]

Xin Li, Ziguan Cui, Linhui Sun, Guanming Lu, Debnath Narayan. Research on iterative repair algorithm of Hyperchaotic image based on support vector machine. Discrete & Continuous Dynamical Systems - S, 2018, 0 (0) : 1199-1218. doi: 10.3934/dcdss.2019083

[5]

Ning Lu, Ying Liu. Application of support vector machine model in wind power prediction based on particle swarm optimization. Discrete & Continuous Dynamical Systems - S, 2015, 8 (6) : 1267-1276. doi: 10.3934/dcdss.2015.8.1267

[6]

Weiping Li, Haiyan Wu, Jie Yang. Intelligent recognition algorithm for social network sensitive information based on classification technology. Discrete & Continuous Dynamical Systems - S, 2018, 0 (0) : 1385-1398. doi: 10.3934/dcdss.2019095

[7]

Sangkyu Baek, Jinsoo Park, Bong Dae Choi. Performance analysis of transmission rate control algorithm from readers to a middleware in intelligent transportation systems. Numerical Algebra, Control & Optimization, 2012, 2 (2) : 357-375. doi: 10.3934/naco.2012.2.357

[8]

K. Schittkowski. Optimal parameter selection in support vector machines. Journal of Industrial & Management Optimization, 2005, 1 (4) : 465-476. doi: 10.3934/jimo.2005.1.465

[9]

Pooja Louhan, S. K. Suneja. On fractional vector optimization over cones with support functions. Journal of Industrial & Management Optimization, 2017, 13 (2) : 549-572. doi: 10.3934/jimo.2016031

[10]

Hong-Gunn Chew, Cheng-Chew Lim. On regularisation parameter transformation of support vector machines. Journal of Industrial & Management Optimization, 2009, 5 (2) : 403-415. doi: 10.3934/jimo.2009.5.403

[11]

Daniel Roggen, Martin Wirz, Gerhard Tröster, Dirk Helbing. Recognition of crowd behavior from mobile sensors with pattern analysis and graph clustering methods. Networks & Heterogeneous Media, 2011, 6 (3) : 521-544. doi: 10.3934/nhm.2011.6.521

[12]

Cai-Tong Yue, Jing Liang, Bo-Fei Lang, Bo-Yang Qu. Two-hidden-layer extreme learning machine based wrist vein recognition system. Big Data & Information Analytics, 2017, 2 (1) : 59-68. doi: 10.3934/bdia.2017008

[13]

Siamak RabieniaHaratbar. Support theorem for the Light-Ray transform of vector fields on Minkowski spaces. Inverse Problems & Imaging, 2018, 12 (2) : 293-314. doi: 10.3934/ipi.2018013

[14]

Keiji Tatsumi, Masashi Akao, Ryo Kawachi, Tetsuzo Tanino. Performance evaluation of multiobjective multiclass support vector machines maximizing geometric margins. Numerical Algebra, Control & Optimization, 2011, 1 (1) : 151-169. doi: 10.3934/naco.2011.1.151

[15]

Fengqiu Liu, Xiaoping Xue. Subgradient-based neural network for nonconvex optimization problems in support vector machines with indefinite kernels. Journal of Industrial & Management Optimization, 2016, 12 (1) : 285-301. doi: 10.3934/jimo.2016.12.285

[16]

Ye Tian, Wei Yang, Gene Lai, Menghan Zhao. Predicting non-life insurer's insolvency using non-kernel fuzzy quadratic surface support vector machines. Journal of Industrial & Management Optimization, 2018, 13 (5) : 1-15. doi: 10.3934/jimo.2018081

[17]

David Kinderlehrer, Adrian Tudorascu. Transport via mass transportation. Discrete & Continuous Dynamical Systems - B, 2006, 6 (2) : 311-338. doi: 10.3934/dcdsb.2006.6.311

[18]

Konovenko Nadiia, Lychagin Valentin. Möbius invariants in image recognition. Journal of Geometric Mechanics, 2017, 9 (2) : 191-206. doi: 10.3934/jgm.2017008

[19]

Yongbin Ou, Cun-Quan Zhang. A new multimembership clustering method. Journal of Industrial & Management Optimization, 2007, 3 (4) : 619-624. doi: 10.3934/jimo.2007.3.619

[20]

Antonio Vitolo. On the growth of positive entire solutions of elliptic PDEs and their gradients. Discrete & Continuous Dynamical Systems - S, 2014, 7 (6) : 1335-1346. doi: 10.3934/dcdss.2014.7.1335

2017 Impact Factor: 0.561

Article outline

Figures and Tables

[Back to Top]