Beruflich Dokumente
Kultur Dokumente
DOI 10.1007/s10586-017-0852-1
Abstract The concept of Industry 4.0 that covers the top- 1 Introduction
ics of Internet of Things, cyber-physical system, and smart
manufacturing, is a result of increasing demand of mass cus- Along with the rapid development of global economy, the
tomized manufacturing. In this paper, a smart manufacturing organization structure of industrial production has encoun-
framework of Industry 4.0 is presented. In the proposed tered a tremendous shift over the past few years [1]. Sellers
framework, the shop-floor entities (machines, conveyers, market that simply focuses on expanding the production
etc.), the smart products and the cloud can communicate capacity without considering the variations in customer needs
and negotiate interactively through networks. The shop-floor has not been regarded as mainstream. In contrast, as market
entities can be considered as agents based on the theory of saturation increases, the market converts into buyers market
multi-agent system. These agents implement dynamic recon- and stimulates the transformation of production manufac-
figuration in a collaborative manner to achieve agility and turing towards product customization called lean production
flexibility. However, without global coordination, problems (LP). The LP has been widely acclaimed because it helps in
such as load-unbalance and inefficiency may occur due to eliminating waste and reducing cycles in the product supply
different abilities and performances of agents. Therefore, chain. Currently, international markets have created a high
the intelligent evaluation and control algorithms are pro- level of competition that requires high agility, rapid changes
posed to reduce the load-unbalance with the assistance of in the customized production style and fast reconfiguration
big data feedback. The experimental results indicate that the of manufacturing systems [2]. The emerging industrial rev-
presented algorithms can easily be deployed in smart man- olution (Industry 4.0) triggered by information technology
ufacturing system and can improve both load-balance and concentrates on the establishment of intelligent products and
efficiency. production processes [3]. The realization of Industry 4.0 will
be possible with the increasing implementations of Internet of
Keywords Smart manufacturing Load-balancing Things (IoT) and cyber-physical system (CPS) [4]. It allows
Multi-agent system Hybrid production Cyber-physical communication between humans, machines and products by
system large networks and will become a critically competitive edge
for markets [5]. Based on IoT and CPS [6,7], several dis-
ruptive advances as well as the cross-domain fertilization
of concepts and the amalgamation of IT-driven approaches
in the traditional industrial automation systems have been
proposed, such as collaborative systems [8], wireless sen-
B Shiyong Wang sor networks (WSN) [9,10], Service-Oriented Architectures
mesywang@scut.edu.cn
(SOA), networked cooperating embedded devices and sys-
1 School of Mechanical and Automotive Engineering, South tems, and big data.
China University of Technology, Guangzhou, China Distributed systems can manage high complexities and
2 School of Mechanical Engineering, Shanghai Jiao Tong form the first step for the CPS with self-organizing and
University, Shanghai, China self-controlling features [11]. The research results in the
123
Cluster Comput
distributed artificial intelligence (DAI) field have indicated tion layer and cloud-assistant layer. The customers in user
that the intelligent manufacturing system equipped with layer can send demand of products to the cloud. The cloud-
agent technology is the most promising development trend. assistant layer as the intermediate layer collects the data from
Multi-agent system (MAS) provides the modeling and imple- the bottom resource layer and the user layer and then per-
mentation of distributed-intelligent manufacturing process forms the analysis on big data for feedback to bottom devices
with a theoretical basis [12,13], in which each department in or management monitoring. In addition, the system param-
the manufacturing system act as a smart agent and can nego- eters can be adjusted according to the system performance.
tiate with others in order to obtain agility and flexibility in The bottom resource interaction layer containing the net-
dynamic reconfiguration [14]. Most agent-based manufactur- work and the devices as the basis of CPS, enables the smart
ing process systems apply negotiation mechanisms to assign objects to cooperate with each other in order to complete the
tasks. The most common negotiation mechanism is the Con- tasks.
tract Net Protocol (CNP) [1521]. However, the proposed Smart shop-floor entities compete and cooperate in the
MAS structure will not be able to handle the consequences decentralized manufacturing environment with self-organized
of local convergence [22], such as the load-unbalancing of ability and hence contribute to complementary advantages to
workshop equipment, due to the performance differences of achieve the flexibility for processing the multi-type products.
various manufacturing agents and the absence of the global In this sense, smart shop-floor entities can be modeled as
coordination. The load-balancing [23] control can be classi- MAS. The workshop appliances can be classified into three
fied into two groups, centralized control (CC) and distributed types of smart agents based on the difference of functions and
control (DC). Both groups have some pros and cons, so a responsibilities. The first type is the machining agent (MA)
better load-balancing performance can be obtained by their that performs machining and storing the operations, such
combination. The DC, CC and their variant versions in MAS as processing equipment, testing equipment and automated
have been widely studied but most of these studies have storage devices. The second type is the conveying agent (CA)
focused on Internet and electric management field [2428] that can move the smart products from current location to
instead of the manufacturing systems discussed above. the destination, such as the conveyor belts, the loading and
This article focuses on the key algorithms that can cope unloading manipulators and the automated guided vehicles
with the MAS complexities in smart manufacturing in (AGVs). The last type is the product gent (PA) that needs
accordance to a proposed smart factory structure that con- processing and is equipped with RFID tags or micro con-
sists of intelligent agents with cloud-assistant feedback and trollers.
coordination [29]. The contributions of this paper can be The workflow of self-organized manufacturing system
summarized in following two parts: First, two intelligent with cloud-assistant is shown in Fig. 2. Once the cloud
evaluation algorithms are proposed for machining agents receives the order data, the PA will retrieve the date from
to choose the single target and for conveying agents to the cloud and write it to the RFID tag. The PA nego-
build a target chain. Second, another algorithm is presented tiates with the MA in accordance to the task and then
to prevent the load-unbalancing by introducing the cloud- chooses the most appropriate MA. After that, the PA will
assistant feedback mechanism. At the end of this article, the negotiate with the CA and will build a route chain to
proposed algorithms are verified and validated using a proof- move the PA from its current location to the location
of-concept experiment of candy packing. of the target MA. Finally, the PA arrives at the destina-
The remainder of the article is organized as follows: tion and completes the first process. In case of subse-
Sect. 2 introduces the proposed smart factory structure, quent operation, the PA begins a new negotiation to finish
presents the two intelligent evaluation methods to enable it.
the proposed negotiation mechanism and elaborates how the The negotiation mechanism is based on CNP. As shown
cloud-assistant coordinates the negotiation to prevent the in Fig. 3, the PA acts as a manager to publish the tasks
load-unbalancing of agents; Sect. 3 describes the experiment and the MA/CA act as contractors to compete for the tasks.
and analyses the main experimental results; In the end, Sect. It is worth mentioning that in the actual scenario of smart
4 concludes the work and outlines the future directions. factory, the PA may store the information on a RFID tag
to communicate with other agents by reading/writing the
RFID tag instead of having a smart chip. In this case,
2 Framework the PA is unable to launch a negotiation by itself, instead
that a negotiation is initiated vicariously by the MA/CA
The structure of smart factory presented in [28] can be con- on behalf of PA. Once the PA publishes the task, all the
sidered as a dual closed-loop system as illustrated in Fig. 1. MA will obtain the task and will compare the calculated
The top loop consists of cloud-assistant layer and user layer, perceptibility with the threshold in terms of the local knowl-
while the bottom loop consists of bottom resource interac- edge base in order to decide whether or not to bid for the
123
Cluster Comput
Flume MySQL
server server
Sqoop
Hive
flume (SQL) Hive
YARN HBase Sqoop
flume (Distributed (NoSQL)
computing
architecture) Tomcat
Servlet
HDFS
(Distributed file system)
Interface
Interface Cloud-assistant
layer
Bottom loop Network
Machining agent
Product agent
Conveying agent
Bottom resource
interaction layer
task. The PA uses some judgement rules to calculate the inferiority of the agents. Thus, five mental parameters,
performance indicators and uses the results to award or including Perceptibility (Per), Reliance (Rel), Activity (Act),
reject the contractors. The successful bidder will execute the Friendship (Fri), and Capability (Cap) are employed. These
task. parameters range from 0 to 100 with ranges of weight values
from 0 to 1. The task agent (TA) represents MA or CA.
3 Intelligent evaluation algorithms for 3.1 Evaluation algorithm for determining a target MA
self-organized negotiation
The perceptibility of the TA is denoted by Per. Higher value
According to the process mentioned in Sect. 2, the evaluation of Per means easier perceptivity of the TA regarding the pub-
function serves as a criterion to evaluate the superiority- lication. The Per is divided into two parts. The one is Idle that
123
Cluster Comput
contarctor:PA contractee:MA/CA
Start
Publish(ID,RI)
User layer Place order
Refuce Yes
Data assist Process order data
layer Bid(ID,RI) Per> LP
No
Negotiate to choose a target
MA No Reject(ID,RI)
t
Ti is the max?
No
Successful? Award(ID,RI)
Yes
Yes
Execute the task
Negotiate to build a CA route
chain
Bottom resource
Successful? No Fig. 3 The process of the intelligent negotiation mechanism
interaction layer
Yes When penalty >> award , the TA should be given a serious
Send the PA to the target MA punishment for failing the task in order to make its reliability
and process it explicit.
Act represents the ratio between the sum of the TA task
bidding and a TA bidding count. Thus, Act satisfies:
Another Yes
process?
Nt
No Act = n i 100, (3)
End k=1 Nkt
Fig. 2 Workflow of the self-organized manufacturing system with where, Nit is tai bidding count for task t, and nk=1 Nkt is the
cloud-assistant sum of the TA bidding. The equation multiplies 100 to unify
the dimensions.
represents the duty cycle of the TA, the other is Res that refers Fri shows the success rate of negotiation and satisfies:
to the remainder resource, such as the surplus of batteries or
materials in storage. Therefore, the relationship among three Nitj
parameters is as follows: Fri = 100, (4)
N tj
123
Cluster Comput
Hi Equation (9) indicates that Tit depends on Iit and the degree
i = 100%, (6) of the cloud intervention in group activities. Moreover, I nti
Cai
and WI are both proportional to the level of the intervention.
where, Cai represents the available hours of i and Hi is the If the load-unbalancing of the TA occurs in the system, the
used hours. cloud will consider the unbalancing degree to adjust the inter-
In this paper, the variance of load ratios S( ) is used to vention strategy. At this moment, WI will become larger with
describe the degree of devices load-balancing and it satisfies: increasing load-unbalancing. In general, I nti is preset to be 1
but the manager can dynamically adjust its value according
to the current performance of device i. It can be seen that
n
= 1
n i Eq. (9) considers all relevant factors about manufacturing to
i=1 (7) select the target MA. This ensures that the target MA is a
n
S( ) = 1
n1 (i )2 , global optimum.
i=1
123
Cluster Comput
123
Cluster Comput
123
Cluster Comput
Robot4(MA4) Conveyor1(CA1)
Robot3(MA3) Robot2(MA2)
Robot5(MA5)
Conveyor2(CA2)
Robot1(MA1)
Conveyor5(CA5)
Conveyor4(CA4)
Conveyor3(CA3)
Product(PA)
Table 1 The processes of nine types of candies the highest and the lowest load ratios are 63% and 8.5%,
Part Pro.1 Pro.2 Pro.3 Pro.4 Pro.5 Pro.6 respectively and S( ) is down to 0.054. For the fourth group
with L l = 30, the highest and the lowest load ratios are
P1 A E A 54% and 13% respectively, and S( ) is decreased to 0.03.
P2 D E B D C E The load ratio of ma1 shows decreasing trend, but the load
P3 E C A B A ratios of other MAs (ma2 to ma5 ) show increasing trend. In
P4 D C B E contrast, the load ratios of all CAs (ca1 to ca5 ) are unchanged
P5 E B D at approximately 30%. In the experiment, both the highest
P6 A D A C load ratio of 33.4% and the lowest load ratio of 27.5% among
P7 C E A C ca1 to ca5 are in normal range. Therefore, the cloud-assistant
P8 A B C E intervention is not occurred during their negotiation.
P9 B D C From the results shown above, several conclusions are
obtained. After all MAs (ma1 to ma5 ) with different perfor-
mances negotiate, their load-unbalancing would occur. When
1
the indicator S() is lower than the preset threshold L l , the
L l = 10, shows that the highest load ratio is decreased cloud begins to intervene. With working load-balancing con-
to 78%, the lowest ratio is increased to 5.2% and S( ) is trol, the originally high load ratio of ma1 becomes lower and
down to 0.104. The third group with L l = 20, shows that the originally low load ratio of other MAs (ma2 to ma5 )
78.2
63.2
load ratio [%]
54.5
16.2 17.3
13.5 13 13.8
11.5 10.7
7.9 8.5
5.3 5.2 5.2
1.8 1.64 1.8 1.04
ma1 ma2 ma3 ma4 ma5 ca1 ca2 ca3 ca4 ca5
Agent
123
Cluster Comput
change to higher values. Once the cloud intervenes, the per- 3. Vyatkin, V., Salcic, Z., Roop, P.S., Fitzgerald, J.: Now thats smart!.
formance of the system balance improves compared with IEEE Ind. Electron. Mag. 1(4), 1729 (2007)
4. Wan, J., Yi, M., Li, D., Zhang, C., Wang, S., Zhou, K.: Mobile
before. The performances of all CAs (ca1 to ca5 ) are sim- services for customization manufacturing systems: an example of
ilar in the experiment. Therefore, load-unbalancing would industry 4.0. IEEE Access. 4, 89778986 (2016)
not occur after their negotiations. Moreover, the threshold L l 5. Zhang, D., He, Z., Qian, Y., Wan, J., Li, D., Zhao, S.: Revisiting
shows positive correlation with balance performance while unknown rfid tag identification in large-scale internet of things.
IEEE Wirel. Commun. 23(5), 2429 (2016)
negative correlation with production efficiency. This indi- 6. Wan, J., Tang, S., Shu, Z., Li, D.: Software-defined industrial inter-
cates that the increasing frequency of cloud intervention net of things in the context of industry 4.0. IEEE Sens. J. 16(20),
causes a drop in productivity. Therefore, the threshold L l 73737380 (2016)
should be tuned carefully in order to consider the trade-off 7. Chen, F., Deng, P., Wan, J., Zhang, D., Vasilakos, A.V., Rong,
X.: Data mining for the internet of things: literature review and
between the efficiency and the balance for achieving the suit-
challenges. Int. J. Distrib. Sens. Netw. (2015). doi:10.1155/2015/
able system performance. 431047
8. Harrison, R., Colombo, A.W.: Collaborative automation from rigid
coupling towards dynamic reconfigurable production systems.
IFAC Proc. Vol. 38(1), 184192 (2005)
6 Conclusions and future work 9. Qiu, M., Sha, E.: Energy-aware online algorithm to satisfy sam-
pling rates with guaranteed probability for sensor applications,
Proceedings of the High Performance Computing and Commu-
In this paper, the defects of load-unbalancing in manufac- nications, pp. 156167. Springer, Heidelberg (2007)
turing scheduling are studied on the basis of multi-agent 10. Alamri, A., Ansari, W.S., Hassan, M.M., Hossain, M.S., Alelaiwi,
scheduling. The algorithms based on intelligent negotiation A., Hossain, M.A.: A survey on sensor-cloud: architecture, appli-
cations, and approaches. Int. J. Distrib. Sens. Netw. 9(9), 917923
mechanism are elaborately proposed to condition the load- (2013). doi:10.1155/2013/917923
unbalancing in self-organized manufacturing system. The 11. Hassan, M.M., Hossain, M.S., Sarkar, A.M., Huh, E.: Cooperative
experimental results demonstrate and validate the effectivity game-based distributed resource allocation in horizontal dynamic
and reliability of the proposed algorithms. The new proposed cloud federation platform. Inform. Syst. Front. 16(4), 523542
(2014)
control method has distinct advantages compared to the tra- 12. Preux, P., Delepoulle, S., Darcheville, J.C.: A generic architecture
ditional manufacturing load balancing control. The proposed for adaptive agents based on reinforcement learning. Inform. Sci.
method not only maintains the approximate degree of load- 161(1), 3755 (2004)
balancing with traditional control, but also allows hybrid 13. Leito, P.: Agent-based distributed manufacturing control: a state-
ofthe-art survey. Eng. Appl. Artif. Intell. 22(7), 979991 (2009)
production in manufacturing process. The focus of future 14. Wang, S., Wan, J., Zhang, D., Li, D., Zhang, C.: Towards smart
research will be in line with the purpose of this paper to con- factory for industry 4.0: a self-organized multi-agent system with
sider the different control effects with multi-group thresholds big data based feedback and coordination. Comput. Netw. 101,
L l and weights in the proposed algorithm. The future research 158168 (2016)
15. Shu, Z., Wan, J., Zhang, D., Li, D.: Cloud-integrated cyber-physical
will include the investigation of the advanced technique and systems for complex industrial applications. Mob. Netw. Appl.
concept of SOA that will act as the communication bridge 21(5), 114 (2015)
between the agents. 16. Huang, C.Y., Cheng, K., Holt, A.: An integrated manufacturing
network management framework by using mobile agent. Int. J.
Acknowledgements This work was supported in part by the National Adv. Manuf. Technol. 32(7), 822833 (2007)
Science Foundation of China (Grant No. 51605168), the National Pro- 17. Lim, M.K., Zhang, Z.: Integrated manufacturing systems control
gram on Key Basic Research Project of China (Grant No. 2013CB035 using a multiagent system. Proceedings of the 33rd International
403), the Science and Technology Planning Project of Guangdong MATADOR Conference, pp. 914. Springer, London (2000)
Province (Grant Nos. 2016A010102008 and 2014B090921003), the 18. Grelle, C., Ippolito, L., Loia, V., Siano, P.: Agent-based architecture
Science and Technology Planning Project of Guangzhou City (Grant for designing hybrid control systems. Inform. Sci. 176(9), 1103
Nos. 201508030007 and 201604010064), the National Key Technol- 1130 (2006)
ogy R&D Program of China (No. 2014BAD08B01), and the program 19. Chen, S.H.: Computationally intelligent agents in economics and
Of Shanghai Subject Chief Scientist (Grant No. 14XD1402000). finance. Inform. Sci. 177(5), 11531168 (2007)
20. Kadar, B., Monostori, L., Szelke, E.: An object-oriented framework
for developing distributed manufacturing architectures. J. Intell.
Manuf. 9(2), 173179 (1998)
21. Yuan, W., Deng, P., Taleb, T., Wan, J., Bi, C.: An unlicensed taxi
References identification model based on big data analysis. IEEE Trans. Intell.
Transp. Syst. 17(6), 17031713 (2016)
1. Brettel, M., Friederichsen, N., Keller, M., Rosenberg, M.: How 22. Liu, Q., Wan, J., Zhou, K.: Cloud manufacturing service system for
virtualization, decentralization and network building change the industrial-cluster-oriented application. Jj. Internet Technol. 15(3),
manufacturing landscape: an Industry 4.0 perspective. Int. J. Mech. 373380 (2014)
Ind. Sci. Eng. 8, 3744 (2014) 23. Shen, W., Hao, Q., Yoon, H.J., Norrie, D.H.: Applications of agent-
2. Guo, Q.L., Zhang, M.: An agent-oriented approach to resolve based systems in intelligent manufacturing: an updated review.
scheduling optimization in intelligent manufacturing. Robot. Com- Adv. Eng. Inform. 20(4), 415431 (2006)
put. Integr. Manuf. 26(1), 3945 (2010)
123
Cluster Comput
24. Cheung, L.S., Kwok, Y.K.: On load balancing approaches for Shiyong Wang was born in
distributed object computing systems. J. Supercomput. 27(2), 149 Huoqiu County, Anhui Province,
175 (2004) China, in 1981. He received
25. Bigham, J., Du, L.: Cooperative negotiation in a multi-agent sys- the B.S. and Ph.D. degrees in
tem for real-time load balancing of a mobile cellular network. mechanical and electrical engi-
In: Proceedings of the second international joint conference on neering from South China Uni-
autonomous agents and multi-agent systems, pp. 568575. ACM versity of Technology, Guang-
(2003) zhou City, Guangdong Province,
26. Bigham, R.D., Du L., Thong W.S., Cuthbert L.: Management of call China, in 2010. Since 2010,
admissions in third generation mobile networks. In: Proceedings he has been a Lecturer with
of XVIII World Telecommunications Congress, Paris (2002) the Mechanical & Electrical
27. Bodanese, E., Cuthbert, L.: Intelligent agents for resource alloca- Engineering Department, South
tion in mobile networks. In: Proceedings of XVII World Telecom- China University of Technology.
munications Congress, Birmingham (2000) He is the author of more than
28. Wang, S., Wan, J., Imran, M., Li, D., Zhang, C.: Cloud-based 20 articles and holds five patents.
smart manufacturing for personalized candy packing application. J. His research interests include smart manufacturing, motion control, and
Supercomput. 1(1), 119 (2016). doi:10.1007/s11227-016-1879-4 robotics. Mr. Wang was a recipient of the First Prize for Science & Tech-
29. Wang, S., Wan, J., Li, D., Zhang, C.: Implementing smart factory of nology Development of Guangdong Province in 2009.
industrie 4.0: an outlook. Int. J. Distrib. Sens. Netw. (2016). doi:10.
1155/2016/3159805
Chengliang Liu received the
B.E. degree from Shandong Uni-
versity of Technology, Shan-
Di Li is currently a Profes-
dong, China and the M.E. and
sor with the School of Mechan-
Ph.D. degrees from Southeast
ical and Automotive Engineer-
University, Nanjing, China, in
ing, South China University of
1991 and 1998, respectively. He
Technology, Guangzhou, China.
has been invited as a Senior
She has directed more than 50
Scholar at the University of
research projects, including the
Michigan, Ann Arbor, and the
National Natural Science Foun-
University of Wisconsin, Madi-
dation of China, etc. Thus so
son, since 2001. He is currently
far, she has authored/coauthored
a professor in the department of
more than 180 scientific papers.
mechanical engineering, Shang-
Her research interests include
hai Jiao Tong University, Shang-
embedded systems, computer
hai, China. His current interests include mechatronic systems, intel-
vision, and cyber-physical sys-
ligent maintenance, MEMS design, intelligent robot control, remote
tems.
monitoring techniques and condition based monitoring.
123