A Secure and Intelligent Data Sharing Scheme for UAV-Assisted Disaster Rescue
Abstract
Unmanned aerial vehicles (UAVs) have the potential to establish flexible and reliable emergency networks in disaster sites when terrestrial communication infrastructures go down. Nevertheless, potential security threats may occur on UAVs during data transmissions due to the untrusted environment and open-access UAV networks. Moreover, UAVs typically have limited battery and computation capacity, making them unaffordable for heavy security provisioning operations when performing complicated rescue tasks. In this paper, we develop RescueChain, a secure and efficient information sharing scheme for UAV-assisted disaster rescue. Specifically, we first implement a lightweight blockchain-based framework to safeguard data sharing under disasters and immutably trace misbehaving entities. A reputation-based consensus protocol is devised to adapt the weakly connected environment with improved consensus efficiency and promoted UAVs’ honest behaviors. Furthermore, we introduce a novel vehicular fog computing (VFC)-based off-chain mechanism by leveraging ground vehicles as moving fog nodes to offload UAVs’ heavy data processing and storage tasks. To offload computational tasks from the UAVs to ground vehicles having idle computing resources, an optimal allocation strategy is developed by choosing payoffs that achieve equilibrium in a Stackelberg game formulation of the allocation problem. For lack of sufficient knowledge on network model parameters and users’ private cost parameters in practical environment, we also design a two-tier deep reinforcement learning-based algorithm to seek the optimal payment and resource strategies of UAVs and vehicles with improved learning efficiency. Simulation results show that RescueChain can effectively accelerate consensus process, improve offloading efficiency, reduce energy consumption, and enhance user payoffs.
Index Terms:
Unmanned aerial vehicle, blockchain, vehicular fog computing, deep reinforcement learning, disaster rescue.I Introduction
Natural disasters, such as earthquakes, bushfires, floods, often inflict devastating losses in lives and property [1, 2, 3]. In disaster areas, reliable and resilient emergency communications are pivotal for quick damage assessment and effective disaster rescue [4]. However, owing to the destruction or inefficiency of terrestrial network infrastructures (e.g., Wi-Fi access points and cellular base stations), unmanned aerial vehicles (UAVs) based communication approach may be the only plausible solution in such situations so far due to their fast deployment and flexible mobility [5, 6, 7]. UAVs can not only be dispatched and deployed quickly to establish the emergency communication infrastructure on the air, but also help information dissemination (e.g., rescue commands, maps of affected areas, and survivors’ locations) in disaster relief networks [8, 9, 10].
There are however several fundamental challenges underlying the UAV-aided disaster relief networks (UDRNs). Since UAVs need to be open to all nodes, including malicious entities, in the disaster area to maximize the life-saving potential, the network is vulnerable to various attacks (e.g., spoofing attack and DDoS attack) perpetrated by adversaries [4]. The UAVs may also be compromised to forge, remove, and replace the transmitted data, and even inject malwares and viruses to mislead or interfere with the rescue operations. In addition, the onboard battery and computing capabilities of UAVs are typically limited, whereas the heavy computation missions in affected areas such as human detection and video recognition often exceed UAVs’ local processing capabilities [11, 12]. Consequently, the time required to execute search and rescue operations may be overextended and the efficiency of disaster rescue may be degraded. Therefore, a secure data transmission scheme with efficient computation and storage offloading should be devised for UAVs in UDRNs.
The emerging blockchain holds numerous potentials to build trust among various collaborative entities; by offering decentralized hash-linked ledgers with time-stamped data and behavior records, the blockchain prevents fraud in a reliable and distributed manner [13, 14, 15]. Participants can share and retrieve the desired data on the basis of blockchain which is featured with immutability, transparency, and auditability. For example, in [16], a decentralized data collection mechanism is designed based on blockchain to safeguard data delivery in UAV-assisted IoT. In [17], a blockchain-based group key distribution mechanism is developed to build trust among UAVs and ensure the security of UAVs’ sensory data.
Existing blockchain approaches for UAVs heavily depend on the availability of infrastructures for security-critical operations (e.g., consensus management and ledger maintenance). A fully distributed approach tolerable to UAV failures is more suitable for practical disaster scenarios. Meanwhile, the compute-intensive data processing and consensus operations along with heavy storage requirements in blockchain-enabled UDRNs often occupy a large amount of constrained computation and storage for UAVs. Existing works mainly focus on cloud or edge based approaches for UAVs’ computation and storage offloading [18, 19, 20]; nonetheless, due to the long distance of remote clouds and the insufficiency or unavailability of edge servers under disasters, the stringent quality of service (QoS) requirements of UAVs (e.g., completing missions before expiration) may fail to meet in the current cloud or edge based offloading approaches. Hence, it is still an open and vital issue to secure data sharing by deploying a lightweight and robust blockchain system in disaster areas while efficiently offloading UAVs’ heavy computation and storage tasks.
In this paper, we develop RescueChain, a novel secure and energy-efficient data sharing scheme for UDRNs. We first propose a lightweight and infrastructure-free blockchain-based framework to safeguard data sharing and immutably trace misbehaving entities in disaster sites. We then devise a reputation-based Tendermint consensus protocol to efficiently and robustly reach consensus under weak network connections while encouraging UAVs’ legitimate behaviors in the network. Afterwards, by exploiting ground vehicles as moving fog nodes, a novel vehicular fog computing (VFC)-based off-chain computation and storage mechanism is presented to collaboratively offload UAVs’ data processing and security provisioning missions to moving vehicles. The Stackelberg game model is formulated to model the interactions between UAVs and vehicles under VFC and the Stackelberg equilibrium (SE) of the static Stackelberg game is derived to stimulate vehicles’ participation in computing resources sharing. As accurate network parameters and the private user cost model are not readily available in realistic offloading applications, a dynamic Stackelberg game is presented, and its near-optimal solution is sought by using an intelligent learning algorithm based on deep reinforcement learning (DRL) techniques. The contribution of this paper is three-fold as follows.
- •
Framework: We present RescueChain, which is low-cost, infrastructure-free, and robust. We make two improvements in the implementation of blockchain in UDRNs: 1) a green consensus protocol with non-mining bookkeeping, low communication complexity, and high robustness under partially synchronous environment; 2) a VFC-based off-chain data storage and computation mechanism to efficiently move the heavy data processing and storage missions from resource-constrained UAVs to nearby cooperative ground vehicles.
- •
Algorithm: Due to sparse network connections in UDRNs, we develop an energy-efficient and partition-tolerant consensus algorithm for battery-limited UAVs based on Tendermint via signature aggregation and reputation evaluation. Besides, nodes’ benign and malicious behaviors can be immutably traced and recorded on the redesigned blockchain ledgers for reputation computing. To promote vehicles’ collaboration under VFC in the fast-changing environment, a learning-based algorithm in the dynamic Stackelberg game is designed to intelligently schedule the optimal resource sharing and pricing strategies for ground vehicles and UAVs. To cope with the large space size and address the curse of dimensionality in learning, we also exploit DRL techniques with two tiers for efficient state space compression and accelerated convergence rate.
- •
Validation: We evaluate the effectiveness of RescueChain through extensive simulations. It is demonstrated that our RescueChain can attain better payoffs for ground vehicles and UAVs, reduced data delivery latency and UAVs’ energy consumption, improved offloading efficiency, and enhanced consensus efficiency in blockchain, by comparing with other existing schemes.
The remainder of the work is organized as follows. Related works are reviewed in Section II. The system model is elaborated in Section III. The design of RescueChain system is presented in Section IV. The optimal offloading policies in static and dynamic games are given in Section V. Section VI evaluates the proposed scheme and Section VII closes this paper with conclusions. For reader’s convenience, the main research contents and their organization structure are illustrated in Fig. 1.
II Related Work
In this section, we review the related works on blockchain-based information sharing approaches and computation offloading methods for UAVs.
II-A Blockchain-Based Data Sharing
The emerging blockchain technologies in wireless networks for secure data sharing have attracted wide attention from both academia and industry. Liang et al. [21] design a permissioned blockchain-based electricity trading platform in industrial Internet of things (IoT) to address the high management cost, ensure reliable data transmission, and build trust among grid operators and electricity consumers. By leveraging the consortium blockchain, Chen et al. [22] develop a trustful on-chain and off-chain data sharing framework in vehicular networks, where edge nodes (i.e., roadside units (RSUs)) are responsible for blockchain maintenance by operating the practical Byzantine fault tolerance (PBFT) consensus protocol. Jiang et al. [23] investigate a blockchain-based reliable artificial intelligence (AI) model sharing mechanism for object detection in autonomous driving with cross-domain adaptation, where mobile edge computing (MEC) nodes run the delegated proof-of-stake (DPoS) algorithm for efficient ledger management. By deploying a vehicular blockchain network with homomorphic cryptosystem, Kong et al. [24] propose a secure and verifiable sensory information collection and sharing scheme in fog computing-enabled IoV, where the consensus process in blockchain is managed by RSUs with PBFT protocol. One can observe that most of the existing blockchain systems heavily depend on communication infrastructures for block building and consensus management and cannot be directly applied for disaster areas with severely disrupted or unavailable infrastructures.
II-B Computation Offloading for UAVs
Recently, many works have been reported on computation offloading for UAVs with constrained onboard resources. Bai et al. [18] design an MEC-based energy-efficient task offloading framework for UAVs in wireless networks with consideration of active and passive eavesdroppers and time-duration constraints. By exploiting the edge infrastructures, Callegaro et al. [25] propose an edge computing-based computation offloading scheme and design the optimal offloading policies for UAVs with joint consideration of network and computation load of MEC nodes. Chen et al. [26] present a hybrid edge/cloud computing-based offloading scheme to efficiently offload UAVs’ real-time computation tasks to proximal edge servers or remote cloud servers to reduce latency and improve energy efficiency. Liu et al. [20] devise an online multi-hop trajectory scheduling and computation task assignment algorithm for UAVs based on Lyapunov optimization and Markov approximation approaches for joint computing delay and cost minimization in the edge-cloud environment. However, as network infrastructures can be unavailable or insufficient in disaster scenarios, conventional cloud or edge based offloading mechanisms are difficult to meet the QoS requirements of UAVs. Moreover, different from the assumption in most of the existing works, it is not readily available for both resource consumers and resource contributors to acquire the accurate cost model parameters to determine the optimal offloading policies in practice.
In this work, distinguished from existing works, we study a lightweight and green consensus protocol for disaster scenarios with weak network connections to facilitate the implementation of blockchain into UDRNs. Besides, we devise an intelligent DRL-based optimal offloading algorithm under the promising VFC paradigm by exploiting the idle computation and storage resources shared by ground vehicles. Compared with our previous work [1], new contributions of this paper include: (1) we design a misbehavior tracing mechanism and give the property analysis of our RescueChain system; (2) we derive the SE for the general case of VFC-based offloading with multiple UAVs and vehicles with continuous strategies; and (3) we develop a two-tier deep Q-network (DQN)-based offloading mechanism to enhance the performance of Q-learning based offloading mechanism in [1].
III System Model
In this section, we introduce the system model including the network model, mobility model, VFC model, communication model, and adversary model, respectively. A summary of notations used in the paper is presented in Table I.
| Notation | Description | Notation | Description |
|---|---|---|---|
| Set of ground vehicles. | Number of validators in the blockchain. | ||
| Set of UAVs. | Number of level-1 validators. | ||
| Set of vehicles at UAV ’s coverage at -th time slot. | Merkle tree of time-stamped transactions in the block body. | ||
| Set of elected validators in the blockchain. | Merkle tree of serialized chunks of the raw block. | ||
| Set of full nodes in the blockchain. | Merkle tree of signed evidences for misbehavior forensics. | ||
| Total number of time slots. | Round/height in the consensus process. | ||
| Radius of A2G/A2A communication range of UAV . | The leader designated from level-1 validators. | ||
| Horizontal location of UAV at -th time slot. | Proof-of-lock (PoL) of the leader . | ||
| Flying altitude of UAV . | Signature of leader /validator . | ||
| Velocity/maximum velocity of UAV at -th time slot. | Off-chain storage transaction. | ||
| Acceleration of UAV at -th time slot. | Report transaction of nodes’ misbehaviors. | ||
| Average vehicular velocity. | A script for misbehavior forensics. | ||
| Maximum/minimum vehicle velocity. | Precommits making the prior block at height committed. | ||
| Traffic density/maximum traffic density of vehicles. | Votes justifying precommits at all rounds for height . | ||
| Total number of UAV ’s tasks to be offloaded. | Reputation value of full node . | ||
| -th computation task offloaded by UAV . | Normalized reputation value of full node . | ||
| Data size of task . | Initial reputation value of full node . | ||
| Required CPU cycles to process one bit of task . | Reputation reward/penalty for behavior . | ||
| Time-to-live (TTL) of task . | Amount of computing resource (AoCR) in doing task . | ||
| Urgency degree of task . | Payment of task . | ||
| Output/input ratio of task . | Satisfaction function of UAV . | ||
| UAV ’s remaining battery energy at -th time slot. | Cost function of UAV . | ||
| Minimum energy reserve of UAV . | Payoff function of UAV . | ||
| Battery energy capacity of UAV . | Payoff function of ground vehicle . | ||
| Flying or propulsion power of UAV at -th time slot. | Positive adjustment parameters. | ||
| Transmit power of vehicle /UAV . | Cost function of vehicle . | ||
| Energy consumption of vehicle in task execution. | State of UAV at time slot . | ||
| Energy consumption of UAV in movement. | State of vehicle at time slot . | ||
| Energy consumption of UAV in A2G transmission. | Q-function of UAV for state-action pair . | ||
| Channel gain between UAV and vehicle . | Q-function of vehicle for state-action pair . | ||
| Euclidean distance between UAV and vehicle . | Discount factor of UAV /vehicle . | ||
| Transmission rate of G2A uplink/A2G downlink. | State sequence of UAV /vehicle in DQN. | ||
| Uplink/downlink bandwidth. | Interaction experience of UAV /vehicle in DQN. | ||
| Total offloading latency of task . | Replay memory of UAV /vehicle in DQN. | ||
| Execution time of task . | Parameter of -greedy policy of UAV /vehicle . | ||
| A2G transmission time of task . | Number of UAV’s payment levels in DQN. | ||
| G2A transmission time of task . | Number of vehicle’s AoCR levels in DQN. |
III-A Network Model
Fig. 2 depicts a typical UAV-aided disaster rescue network (UDRN), which is composed of a group of UAVs, ground vehicles, ground stations, and a permissioned blockchain. More basic information about UDRNs can be found in works [10, 8].
In a given investigated disaster area, a set of vehicles, denoted as , are to perform search and rescue missions, where part of roads and network infrastructures are damaged. To facilitate data transmissions among ground rescue vehicles, a fleet of UAVs, denoted as , are dispatched to establish emergency communications by forming flexible aerial subnetworks. Each UAV is equipped with multiple sensors (e.g., thermometer, infrared camera, and GPS) to perceive its surroundings. On one hand, to save UAV’s limited battery energy, the sensory data (e.g., images, videos, and audios) collected by UAVs can be transmitted to ground vehicles for processing (referred to as VFC) such as pattern recognition and survivor detection via aerial-to-ground (A2G) links. On the other hand, a group of UAVs can serve as aerial communication relays via aerial-to-aerial (A2A) links to enhance network connectivity. Let and denote the radiuses of A2G and A2A communication ranges of UAV , respectively. Due to the destruction of network infrastructures, the emergency control centers such as ground stations are deployed to coordinate both aerial and ground subnetworks by scheduling UAVs and vehicles. To better adapt to the affected areas, the ground station is hosted by an emergency communication vehicle (ECV) [27] with powerful communication and computing capabilities.
The blockchain contains a growing sequence of hash-chained blocks and each block has two parts: the block body and the block header . The block body includes a set of time-stamped records (e.g., sensory data, computing results, rescue commands, and node misbehaviors) which are compressed into a Merkle tree . To alleviate the heavy storage burden of blockchain, only the data pointers are recorded on-chain while the source data are moved to an off-chain data repository. The block header consists of the metadata of block such as the hashes of parent and current blocks, the Merkle root of , the block height, the signature of block creator, aggregated signatures of block validators, and a script for misbehavior tracing (defined in IV-D). In RescueChain, only authorized entities can participate in the permissioned blockchain network after registration at the certification authority (CA) using their true identities. Let be the set of authorized nodes in the blockchain. Three different roles of participants are considered in the blockchain as follows:
- •
Full nodes store the copy of all blocks and are candidates of validators.
- •
Lightweight nodes only need to store the block headers and can receive blockchain services from nearby full nodes. They can not participate in the consensus process for ledger maintenance.
- •
Validators are part of full nodes and serve as consensus nodes in the blockchain that are responsible for consensus management by executing consensus protocols.
In the system, each ECV acts as a full node. Each authorized UAV can opt to be a lightweight node or full node based on its computation and storage capacities.
III-B Mobility Model
For efficient flying trajectory modeling, the total time period is evenly divided into time slots with an interval of . As each time slot can be sufficiently small, UAV ’s instant location at -th time slot can be roughly fixed. The horizontal location of UAV at -th time slot is denoted as . To avoid frequent ascending and descending and maintain continuous flight over the air, the hovering altitude of UAV is considered to be fixed at during executing a rescue task [5, 28, 29, 30, 31], which varies for different tasks. In practice, the fixed hovering altitude refers to the lowest altitude at which the UAV can avoid any terrain or building obstructions in the task area, hence reducing the additional energy loss caused by frequent height changes. Let be the minimum energy reserve of UAV to prolong its battery life. Then, UAV ’s remaining battery energy at -th time slot is constrained by , where is the battery energy capacity of UAV . As UAV flies at a constant height, according to [29, 30, 31], its flying power to propel its mobility and keep it aloft at -th time slot is positively related with both the velocity and acceleration , i.e.,
| (1) |
where is gravitational acceleration with nominal value . and are parameters depending on UAV’s weight (containing its payload), air density, wing area, UAV type (e.g., fixed-wing or rotary-wing), etc. The flying velocity of UAV is:
| (2) |
where is the maximum velocity of UAV .
For ground vehicles, the fluid traffic model [32] is adopted to capture the relationship between the traffic density and average vehicular velocity . We have:
| (3) |
where means the maximum traffic density. and are the maximum and minimum vehicle velocities, respectively. The number of ground vehicles entering the communication coverage of UAV at -th time slot can be computed as . Let denote the ratio of ground vehicles leaving the coverage of UAV at -th time slot. Based on [11], the number of vehicles in the communication range of UAV at -th time slot is calculated as:
| (4) |
III-C Vehicular Fog Computing Model
The limited communication and battery resources of UAVs may be unaffordable to execute compute-intensive and delay-critical rescue tasks. Consequently, the executing time for rescue missions may be prolonged and the recharging interval of UAVs may be shortened. Under the VFC paradigm, the UAV’s heavy data computation and storage missions can be efficiently offloaded to ground vehicles in its communication coverage by collaboratively contributing their idle resources. Let be the set of cooperative vehicles in UAV ’s coverage at -th time slot. Each task of UAV to be offloaded to a vehicle can be denoted as a 4-tuple, i.e.,
| (5) |
where (in bits) denotes the data size of task. (in CPU cycles/bit) indicates the required CPU cycles to process one bit. (in seconds) means the time-to-live (TTL) of task. is the urgency degree for mission processing, and a higher implies a higher urgency degree. is the total number of UAV ’s tasks to be offloaded.
In VFC, when all bits of task data are transmitted to a ground vehicle through A2G communication, the data computation process is executed immediately on the vehicle, and then bits of the processed results are sent back to the UAV through ground-to-aerial (G2A) communication. Here, denotes the output/input ratio. Let be the amount of computing resource (AoCR) contributed by vehicle in performing mission , which is measured by CPU cycles per second. According to [33], the execution time of mission in vehicle can be calculated as . Besides, the energy consumption of vehicle in performing mission is:
| (6) |
where is the effective switched capacitance [34].
III-D Communication Model
For A2G/G2A communications, the line-of-sight (LoS) link is presumed to be dominant [33], and the channel gain between UAV and ground vehicle can be modeled by the free-space path loss model, i.e., , where is the channel gain at the reference distance , means the path loss exponent, and represents the Euclidean distance between UAV and ground vehicle at -th time slot. The frequency division multiple access (FDMA) protocol is applied for bandwidth sharing among ground vehicles in transmitting computation outcomes to the UAV [34]. Then, the available G2A uplink transmission rate from vehicle to UAV is obtained as:
| (7) |
where is the assigned uplink bandwidth to vehicle , means vehicle ’s transmit power, and is the power of additive white Gaussian noise. Moreover, the A2G downlink transmission rate from UAV to vehicle is denoted as:
| (8) |
where is UAV ’s downlink bandwidth, and is UAV ’s transmit power.
III-E Adversary Model
Three kinds of adversaries considered during information sharing in UDRNs are listed as follows.
- •
Malicious Insider UAVs. Due to the open-access features of UAV networking to maximize the life-saving potential under disasters, any entities including malicious ones can connect to UAVs freely. Consequently, UAVs may be compromised and controlled by them to tamper with the sensory data, disseminate falsified information, and produce fake blocks.
- •
Threats to Data Dependability. Owing to the unreliable wireless environment, the disseminated data (e.g., sensory data, processed results, and scheduling commands) may be forged, replaced, or deleted during multi-hop data transmissions[35]. Moreover, it is difficult to transparently audit the delivered information to enforce accountability when disputes occur.
- •
Threats to Misbehavior Traceability. Traditional centralized misbehavior tracing mechanisms usually lack transparency and auditability and may suffer from the single point of failure (SPoF) and DDoS attack, causing difficulty in trustworthy, auditable, and immutable misbehavior tracing and punishment enforcement.
IV Design of RescueChain
In this section, we present the detailed design of RescueChain, which is a blockchain-based system for secure and efficient information sharing in UDRNs.
IV-A Overview of RescueChain
In UDRNs, owing to the sparse network environment and possible poor connections, network partitions may be frequent, resulting in the risks of blockchain forking. Besides, the limited resource of UAVs in terms of battery, computation, and storage restrict the adoption of conventional resource-hungry blockchains. Accordingly, our RescueChain should be low-cost, infrastructure-free, and robust in UDRNs. To achieve the three goals, we make two improvements: one is the VFC-based off-chain mechanism to offload the heavy data computation and storage tasks from UAVs; the other is the reputation-based Tendermint consensus protocol to robustly reach consensus in the weakly connected environment with enhanced safety. In particular, as shown in Fig. 3, the following three phases need to be undertaken:
- •
Entity registration and key distribution. In this phase, after registration at CA, each authorized entity obtains its key pair and opts its role in the blockchain system.
- •
VFC-based off-chain storage and computation. This phase performs off-chain data computation and storage for UAVs under the VFC paradigm.
- •
Reputation-based Tendermint consensus process. In this phase, each entity runs the reputation-based Tendermint protocol to reach consensus on the new transactions to be added to the blockchain via validator election, two-phase voting with locking, and reputation assessment.
IV-B Entity Registration and Key Distribution
The system parameters are selected by CA based on the Boneh-Lynn-Shacham (BLS) short signature scheme [36]. A multiplicative bilinear map is chosen by CA, where and are generators of groups and , and is the prime order of . Two hash functions and are chosen by CA. Then, CA broadcasts the system parameters to the network:
| (9) |
Each authorized node registers itself at CA using the real identity and receives a group of private/public key pairs , wallet addresses, and certificates in the blockchain from CA. Here, , , and indicates randomly sampling.
IV-C VFC-Based Off-Chain Storage and Computation
Under VFC, UAVs’ compute-intensive missions (e.g., human detection and multi-object tracking) on sensory data can be offloaded to ground vehicles to save their constrained battery energy. To alleviate the overhead of blockchain and improve system scalability, the VFC-based off-chain approach is adopted by moving both sensed and processed data to off-chain repositories while retaining a data pointer of source data on the blockchain. The set of data to be disseminated in UDRNs is denoted as . Each data is composed of two parts, i.e., the raw sensory data and the computation outcome . In RescueChain, the InterPlanetary File System (IPFS) [37] serves as the distributed off-chain data store, where each data is stored in the format of distributed files in IPFS and is uniquely addressed by its hash pointer . The ground vehicles serve as the distributed storage nodes in IPFS. After VFC-based computation offloading process for task , UAV sends an off-chain storage transaction to the network as:
|
|
(10) |
where is the public key of UAV . is the group of public keys of vehicles involved in task . is the description of data . is the timestamp of generation. means the signature of UAV . is the BLS multi-signature of vehicles, where and . is the unique certificate issued by the IPFS data store.
IV-D Reputation-Based Tendermint Consensus Protocol
In RescueChain, the Tendermint protocol [38] is adopted to reach consensus among distrustful UAVs due to its high energy efficiency and partial partition tolerance than its alternatives. To be adaptive to the sparse network environment in UDRNs, the multi-signature method [36] is applied in the consensus phase for bandwidth saving. To further enhance the safety of consensus and speed up the consensus process, our RescueChain incorporates reputation assessment into the Tendermint for validator election and block bookkeeping. In the proposed reputation-based Tendermint protocol, the following steps are included:
Step 1: Validator election. The consensus process is carried out by an elected validator committee, denoted as . Let be the set of full nodes. Every full node can vote for a delegate and its voting weight is determined by its stake, namely, the reputation value . The top delegates with the highest votes are selected to form the validator committee , which can be further classified into two kinds: level-1 validators and level-2 validators. The top validators with the highest votes serve as level-1 validators which can propose and validate new blocks, while the remaining validators are level-2 validators that can only perform block verification.
Step 2: Consensus process. The consensus process is composed of three phases: propose, prevote, and precommit. To eventually reach consensus in weakly connected UDRNs, the network is assumed to be partially synchronous, and the partial synchrony model [39] is applied in protocol design. An upper bound of transmission delay and an unknown global stabilization time (GST) are defined in UDRN. In the partial synchrony model, there exist either a known upper bound after the unknown GST or an unknown upper bound on the transmission latency of messages. It means that the transmission between two correct entities in UDRN will eventually arrive within 1) the unknown timeout , or 2) the known timeout beginning with an unknown GST. At each round of consensus process for a certain height, a small fixed increment of the timeout is added than its previous round [40]. Besides, the internal clocks of non-Byzantine validators are assumed to be sufficiently accurate during a short time period until reaching consensus on the next block. In the following, we elaborate the detailed process to reach consensus in our RescueChain.
1) Propose phase. A leader is designated from level-1 validators in a round-robin fashion. At its round , the leader collects a batch of recent transactions from its local memory pool, compresses them into a Merkle tree , and packages them into a block which includes a hash linked to the previous block. Then, a signed proposal is gossiped to the network, i.e.,
| (11) |
where is the proof-of-lock (PoL) indicating the locked block of the leader , and is its signature. A PoL for block (or ) means that a leader receives at least prevotes for block (or ) at round for height [40]. Note that the block can be quite large, and can be a network bottleneck in disseminating it to other validators. To alleviate the communication burden of leader in disseminating block , we design a block partition method for efficient proposal transmission. Specifically, the raw block is serialized and split into multiple chunks with appropriate size, and all the chunks are hashed into a Merkle tree . A Merkle root together with the signature of leader are included in the proposal. Once a validator receives all the chunks, it performs the block deserialization operation and validates the correctness of the received proposal by checking the Merkle root .
2) Two-phase voting with locking. In two-phase voting, each validator sends its prevote result of the proposal to the network in the first phase, and tells its precommit result of other validators’ claims regarding the proposal in the second phase. Intuitively, it can be ensured that the result of the first phase has been witnessed by enough validators in the second phase to offer Byzantine tolerance. Besides, the following two rules are defined in the locking mechanism to ensure blockchain safety:
- •
Locking rule. A validator is locked on (or ) if it receives over prevotes for block (or ) at round for height . Then, at round for height , it should prevote for the locked block, and propose it if it is the leader. This can prevent validators from prevoting different blocks in different rounds, thereby protecting safety as conflicting blocks may be committed at the same height.
- •
Unlocking rule. A validator can only unlock the block which is locked at round if there exist a PoL for another block (or ) at a higher round , where . This allows validators to be unlocked and precommit another block that the rest of the network intend to commit, thereby protecting liveness.
If the validator is locked on a block proposal at a previous round, it broadcasts a prevote for the locked block with its signature . Otherwise, if a valid proposal is received for the current round after verification, validator broadcasts a prevote for that block with its signature. If no proposal or a invalid one is received within the timeout , validator sends a special prevote for instead. The form of prevote message is:
| (12) |
where is the prevoted block or . is the maximum time that a validator stays in the propose phase, which is initialized as at the beginning of a height and is incremented every time expires.
If there exists a PoL for block , the validator locks on block , releases the prior locked block, and broadcasts a precommit for . If there exists a PoL for , the validator unlocks, and it broadcasts a precommit for . Otherwise, the validator precommits . The explicit form of precommit message is
| (13) |
The same prevote or precommit messages signed by distinct validators can be aggregated by BLS multi-signatures for compressed signature size. If validator receives over two-thirds of precommits for a specific block, it simply sets its commit time to the current time and moves on to round at the next height . Then, the specific block is eventually committed. Otherwise, it moves to the next round at current height . Then, a new leader is designated and the above process is repeated. Before entering the next height , validators wait until some fixed time duration past to include more commits from validators with slower network connections.
Step 3: Misbehavior tracing. Malicious validators may conduct various kinds of misbehaviors to crash the consensus process and fork the blockchain. A malicious leader may conduct conflicting proposals (cp) misbehavior by disseminating conflicting block proposals to different validators within a round, and malicious validators may perform conflicting votes (cv) misbehavior by giving prevotes or precommits to conflicting proposals. A malicious leader can conduct wrong block creation (wbc) misbehavior by producing invalid block or true block at false round and height, and non-block creation (nbc) misbehavior if the block proposal is not generated on time or it is offline or partitioned. The above misbehaviors (i.e., , , , and ) can be identified via their signatures attached on the proposals or votes, thereby the corresponding misbehaving entities can be detected. Moreover, malicious validators can perform violation of locking (vol) misbehaviors by violating the locking and unlocking rules to make the network commit on two different blocks at a height. In this case, if a prevote or precommit resulted from a misbehavior affects the final commit, at least one honest validator must have been received it. As honest validators should broadcast all their received votes at each round of a height, the evidences of violations of the locking rule can be collected by stitching all votes and matching every prevote with the most recent precommit of the same validator. The violations of unlocking rule can be detected similarly via matching every precommit with the PoL that justifies it.
For efficient and reliable misbehavior forensics and tracing, a script denoted by is included in the next block at height , which contains the set of signed precommits that make the prior block at height committed (i.e., ), together with all votes justifying the precommits at all rounds for height (i.e., ). As such, the unjustified votes and the misbehaving entities can be identified and traced. For alleviated blockchain burden, all the votes in are moved to an off-chain data store instead, and only a Merkle tree constructed from are included in the with a root . Furthermore, to accelerate misbehavior detection, nodes can form informer groups to report misbehaviors by collecting the cryptography trails as evidence and generating a report transaction as:
|
|
(14) |
where is the public key of accused node . and are the public keys and BLS multi-signature of the informers, respectively. is the fixed report fee to prevent DDoS attack and is evenly divided among them. is the collected evidence such as the digital signatures on votes or proposals at different rounds of a height.
Step 4: Reputation evaluation. The reputation of each full node is calculated based on two aspects: behavior effect and time fading effect. Commonly, node’s reputation can be gradually improved by benign behaviors and significantly decreased by misbehaviors; meanwhile, latest behaviors are of more significance than previous ones in determining current reputation. The following benign behaviors are considered in blockchain: the successful block creation (sbc) behavior of the leader and the successful block verification (sbv) behavior of validators. Both the and behaviors can be detected by the signatures on block proposal and precommits included in the . Let be the reputation reward or penalty for behavior . A binary variable is defined, where if is a benign behavior; and if is a misbehavior. Besides, if is verified as true and recorded in blockchain, all members within the informer group are rewarded with a reputation increase , as well as a reputation decrease for the accused entity. Otherwise, the expended report fee is in vain. Here, the evidence collection and misbehavior forensics are out of scope for this paper, and readers can refer to existing works [41, 42]. At each time slot, each full node ’s reputation can be computed as:
| (15) |
where is the initial reputation of full node , is the number of recorded behaviors of full node at -th time slot, and is the exponential decay factor. The normalized reputation of each full node can be formulated as . The reputation values of full nodes are updated after each round of consensus according to the time-stamped behavior records stored in the blockchain.
IV-E Analysis of RescueChain
Let denote the ratio of Byzantine validators in RescueChain, and be the ratio of validators that are offline or partitioned in UDRNs. According to [40, 38], under partial synchrony assumption of the network, our RescueChain system is resilient up to Byzantine validators. Next, we analyze the finality, network availability, and communication complexity of RescueChain in the following Theorems 1–3, respectively.
Theorem 1 (Finality): With assumptions of partial synchrony and , by taking multiple rounds at a given height to commit a block via two-phase voting with locking, our RescueChain can reach deterministic finality, where a deadlock that different blocks are locked by part of honest validators at different rounds can be avoided.
Proof:
We prove the theorem by contradiction. Suppose that RescueChain does not satisfy finality, where more than one block are committed at the same height. Without loss of generality, we consider two committed blocks and of height at rounds and , respectively. There exist the following two cases: and . In the first case that , both blocks and receive over two thirds of precommits at round . Obviously, at least Byzantine validators has precommitted for both blocks at round . In the other case that , we assume without loss of generality. As over two thirds of validators precommit for at round , they get locked on and must prevote for . To precommit for block , it requires over two-thirds to prevote for , which means that at least Byzantine validators violate the locking and unlocking rules. ∎
Theorem 2 (Availability): In face of network asynchrony, our system will never halt if , where is the ratio of offline or partitioned Byzantine validators to the total number of offline or partitioned validators.
Proof:
Let denote the ratio of remaining non-Byzantine validators that are not offline or partitioned in UDRNs. We have . When , as analyzed in Theorem 1, our system will never halt and the unambiguous consensus can be reached. ∎
Remark: If over a third of validators get offline or partitioned (i.e., ), the network will halt since no block can receive two thirds or more votes from non-Byzantine validators (i.e., ). The unambiguous consensus can be restored until the network connection recovers.
Theorem 3 (Complexity): Compared with the view-change overhead in PBFT, the total communication complexity is reduced to in our RescueChain.
Proof:
In the propose phase, the new block proposal needs to be delivered to other validators, and the communication complexity is . In the two-phase voting phase, each validator needs to collect the voting messages from others to make progress, and the communication complexity is . Therefore, the total communication complexity is . ∎
Remark: Based on the proposed block partition method in the propose phase and the BLS signature aggregation in two-phase voting, the delivery latency of block proposal and the signature size in voting can be reduced, thereby alleviating the communication burden in consensus process.
Next, we give the security analysis of our RescueChain. Our paper mainly focuses on the blockchain-based solution to defend against attacks defined in Sect. III-E. The authentication and access control, which are also essential to ensure network security in UDRNs, are out of scope for this paper, and readers can refer to existing cryptographic approaches [43, 44].
- •
Thanks to the decentralized ledgers and special data structure of blockchain (i.e., transactions are time-stamped, signed, and recorded in the Merkle tree structure in hash-chained blocks), the metadata of shared data can be immutably recorded on the blockchain to prevent data tampering attacks and guarantee the integrity and dependability of delivered information; meanwhile, the recorded node misbehaviors on blockchain ledgers can be transparently traced back to the source to ensure the traceability of misbehaviors. Besides, the defense against compromised insider UAVs is analyzed in the simulation section.
- •
Since only registered nodes are authorized for network access, the air traffic scheduling of UAVs can be facilitated while preventing identity thefts. By dynamically altering the public keys in transactions via existing pseudonymity mechanisms in [45], the true identities can be hidden and remain unlinkable to preserve nodes’ identity privacy.
V Optimal Offloading in Static and Dynamic Games
In this section, the payoff functions and optimization problems of UAVs and ground vehicles in VFC-based offloading are first formulated. Then, we analyze the optimal offloading strategies of vehicles and the optimal payment strategies of UAVs under a static Stackelberg game model with one interaction and a dynamic Stackelberg game with repeated interactions, respectively.
V-A Optimization Problem
Payoff function of UAV. During VFC-based offloading process, to stimulate ground vehicles’ participation and high amount of resource sharing, each UAV needs to determine the payment vector for each task to compensate the cost of ground vehicles in contributing computation resources. Let denote the AoCR vector of ground vehicles that participate in the offloading process for UAV . The payoff function of UAV is defined as the difference between the satisfaction and its cost, i.e.,
|
|
(16) |
where is a binary variable which equals to zero if vehicle does not participate in the offloading of task , otherwise it equals to one. is the satisfaction function of UAV with the obtained AoCR of each task . is the cost function of UAV during offloading. Here, the logarithmic function, which is widely employed in resource allocation mechanisms [46], is used to model the satisfaction. We have
| (17) |
where means the satisfaction parameter of UAV , and is the urgency degree of task defined in Eq. (5). The cost function is composed of two parts: the payment for shared computation resource (i.e., ) and the time delay to obtain the processing results (i.e., ). We have
|
|
(18) |
where means the weight factor, and is the price adjustment parameter. Next, we analyze the total delay and energy consumption in task offloading.
1) Delay analysis. The total offloading latency for every task includes three parts: the A2G transmission time , the task execution time , and the G2A transmission time . The A2G transmission time is denoted as . As UAVs and ground vehicles are highly mobile, vehicle may leave the communication range of UAV and drive into the coverage of another UAV , . Without loss of generality, we denote as the time slot that UAV begins to offload mission . Two cases of G2A transmission latency are considered as below:
| (19) |
where is the A2A transmission rate between UAV and UAV . Hence, we have .
2) Energy consumption analysis. The energy consumption of UAV during task offloading includes two parts: the A2G transmission energy and the flying energy. UAV ’s energy consumption during A2G transmission is denoted as . The flying energy of UAV can be attained as .
The target of each UAV is to maximize its payoff function by deciding the optimal payment strategy , whereby its optimization problem is formulated as:
| (20) |
| (21) | |||||
| (22) | |||||
| (23) |
Constraint (21) indicates that the total time delay of each task should be less than or equal to the task TTL . Constraint (22) implies that the remaining battery energy of UAV after task execution should not less than its minimum energy reserve . Constraint (23) means that the payment should be constrained by the lower bound and the upper bound .
Payoff function of ground vehicle. In VFC-based task offloading, the payoff function of each ground vehicle is associated with the payment provided by the UAV and its cost of sharing computing resources to the UAV. As such, the payoff function of ground vehicle , is the difference between the payment and the cost in sharing computing resource to UAV , i.e.,
| (24) |
where is the cost function, which contains two parts: the cost for sharing amount of computation resources and the energy consumption in data computing and transmission. According to the quadratic cost model [47], the cost of resources sharing can be formulated as a quadratic function of the contributed resources. As such, can be defined as
| (25) |
The first term in formula (25) represents the quadratic cost in sharing amount of computation resources, and the second term indicates the total energy consumption in computing (i.e., ) and data transmission (i.e., ). Here, and are positive adjustment parameters. is the unit cost of vehicle ’s computation resource.
The target of each vehicle is to maximize its payoff function by deciding the optimal AoCR strategy , whereby its optimization problem is formulated as:
| (26) |
| (27) |
Constraint (27) means that the AoCR of vehicle in executing task should be constrained by the lower bound and the upper bound .
V-B Static Stackelberg Game Analysis
During VFC-based offloading process, both UAVs and ground vehicles are rational and selfish and they are aimed to maximize their own profits [45]. Specifically, the UAV intends to enjoy high amount of computing resource with low payments, while each ground vehicle hopes the payment can be as high as possible. Based on the existing work [46], the competitive interactions between a UAV and ground vehicles can be formulated as a one-leader and multiple-followers Stackelberg game, i.e.,
| (28) |
In the two-stage game , the UAV first determines its optimal payment strategy in stage I to optimize its payoff, and then each vehicle selects its optimal AoCR strategy in stage II to maximize its benefit. Here, is a solution of problem , and is a solution of problem . The solution of game is the Stackelberg equilibrium (SE) defined in the following Definition 1, which means neither the UAV nor the ground vehicles can improve their payoffs by deviating it.
Definition 1
The point is a SE of the proposed game , if the following conditions hold:
| (29) | ||||
| (30) |
In the static Stackelberg game with one interaction, the parameters of the game are public known by all players. To find the SE of the static Stackelberg game, the backward induction method is employed. Specifically, we first investigate the decision process of every follower (i.e., vehicle) in stage II to attain its optimal AoCR strategy. Then, we analyze the optimal payment strategy of the leader (i.e., UAV) in stage I. Every ground vehicle determines its optimal AoCR strategy to maximize its payoff according to the following theorem.
Theorem 4: The optimal AoCR strategies of vehicle in performing task of UAV is
Proof:
Refer to Appendix A ∎
Given the optimal AoCR strategy of vehicles in Eq. (V-B), UAV determines its optimal payment strategy for tasks to maximize its payoff based on the following theorem.
Theorem 5: The optimal payment strategy of UAV on task for vehicle is
where
| (36) | ||||
| (37) |
Proof:
Refer to Appendix B ∎
Based on above analysis, the SE of the Stackelberg game can be derived as:
|
|
Remark: In the static Stackelberg game-based offloading process where the parameters of the game are public knowledge, both UAVs and ground vehicles can apply the above SE to decide their optimal strategies to gain maximized payoffs.
V-C DQN-Based Offloading for Dynamic Stackelberg Game
In a realistic VFC-based offloading application, the parameters of user payoff model (e.g., satisfaction, cost, and network parameters) are usually private and the parameters of network model are time-varying [7]. As a consequence, these parameters cannot be readily available for all participants. Both UAVs and ground vehicles can conduct multiple interactions and employ reinforcement learning technologies to find the optimal payment and AoCR strategies via trials, respectively, without fully knowing the accurate parameters of the network model and payoff model. The repeated sequential interactions between a UAV and ground vehicles can be formulated as a dynamic Stackelberg game.
DQN-based payment strategy of UAV. A high payment of UAV for can decrease its immediate payoff, but it stimulates more vehicles’ participation and their higher AoCR contribution in the future. Therefore, the current payment strategy of the UAV influences the long-term benefits. The payment decision of UAV in the dynamic game can be formulated as a finite Markov decision process (MDP) [4], and reinforcement learning algorithms can be exploited to achieve the optimal payment strategy. In particular, UAV observes the previous AoCR sequences of corresponding ground vehicles and formulates the current system state. The state of UAV at -th time slot (or interaction) is , and we have . The action of UAV at time slot is . For simplicity, the feasible payments of UAV are uniformly discretized into levels, i.e., . Let denote the Q-function of UAV with state-action pair , which means the expected long-term discounted reward. Note the size of state space of UAV , i.e., [48], increases with both the number of involved vehicles (i.e., ). Due to the presence of large state space, traditional Q-learning approaches may suffer the curse of dimensionality and cause slow learning speed and long convergence time.
In the DQN-based pricing process, to address the curse of dimensionality and accelerate the convergence rate of Q-learning, the convolutional neural network (CNN) is exploited for efficient state space compression and Q-value estimation. Specifically, the output of the CNN is the Q-value for each payment level, i.e.,
|
|
(40) |
where is the discount factor implying the myopic view of UAV about the future return. is the new state transited from with action . The payoff represents the immediate reward of UAV , which is rewritten as . In DQN, the value of Q-function is estimated by a nonlinear neural network function approximator realized by CNN, which includes convolutional (Conv) layers and fully connected (FC) layers. The first Conv layer involves filters and each of them has size and stride . The second Conv layer contains filters and each of them has size and stride . The widely used rectified linear unit (ReLU) [49] is adopted as the activation function in both Conv layers. The first FC layer uses ReLUs, while the second FC layer has ReLUs for each participating vehicle. The architecture parameters in CNN are summarized in Table II.
| Layer | Input | Filter Size | Stride | # Filters | Activation | Output | ||
|---|---|---|---|---|---|---|---|---|
| Conv 1 | 1 | 20 | ReLU | |||||
| Conv 2 | 1 | 40 | ReLU | |||||
| FC 1 | 180 | ReLU | ||||||
|
ReLU | |||||||
|
ReLU |
To efficiently learn from past experiences and smooth the learning, the state sequence is constructed for UAV in DQN, which consists of the current state and prior states, i.e.,
| (41) |
The state sequence is then reshaped into a matrix and input to the CNN. We rewrite as for simplicity. The interaction experience that UAV learned at time slot is denoted as
| (42) |
and is stored into a replay memory, denoted as . Here, only the latest related experiences are stored to save memory space and restrain UAV from focusing on the immediate interaction experience. Let denote the filter weights of UAV in the CNN. Based on the experience replay method, is updated for times at every time slot by randomly selecting an experience from to minimize the mean-squared error of the target optimal Q-function. According to [49], the loss function can be defined as:
|
|
(43) |
The stochastic gradient descent (SGD) algorithm is adopted to update for alleviated computational cost in learning via mini-batch updates. Based on the CNN model and current system state , UAV applies the -greedy policy to choose its action for a better tradeoff between exploration and exploitation. More specifically, the greedy payment vector that maximizes its Q function is chosen with a high probability , and other actions are randomly selected with a very small chance , i.e.,
The detailed procedure of DQN-based payment for UAV is shown in Algorithm 1.
DQN-based AoCR strategy of ground vehicle. The AoCR decision of each ground vehicle can be formulated as an MDP with finite states. As it is unrealistic for vehicles to have full knowledge of the network model and the UAV’s private payoff model in time, each vehicle can utilize the DQN method to obtain its optimal AoCR strategy in the dynamic game. In the DQN-based AoCR decision-making process, the payment of UAV at the last time slot is used by vehicle as the current state to decide the current AoCR action. The system state of vehicle at time slot is , and its action at time slot is . For simplicity, the feasible AoCRs of vehicle are discretized into levels, i.e., . The Q-function of vehicle for every state-action pair is denoted by and is estimated by the CNN, i.e.,
|
|
(46) |
where is the discount factor implying the myopic view of vehicle about the future return. is the new state transited from with action . The payoff means the immediate reward of vehicle , and is rewritten as for simplicity. As shown in Table II, the parameters of CNN for each vehicle are similar to those of UAV except that this CNN has outputs.
Each vehicle builds its state sequence in DQN and reshapes it into a matrix as the input of the CNN. The state sequence includes the recent states, i.e.,
| (47) |
Then, each vehicle stores its previous interaction experiences into a replay memory , where is the experience that vehicle has acquired at time slot , i.e.,
| (48) |
The parameters of the Q-network of vehicle , denoted by , is updated by SGD based on the loss function, which is similar to Eq. (43). The SGD training process is repeated times to update at each time slot based on the randomly chosen experience from the replay memory, i.e., .
To avoid staying at the local optimum, the -greedy policy is exploited by each vehicle to opt its action , i.e.,
|
|
The detailed procedure of DQN-based AoCR for vehicle is shown in Algorithm 2.
Remark: The proposed two-tier DQN algorithm satisfies both convergency and robustness in the VFC-based offloading process.
1) Convergency. According to [50], it is theoretically guaranteed that Q-learning can converge to the optimal action-value function when . Besides, based on the experimental validations in [49], the large CNN can be efficiently trained in a stable manner in DQN via experience replay and SGD. The stability of CNN training and the convergency of the two-tier DQN algorithm are demonstrated in the simulation section.
2) Robustness. By incorporating CNNs for state space compression and experience replay methods for mitigation of oscillations or divergence in learning, our DQN-based offloading algorithm can be effective in a large-scale network involving a large number of vehicles [48]. Besides, according to the experimental results in [51], the training data obtained from the historical experiments performed in similar scenarios can be exploited to accelerate the learning speed of Q-learning. Hence, each UAV or vehicle can pre-train its DQN model in an off-line manner (e.g., when they are in recharging state) by exploiting previous experiences learned from similar scenarios to speed up the convergence rate.
VI PERFORMANCE EVALUATION
VI-A Simulation Setup
As shown in Fig 4, we consider a simulation scenario with UAVs, ground vehicles, and ECVs in a disaster site with width of m and length of m. UAVs fly along the predefined straight-line trajectory [6] with a fixed altitude of m over the two-lane road. UAVs are initially deployed alongside the road every m, and vehicles are randomly distributed on each lane of the road with minimum safe distance of m. The minimum and maximum velocities of ground vehicles on the road are set as km/h and km/h. The number of UAV’s offloading tasks follows the uniform distribution between and . The data size of each task is randomly in Mbits. The required CPU cycles for one-bit data processing is randomly selected in CPU cycles/bit [34]. Each vehicle’s cost parameter is uniformly distributed between and cents. Our RescueChain system is established atop the Tendermint Core consensus engine [52] by utilizing the Docker container environment run on three computers with Intel Core i7-8700 CPU, 8GB RAM, and Ubuntu 16.04 OS. Other parameters are summarized in Table III.
| Parameter | Value | Parameter | Value |
|---|---|---|---|
| m/s [34] | W [33] | ||
| W [33] | W [33] | ||
| dBm [9] | dBm [33] | ||
| MHz [33] | MHz [33] | ||
| m | m | ||
| [4] | [34] | ||
| [29] | kJ [29] | ||
| cents | GHz | ||
In the simulation, we consider two kinds of insider attacks launched by malicious insider UAVs: (i) spoofing attack: they behave honestly at first to gain reputation and then begin to commit misbehaviors; and (ii) collusion attack: they collude to vote malicious delegates and witness incorrect blocks in the consensus process. The performance of our proposal is evaluated by comparing with the following conventional schemes:
- •
Two-tier Q-learning scheme [1]: both ground vehicles and UAVs employ the Q-learning method to seek their optimal AoCR and pricing strategies in the dynamic Stackelberg game, respectively.
- •
Greedy scheme: both ground vehicles and UAVs greedily opt their optimal AoCR and pricing strategies during repeated interactions in the dynamic Stackelberg game, respectively.
- •
Accumulative reputation-based Tendermint (ART) scheme: the reputation of validators in Tendermint are evaluated using the accumulative behavior effects in Eq. (15) with and , where the level-2 validators and the time decay effect are not taken into account.
- •
Naive Tendermint scheme [40]: the naive Tendermint protocol is operated by all full nodes to achieve consensus without considering the reputation assessment of full nodes.
VI-B Simulation Results
Fig. 7 and Fig. 7 show the evolutions of average AoCR and payment of ground vehicles and UAVs in different schemes. As seen in the two figures, the proposed two-tier DQN scheme effectively motivates higher AoCR of vehicles with lower payment and attains a smaller deviation with the SE analyzed in Eq. (V-B), compared with the two-tier Q-learning scheme and the greedy scheme. It can be explained as follows. In the two-tier Q-learning scheme, owing to the curse of dimensionality in searching the large state space, it is difficult for the UAV to efficiently find its optimal payment policy via Q-learning to encourage vehicles’ high computing resource contributions, thereby resulting in a relatively lower AoCR and higher payment. In the greedy scheme, since both UAVs and ground vehicles behave greedily during the strategy-making process, they can only attain the local optimum of the payoff, causing the low AoCR and high payment. Besides, the AoCR in our two-tier DQN scheme in Fig. 7 first increases then decreases, and finally reaches a stable value. The reason is that the initial high payment of UAV can motivate vehicles’ high AoCR, while vehicles tend to decrease the AoCR after observing the subsequent decreasing payment.
Fig. 7 show the evolutions of average payoffs of UAVs and vehicles in three schemes. From Fig. 7, the proposed two-tier DQN scheme outperforms the two-tier Q-learning scheme in attaining a smaller deviation with the SE, as our proposal can promote vehicles’ higher AoCR contributions with lower payments as shown in the above two figures. Besides, as time grows, the average payoff of UAVs increases, while that of vehicles is in a decline. It is because after seeing the initial high AoCR of vehicles, the UAV prefers decreasing its payment gradually to improve its payoff. Meanwhile, after observing UAV’s prior payments, vehicles intend to increase their AoCR to seek optimized profit.
Fig. 10 and Fig. 10 compare the proposed scheme with other two schemes in terms of the average AoCR of vehicles and the average payoff of UAVs, where the cost parameter of vehicle varies from to cents. From these two figures, the proposed scheme can achieve a higher AoCR of vehicles and a better payoff of UAV in comparison with the two-tier Q-learning scheme and the greedy scheme. It can be explained as follows. In the two-tier Q-learning scheme, due to the presence of curse of dimensionality resulted from the large state space, UAVs cannot efficiently motivate the high AoCR sharing of vehicles with low payment for enhanced payoffs. In the greedy scheme, as participants greedily seek the optimal AoCR and payment strategies in the Q-learning process, both UAV’s payoff and vehicles’ AoCR can only stay at the local optimums.
Fig. 10 illustrates the throughput and the block latency in our RescueChain when the block size (i.e., the number of transactions included in a block) increases from to . In this simulation, we set seconds and millisecond. As seen in Fig. 10, our RescueChain system can efficiently cope with thousands of transactions per second with about one-second block latency. Moreover, with the increase of block size, both the blockchain throughput and the block latency increase. The reason is that the higher block size implies more transactions to be processed within a block while it incurs higher block propagation latency.
Fig. 13 compares our RescueChain with other two schemes in terms of the average round to reach consensus, given different ratios of Byzantine nodes. As seen in Fig. 13, our RescueChain outperforms the ART scheme and the naive Tendermint scheme in achieving the lowest average round to reach consensus. This is because in the ART scheme, with a reputation decrease (as a punishment) for misbehaving participants, the chance of honest nodes becoming validators can be increased, resulting in a lower average round to reach consensus than the naive Tendermint scheme. Besides, as the time decay in reputation is absent, previous behaviors occupy a large weight in determining the current reputation, causing a higher risk of suffering spoofing attacks. Moreover, as the level-2 validators are not considered in the ART scheme in reputation evaluation, the chance of misbehaving participants acting as the leader in blockchain can be increased. Accordingly, the average round to achieve consensus in the ART scheme is relatively larger than that in our RescueChain.
Fig. 13 depicts the average offloading delay in two schemes, where the data size of task changes from to Mbits and three different values of vehicle density are exploited. In the scheme without VFC, UAVs’ computation tasks on sensory data are offloaded to the ECVs. We can see that, compared with the scheme without VFC, our proposed scheme with VFC can efficiently decrease the offloading delay given different vehicular densities and task sizes. This is because the ground vehicles are provisioned with sufficient computation capacities and are closer to UAVs. Moreover, as all UAVs offload their heavy tasks to the remote ECVs, the ECVs’ limited computing resource can be fully occupied, resulting in a longer waiting time for computation and increased latency for result delivery. Besides, as seen in Fig. 13, given the task size, the average task delay decreases with the increase of vehicle density. The reason is that the higher vehicle density implies more neighboring vehicles for task offloading and the corresponding higher AoCR sharing in computation, causing a decline in the task latency.
Fig. 13 demonstrates the average saved energy of UAV in task offloading given different data sizes of task and vehicle densities . From Fig. 13, the UAV’s saved energy increases with the task size and the vehicle density. It is because with the increase of vehicle density, more computation resources can be contributed to UAVs, thereby saving more limited battery energy of UAVs. Besides, the heavy computing tasks can be effectively offloaded to vehicles under VFC when the task size grows, thereby improving the energy efficiency of UAVs.
| # validators () |
| |||
|---|---|---|---|---|
| Proposal | Naive Tendermint | |||
| = 10 | 28.41 J | 28.55 J | ||
| = 50 | 144.02 J | 145.89 J | ||
| = 100 | 293.04 J | 299.67 J | ||
| = 1000 | 3589.95 J | 4413.62 J | ||
| Average energy consumption per transaction in Bitcoin: J | ||||
| Average energy consumption per transaction in Ethereum: J | ||||
Table IV shows the energy efficiency of our RescueChain in the consensus phase in comparison with the naive Tendermint scheme, Bitcoin, and Ethereum. Here, the number of validators in the blockchain varies from to , and the block size (i.e., number of transactions included in a block) is set as . As shown in Table IV, our proposed RescueChain attains a much-improved energy efficiency in reaching consensus than traditional Bitcoin and Ethereum blockchains. According to [53, 54], the numbers of current reachable Bitcoin nodes and Ethereum Mainnet clients are and , respectively. In both Bitcoin and Ethereum, the compute-intensive PoW consensus protocol is leveraged to reach the unambiguous consensus among huge number of miners, thereby consuming dramatically considerable energy in reaching consensus, which is much larger than both naive Tendermint and our RescueChain. Besides, the proposed consensus scheme is more energy-efficient than the naive Tendermint scheme, especially when the number of validators is very large (i.e., ). The reason is that thanks to the proposed reputation evaluation mechanism, our RescueChain can enjoy a lower average round to reach consensus on a new block than the naive Tendermint scheme, which is also validated in Fig. 13. Thereby, our RescueChain can save more energy for validator UAVs in block transmission and vote verification during the consensus process, resulting in improved energy efficiency.
VI-C Insights for Implementation
In this subsection, we discuss the following key components in the practical implementation of the proposed scheme.
| Link | Description | Protocol | Data | Range | Throughput | ||||
| A2A | UAVUAV |
|
Task data, transactions | <800m | <1.2 GB/s | ||||
| A2G/ G2A | UAVvehicle |
|
|
<800m | <1.2 GB/s | ||||
| UAVECV | LTE cellular |
|
1-3 km | 37.5 MB/s | |||||
| V2E | vehicleECV | LTE cellular |
|
1-3 km | 37.5 MB/s | ||||
| V2V | vehiclevehicle |
|
|
<1 km | 3-27 Mb/s |
1) Selection of communication protocols. In the aerial subnetwork, the Wi-Fi 6 (IEEE 802.11ax) protocol that operates in the unlicensed spectrum can be utilized to transmit the sensory data, task data, and transactions among UAVs due to its high data rate (<1.2 GB/s) and ease of management. In the ground subnetwork, the well-known WAVE (Wireless Access in Vehicular Environments) protocol supported by IEEE 802.11p standard can be available for V2V links among ground rescue vehicles, which utilizes the 5.9 GHz band. Besides, due to the sparse network connections and potential network partitions, if the multi-hop V2V/A2A link is unavailable, the vehicle or UAV can deliver the information in a store-carry-and-forward fashion [27]. For the A2G/G2A links between UAVs and ground vehicles, the Wi-Fi module can be used for the transmission of task data, processing results, blockchain transactions, etc. For the ECVs, they can quickly enter part of disaster areas and establish cellular networks with large coverage (about 1-3 km in LTE) and moderate throughput for UAVs and rescue vehicles for rescue coordination (e.g., collision avoidance and position adjustment). Besides, the UAV can offload its computation task to the ECV in its coverage via the cellular module if there are no available ground vehicles or they do not have sufficient computing resources, as a complement to the VFC paradigm. Table V shows the performance measurements of different communication protocols for A2A, A2G/G2A, vehicle-to-ECV (V2E), and V2V links in UDRNs.
2) Pre-training DQN models in task offloading. In DQN-based task offloading, as seen in Figs. 7–7, it takes a long time for UAVs and vehicles to learn the optimal offloading strategies, especially in a large-scale network involving a large number of participants. In the real implementation, each UAV and vehicle can pre-train its DQN model by exploiting historical experiences (i.e., previous interaction information) learned from similar scenarios, thereby accelerating learning speed and alleviating energy consumption.
3) Selection of blockchain parameters. As shown in Figs. 10–13 and Table IV, the blockchain parameters such as block size, ratio of Byzantine nodes, and number of validators can have a large effect on the performance of our RescueChain in terms of throughput, block latency, average consensus round, and energy consumption. For example, the higher block size results in higher throughput but also higher block latency; an assumption of low ratio of Byzantine nodes leads to low average consensus rounds but sacrifices consensus security; and more validator UAVs indicates better decentralization but yields higher energy consumption. Thereby, a trade-off needs to be achieved in the practical implementation, where appropriate blockchain parameters should be determined depending on specific scenarios. For example, for the scenario with highly sparse network connections, a low block size is preferred to attain a small block propagation latency; for the scenario with highly constrained UAV battery energy, a low number of UAV validators is preferred to achieve low energy consumption; and for the scenario with few malicious nodes, the small ratio of Byzantine nodes is preferred for faster consensus reaching and higher throughput.
4) Cold start issue. Initially, it is assumed that there exist no less than four connected ECVs in the disaster area to facilitate rescue missions. The genesis block of the blockchain can be created by these ECVs via the consensus process, which mainly includes the initial reputation setting for nodes, the role of the CA, block rewards, creation time, and hash of this block.
VII Conclusion and Future Work
Our paper focuses on the fundamental issue of provisioning guaranteed security for data dissemination in UDRNs. We have proposed the RescueChain scheme in disaster sites to address secure data sharing and efficient computation offloading for resource-limited UAVs. Within this scheme, a lightweight blockchain-based framework has been presented under the collaborative aerial-ground network to immutably trace misbehaving entities and safeguard information sharing. Then, we have devised a reputation-based consensus protocol and a VFC-based off-chain mechanism for improved consensus efficiency and robustness in weakly connected UDRNs. To stimulate vehicles’ collaborative behaviors in VFC-based computation offloading for UAVs, we have formulated the interactions between them as a Stackelberg game and derived the SE of the static Stackelberg game. Apart from this, in the dynamic Stackelberg game, a novel two-tier DQN-based algorithm has been devised to intelligently and distributively seek the optimal payment strategies for UAVs (tier 1) and computing resource sharing strategies for vehicles (tier 2), without fully knowing the opponent’s private parameters and time-varying network parameters. At last, simulation results have validated the effectiveness of our RescueChain in terms of enhanced consensus and offloading efficiency, reduced task latency and UAVs’ energy consumption, and improved payoffs of participants.
For future work, we plan to investigate: 1) the cooperation mechanism among a swarm of UAVs for collaborative sensing, trajectory scheduling, and resource sharing in UDRNs; 2) the coordination of satellites in various earth orbits, UAV swarms, and ground equipments to construct efficient space-air-ground disaster rescue networks; and 3) the vehicle-assisted mobile charging mechanism for efficient UAV battery recharging by equipping wireless energy transfer (WPT) pads on vehicular roofs.
Appendix A proof of theorem
Proof:
Note that when , it means that vehicle will not participate in the offloading process of task for UAV . Consequently, the corresponding payment of UAV to vehicle is zero. As such, and . Here, we only consider the case . The first order differential of vehicle ’s payoff function with respect to is . The second order differential for with respect to is , which indicates that the function is monotonically decreasing. The following two cases are considered.
Case : High payment. If the payment of UAV for task is high, i.e., , we have . As such, is a monotonic increasing function. Then, the optimal AoCR strategy of vehicle is .
Case : Low payment. If the payment of UAV for task is low, i.e., , we have . As such, the utility function of vehicle is strict convex, and vehicle ’s optimal AoCR strategy can be obtained by solving , i.e., . Theorem 4 is proved. ∎
Appendix B proof of theorem
Proof:
If , by substituting into , the utility function of UAV can be rewritten as . As the above function is monotonically decreasing with respect to , UAV ’s optimal payment strategy can be attained as .
If , by substituting into , UAV ’s payoff function can be rewritten as:
The first order differential of UAV ’s payoff with respect to is . The second order differential of UAV ’s payoff satisfies . It implies that UAV ’s payoff function is strictly convex, and the maximum value can be derived by solving with KKT conditions. The optimal payment strategy can be obtained as shown in Eq. (V-B). Theorem 5 is proved. ∎
References
- [1] Y. Wang, Z. Su, Q. Xu, R. Li, and T. H. Luan, “Lifesaving with RescueChain: Energy-efficient and partition-tolerant blockchain based secure information sharing for UAV-aided disaster rescue,” in IEEE INFOCOM 2021, Vancouver, Canada, May 2021.
- [2] M. Stute, F. Kohnhäuser, L. Baumgärtner, L. Almon, M. Hollick, S. Katzenbeisser, and B. Freisleben, “Rescue: A resilient and secure device-to-device communication framework for emergencies,” IEEE Transactions on Dependable and Secure Computing, vol. 19, no. 3, pp. 1722–1734, 2022.
- [3] Y. Wang, W. Chen, T. H. Luan, Z. Su, Q. Xu, R. Li, and N. Chen, “Task offloading for post-disaster rescue in unmanned aerial vehicles networks,” IEEE/ACM Transactions on Networking, vol. 30, no. 4, pp. 1525–1539, 2022.
- [4] Z. Su, Y. Wang, Q. Xu, and N. Zhang, “LVBS: lightweight vehicular blockchain for secure data sharing in disaster rescue,” IEEE Transactions on Dependable and Secure Computing, vol. 19, no. 1, pp. 19–32, 2022.
- [5] C. Luo, M. N. Satpute, D. Li, Y. Wang, W. Chen, and W. Wu, “Fine-grained trajectory optimization of multiple UAVs for efficient data gathering from WSNs,” IEEE/ACM Transactions on Networking, vol. 29, no. 1, pp. 162–175, 2021.
- [6] X. Liu, Z. Li, N. Zhao, W. Meng, G. Gui, Y. Chen, and F. Adachi, “Transceiver design and multihop D2D for UAV IoT coverage in disasters,” IEEE Internet of Things Journal, vol. 6, no. 2, pp. 1803–1815, April 2019.
- [7] X. Zhong, Y. Guo, N. Li, and Y. Chen, “Joint optimization of relay deployment, channel allocation, and relay assignment for UAVs-aided D2D networks,” IEEE/ACM Transactions on Networking, vol. 28, no. 2, pp. 804–817, 2020.
- [8] Y. Wang, Z. Su, N. Zhang, and D. Fang, “Disaster relief wireless networks: Challenges and solutions,” IEEE Wireless Communications, vol. 28, no. 5, pp. 148–155, 2021.
- [9] S. Zhang and J. Liu, “Analysis and optimization of multiple unmanned aerial vehicle-assisted communications in post-disaster areas,” IEEE Transactions on Vehicular Technology, vol. 67, no. 12, pp. 12 049–12 060, 2018.
- [10] M. Erdelj, E. Natalizio, K. R. Chowdhury, and I. F. Akyildiz, “Help from the sky: Leveraging UAVs for disaster management,” IEEE Pervasive Computing, vol. 16, no. 1, pp. 24–32, 2017.
- [11] W. Chen, Z. Su, Q. Xu, T. H. Luan, and R. Li, “VFC-based cooperative UAV computation task offloading for post-disaster rescue,” in IEEE INFOCOM 2020, 2020, pp. 228–236.
- [12] M. Erdelj, M. Krl, and E. Natalizio, “Wireless sensor networks and multi-UAV systems for natural disaster management,” Computer Networks, vol. 124, no. C, p. 72–86, Sep. 2017.
- [13] Y. Wang, Z. Su, J. Ni, N. Zhang, and X. Shen, “Blockchain-empowered space-air-ground integrated networks: Opportunities, challenges, and solutions,” IEEE Communications Surveys & Tutorials, vol. 24, no. 1, pp. 160–209, 2022.
- [14] S. Wu, Y. Chen, M. Li, X. Luo, Z. Liu, and L. Liu, “Survive and thrive: A stochastic game for DDoS attacks in Bitcoin mining pools,” IEEE/ACM Transactions on Networking, vol. 28, no. 2, pp. 874–887, 2020.
- [15] Y. Wang, H. Peng, Z. Su, T. H. Luan, A. Benslimane, and Y. Wu, “A platform-free proof of federated learning consensus mechanism for sustainable blockchains,” IEEE Journal on Selected Areas in Communications, 2022, doi:10.1109/JSAC.2022.3213347.
- [16] A. Islam and S. Y. Shin, “BUAV: A blockchain based secure UAV-assisted data acquisition scheme in internet of things,” Journal of Communications and Networks, vol. 21, no. 5, pp. 491–502, 2019.
- [17] X. Li, Y. Wang, P. Vijayakumar, D. He, N. Kumar, and J. Ma, “Blockchain-based mutual-healing group key distribution scheme in unmanned aerial vehicles ad-hoc network,” IEEE Transactions on Vehicular Technology, vol. 68, no. 11, pp. 11 309–11 322, 2019.
- [18] T. Bai, J. Wang, Y. Ren, and L. Hanzo, “Energy-efficient computation offloading for secure UAV-edge-computing systems,” IEEE Transactions on Vehicular Technology, vol. 68, no. 6, pp. 6074–6087, 2019.
- [19] M. Messous, S. Senouci, H. Sedjelmaci, and S. Cherkaoui, “A game theory based efficient computation offloading in an UAV network,” IEEE Transactions on Vehicular Technology, vol. 68, no. 5, pp. 4964–4974, 2019.
- [20] B. Liu, W. Zhang, W. Chen, H. Huang, and S. Guo, “Online computation offloading and traffic routing for UAV swarms in edge-cloud computing,” IEEE Transactions on Vehicular Technology, vol. 69, pp. 8777–8791, 2020.
- [21] W. Liang, M. Tang, J. Long, X. Peng, J. Xu, and K. Li, “A secure fabric blockchain-based data transmission technique for industrial internet-of-things,” IEEE Transactions on Industrial Informatics, vol. 15, no. 6, pp. 3582–3592, 2019.
- [22] W. Chen, Y. Chen, X. Chen, and Z. Zheng, “Toward secure data sharing for the IoV: A quality-driven incentive mechanism with on-chain and off-chain guarantees,” IEEE Internet of Things Journal, vol. 7, pp. 1625–1640, 2020.
- [23] X. Jiang, F. R. Yu, T. Song, Z. Ma, Y. Song, and D. Zhu, “Blockchain-enabled cross-domain object detection for autonomous driving: A model sharing approach,” IEEE Internet of Things Journal, vol. 7, no. 5, pp. 3681–3692, 2020.
- [24] Q. Kong, L. Su, and M. Ma, “Achieving privacy-preserving and verifiable data sharing in vehicular fog with blockchain,” IEEE Transactions on Intelligent Transportation Systems, pp. 1–10, 2020.
- [25] D. Callegaro and M. Levorato, “Optimal computation offloading in edge-assisted UAV systems,” in IEEE GLOBECOM 2018, 2018, pp. 1–6.
- [26] W. Chen, B. Liu, H. Huang, S. Guo, and Z. Zheng, “When UAV swarm meets edge-cloud computing: The QoS perspective,” IEEE Network, vol. 33, no. 2, pp. 36–43, 2019.
- [27] Y. Zhou, N. Cheng, N. Lu, and X. S. Shen, “Multi-UAV-aided networks: Aerial-ground cooperative vehicular networking architecture,” IEEE Vehicular Technology Magazine, vol. 10, no. 4, pp. 36–44, 2015.
- [28] F. Zhou, Y. Wu, R. Q. Hu, and Y. Qian, “Computation rate maximization in UAV-enabled wireless-powered mobile-edge computing systems,” IEEE Journal on Selected Areas in Communications, vol. 36, no. 9, pp. 1927–1941, 2018.
- [29] S. Jeong, O. Simeone, and J. Kang, “Mobile edge computing via a UAV-mounted cloudlet: Optimization of bit allocation and path planning,” IEEE Transactions on Vehicular Technology, vol. 67, no. 3, pp. 2049–2063, 2018.
- [30] Y. Zeng and R. Zhang, “Energy-efficient UAV communication with trajectory optimization,” IEEE Transactions on Wireless Communications, vol. 16, no. 6, pp. 3747–3760, 2017.
- [31] C. Zhan and Y. Zeng, “Energy-efficient data uploading for cellular-connected UAV systems,” IEEE Transactions on Wireless Communications, vol. 19, no. 11, pp. 7279–7292, 2020.
- [32] H. Zhou, B. Liu, F. Hou, T. H. Luan, N. Zhang, L. Gui, Q. Yu, and X. S. Shen, “Spatial coordinated medium sharing: Optimal access control management in drive-thru Internet,” IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 5, pp. 2673–2686, 2015.
- [33] Z. Yu, Y. Gong, S. Gong, and Y. Guo, “Joint task offloading and resource allocation in UAV-enabled mobile edge computing,” IEEE Internet of Things Journal, vol. 7, no. 4, pp. 3147–3159, 2020.
- [34] H. Guo and J. Liu, “UAV-enhanced intelligent offloading for internet of things at the edge,” IEEE Transactions on Industrial Informatics, vol. 16, no. 4, pp. 2737–2746, 2020.
- [35] R. Alkadi, N. Alnuaimi, C. Y. Yeun, and A. Shoufan, “Blockchain interoperability in unmanned aerial vehicles networks: State-of-the-art and open issues,” IEEE Access, vol. 10, pp. 14 463–14 479, 2022.
- [36] D. Boneh, B. Lynn, and H. Shacham, “Short signatures from the weil pairing,” in Advances in Cryptology–ASIACRYPT 2001, 2001, pp. 514–532.
- [37] J. Benet, “IPFS - content addressed, versioned, P2P file system,” CoRR, vol. abs/1407.3561, 2014. [Online]. Available: http://arxiv.org/abs/1407.3561
- [38] J. Kwon, “Tendermint: Consensus without mining,” 2014. [Online]. Available: https://tendermint.com/static/docs/tendermint.pdf
- [39] C. Dwork, N. Lynch, and L. Stockmeyer, “Consensus in the presence of partial synchrony,” Journal of the ACM, vol. 35, no. 2, pp. 288–323, 1988.
- [40] E. Buchman, “Tendermint: Byzantine fault tolerance in the age of blockchains,” 2016. [Online]. Available: https://allquantor.at/blockchainbib/pdf/buchman2016tendermint.pdf
- [41] K. Cai, H. Xie, and J. C. S. Lui, “Information spreading forensics via sequential dependent snapshots,” IEEE/ACM Transactions on Networking, vol. 26, no. 1, pp. 478–491, 2018.
- [42] A. Castiglione, G. Cattaneo, G. De Maio, A. De Santis, and G. Roscigno, “A novel methodology to acquire live big data evidence from the cloud,” IEEE Transactions on Big Data, vol. 5, no. 4, pp. 425–438, 2019.
- [43] X. Li, M. Wang, H. Wang, Y. Yu, and C. Qian, “Toward secure and efficient communication for the internet of things,” IEEE/ACM Transactions on Networking, vol. 27, no. 2, pp. 621–634, 2019.
- [44] H. Cui, R. H. Deng, and G. Wang, “An attribute-based framework for secure communications in vehicular ad hoc networks,” IEEE/ACM Transactions on Networking, vol. 27, no. 2, pp. 721–733, 2019.
- [45] H. Wu, L. Wang, G. Xue, J. Tang, and D. Yang, “Enabling data trustworthiness and user privacy in mobile crowdsensing,” IEEE/ACM Transactions on Networking, vol. 27, no. 6, pp. 2294–2307, 2019.
- [46] K. Wang, F. C. M. Lau, L. Chen, and R. Schober, “Pricing mobile data offloading: A distributed market framework,” IEEE Transactions on Wireless Communications, vol. 15, no. 2, pp. 913–927, 2016.
- [47] L. Wu, “A tighter piecewise linear approximation of quadratic cost curves for unit commitment problems,” IEEE Transactions on Power Systems, vol. 26, no. 4, pp. 2581–2583, Nov 2011.
- [48] L. Xiao, Y. Li, G. Han, H. Dai, and H. V. Poor, “A secure mobile crowdsensing game with deep reinforcement learning,” IEEE Transactions on Information Forensics and Security, vol. 13, no. 1, pp. 35–47, 2018.
- [49] V. Mnih, K. Kavukcuoglu, D. Silver, and et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, pp. 529–533, 2015.
- [50] C. J. C. H. Watkins and P. Dayan, “Technical note: Q-learning,” Machine Learning, vol. 8, pp. 279–292, 1992.
- [51] L. Xiao, D. Xu, N. B. Mandayam, and H. V. Poor, “Attacker-centric view of a detection game against advanced persistent threats,” IEEE Transactions on Mobile Computing, vol. 17, no. 11, pp. 2512–2523, 2018.
- [52] (2020) Tendermint core consensus engine. [Online]. Available: https://github.com/tendermint/tendermint
- [53] Accessed: June. 11, 2022. [Online]. Available: https://bitnodes.io/
- [54] Accessed: June. 11, 2022. [Online]. Available: https://ethernodes.org/
| Yuntao Wang received the Ph.D degree in Cyberspace Security from Xi’an Jiaotong University, Xi’an, China, in 2022. His research interests include security and privacy in IoT, network games, edge intelligence, and blockchain. |
| Zhou Su has published technical papers, including top journals and top conferences, such as IEEE Journal On Selected Areas In Communications, IEEE Transactions On Information Forensics And Security, IEEE Transactions On Dependable And Secure Computing, IEEE Transactions On Mobile Computing, IEEE/ACM Transactions On Networking, and INFOCOM. His research interests include multimedia communication, wireless communication, and network traffic. Dr. Su received the Best Paper Award of International Conference IEEE ICC2020, IEEE BigdataSE2019, and IEEE CyberSciTech2017. He is an Associate Editor of IEEE Internet Of Things Journal, IEEE Open Journal Of Computer Society, and IET Communications. |
| Qichao Xu received the Ph.D. degree from the School of Mechatronic Engineering and Automation, Shanghai University, Shanghai, China, in 2019. He is currently an Assistant Professor with Shanghai University. His research interests include wireless network architecture and vehicular networks. |
| Ruidong Li received the D.Eng. degree from the University of Tsukuba in 2008. He is currently an Associate Professor with the College of Science and Engineering, Kanazawa University, Japan. His current research interests include future networks, big data networking, blockchain, the Internet of Things, and network security. He is the Secretary of IEEE ComSoC Internet Technical Committee and the Founder and Chair of the IEEE SIG on big data intelligent networking and IEEE SIG on intelligent Internet edge. He is a guest editor of prestigious journals, such as IEEE Communications Magazine, IEEE Network Magazine, and IEEE Transactions on Network Science and Engineering. |
| Tom H. Luan received the Ph.D. degree from the University of Waterloo, Canada, in 2012. He is currently a Professor with the School of Cyber Science and Engineering, Xi’an Jiaotong University, China. He has authored/coauthored more than 90 journal articles and 30 technical articles in conference proceedings. His research mainly focuses on content distribution and media streaming in vehicular ad hoc networks and peer-to-peer networking and the protocol design and performance evaluation of wireless cloud computing and edge computing. He served as a TPC Member for IEEE Globecom, ICC, and PIMRC. |
| Pinghui Wang received the BS and PhD degrees in information engineering from Xi’an Jiaotong University, Xi’an, China, in 2006 and 2012, respectively. He is currently a professor with the MOE Key Laboratory for Intelligent Networks and Network Security, Xi’an Jiaotong University, China. His research interests include Internet traffic measurement and modeling, traffic classification, abnormal detection, and online social network measurement. |