title: Evaluating Music Recommendations with Binary Feedback for Multiple Stakeholders

abstract: High quality user feedback data is essential to training and evaluating a successful music recommendation system, particularly one that has to balance the needs of multiple stakeholders. Most existing music datasets suffer from noisy feedback and self-selection biases inherent in the data collected by music platforms. Using the Piki Music dataset of 500k ratings collected over a two-year time period, we evaluate the performance of classic recommendation algorithms on three important stakeholders: consumers, well-known artists and lesser-known artists. We show that a matrix factorization algorithm trained on both likes and dislikes performs significantly better compared to one trained only on likes for all three stakeholders.


title: High order harmonic generation in semiconductors driven at near- and mid-IR wavelengths

abstract: We study high order harmonics generation (HHG) in crystalline silicon and diamond subjected to near and mid-infrared laser pulses. We employ time-dependent density functional theory and solve the time-dependent Kohn-Sham equation in the single-cell geometry. We demonstrate that clear and clean HHG spectra can be generated with careful selection of the pulse duration. In addition, we simulate dephasing effects in a large silicon super-cell through displacement of atomic positions prepared by a molecular dynamics simulation. We compare our results with the previous calculations by Floss et al. [arXiv:1705.10707] [Phys. Rev. A 97, 011401(R) (2018)] on Diamond at 800 nm and by Tancogne-Dejean et al. [arXiv:1609.09298] [Phys. Rev. Lett. 118, 087403 (2017)] on Si at 3000 nm.


title: A kilonova from an ultra-quick merger of a neutron star binary

abstract: GRB 060505 was the first well-known nearby (at redshift 0.089) "hybrid" gamma-ray burst that has a duration longer than 2 seconds but without the association of a supernova down to very stringent limits. The prompt $\gamma-$ray flash lasting $\sim 4$ sec could consist of an intrinsic short burst and its tail emission, but the sizable temporal lag ($\sim 0.35$ sec) as well as the environment properties led to the widely-accepted classification of a long duration gamma-ray burst originated from the collapse of a massive star. Here for the $ first$ time we report the convincing evidence for a thermal-like optical radiation component in the spectral energy distribution of the early afterglow emission. In comparison to AT2017gfo, the thermal radiation is $\sim 2$ times brighter and the temperature is comparable at similar epochs. The optical decline is much quicker than that in X-rays, which is also at odds with the fireball afterglow model but quite natural for the presence of a blue kilonova. Our finding reveals a neutron star merger origin of the hybrid GRB 060505 and strongly supports the theoretical speculation that some binary neutron stars can merge ultra-quickly (within $\sim 1$ Myr) after their formation when the surrounding region is still highly star-forming and the metallicity remains low. Gravitational wave and electromagnetic jointed observations are expected to confirm such scenarios in the near future.


title: Enigmatic Nebulous Companions to the Great September Comet of 1882 As SOHO-Like Kreutz Sungrazers Caught in Terminal Outburst

abstract: I investigate the nature of the transient nebulous companions to the sungrazing comet C/1882 R1, known as the Great September Comet. The features were located several degrees to the southwest of the comet's head and reported independently by four observers, including J. F. J. Schmidt and E. E. Barnard, over a period of ten days nearly one month after perihelion, when the comet was 0.7 AU to 1 AU from the Sun. I conclude that none of the nebulous companions was ever sighted more than once and that, contrary to his belief, Schmidt observed unrelated objects on the four consecutive mornings. Each nebulous companion is proposed to have been triggered by a fragment at most a few tens of meters across, released from the comet's nucleus after perihelion and seen only because it happened to be caught in the brief terminal outburst, when its mass was suddenly shattered into a cloud of mostly microscopic debris due possibly to rotational bursting triggered by sublimation torques. The fragment's motion was affected by a strong outgassing-driven nongravitational acceleration with a significant out-of-plane component. Although fragmentation events were common, only a small fraction of nebulous companions was detected because of their transient nature. The observed brightness of the nebulous companions is proposed to have been due mainly to C2 emissions, with a contribution from scattering of sunlight by the microscopic dust. By their nature, the fragments responsible for the nebulous companions bear a strong resemblance to the dwarf Kreutz sungrazers detected with the coronagraphs aboard the SOHO space probe. Only their fragmentation histories are different and the latter display no terminal outburst, a consequence of extremely short lifetimes of the sublimating icy and refractory material in the Sun's corona.


title: Spectroscopic Confirmation of a Protocluster at $z=3.37$ with a High Fraction of Quiescent Galaxies

abstract: We report the discovery of MAGAZ3NE J095924+022537, a spectroscopically-confirmed protocluster at $z = 3.3665^{+0.0009}_{-0.0012}$ around a spectroscopically-confirmed $UVJ$-quiescent ultra-massive galaxy (UMG; $M_{\star}=2.34^{+0.23}_{-0.34}\times10^{11} {\rm M}_\odot$) in the COSMOS UltraVISTA field. We present a total of 38 protocluster members (14 spectroscopic and 24 photometric), including the UMG. Notably, and in marked contrast to protoclusters previously reported at this epoch which have been found to contain predominantly star-forming members, we measure an elevated fraction of quiescent galaxies relative to the coeval field ($73.3^{+26.7}_{-16.9}\%$ versus $11.6^{+7.1}_{-4.9}\%$ for galaxies with stellar mass $M_{\star} \geq 10^{11} {\rm M}_\odot$). This high quenched fraction provides a striking and important counterexample to the seeming ubiquitousness of star-forming galaxies in protoclusters at $z>2$ and suggests, rather, that protoclusters exist in a diversity of evolutionary states in the early Universe. We discuss the possibility that we might be observing either "early mass quenching" or non-classical "environmental quenching." We also present the discovery of MAGAZ3NE J100028+023349, a second spectroscopically-confirmed protocluster, at a very similar redshift of $z = 3.3801^{+0.0213}_{-0.0281}$. We present a total of 20 protocluster members, 12 of which are photometric and 8 spectroscopic including a post-starburst UMG ($M_{\star}=2.95^{+0.21}_{-0.20}\times10^{11} {\rm M}_\odot$). Protoclusters MAGAZ3NE J0959 and MAGAZ3NE J1000 are separated by 18 arcminutes on the sky (35 comoving Mpc), in good agreement with predictions from simulations for the size of "Coma"-type cluster progenitors at this epoch. It is highly likely that the two UMGs are the progenitors of Brightest Cluster Galaxies (BCGs) seen in massive virialized clusters at lower redshift.


title: Second-order perturbative correlation energy functional in the ensemble density-functional theory

abstract: We derive the second-order approximation (PT2) to the ensemble correlation energy functional by applying the G\"{o}rling-Levy perturbation theory on the ensemble density-functional theory (EDFT). Its performance is checked by calculating excitation energies with the direct ensemble correction method in 1D model systems and 3D atoms using numerically exact Kohn-Sham orbitals and potentials. Comparing with the exchange-only approximation, the inclusion of the ensemble PT2 correlation improves the excitation energies in 1D model systems in most cases, including double excitations and charge-transfer excitations. However, the excitation energies for atoms are generally worse with PT2. We find that the failure of PT2 in atoms is due to the two contributions of an orbital-dependent functional to excitation energies being inconsistent in the calculations. We also analyze the convergence of PT2 excitation energies with respect to the number of unoccupied orbitals.


title: Handling Noise in Search-Based Scenario Generation for Autonomous Driving Systems

abstract: This paper presents the first evaluation of k-nearest neighbours-Averaging (kNN-Avg) on a real-world case study. kNN-Avg is a novel technique that tackles the challenges of noisy multi-objective optimisation (MOO). Existing studies suggest the use of repetition to overcome noise. In contrast, kNN-Avg approximates these repetitions and exploits previous executions, thereby avoiding the cost of re-running. We use kNN-Avg for the scenario generation of a real-world autonomous driving system (ADS) and show that it is better than the noisy baseline. Furthermore, we compare it to the repetition-method and outline indicators as to which approach to choose in which situations.


title: Multi-Dimensional Data Compression and Query Processing in Array Databases

abstract: In recent times, the production of multidimensional data in various domains and their storage in array databases has witnessed a sharp increase; this rapid growth in data volumes necessitates compression in array databases. However, existing compression schemes used in array databases are general-purpose and not designed specifically for the databases. They could degrade query performance with complex analytical tasks, which incur huge computing costs. Thus, a compression scheme that considers the workflow of array databases is required. This study presents a compression scheme, SEACOW, for storing and querying multidimensional array data. The scheme is specially designed to be efficient for both dimension-based and value-based exploration. It considers data access patterns for exploration queries and embeds a synopsis, which can be utilized as an index, in the compressed array. In addition, we implement an array storage system, namely MSDB, to perform experiments. We evaluate query performance on real scientific datasets and compared it with those of existing compression schemes. Finally, our experiments demonstrate that SEACOW provides high compression rates compared to existing compression schemes, and the synopsis improves analytical query processing performance.


title: Comment on "Maximum force and cosmic censorship"

abstract: Despite suggestions to the contrary, no counterargument to the principle of maximum force or to the equivalent principle of maximum power has yet been provided.


title: SPIN Road Mapper: Extracting Roads from Aerial Images via Spatial and Interaction Space Graph Reasoning for Autonomous Driving

abstract: Road extraction is an essential step in building autonomous navigation systems. Detecting road segments is challenging as they are of varying widths, bifurcated throughout the image, and are often occluded by terrain, cloud, or other weather conditions. Using just convolution neural networks (ConvNets) for this problem is not effective as it is inefficient at capturing distant dependencies between road segments in the image which is essential to extract road connectivity. To this end, we propose a Spatial and Interaction Space Graph Reasoning (SPIN) module which when plugged into a ConvNet performs reasoning over graphs constructed on spatial and interaction spaces projected from the feature maps. Reasoning over spatial space extracts dependencies between different spatial regions and other contextual information. Reasoning over a projected interaction space helps in appropriate delineation of roads from other topographies present in the image. Thus, SPIN extracts long-range dependencies between road segments and effectively delineates roads from other semantics. We also introduce a SPIN pyramid which performs SPIN graph reasoning across multiple scales to extract multi-scale features. We propose a network based on stacked hourglass modules and SPIN pyramid for road segmentation which achieves better performance compared to existing methods. Moreover, our method is computationally efficient and significantly boosts the convergence speed during training, making it feasible for applying on large-scale high-resolution aerial images. Code available at: https://github.com/wgcban/SPIN_RoadMapper.git.


title: A Multi-Task Cross-Task Learning Architecture for Ad-hoc Uncertainty Estimation in 3D Cardiac MRI Image Segmentation

abstract: Medical image segmentation has significantly benefitted thanks to deep learning architectures. Furthermore, semi-supervised learning (SSL) has recently been a growing trend for improving a model's overall performance by leveraging abundant unlabeled data. Moreover, learning multiple tasks within the same model further improves model generalizability. To generate smoother and accurate segmentation masks from 3D cardiac MR images, we present a Multi-task Cross-task learning consistency approach to enforce the correlation between the pixel-level (segmentation) and the geometric-level (distance map) tasks. Our extensive experimentation with varied quantities of labeled data in the training sets justifies the effectiveness of our model for the segmentation of the left atrial cavity from Gadolinium-enhanced magnetic resonance (GE-MR) images. With the incorporation of uncertainty estimates to detect failures in the segmentation masks generated by CNNs, our study further showcases the potential of our model to flag low-quality segmentation from a given model.


title: ROS-X-Habitat: Bridging the ROS Ecosystem with Embodied AI

abstract: We introduce ROS-X-Habitat, a software interface that bridges the AI Habitat platform for embodied learning-based agents with other robotics resources via ROS. This interface not only offers standardized communication protocols between embodied agents and simulators, but also enables physically and photorealistic simulation that benefits the training and/or testing of vision-based embodied agents. With this interface, roboticists can evaluate their own Habitat RL agents in another ROS-based simulator or use Habitat Sim v2 as the test bed for their own robotic algorithms. Through in silico experiments, we demonstrate that ROS-X-Habitat has minimal impact on the navigation performance and simulation speed of a Habitat RGBD agent; that a standard set of ROS mapping, planning and navigation tools can run in Habitat Sim v2; and that a Habitat agent can run in the standard ROS simulator Gazebo.


title: Federated Submodel Optimization for Hot and Cold Data Features

abstract: We study practical data characteristics underlying federated learning, where non-i.i.d. data from clients have sparse features, and a certain client's local data normally involves only a small part of the full model, called a submodel. Due to data sparsity, the classical federated averaging (FedAvg) algorithm or its variants will be severely slowed down, because when updating the global model, each client's zero update of the full model excluding its submodel is inaccurately aggregated. Therefore, we propose federated submodel averaging (FedSubAvg), ensuring that the expectation of the global update of each model parameter is equal to the average of the local updates of the clients who involve it. We theoretically proved the convergence rate of FedSubAvg by deriving an upper bound under a new metric called the element-wise gradient norm. In particular, this new metric can characterize the convergence of federated optimization over sparse data, while the conventional metric of squared gradient norm used in FedAvg and its variants cannot. We extensively evaluated FedSubAvg over both public and industrial datasets. The evaluation results demonstrate that FedSubAvg significantly outperforms FedAvg and its variants.


title: Mixed Control for Whole-Body Compliance of a Humanoid Robot

abstract: The hierarchical quadratic programming (HQP) is commonly applied to consider strict hierarchies of multi-tasks and robot's physical inequality constraints during whole-body compliance. However, for the one-step HQP, the solution can oscillate when it is close to the boundary of constraints. It is because the abrupt hit of the bounds gives rise to unrealisable jerks and even infeasible solutions. This paper proposes the mixed control, which blends the single-axis model predictive control (MPC) and proportional derivate (PD) control for the whole-body compliance to overcome these deficiencies. The MPC predicts the distances between the bounds and the control target of the critical tasks, and it provides smooth and feasible solutions by prediction and optimisation in advance. However, applying MPC will inevitably increase the computation time. Therefore, to achieve a 500 Hz servo rate, the PD controllers still regulate other tasks to save computation resources. Also, we use a more efficient null space projection (NSP) whole-body controller instead of the HQP and distribute the single-axis MPCs into four CPU cores for parallel computation. Finally, we validate the desired capabilities of the proposed strategy via Simulations and the experiment on the humanoid robot Walker X.


title: Basil: A Fast and Byzantine-Resilient Approach for Decentralized Training

abstract: Detection and mitigation of Byzantine behaviors in a decentralized learning setting is a daunting task, especially when the data distribution at the users is heterogeneous. As our main contribution, we propose Basil, a fast and computationally efficient Byzantine robust algorithm for decentralized training systems, which leverages a novel sequential, memory assisted and performance-based criteria for training over a logical ring while filtering the Byzantine users. In the IID dataset distribution setting, we provide the theoretical convergence guarantees of Basil, demonstrating its linear convergence rate. Furthermore, for the IID setting, we experimentally demonstrate that Basil is robust to various Byzantine attacks, including the strong Hidden attack, while providing up to ${\sim}16 \%$ higher test accuracy over the state-of-the-art Byzantine-resilient decentralized learning approach. Additionally, we generalize Basil to the non-IID dataset distribution setting by proposing Anonymous Cyclic Data Sharing (ACDS), a technique that allows each node to anonymously share a random fraction of its local non-sensitive dataset (e.g., landmarks images) with all other nodes. We demonstrate that Basil alongside ACDS with only $5\%$ data sharing provides effective toleration of Byzantine nodes, unlike the state-of-the-art Byzantine robust algorithm that completely fails in the heterogeneous data setting. Finally, to reduce the overall latency of Basil resulting from its sequential implementation over the logical ring, we propose Basil+. In particular, Basil+ provides scalability by enabling Byzantine-robust parallel training across groups of logical rings, and at the same time, it retains the performance gains of Basil due to sequential training within each group. Furthermore, we experimentally demonstrate the scalability gains of Basil+ through different sets of experiments.


title: Dense Pruning of Pointwise Convolutions in the Frequency Domain

abstract: Depthwise separable convolutions and frequency-domain convolutions are two recent ideas for building efficient convolutional neural networks. They are seemingly incompatible: the vast majority of operations in depthwise separable CNNs are in pointwise convolutional layers, but pointwise layers use 1x1 kernels, which do not benefit from frequency transformation. This paper unifies these two ideas by transforming the activations, not the kernels. Our key insights are that 1) pointwise convolutions commute with frequency transformation and thus can be computed in the frequency domain without modification, 2) each channel within a given layer has a different level of sensitivity to frequency domain pruning, and 3) each channel's sensitivity to frequency pruning is approximately monotonic with respect to frequency. We leverage this knowledge by proposing a new technique which wraps each pointwise layer in a discrete cosine transform (DCT) which is truncated to selectively prune coefficients above a given threshold as per the needs of each channel. To learn which frequencies should be pruned from which channels, we introduce a novel learned parameter which specifies each channel's pruning threshold. We add a new regularization term which incentivizes the model to decrease the number of retained frequencies while still maintaining task accuracy. Unlike weight pruning techniques which rely on sparse operators, our contiguous frequency band pruning results in fully dense computation. We apply our technique to MobileNetV2 and in the process reduce computation time by 22% and incur <1% accuracy degradation.


title: Compressed Oblivious Encoding for Homomorphically Encrypted Search

abstract: Fully homomorphic encryption (FHE) enables a simple, attractive framework for secure search. Compared to other secure search systems, no costly setup procedure is necessary; it is sufficient for the client merely to upload the encrypted database to the server. Confidentiality is provided because the server works only on the encrypted query and records. While the search functionality is enabled by the full homomorphism of the encryption scheme. For this reason, researchers have been paying increasing attention to this problem. Since Akavia et al. (CCS 2018) presented a framework for secure search on FHE encrypted data and gave a working implementation called SPiRiT, several more efficient realizations have been proposed. In this paper, we identify the main bottlenecks of this framework and show how to significantly improve the performance of FHE-base secure search. In particular, 1. To retrieve $\ell$ matching items, the existing framework needs to repeat the protocol $\ell$ times sequentially. In our new framework, all matching items are retrieved in parallel in a single protocol execution. 2. The most recent work by Wren et al. (CCS 2020) requires $O(n)$ multiplications to compute the first matching index. Our solution requires no homomorphic multiplication, instead using only additions and scalar multiplications to encode all matching indices. 3. Our implementation and experiments show that to fetch 16 matching records, our system gives an 1800X speed-up over the state of the art in fetching the query results resulting in a 26X speed-up for the full search functionality.


title: Dynamical quantum phase transitions in the one-dimensional extended Fermi-Hubbard model

abstract: We study the emergence of dynamical quantum phase transitions (DQPTs) in a half-filled one-dimensional lattice described by the extended Fermi-Hubbard model, based on tensor network simulations. Considering different initial states, namely noninteracting, metallic, insulating spin and charge density waves, we identify several types of sudden interaction quenches which lead to DQPTs. Furthermore, clear connections to particular properties of observables, specifically the mean double occupation or charge imbalance, are established in two main regimes, and scenarios in which such correspondence is degraded and lost are discussed. Dynamical transitions resulting solely from high-frequency time-periodic modulation are also found, which are well described by a Floquet effective Hamiltonian. State-of-the-art cold-atom quantum simulators constitute ideal platforms to implement several reported DQPTs experimentally.


title: Exploiting Activation based Gradient Output Sparsity to Accelerate Backpropagation in CNNs

abstract: Machine/deep-learning (ML/DL) based techniques are emerging as a driving force behind many cutting-edge technologies, achieving high accuracy on computer vision workloads such as image classification and object detection. However, training these models involving large parameters is both time-consuming and energy-hogging. In this regard, several prior works have advocated for sparsity to speed up the of DL training and more so, the inference phase. This work begins with the observation that during training, sparsity in the forward and backward passes are correlated. In that context, we investigate two types of sparsity (input and output type) inherent in gradient descent-based optimization algorithms and propose a hardware micro-architecture to leverage the same. Our experimental results use five state-of-the-art CNN models on the Imagenet dataset, and show back propagation speedups in the range of 1.69$\times$ to 5.43$\times$, compared to the dense baseline execution. By exploiting sparsity in both the forward and backward passes, speedup improvements range from 1.68$\times$ to 3.30$\times$ over the sparsity-agnostic baseline execution. Our work also achieves significant reduction in training iteration time over several previously proposed dense as well as sparse accelerator based platforms, in addition to achieving order of magnitude energy efficiency improvements over GPU based execution.


title: DeepMTS: Deep Multi-task Learning for Survival Prediction in Patients with Advanced Nasopharyngeal Carcinoma using Pretreatment PET/CT

abstract: Nasopharyngeal Carcinoma (NPC) is a malignant epithelial cancer arising from the nasopharynx. Survival prediction is a major concern for NPC patients, as it provides early prognostic information to plan treatments. Recently, deep survival models based on deep learning have demonstrated the potential to outperform traditional radiomics-based survival prediction models. Deep survival models usually use image patches covering the whole target regions (e.g., nasopharynx for NPC) or containing only segmented tumor regions as the input. However, the models using the whole target regions will also include non-relevant background information, while the models using segmented tumor regions will disregard potentially prognostic information existing out of primary tumors (e.g., local lymph node metastasis and adjacent tissue invasion). In this study, we propose a 3D end-to-end Deep Multi-Task Survival model (DeepMTS) for joint survival prediction and tumor segmentation in advanced NPC from pretreatment PET/CT. Our novelty is the introduction of a hard-sharing segmentation backbone to guide the extraction of local features related to the primary tumors, which reduces the interference from non-relevant background information. In addition, we also introduce a cascaded survival network to capture the prognostic information existing out of primary tumors and further leverage the global tumor information (e.g., tumor size, shape, and locations) derived from the segmentation backbone. Our experiments with two clinical datasets demonstrate that our DeepMTS can consistently outperform traditional radiomics-based survival prediction models and existing deep survival models.


title: Reconstructing a potential perturbation of the biharmonic operator on transversally anisotropic manifolds

abstract: We prove that a continuous potential $q$ can be constructively determined from the knowledge of the Dirichlet-to-Neumann map for the perturbed biharmonic operator $\Delta_g^2+q$ on a conformally transversally anisotropic Riemannian manifold of dimension $\ge 3$ with boundary, assuming that the geodesic ray transform on the transversal manifold is constructively invertible. This is a constructive counterpart of the uniqueness result of [51]. In particular, our result is applicable and new in the case of smooth bounded domains in the $3$-dimensional Euclidean space as well as in the case of $3$-dimensional admissible manifolds.


title: Transferable Persona-Grounded Dialogues via Grounded Minimal Edits

abstract: Grounded dialogue models generate responses that are grounded on certain concepts. Limited by the distribution of grounded dialogue data, models trained on such data face the transferability challenges in terms of the data distribution and the type of grounded concepts. To address the challenges, we propose the grounded minimal editing framework, which minimally edits existing responses to be grounded on the given concept. Focusing on personas, we propose Grounded Minimal Editor (GME), which learns to edit by disentangling and recombining persona-related and persona-agnostic parts of the response. To evaluate persona-grounded minimal editing, we present the PersonaMinEdit dataset, and experimental results show that GME outperforms competitive baselines by a large margin. To evaluate the transferability, we experiment on the test set of BlendedSkillTalk and show that GME can edit dialogue models' responses to largely improve their persona consistency while preserving the use of knowledge and empathy.


title: Elliptic solitons in optical fiber media

abstract: We examine the evolution of a time-varying perturbation signal pumped into a mono-mode fiber in the anomalous dispersion regime. We analytically establish that the perturbation evolves into a conservative pattern of periodic pulses which structures and profiles share close similarity with the so-called soliton-crystal states recently observed in fiber media [see e.g. A. Haboucha et al., Phys. Rev. A\textbf{78}, 043806 (2008); D. Y. Tang et al., Phys. Rev. Lett. \textbf{101}, 153904 (2008); F. Amrani et al., Opt. Express \textbf{19}, 13134 (2011)]. We derive mathematically and generate numerically a crystal of solitons using time division multiplexing of identical pulses. We suggest that at very fast pumping rates, the pulse signals overlap and create an unstable signal that is modulated by the fiber nonlinearity to become a periodic lattice of pulse solitons which can be described by elliptic functions. We carry out a linear stability analysis of the soliton-crystal structure and establish that the correlation of centers of mass of interacting pulses broadens their internal-mode spectrum, some modes of which are mutually degenerate. While it has long been known that high-intensity periodic pulse trains in optical fibers are generated from the phenomenon of modulational instability of continuous waves, the present study provides evidence that they can also be generated via temporal multiplexing of an infinitely large number of equal-intensity single pulses to give rise to stable elliptic solitons.


title: The First Law for the Lorentzian Rotating Taub-NUT

abstract: We show that the first law for the rotating Taub-NUT is straightforwardly established with the surface charge method. The entropy is explicitly found as a charge, and its value is not proportional to the horizon area. We conclude that there are unavoidable contributions from the Misner strings to the charges, still, the mass and angular momentum gets standard values. However, there are no independent charges associated with the Misner strings.


title: Sparse optimal stochastic control

abstract: In this paper, we investigate a sparse optimal control of continuous-time stochastic systems. We adopt the dynamic programming approach and analyze the optimal control via the value function. Due to the non-smoothness of the $L^0$ cost functional, in general, the value function is not differentiable in the domain. Then, we characterize the value function as a viscosity solution to the associated Hamilton-Jacobi-Bellman (HJB) equation. Based on the result, we derive a necessary and sufficient condition for the $L^0$ optimality, which immediately gives the optimal feedback map. Especially for control-affine systems, we consider the relationship with $L^1$ optimal control problem and show an equivalence theorem.


title: R-PCC: A Baseline for Range Image-based Point Cloud Compression

abstract: In autonomous vehicles or robots, point clouds from LiDAR can provide accurate depth information of objects compared with 2D images, but they also suffer a large volume of data, which is inconvenient for data storage or transmission. In this paper, we propose a Range image-based Point Cloud Compression method, R-PCC, which can reconstruct the point cloud with uniform or non-uniform accuracy loss. We segment the original large-scale point cloud into small and compact regions for spatial redundancy and salient region classification. Compared with other voxel-based or image-based compression methods, our method can keep and align all points from the original point cloud in the reconstructed point cloud. It can also control the maximum reconstruction error for each point through a quantization module. In the experiments, we prove that our easier FPS-based segmentation method can achieve better performance than instance-based segmentation methods such as DBSCAN. To verify the advantages of our proposed method, we evaluate the reconstruction quality and fidelity for 3D object detection and SLAM, as the downstream tasks. The experimental results show that our elegant framework can achieve 30$\times$ compression ratio without affecting downstream tasks, and our non-uniform compression framework shows a great improvement on the downstream tasks compared with the state-of-the-art large-scale point cloud compression methods. Our real-time method is efficient and effective enough to act as a baseline for range image-based point cloud compression. The code is available on https://github.com/StevenWang30/R-PCC.git.


title: Asymptotic Bounds for CO-irredundant and Irredundant Ramsey Numbers

abstract: A set of vertices $X\subseteq V$ in a simple graph $G(V,E)$ is irredundant (CO-irredundant) if each vertex $x\in X$ is either isolated in the induced subgraph $G[X]$ or else has a private neighbor $y\in V\setminus X$ ($y\in V$) that is adjacent to $x$ and to no other vertex of $X$. The irredundant Ramsey number $s(t_{1},\ldots,t_{l})$, CO-irredundant Ramsey number $s_{\operatorname{CO}}(t_{1},\ldots,t_{l})$, is the minimum $N$ such that every $l$-coloring of the edges of the complete graph $K_{N}$ on $N$ vertices has a monochromatic irredundant set, a monochromatic CO-irredundant set, of size $t_{i}$ for some $1\leq i\leq l$, respectively. In this paper, firstly, we establish a lower bound for the irredundant Ramsey number $s(t_{1},\ldots,t_{l})$ by a random and probabilistic method. Secondly, we improve an upper bound for $s(3,9)$ such that $24\leq s(3,9)\leq 26$. Thirdly, using Krivelevich's lemma, we establish an asymptotic lower bound for the $\operatorname{CO}$-irredundant Ramsey number $s_{\operatorname{CO}}(m,n)$.


title: Efficient Differentiable Simulation of Articulated Bodies

abstract: We present a method for efficient differentiable simulation of articulated bodies. This enables integration of articulated body dynamics into deep learning frameworks, and gradient-based optimization of neural networks that operate on articulated bodies. We derive the gradients of the forward dynamics using spatial algebra and the adjoint method. Our approach is an order of magnitude faster than autodiff tools. By only saving the initial states throughout the simulation process, our method reduces memory requirements by two orders of magnitude. We demonstrate the utility of efficient differentiable dynamics for articulated bodies in a variety of applications. We show that reinforcement learning with articulated systems can be accelerated using gradients provided by our method. In applications to control and inverse problems, gradient-based optimization enabled by our work accelerates convergence by more than an order of magnitude.


title: Causal State Feedback Representation for Linear Quadratic Optimal Control Problems of Singular Volterra Integral Equations

abstract: This paper is concerned with a linear quadratic optimal control for a class of singular Volterra integral equations. Under proper convexity conditions, optimal control uniquely exists, and it could be characterized via Frechet derivative of the quadratic functional in a Hilbert space or via maximum principle type necessary conditions. However, these (equivalent) characterizations have a shortcoming that the current value of the optimal control depends on the future values of the optimal state. Practically, this is not feasible. The main purpose of this paper is to obtain a causal state feedback representation of the optimal control.


title: Blockchain for Trust and Reputation Management in Cyber-physical Systems

abstract: The salient features of blockchain, such as decentralisation and transparency, have allowed the development of Decentralised Trust and Reputation Management Systems (DTRMS), which mainly aim to quantitatively assess the trustworthiness of the network participants and help to protect the network from adversaries. In the literature, proposals of DTRMS have been applied to various Cyber-physical Systems (CPS) applications, including supply chains, smart cities and distributed energy trading. In this chapter, we outline the building blocks of a generic DTRMS and discuss how it can benefit from blockchain. To highlight the significance of DTRMS, we present the state-of-the-art of DTRMS in various field of CPS applications. In addition, we also outline challenges and future directions in developing DTRMS for CPS.


title: Propensity score regression for causal inference with treatment heterogeneity

abstract: Understanding how treatment effects vary on individual characteristics is critical in the contexts of personalized medicine, personalized advertising and policy design. When the characteristics are of practical interest are only a subset of full covariate, non-parametric estimation is often desirable; but few methods are available due to the computational difficult. Existing non-parametric methods such as the inverse probability weighting methods have limitations that hinder their use in many practical settings where the values of propensity scores are close to 0 or 1. We propose the propensity score regression (PSR) that allows the non-parametric estimation of the heterogeneous treatment effects in a wide context. PSR includes two non-parametric regressions in turn, where it first regresses on the propensity scores together with the characteristics of interest, to obtain an intermediate estimate; and then, regress the intermediate estimates on the characteristics of interest only. By including propensity scores as regressors in the non-parametric manner, PSR is capable of substantially easing the computational difficulty while remain (locally) insensitive to any value of propensity scores. We present several appealing properties of PSR, including the consistency and asymptotical normality, and in particular the existence of an explicit variance estimator, from which the analytical behaviour of PSR and its precision can be assessed. Simulation studies indicate that PSR outperform existing methods in varying settings with extreme values of propensity scores. We apply our method to the national 2009 flu survey (NHFS) data to investigate the effects of seasonal influenza vaccination and having paid sick leave across different age groups.


title: Targeted Attack on Deep RL-based Autonomous Driving with Learned Visual Patterns

abstract: Recent studies demonstrated the vulnerability of control policies learned through deep reinforcement learning against adversarial attacks, raising concerns about the application of such models to risk-sensitive tasks such as autonomous driving. Threat models for these demonstrations are limited to (1) targeted attacks through real-time manipulation of the agent's observation, and (2) untargeted attacks through manipulation of the physical environment. The former assumes full access to the agent's states/observations at all times, while the latter has no control over attack outcomes. This paper investigates the feasibility of targeted attacks through visually learned patterns placed on physical objects in the environment, a threat model that combines the practicality and effectiveness of the existing ones. Through analysis, we demonstrate that a pre-trained policy can be hijacked within a time window, e.g., performing an unintended self-parking, when an adversarial object is present. To enable the attack, we adopt an assumption that the dynamics of both the environment and the agent can be learned by the attacker. Lastly, we empirically show the effectiveness of the proposed attack on different driving scenarios, perform a location robustness test, and study the tradeoff between the attack strength and its effectiveness. Code is available at https://github.com/ASU-APG/Targeted-Physical-Adversarial-Attacks-on-AD


title: Strategic Remote Attestation: Testbed for Internet-of-Things Devices and Stackelberg Security Game for Optimal Strategies

abstract: Internet of Things (IoT) devices and applications can have significant vulnerabilities, which may be exploited by adversaries to cause considerable harm. An important approach for mitigating this threat is remote attestation, which enables the defender to remotely verify the integrity of devices and their software. There are a number of approaches for remote attestation, and each has its unique advantages and disadvantages in terms of detection accuracy and computational cost. Further, an attestation method may be applied in multiple ways, such as various levels of software coverage. Therefore, to minimize both security risks and computational overhead, defenders need to decide strategically which attestation methods to apply and how to apply them, depending on the characteristic of the devices and the potential losses. To answer these questions, we first develop a testbed for remote attestation of IoT devices, which enables us to measure the detection accuracy and performance overhead of various attestation methods. Our testbed integrates two example IoT applications, memory-checksum based attestation, and a variety of software vulnerabilities that allow adversaries to inject arbitrary code into running applications. Second, we model the problem of finding an optimal strategy for applying remote attestation as a Stackelberg security game between a defender and an adversary. We characterize the defender's optimal attestation strategy in a variety of special cases. Finally, building on experimental results from our testbed, we evaluate our model and show that optimal strategic attestation can lead to significantly lower losses than naive baseline strategies.


title: Sister Help: Data Augmentation for Frame-Semantic Role Labeling

abstract: While FrameNet is widely regarded as a rich resource of semantics in natural language processing, a major criticism concerns its lack of coverage and the relative paucity of its labeled data compared to other commonly used lexical resources such as PropBank and VerbNet. This paper reports on a pilot study to address these gaps. We propose a data augmentation approach, which uses existing frame-specific annotation to automatically annotate other lexical units of the same frame which are unannotated. Our rule-based approach defines the notion of a sister lexical unit and generates frame-specific augmented data for training. We present experiments on frame-semantic role labeling which demonstrate the importance of this data augmentation: we obtain a large improvement to prior results on frame identification and argument identification for FrameNet, utilizing both full-text and lexicographic annotations under FrameNet. Our findings on data augmentation highlight the value of automatic resource creation for improved models in frame-semantic parsing.


title: MOVER: Mask, Over-generate and Rank for Hyperbole Generation

abstract: Despite being a common figure of speech, hyperbole is under-researched in Figurative Language Processing. In this paper, we tackle the challenging task of hyperbole generation to transfer a literal sentence into its hyperbolic paraphrase. To address the lack of available hyperbolic sentences, we construct HYPO-XL, the first large-scale English hyperbole corpus containing 17,862 hyperbolic sentences in a non-trivial way. Based on our corpus, we propose an unsupervised method for hyperbole generation that does not require parallel literal-hyperbole pairs. During training, we fine-tune BART to infill masked hyperbolic spans of sentences from HYPO-XL. During inference, we mask part of an input literal sentence and over-generate multiple possible hyperbolic versions. Then a BERT-based ranker selects the best candidate by hyperbolicity and paraphrase quality. Automatic and human evaluation results show that our model is effective at generating hyperbolic paraphrase sentences and outperforms several baseline systems.


title: Secure Transmission for Hierarchical Information Accessibility in Downlink MU-MIMO

abstract: Physical layer security is a useful tool to prevent confidential information from wiretapping. In this paper, we consider a generalized model of conventional physical layer security, referred to as hierarchical information accessibility (HIA). A main feature of the HIA model is that a network has a hierarchy in information accessibility, wherein decoding feasibility is determined by a priority of users. Under this HIA model, we formulate a sum secrecy rate maximization problem with regard to precoding vectors. This problem is challenging since multiple non-smooth functions are involved into the secrecy rate to fulfill the HIA conditions and also the problem is non-convex. To address the challenges, we approximate the minimum function by using the LogSumExp technique, thereafter obtain the first-order optimality condition. One key observation is that the derived condition is cast as a functional eigenvalue problem, where the eigenvalue is equivalent to the approximated objective function of the formulated problem. Accordingly, we show that finding a principal eigenvector is equivalent to finding a local optimal solution. To this end, we develop a novel method called generalized power iteration for HIA (GPI-HIA). Simulations demonstrate that the GPI-HIA significantly outperforms other baseline methods in terms of the secrecy rate.


title: The $N$-Stable Category

abstract: A well-known theorem of Buchweitz provides equivalences between three categories: the stable category of Gorenstein projective modules over a Gorenstein algebra, the homotopy category of acyclic complexes of projectives, and the singularity category. To adapt this result to $N$-complexes, one must find an appropriate candidate for the $N$-analogue of the stable category. We identify this "$N$-stable category" via the monomorphism category and prove Buchweitz's theorem for $N$-complexes over a Frobenius exact abelian category. We also compute the Serre functor on the $N$-stable category over a self-injective algebra and study the resultant fractional Calabi-Yau properties.


title: Beyond 5G RIS mmWave Systems: Where Communication and Localization Meet

abstract: Upcoming beyond fifth generation (5G) communications systems aim at further enhancing key performance indicators and fully supporting brand new use cases by embracing emerging techniques, e.g., reconfigurable intelligent surface (RIS), integrated communication, localization, and sensing, and mmWave/THz communications. The wireless intelligence empowered by state-of-the-art artificial intelligence techniques has been widely considered at the transceivers, and now the paradigm is deemed to be shifted to the smart control of radio propagation environment by virtue of RISs. In this article, we argue that to harness the full potential of RISs, localization and communication must be tightly coupled. This is in sharp contrast to 5G and earlier generations, where localization was a minor additional service. To support this, we first introduce the fundamentals of RIS mmWave channel modeling, followed by RIS channel state information acquisition and link establishment. Then, we deal with the connection between localization and communications, from a separate and joint perspective.


title: Machine learning with quantum field theories

abstract: The precise equivalence between discretized Euclidean field theories and a certain class of probabilistic graphical models, namely the mathematical framework of Markov random fields, opens up the opportunity to investigate machine learning from the perspective of quantum field theory. In this contribution we will demonstrate, through the Hammersley-Clifford theorem, that the $\phi^{4}$ scalar field theory on a square lattice satisfies the local Markov property and can therefore be recast as a Markov random field. We will then derive from the $\phi^{4}$ theory machine learning algorithms and neural networks which can be viewed as generalizations of conventional neural network architectures. Finally, we will conclude by presenting applications based on the minimization of an asymmetric distance between the probability distribution of the $\phi^{4}$ machine learning algorithms and target probability distributions.

categories: cs.LG hep-lat hep-th math-ph math.MP math.PR


title: Star Formation in CALIFA survey perturbed galaxies. II. Star Formation Histories and Oxygen Abundances

abstract: Galaxy evolution is generally affected by tidal interactions. Firstly, in this series, we reported several effects which suggest that tidal interactions contribute to regulating star formation (SF). To confirm that so, we now compare stellar mass assembly histories and SF look-back time annular profiles between CALIFA survey tidally and non-tidally perturbed galaxies. We pair their respective star-forming regions at the closest stellar mass surface densities to reduce the influence of stellar mass. The assembly histories and annular profiles show statistically significant differences so that higher star formation rates characterize regions in tidally perturbed galaxies. These regions underwent a more intense (re)activation of SF in the last 1 Gyr. Varying shapes of the annular profiles also reflect fluctuations between suppression and (re)activation of SF. Since gas-phase abundances use to be lower in more actively than in less actively star-forming galaxies, we further explore the plausible presence of metal-poor gas inflows able to dilute such abundances. The resolved relations of oxygen (O) abundance, with stellar mass density and with total gas fraction, show slightly lower O abundances for regions in tidally perturbed galaxies. The single distributions of O abundances statistically validate that so. Moreover, from a metallicity model based on stellar feedback, the mass rate differentials (inflows$-$outflows) show statistically valid higher values for regions in tidally perturbed galaxies. These differentials, and the metal fractions from the population synthesis, suggest dominant gas inflows in these galaxies. This dominance, and the differences in SF through time, confirm the previously reported effects of tidal interactions on SF.


title: Hadronic Decays of Charmed Hadron

abstract: The BESIII experiment has collected the $e^+e^-$ collision data samples corresponding to integrated luminosities of 2.93 $\mathrm{fb}^{-1}$, $3.19$ $\mathrm{fb}^{-1}$, 3.13 $\mathrm{fb}^{-1}$ and 567 $\mathrm{pb}^{-1}$ at center-of-mass energies of 3.773 GeV, 4.178 GeV, 4.189-4.226 GeV and 4.599 GeV, respectively. We report the measurements of strong-phase parameters based on the decays $D^0\to K^0_{S/L}\pi^+\pi^-$, $D^0\to K^0_{S/L}K^+K^-$, $D^0\to K^-\pi^+\pi^+\pi^-$ and $D^0\to K^-\pi^+\pi^0$, which are important input for binned model-independent measurement of the CKM angle $\gamma/\phi_3$. In addition, we report amplitude analyses and branching fraction measurements of $D^+$, $D_s^+$ and $\Lambda_c^+$ decays along with the $\Lambda_c^+$ spin determination.


title: The production of doubly charmed exotic hadrons in heavy ion collisions

abstract: Hadron spectroscopy provides direct physical measurements that shed light on the non-perturbative behavior of quantum chromodynamics (QCD). In particular, various exotic hadrons such as the newly observed $T_{cc}^+$ by the LHCb collaboration, offer unique insights on the QCD dynamics in hadron structures. In this letter, we demonstrate how heavy ion collisions can serve as a powerful venue for hadron spectroscopy study of doubly charmed exotic hadrons by virtue of the extremely charm-rich environment created in such collisions. The yields of $T_{cc}^+$ as well as its potential isospin partners are computed within the molecular picture for Pb-Pb collisions at center-of-mass energy $2.76~\mathrm{TeV}$. We find about three-order-of-magnitude enhancement in the production of $T_{cc}^+$ in Pb-Pb collisions as compared with the yield in proton-proton collisions, with a moderately smaller enhancement in the yields of the isospin partners $T_{cc}^0$ and $T_{cc}^{++}$. The $T_{cc}^+$ yield is comparable to that of the $X(3872)$ in the most central collisions while shows a considerably stronger decrease toward peripheral collisions, due to a "threshold" effect of the required double charm quarks for $T_{cc}^+$. Final results for their rapidity and transverse momentum $p_T$ dependence as well as the elliptic flow coefficient are reported and can be tested by future experimental measurements.


title: Few-Shot Object Detection by Attending to Per-Sample-Prototype

abstract: Few-shot object detection aims to detect instances of specific categories in a query image with only a handful of support samples. Although this takes less effort than obtaining enough annotated images for supervised object detection, it results in a far inferior performance compared to the conventional object detection methods. In this paper, we propose a meta-learning-based approach that considers the unique characteristics of each support sample. Rather than simply averaging the information of the support samples to generate a single prototype per category, our method can better utilize the information of each support sample by treating each support sample as an individual prototype. Specifically, we introduce two types of attention mechanisms for aggregating the query and support feature maps. The first is to refine the information of few-shot samples by extracting shared information between the support samples through attention. Second, each support sample is used as a class code to leverage the information by comparing similarities between each support feature and query features. Our proposed method is complementary to the previous methods, making it easy to plug and play for further improvement. We have evaluated our method on PASCAL VOC and COCO benchmarks, and the results verify the effectiveness of our method. In particular, the advantages of our method are maximized when there is more diversity among support data.


title: Decentralized Control of Quadrotor Swarms with End-to-end Deep Reinforcement Learning

abstract: We demonstrate the possibility of learning drone swarm controllers that are zero-shot transferable to real quadrotors via large-scale multi-agent end-to-end reinforcement learning. We train policies parameterized by neural networks that are capable of controlling individual drones in a swarm in a fully decentralized manner. Our policies, trained in simulated environments with realistic quadrotor physics, demonstrate advanced flocking behaviors, perform aggressive maneuvers in tight formations while avoiding collisions with each other, break and re-establish formations to avoid collisions with moving obstacles, and efficiently coordinate in pursuit-evasion tasks. We analyze, in simulation, how different model architectures and parameters of the training regime influence the final performance of neural swarms. We demonstrate the successful deployment of the model learned in simulation to highly resource-constrained physical quadrotors performing station keeping and goal swapping behaviors. Code and video demonstrations are available on the project website at https://sites.google.com/view/swarm-rl.


title: Large Magnetoresistance and Weak Antilocalization in V1-delta Sb2 Single Crystal

abstract: The binary pnictide semimetals have attracted considerable attention due to their fantastic physical properties that include topological effects, negative magnetoresistance, Weyl fermions and large non-saturation magnetoresistance. In this paper, we have successfully grown the high-quality V1-deltaSb2 single crystals by Sb flux method and investigated their electronic transport properties. A large positive magnetoresistance that reaches 477% under a magnetic field of 12 T at T = 1.8 K was observed. Notably, the magnetoresistance showed a cusp-like feature at the low magnetic fields and such feature weakened gradually as the temperature increased, which indicated the presence of weak antilocalization effect (WAL). The angle-dependent magnetoconductance and the ultra-large prefactor alpha extracted from the Hikami-Larkin-Nagaoka equation revealed that the WAL effect is a 3D bulk effect originated from the three-dimensional bulk spin-orbital coupling.


title: Local parameters of supercuspidal representations

abstract: For a connected reductive group $G$ over a non-archime\-dean local field $F$ of positive characteristic, Genestier and Lafforgue have attached a semisimple parameter $\CL^{ss}(\pi)$ to each irreducible representation $\pi$. Our first result shows that the Genestier-Lafforgue parameter of a tempered $\pi$ can be uniquely refined to a tempered L-parameter $\CL(\pi)$, thus giving the unique local Langlands correspondence which is compatible with the Genestier-Lafforgue construction. Our second result establishes ramification properties of $\CL^{ss}(\pi)$ for unramfied $G$ and supercuspidal $\pi$ constructed by induction from an open compact (modulo center) subgroup. If $L^{ss}(\pi)$ is pure in an appropriate sense, we show that $\CL^{ss}(\pi)$ is ramified (unless $G$ is a torus). If the inducing subgroup is sufficiently small in a precise sense, we show $\mathcal{L}^{ss}(\pi)$ is wildly ramified. The proofs are via global arguments, involving the construction of Poincar\'e series with strict control on ramification when the base curve is $\PP^1$ and a simple application of Deligne's Weil II.


title: Noise Robust Core-Stable Coalitions of Hedonic Games

abstract: We consider the coalition formation games with an additional component, `noisy preferences'. Moreover, such noisy preferences are available only for a sample of coalitions. We propose a multiplicative noise model and obtain the prediction probability, defined as the probability that the estimated PAC core-stable partition of the noisy game is also PAC core-stable for the unknown noise-free game. This prediction probability depends on the probability of a combinatorial construct called an `agreement event'. We explicitly obtain the agreement probability for $n$ agent noisy game with l\geq 2 support noise distribution. For a user-given satisfaction value on this probability, we identify the noise regimes for which an estimated partition is noise robust; that is, it is PAC core-stable in both noisy and noise-free games. We obtain similar robustness results when the estimated partition is not PAC core-stable. These noise regimes correspond to the level sets of the agreement probability function and are non-convex sets. Moreover, an important fact is that the prediction probability can be high even if high noise values occur with a high probability. Further, for a class of top-responsive hedonic games, we obtain the bounds on the extra noisy samples required to get noise robustness with a user-given satisfaction value. We completely solve the noise robustness problem of a $2$ agent hedonic game. In particular, we obtain the prediction probability function for l=2 and l=3 noise support cases. For l=2, the prediction probability is convex in noise probability, but the noise robust regime is non-convex. Its minimum value, called the safety value, is 0.62; so, below 0.62, the noise robust regime is the entire probability simplex. However, for l \geq 3, the prediction probability is non-convex; so, the safety value is the global minima of a non-convex function and is computationally hard.


title: A Comparative Study of Machine Learning Methods for Predicting the Evolution of Brain Connectivity from a Baseline Timepoint

abstract: Predicting the evolution of the brain network, also called connectome, by foreseeing changes in the connectivity weights linking pairs of anatomical regions makes it possible to spot connectivity-related neurological disorders in earlier stages and detect the development of potential connectomic anomalies. Remarkably, such a challenging prediction problem remains least explored in the predictive connectomics literature. It is a known fact that machine learning (ML) methods have proven their predictive abilities in a wide variety of computer vision problems. However, ML techniques specifically tailored for the prediction of brain connectivity evolution trajectory from a single timepoint are almost absent. To fill this gap, we organized a Kaggle competition where 20 competing teams designed advanced machine learning pipelines for predicting the brain connectivity evolution from a single timepoint. The competing teams developed their ML pipelines with a combination of data pre-processing, dimensionality reduction, and learning methods. Utilizing an inclusive evaluation approach, we ranked the methods based on two complementary evaluation metrics (mean absolute error (MAE) and Pearson Correlation Coefficient (PCC)) and their performances using different training and testing data perturbation strategies (single random split and cross-validation). The final rank was calculated using the rank product for each competing team across all evaluation measures and validation strategies. In support of open science, the developed 20 ML pipelines along with the connectomic dataset are made available on GitHub. The outcomes of this competition are anticipated to lead to the further development of predictive models that can foresee the evolution of brain connectivity over time, as well as other types of networks (e.g., genetic networks).


title: Scaling Laws for Neural Machine Translation

abstract: We present an empirical study of scaling properties of encoder-decoder Transformer models used in neural machine translation (NMT). We show that cross-entropy loss as a function of model size follows a certain scaling law. Specifically (i) We propose a formula which describes the scaling behavior of cross-entropy loss as a bivariate function of encoder and decoder size, and show that it gives accurate predictions under a variety of scaling approaches and languages; we show that the total number of parameters alone is not sufficient for such purposes. (ii) We observe different power law exponents when scaling the decoder vs scaling the encoder, and provide recommendations for optimal allocation of encoder/decoder capacity based on this observation. (iii) We also report that the scaling behavior of the model is acutely influenced by composition bias of the train/test sets, which we define as any deviation from naturally generated text (either via machine generated or human translated text). We observe that natural text on the target side enjoys scaling, which manifests as successful reduction of the cross-entropy loss. (iv) Finally, we investigate the relationship between the cross-entropy loss and the quality of the generated translations. We find two different behaviors, depending on the nature of the test data. For test sets which were originally translated from target language to source language, both loss and BLEU score improve as model size increases. In contrast, for test sets originally translated from source language to target language, the loss improves, but the BLEU score stops improving after a certain threshold. We release generated text from all models used in this study.


title: STD-Trees: Spatio-temporal Deformable Trees for Multirotors Kinodynamic Planning

abstract: In constrained solution spaces with a huge number of homotopy classes, stand-alone sampling-based kinodynamic planners suffer low efficiency in convergence. Local optimization is integrated to alleviate this problem. In this paper, we propose to thrive the trajectory tree growing by optimizing the tree in the forms of deformation units, and each unit contains one tree node and all the edges connecting it. The deformation proceeds both spatially and temporally by optimizing the node state and edge time durations efficiently. The unit only changes the tree locally yet improves the overall quality of a corresponding sub-tree. Further, variants to deform different tree parts considering the computation burden and optimizing level are studied and compared, all showing much faster convergence. The proposed deformation is compatible with different RRT-based kinodynamic planning methods, and numerical experiments show that integrating the spatio-temporal deformation greatly accelerates the convergence and outperforms the spatial-only deformation.


title: Entropy growth during free expansion of an ideal gas

abstract: To illustrate Boltzmann's construction of an entropy function that is defined for a microstate of a macroscopic system, we present here the simple example of the free expansion of a one dimensional gas of non-interacting point particles. The construction requires one to define macrostates, corresponding to macroscopic variables. We define a macrostate $M$ by specifying the fraction of particles in rectangular boxes $\Delta x \Delta v$ of the single particle position-velocity space $\{x,v\}$. We verify that when the number of particles is large the Boltzmann entropy, $S_B(t)$, of a typical microstate of a nonequilibrium ensemble coincides with the Gibbs entropy of the coarse-grained time-evolved one-particle distribution associated with this ensemble. $S_B(t)$ approaches its maximum possible value for the dynamical evolution of the given initial state. The rate of approach depends on the size of $\Delta v$ in the definition of the macrostate, going to zero at any fixed time $t$ when $\Delta v \to 0$. Surprisingly the different curves $S_B(t)$ collapse when time is scaled with $\Delta v$ as: $t \sim \tau/\Delta v$. We find an explicit expression for $S_B(\tau)$ in the limit $\Delta v \to 0$. We also consider a different, more hydrodynamical, definition of macrostates for which $S_B(t)$ is monotone increasing, unlike the previous one which has small decaying oscillations near its maximum value. Our system is non-ergodic, non-chaotic and non-interacting; our results thus illustrate that these concepts are not as relevant as sometimes claimed, for observing macroscopic irreversibility and entropy increase. Rather, the notions of initial conditions, typicality, large numbers and coarse-graining are the important factors. We demonstrate these ideas through extensive simulations as well as analytic results.


title: Optimal Probing with Statistical Guarantees for Network Monitoring at Scale

abstract: Cloud networks are difficult to monitor because they grow rapidly and the budgets for monitoring them are limited. We propose a framework for estimating network metrics, such as latency and packet loss, with guarantees on estimation errors for a fixed monitoring budget. Our proposed algorithms produce a distribution of probes across network paths, which we then monitor; and are based on A- and E-optimal experimental designs in statistics. Unfortunately, these designs are too computationally costly to use at production scale. We propose their scalable and near-optimal approximations based on the Frank-Wolfe algorithm. We validate our approaches in simulation on real network topologies, and also using a production probing system in a real cloud network. We show major gains in reducing the probing budget compared to both production and academic baselines, while maintaining low estimation errors, even with very low probing budgets.


title: SuperNIC: A Hardware-Based, Programmable, and Multi-Tenant SmartNIC

abstract: With CPU scaling slowing down in today's data centers, more functionalities are being offloaded from the CPU to auxiliary devices. One such device is the SmartNIC, which is being increasingly adopted in data centers. In today's cloud environment, VMs on the same server can each have their own network computation (or network tasks) or workflows of network tasks to offload to a SmartNIC. These network tasks can be dynamically added/removed as VMs come and go and can be shared across VMs. Such dynamism demands that a SmartNIC not only schedules and processes packets but also manages and executes offloaded network tasks for different users. Although software solutions like an OS exist for managing software-based network tasks, such software-based SmartNICs cannot keep up with the quickly increasing data-center network speed. This paper proposes a new SmartNIC platform called SuperNIC that allows multiple tenants to efficiently and safely offload FPGA-based network computation DAGs. For efficiency and scalability, our core idea is to group network tasks into chains that are connected and scheduled as one unit. We further propose techniques to automatically scale network task chains with different types of parallelism. Moreover, we propose a fair share mechanism that considers both fair space sharing and fair time sharing of different types of hardware resources. Our FPGA prototype of SuperNIC achieves high bandwidth, low latency performance whilst efficiently utilizing and fairly sharing resources.


title: Estimating Wildfire Evacuation Decision and Departure Timing Using Large-Scale GPS Data

abstract: With increased frequency and intensity due to climate change, wildfires have become a growing global concern. This creates severe challenges for fire and emergency services as well as communities in the wildland-urban interface (WUI). To reduce wildfire risk and enhance the safety of WUI communities, improving our understanding of wildfire evacuation is a pressing need. To this end, this study proposes a new methodology to analyze human behavior during wildfires by leveraging a large-scale GPS dataset. This methodology includes a home-location inference algorithm and an evacuation-behavior inference algorithm, to systematically identify different groups of wildfire evacuees (i.e., self-evacuee, shadow evacuee, evacuee under warning, and ordered evacuee). We applied the methodology to the 2019 Kincade Fire in Sonoma County, CA. We found that among all groups of evacuees, self-evacuees and shadow evacuees accounted for more than half of the evacuees during the Kincade Fire. The results also show that inside of the evacuation warning/order zones, the total evacuation compliance rate was around 46% among all the categorized people. The findings of this study can be used by emergency managers and planners to better target public outreach campaigns, training protocols, and emergency communication strategies to prepare WUI households for future wildfire events.


title: Relaxation limit for a damped one-velocity Baer-Nunziato model to a Kappila model

abstract: In this paper we study a singular limit problem in the context of partially dissipative first order quasilinear systems. This problem arises in multiphase fluid mechanics. More precisely, taking into account dissipative effects for the velocity, we show that the so-called Kapilla system is obtained as a relaxation limit from the Baer-Nunziato (BN) system and derive the convergence rate of this process. The main problem we encounter is that the (BN)-system does not verify the celebrated (SK) condition due to Shizuta and Kawashima. It turns out that we can rewrite the (BN)-system in terms of new variables such as to highlight a subsystem for which the linearized does verify the (SK) condition which is coupled through lower-order terms with a transport equation. We construct an appropriate weighted energy-functional which allows us to tackle the lack of symmetry of the system, provides decay information and allows us to close the estimate uniformly with respect to the relaxation parameter.


title: Neural-network acceleration of projection-based model-order-reduction for finite plasticity: Application to RVEs

abstract: Compared to conventional projection-based model-order-reduction, its neural-network acceleration has the advantage that the online simulations are equation-free, meaning that no system of equations needs to be solved iteratively. Consequently, no stiffness matrix needs to be constructed and the stress update needs to be computed only once per increment. In this contribution, a recurrent neural network is developed to accelerate a projection-based model-order-reduction of the elastoplastic mechanical behaviour of an RVE. In contrast to a neural network that merely emulates the relation between the macroscopic deformation (path) and the macroscopic stress, the neural network acceleration of projection-based model-order-reduction preserves all microstructural information, at the price of computing this information once per increment.


title: Evaluating the Impact of Semantic Segmentation and Pose Estimation on Dense Semantic SLAM

abstract: Recent Semantic SLAM methods combine classical geometry-based estimation with deep learning-based object detection or semantic segmentation. In this paper we evaluate the quality of semantic maps generated by state-of-the-art class- and instance-aware dense semantic SLAM algorithms whose codes are publicly available and explore the impacts both semantic segmentation and pose estimation have on the quality of semantic maps. We obtain these results by providing algorithms with ground-truth pose and/or semantic segmentation data available from simulated environments. We establish that semantic segmentation is the largest source of error through our experiments, dropping mAP and OMQ performance by up to 74.3% and 71.3% respectively.


title: Malliavin-Stein method for the multivariate compound Hawkes process

abstract: In this paper, we provide upper bounds on the d2 distance between a large class of functionals of a multivariate compound Hawkes process and a given Gaussian vector. This is proven using Malliavin's calculus defined on an underlying Poisson embedding. The upper bound is then used to infer the speed of convergence of Central Limit Theorems for the multivariate compound Hawkes process with exponential kernels as the observation time T goes to infinity.


title: Utterance-level neural confidence measure for end-to-end children speech recognition

abstract: Confidence measure is a performance index of particular importance for automatic speech recognition (ASR) systems deployed in real-world scenarios. In the present study, utterance-level neural confidence measure (NCM) in end-to-end automatic speech recognition (E2E ASR) is investigated. The E2E system adopts the joint CTC-attention Transformer architecture. The prediction of NCM is formulated as a task of binary classification, i.e., accept/reject the input utterance, based on a set of predictor features acquired during the ASR decoding process. The investigation is focused on evaluating and comparing the efficacies of predictor features that are derived from different internal and external modules of the E2E system. Experiments are carried out on children speech, for which state-of-the-art ASR systems show less than satisfactory performance and robust confidence measure is particularly useful. It is noted that predictor features related to acoustic information of speech play a more important role in estimating confidence measure than those related to linguistic information. N-best score features show significantly better performance than single-best ones. It has also been shown that the metrics of EER and AUC are not appropriate to evaluate the NCM of a mismatched ASR with significant performance gap.


title: Towards a Provenance Management System for Astronomical Observatories

abstract: We present here a provenance management system adapted to astronomical projects needs. We collected use cases from various astronomy projects and defined a data model in the ecosystem developed by the IVOA (International Virtual Observatory Alliance). From those use cases, we observed that some projects already have data collections generated and archived, from which the provenance has to be extracted (provenance "on top"), and some projects are building complex pipelines that automatically capture provenance information during the data processing (capture "inside"). Different tools and prototypes have been developed and tested to capture, store, access and visualize the provenance information, which participate to the shaping of a full provenance management system able to handle detailed provenance information.


title: Deep Visual Navigation under Partial Observability

abstract: How can a robot navigate successfully in rich and diverse environments, indoors or outdoors, along office corridors or trails on the grassland, on the flat ground or the staircase? To this end, this work aims to address three challenges: (i) complex visual observations, (ii) partial observability of local visual sensing, and (iii) multimodal robot behaviors conditioned on both the local environment and the global navigation objective. We propose to train a neural network (NN) controller for local navigation via imitation learning. To tackle complex visual observations, we extract multi-scale spatial representations through CNNs. To tackle partial observability, we aggregate multi-scale spatial information over time and encode it in LSTMs. To learn multimodal behaviors, we use a separate memory module for each behavior mode. Importantly, we integrate the multiple neural network modules into a unified controller that achieves robust performance for visual navigation in complex, partially observable environments. We implemented the controller on the quadrupedal Spot robot and evaluated it on three challenging tasks: adversarial pedestrian avoidance, blind-spot obstacle avoidance, and elevator riding. The experiments show that the proposed NN architecture significantly improves navigation performance.


title: Multilevel-Langevin pathwise average for Gibbs approximation

abstract: We propose and study a new multilevel method for the numerical approximation of a Gibbs distribution $\pi$ on $\mathbb{R}^d$, based on (overdamped) Langevin diffusions. This method inspired by \cite{mainPPlangevin} and \cite{giles_szpruch_invariant} relies on a multilevel occupation measure, $i.e.$ on an appropriate combination of $R$ occupation measures of (constant-step) Euler schemes with respective steps $\gamma_r = \gamma_0 2^{-r}$, $r=0,\ldots,R$. We first state a quantitative result under general assumptions which guarantees an \textit{$\varepsilon$-approximation} (in a $L^2$-sense) with a cost of the order $\varepsilon^{-2}$ or $\varepsilon^{-2}|\log \varepsilon|^3$ under less contractive assumptions. We then apply it to overdamped Langevin diffusions with strongly convex potential $U:\mathbb{R}^d\rightarrow\mathbb{R}$ and obtain an \textit{$\varepsilon$-complexity} of the order ${\cal O}(d\varepsilon^{-2}\log^3(d\varepsilon^{-2}))$ or ${\cal O}(d\varepsilon^{-2})$ under additional assumptions on $U$. More precisely, up to universal constants, an appropriate choice of the parameters leads to a cost controlled by ${(\bar{\lambda}_U\vee 1)^2}{\underline{\lambda}_U^{-3}} d\varepsilon^{-2}$ (where $\bar{\lambda}_U$ and $\underline{\lambda}_U$ respectively denote the supremum and the infimum of the largest and lowest eigenvalue of $D^2U$). We finally complete these theoretical results with some numerical illustrations including comparisons to other algorithms in Bayesian learning and opening to non strongly convex setting.


title: Capacity Optimization using Reconfigurable Intelligent Surfaces: A Large System Approach

abstract: Reconfigurable Intelligent Surfaces (RISs), comprising large numbers of low-cost and passive metamaterials with tunable reflection properties, have been recently proposed as an enabler for programmable radio propagation environments. However, the role of the channel conditions near the RISs on their optimizability has not been analyzed adequately. In this paper, we present an asymptotic closed-form expression for the mutual information of a multi-antenna transmitter-receiver pair in the presence of multiple RISs, in the large-antenna limit, using the random matrix and replica theories. Under mild assumptions, asymptotic expressions for the eigenvalues and the eigenvectors of the channel covariance matrices are derived. We find that, when the channel close to an RIS is correlated, for instance due to small angle spread, the communication link benefits significantly from the RIS optimization, resulting in gains that are surprisingly higher than the nearly uncorrelated case. Furthermore, when the desired reflection from the RIS departs significantly from geometrical optics, the surface can be optimized to provide robust communication links. Building on the properties of the eigenvectors of the covariance matrices, we are able to find the optimal response of the RISs in closed form, bypassing the need for brute-force optimization.


title: Mask-Guided Feature Extraction and Augmentation for Ultra-Fine-Grained Visual Categorization

abstract: While the fine-grained visual categorization (FGVC) problems have been greatly developed in the past years, the Ultra-fine-grained visual categorization (Ultra-FGVC) problems have been understudied. FGVC aims at classifying objects from the same species (very similar categories), while the Ultra-FGVC targets at more challenging problems of classifying images at an ultra-fine granularity where even human experts may fail to identify the visual difference. The challenges for Ultra-FGVC mainly comes from two aspects: one is that the Ultra-FGVC often arises overfitting problems due to the lack of training samples; and another lies in that the inter-class variance among images is much smaller than normal FGVC tasks, which makes it difficult to learn discriminative features for each class. To solve these challenges, a mask-guided feature extraction and feature augmentation method is proposed in this paper to extract discriminative and informative regions of images which are then used to augment the original feature map. The advantage of the proposed method is that the feature detection and extraction model only requires a small amount of target region samples with bounding boxes for training, then it can automatically locate the target area for a large number of images in the dataset at a high detection accuracy. Experimental results on two public datasets and ten state-of-the-art benchmark methods consistently demonstrate the effectiveness of the proposed method both visually and quantitatively.


title: Dense Semantic Contrast for Self-Supervised Visual Representation Learning

abstract: Self-supervised representation learning for visual pre-training has achieved remarkable success with sample (instance or pixel) discrimination and semantics discovery of instance, whereas there still exists a non-negligible gap between pre-trained model and downstream dense prediction tasks. Concretely, these downstream tasks require more accurate representation, in other words, the pixels from the same object must belong to a shared semantic category, which is lacking in the previous methods. In this work, we present Dense Semantic Contrast (DSC) for modeling semantic category decision boundaries at a dense level to meet the requirement of these tasks. Furthermore, we propose a dense cross-image semantic contrastive learning framework for multi-granularity representation learning. Specially, we explicitly explore the semantic structure of the dataset by mining relations among pixels from different perspectives. For intra-image relation modeling, we discover pixel neighbors from multiple views. And for inter-image relations, we enforce pixel representation from the same semantic class to be more similar than the representation from different classes in one mini-batch. Experimental results show that our DSC model outperforms state-of-the-art methods when transferring to downstream dense prediction tasks, including object detection, semantic segmentation, and instance segmentation. Code will be made available.


title: Bistable turbulence in strongly magnetised plasmas with a sheared mean flow

abstract: The prevailing paradigm for plasma turbulence associates a unique stationary state to given equilibrium parameters. We report the discovery of bistable turbulence in a strongly magnetised plasma. Two distinct states, obtained with identical equilibrium parameters in first-principle gyrokinetic simulations, have turbulent fluxes of particles, momentum and energy that differ by an order of magnitude, with the low-transport state agreeing with experimental observations. Occurrences of the two states are regulated by the competition between an externally imposed mean flow shear and "zonal" flows generated by the plasma. With small turbulent amplitudes, zonal flows have little impact, and the mean shear causes turbulence to saturate in a low-transport state. With larger amplitudes, the zonal shear can (partially) oppose the effect of the mean shear, allowing the system to sustain a high-transport state. This poses a new challenge for research that has so far assumed a uniquely defined turbulent state.


title: Dynamics of hyperbolically symmetric fluids

abstract: We study the general properties of dissipative fluid distributions endowed with hyperbolical symmetry. Their physical properties are analyzed in detail. It is shown that the energy density is necessarily negative and the fluid distribution cannot fill the region close to the center of symmetry. Such a region may be represented by a vacuum cavity around the center. By assuming a causal transport equation some interesting thermodynamical properties of these fluids are found. Several exact analytical solutions which evolve in the quasi-homologous regime and satisfy the vanishing complexity factor condition, are exhibited


title: The number of limit cycles for regularized piecewise polynomial systems is unbounded

abstract: In this paper, we extend the slow divergence-integral from slow-fast systems, due to De Maesschalck, Dumortier and Roussarie, to smooth systems that limit onto piecewise smooth ones as $\epsilon\rightarrow 0$. In slow-fast systems, the slow divergence-integral is an integral of the divergence along a canard cycle with respect to the slow time and it has proven very useful in obtaining good lower and upper bounds of limit cycles in planar polynomial systems. In this paper, our slow divergence-integral is based upon integration along a generalized canard cycle for a piecewise smooth two-fold bifurcation (of type visible-invisible called $VI_3$). We use this framework to show that the number of limit cycles in regularized piecewise smooth polynomial systems is unbounded.


title: Learning Observation-Based Certifiable Safe Policy for Decentralized Multi-Robot Navigation

abstract: Safety is of great importance in multi-robot navigation problems. In this paper, we propose a control barrier function (CBF) based optimizer that ensures robot safety with both high probability and flexibility, using only sensor measurement. The optimizer takes action commands from the policy network as initial values and then provides refinement to drive the potentially dangerous ones back into safe regions. With the help of a deep transition model that predicts the evolution of surrounding dynamics and the consequences of different actions, the CBF module can guide the optimization in a reasonable time horizon. We also present a novel joint training framework that improves the cooperation between the Reinforcement Learning (RL) based policy and the CBF-based optimizer both in training and inference procedures by utilizing reward feedback from the CBF module. We observe that the policy using our method can achieve a higher success rate while maintaining the safety of multiple robots in significantly fewer episodes compared with other methods. Experiments are conducted in multiple scenarios both in simulation and the real world, the results demonstrate the effectiveness of our method in maintaining the safety of multi-robot navigation. Code is available at \url{https://github.com/YuxiangCui/MARL-OCBF


title: Fixed angle inverse scattering for sound speeds close to constant

abstract: We study the fixed angle inverse scattering problem of determining a sound speed from scattering measurements corresponding to a single incident wave. The main result shows that a sound speed close to constant can be stably determined by just one measurement. Our method is based on studying the linearized problem, which turns out to be related to the acoustic problem in photoacoustic imaging. We adapt the modified time-reversal method from [P. Stefanov and G. Uhlmann, Thermoacoustic tomography with variable sound speed, Inverse Problems 25 (2009), 075011] to solve the linearized problem in a stable way, and we use this to give a local uniqueness result for the nonlinear inverse problem.


title: The scattering coefficients of superconducting microwave resonators: I. Transfer-matrix approach

abstract: We describe a unified classical approach for analyzing the scattering coefficients of superconducting microwave resonators with a variety of geometries. To fill the gap between experiment and theory, we also consider the influences of small circuit asymmetry and the finite length of the feedlines, and describe a procedure to correct them in typical measurement results. We show that, similar to the transmission coefficient of a hanger-type resonator, the reflection coefficient of a necklace- or bridge-type resonator does also contain a reference point which can be used to characterize the electrical properties of a microwave resonator in a single step. Our results provide a comprehensive understanding of superconducting microwave resonators from the design concepts to the characterization details.


title: Design and Evaluation of Reconfigurable Intelligent Surfaces in Real-World Environment

abstract: Reconfigurable intelligent surfaces (RISs) have promising coverage and data rate gains for wireless communication systems in 5G and beyond. Prior work has mainly focused on analyzing the performance of these surfaces using computer simulations or lab-level prototypes. To draw accurate insights about the actual performance of these systems, this paper develops an RIS proof-of-concept prototype and extensively evaluates its potential gains in the field and under realistic wireless communication settings. In particular, a 160-element reconfigurable surface, operating at a 5.8GHz band, is first designed, fabricated, and accurately measured in the anechoic chamber. This surface is then integrated into a wireless communication system and the beamforming gains, path-loss, and coverage improvements are evaluated in realistic outdoor communication scenarios. When both the transmitter and receiver employ directional antennas and with 5m and 10m distances between the transmitter-RIS and RIS-receiver, the developed RIS achieves $15$-$20$dB gain in the signal-to-noise ratio (SNR) in a range of $\pm60^\circ$ beamforming angles. In terms of coverage, and considering a far-field experiment with a blockage between a base station and a grid of mobile users and with an average distance of $35m$ between base station (BS) and the user (through the RIS), the RIS provides an average SNR improvement of $6$dB (max $8$dB) within an area $> 75$m$^2$. Thanks to the scalable RIS design, these SNR gains can be directly increased with larger RIS areas. For example, a 1,600-element RIS with the same design is expected to provide around $26$dB SNR gain for a similar deployment. These results, among others, draw useful insights into the design and performance of RIS systems and provide an important proof for their potential gains in real-world far-field wireless communication environments.


title: Meeting-Merging-Mission: A Multi-robot Coordinate Framework for Large-Scale Communication-Limited Exploration

abstract: This letter presents a complete framework Meeting-Merging-Mission for multi-robot exploration under communication restriction. Considering communication is limited in both bandwidth and range in the real world, we propose a lightweight environment presentation method and an efficient cooperative exploration strategy. For lower bandwidth, each robot utilizes specific polytopes to maintains free space and super frontier information (SFI) as the source for exploration decision-making. To reduce repeated exploration, we develop a mission-based protocol that drives robots to share collected information in stable rendezvous. We also design a complete path planning scheme for both centralized and decentralized cases. To validate that our framework is practical and generic, we present an extensive benchmark and deploy our system into multi-UGV and multi-UAV platforms.


title: Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Models

abstract: We introduce CoWeSe (the Corpus Web Salud Espa\~nol), the largest Spanish biomedical corpus to date, consisting of 4.5GB (about 750M tokens) of clean plain text. CoWeSe is the result of a massive crawler on 3000 Spanish domains executed in 2020. The corpus is openly available and already preprocessed. CoWeSe is an important resource for biomedical and health NLP in Spanish and has already been employed to train domain-specific language models and to produce word embbedings. We released the CoWeSe corpus under a Creative Commons Attribution 4.0 International license, both in Zenodo (\url{https://zenodo.org/record/4561971\#.YTI5SnVKiEA}).


title: The scattering coefficients of superconducting microwave resonators: II. System-bath approach

abstract: We describe a unified quantum approach for analyzing the scattering coefficients of superconducting microwave resonators with a variety of geometries. We also generalize the method to a chain of resonators with time delays, and reveal several transport properties similar to a photonic crystal. It is shown that both the quantum and classical analyses provide consistent results, and they together reveal different decay and decoherence mechanisms in a general microwave resonator. These results form a solid basis for understanding the scattering spectrums of networks of microwave resonators, and pave the way for applying superconducting microwave resonators in complex circuits.


title: Gaussian Broadcast Channels under Heterogeneous Blocklength Constraints

abstract: Future wireless access networks aim to simultaneously support a large number of devices with heterogeneous service requirements, including data rates, error rates, and latencies. While achievable rate and capacity results exist for Gaussian broadcast channels in the asymptotic blocklength regime, the characterization of second-order achievable rate regions for heterogeneous blocklength constraints is not available. Therefore, we investigate a two-user Gaussian broadcast channel (GBC) with heterogeneous blocklength constraints, specified according to users' channel output signal-to-noise ratios (SNRs). We assume the user with higher output SNR has a shorter blocklength constraint. We show that with sufficiently large output SNR, the stronger user can perform the \textit{early decoding} (ED) technique to decode and subtract the interference via successive interference cancellation (SIC). To achieve it, we derive an explicit lower bound on the necessary number of received symbols for a successful ED, using an independent and identically distributed Gaussian input. A second-order rate of the weaker user who suffers from an SNR change due to the heterogeneous blocklength constraint, is also derived. Numerical results show that ED can outperform the hybrid non-orthogonal multiple access scheme when the stronger channel is sufficiently better than the weaker one. Under the considered setting, about 7-dB SNR gain can be achieved. These results shows that ED with SIC is a promising technique for the future wireless networks.


title: Path Loss in Urban LoRa Networks: A Large-Scale Measurement Study

abstract: Urban LoRa networks promise to provide a cost-efficient and scalable communication backbone for smart cities. One core challenge in rolling out and operating these networks is radio network planning, i.e., precise predictions about possible new locations and their impact on network coverage. Path loss models aid in this task, but evaluating and comparing different models requires a sufficiently large set of high-quality received packet power samples. In this paper, we report on a corresponding large-scale measurement study covering an urban area of 200km2 over a period of 230 days using sensors deployed on garbage trucks, resulting in more than 112 thousand high-quality samples for received packet power. Using this data, we compare eleven previously proposed path loss models and additionally provide new coefficients for the Log-distance model. Our results reveal that the Log-distance model and other well-known empirical models such as Okumura or Winner+ provide reasonable estimations in an urban environment, and terrain based models such as ITM or ITWOM have no advantages. In addition, we derive estimations for the needed sample size in similar measurement campaigns. To stimulate further research in this direction, we make all our data publicly available.


title: Thermopower in transition-metal perovskites

abstract: High-temperature thermopower is interpreted as entropy that a carrier carries. Owing to spin and orbital degrees of freedom, a transition metal perovskite exhibits large thermopower at high temperatures. In this paper, we revisit the high-temperature thermopower in the perovskites to shed light on the degrees of freedom. Thus, we theoretically derive an expression of thermopower in one-dimensional octahedral-MX6-clusters chain using linear-response theory and electronic structure calculation of the chain based on the tight-binding approximation. The derived expression of the thermopower is consistent with the extended Heikes formula and well reproduced experimental data of several perovskite oxides at high temperatures. In this expression, a degeneracy of many electron states in octahedral ligand field (which is characterized by multiplet term) appears instead of the spin and orbital degeneracies. Complementarity in between our expression and the extended Heikes formula is discussed.