title: A Fast Point Cloud Ground Segmentation Approach Based on Coarse-To-Fine Markov Random Field

abstract: Ground segmentation is an important preprocessing task for autonomous vehicles (AVs) with 3D LiDARs. To solve the problem of existing ground segmentation methods being very difficult to balance accuracy and computational complexity, a fast point cloud ground segmentation approach based on a coarse-to-fine Markov random field (MRF) method is proposed. The method uses an improved elevation map for ground coarse segmentation, and then uses spatiotemporal adjacent points to optimize the segmentation results. The processed point cloud is classified into high-confidence obstacle points, ground points, and unknown classification points to initialize an MRF model. The graph cut method is then used to solve the model to achieve fine segmentation. Experiments on datasets showed that our method improves on other algorithms in terms of ground segmentation accuracy and is faster than other graph-based algorithms, which require only a single core of an I7-3770 CPU to process a frame of Velodyne HDL-64E data (in 39.77 ms, on average). Field tests were also conducted to demonstrate the effectiveness of the proposed method.


title: Don't cross the streams: caustics from Fuzzy Dark Matter

abstract: We study how tidal streams from globular clusters may be used to constrain the mass of ultra-light dark matter particles, called `fuzzy' dark matter (FDM). A general feature of FDM models is the presence of ubiquitous density fluctuations in bound, virialized dark matter structures, on the scale of the de Broglie wavelength, arising from wave interference in the evolving dark matter distribution. These time-varying fluctuations can disturb the motions of stars, leading to potentially observable signatures in cold thin tidal streams in our own Galaxy. The study of this effect has been hindered by the difficulty in simulating the FDM wavefunction in Milky Way-sized systems. We present a simple method to evolve realistic wavefunctions in nearly static potentials, that should provide an accurate estimate of this granulation effect. We quantify the impact of FDM perturbations on tidal streams, and show that initially, while stream perturbations are small in amplitude, their power spectra exhibit a sharp cutoff corresponding to the de Broglie wavelength of the FDM potential fluctuations. Eventually, when stream perturbations become nonlinear, fold caustics generically arise that lead to density fluctuations with universal behavior. This erases the signature of the de Broglie wavelength in the stream density power spectrum, but we show that it will still be possible to determine the FDM mass in this regime, by considering the fluctuations in quantities like angular momenta or actions.


title: Quadruply-imaged quasars: some general features

abstract: Gravitational lensing of point sources located inside the lens caustic is known to produce four images in a configuration closely related to the source position. We study this relation in the particular case of a sample of quadruply-imaged quasars observed by the Hubble Space Telescope (HST). Strong correlations between the parameters defining the image configuration are revealed. The relation between the image configuration and the source position is studied. Some simple features of the selected data sample are exposed and commented upon. In particular, evidence is found for the selected sample to be biased in favour of large magnification systems. While having no direct impact on practical analyses of specific systems, the results have pedagogical value and deepen our understanding of the mechanism of gravitational lensing.


title: Impacts of Noise and Structure on Quantum Information Encoded in a Quantum Memory

abstract: As larger, higher-quality quantum devices are built and demonstrated in quantum information applications, such as quantum computation and quantum communication, the need for high-quality quantum memories to store quantum states becomes ever more pressing. Future quantum devices likely will use a variety of physical hardware, some being used primarily for processing of quantum information and others for storage. Here, we study the correlation of the structure of quantum information with physical noise models of various possible quantum memory implementations. Through numerical simulation of different noise models and approximate analytical formulas applied to a variety of interesting quantum states, we provide comparisons between quantum hardware with different structure, including both qubit- and qudit-based quantum memories. Our findings point to simple, experimentally relevant formulas for the relative lifetimes of quantum information in different quantum memories and have relevance to the design of hybrid quantum devices.


title: Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images

abstract: Despite the remarkable advances in visual saliency analysis for natural scene images (NSIs), salient object detection (SOD) for optical remote sensing images (RSIs) still remains an open and challenging problem. In this paper, we propose an end-to-end Dense Attention Fluid Network (DAFNet) for SOD in optical RSIs. A Global Context-aware Attention (GCA) module is proposed to adaptively capture long-range semantic context relationships, and is further embedded in a Dense Attention Fluid (DAF) structure that enables shallow attention cues flow into deep layers to guide the generation of high-level feature attention maps. Specifically, the GCA module is composed of two key components, where the global feature aggregation module achieves mutual reinforcement of salient feature embeddings from any two spatial locations, and the cascaded pyramid attention module tackles the scale variation issue by building up a cascaded pyramid framework to progressively refine the attention map in a coarse-to-fine manner. In addition, we construct a new and challenging optical RSI dataset for SOD that contains 2,000 images with pixel-wise saliency annotations, which is currently the largest publicly available benchmark. Extensive experiments demonstrate that our proposed DAFNet significantly outperforms the existing state-of-the-art SOD competitors. https://github.com/rmcong/DAFNet_TIP20


title: Five-brane Current Algebras in Type II String Theories

abstract: We study the current algebras of the NS5-branes, the Kaluza-Klein (KK) five-branes and the exotic $5^2_2$-branes in type IIA/IIB superstring theories. Their worldvolume theories are governed by the six-dimensional $\mathcal{N}= (2,0)$ tensor and the $\mathcal{N} = (1,1)$ vector multiplets. We show that the current algebras are determined through the S- and T-dualities. The algebras of the $\mathcal{N} = (2,0)$ theories are characterized by the Dirac bracket caused by the self-dual gauge field in the five-brane worldvolumes, while those of the $\mathcal{N} = (1,1)$ theories are given by the Poisson bracket. By the use of these algebras, we examine extended spaces in terms of tensor coordinates which are the representation of ten-dimensional supersymmetry. We also examine the transition rules of the currents in the type IIA/IIB supersymmetry algebras in ten dimensions. Based on the algebras, we write down the section conditions in the extended spaces and gauge transformations of the supergravity fields.


title: Learning to Assist Drone Landings

abstract: Unmanned aerial vehicles (UAVs) are often used for navigating dangerous terrains, however they are difficult to pilot. Due to complex input-output mapping schemes, limited perception, the complex system dynamics and the need to maintain a safe operation distance, novice pilots experience difficulties in performing safe landings in obstacle filled environments. In this work we propose a shared autonomy approach that assists novice pilots to perform safe landings on one of several elevated platforms at a proficiency equal to or greater than experienced pilots. Our approach consists of two modules, a perceptual module and a policy module. The perceptual module compresses high dimensionality RGB-D images into a latent vector trained with a cross-modal variational auto-encoder. The policy module provides assistive control inputs trained with the reinforcement algorithm TD3. We conduct a user study (n=33) where participants land a simulated drone with and without the use of the assistant. Despite the goal platform not being known to the assistant, participants of all skill levels were able to outperform experienced participants while assisted in the task.


title: Generalized Mutual Information-Maximizing Quantized Decoding of LDPC Codes with Layered Scheduling

abstract: In this paper, we propose a framework of the mutual information-maximizing (MIM) quantized decoding for low-density parity-check (LDPC) codes by using simple mappings and fixed-point additions. Our decoding method is generic in the sense that it can be applied to LDPC codes with arbitrary degree distributions, and can be implemented based on either the belief propagation (BP) algorithm or the min-sum (MS) algorithm. In particular, we propose the MIM density evolution (MIM-DE) to construct the lookup tables (LUTs) for the node updates. The computational complexity and memory requirements are discussed and compared to the LUT decoder variants. For applications with low-latency requirement, we consider the layered schedule to accelerate the convergence speed of decoding quasi-cyclic LDPC codes. In particular, we develop the layered MIM-DE to design the LUTs based on the MS algorithm, leading to the MIM layered quantized MS (MIM-LQMS) decoder. An optimization method is further introduced to reduce the memory requirement for storing the LUTs. Simulation results show that the MIM quantized decoders outperform the state-of-the-art LUT decoders in the waterfall region with both 3-bit and 4-bit precision over the additive white Gaussian noise channels. For small decoding iterations, the MIM quantized decoders also achieve a faster convergence speed compared to the benchmarks. Moreover, the 4-bit MIM-LQMS decoder can approach the error performance of the floating-point layered BP decoder within 0.3 dB in the moderate-to-high SNR regions, over both the AWGN channels and the fast fading channels.


title: Streaming end-to-end multi-talker speech recognition

abstract: End-to-end multi-talker speech recognition is an emerging research trend in the speech community due to its vast potential in applications such as conversation and meeting transcriptions. To the best of our knowledge, all existing research works are constrained in the offline scenario. In this work, we propose the Streaming Unmixing and Recognition Transducer (SURT) for end-to-end multi-talker speech recognition. Our model employs the Recurrent Neural Network Transducer (RNN-T) as the backbone that can meet various latency constraints. We study two different model architectures that are based on a speaker-differentiator encoder and a mask encoder respectively. To train this model, we investigate the widely used Permutation Invariant Training (PIT) approach and the Heuristic Error Assignment Training (HEAT) approach. Based on experiments on the publicly available LibriSpeechMix dataset, we show that HEAT can achieve better accuracy compared with PIT, and the SURT model with 150 milliseconds algorithmic latency constraint compares favorably with the offline sequence-to-sequence based baseline model in terms of accuracy.


title: Better Knowledge Retention through Metric Learning

abstract: In continual learning, new categories may be introduced over time, and an ideal learning system should perform well on both the original categories and the new categories. While deep neural nets have achieved resounding success in the classical supervised setting, they are known to forget about knowledge acquired in prior episodes of learning if the examples encountered in the current episode of learning are drastically different from those encountered in prior episodes. In this paper, we propose a new method that can both leverage the expressive power of deep neural nets and is resilient to forgetting when new categories are introduced. We found the proposed method can reduce forgetting by 2.3x to 6.9x on CIFAR-10 compared to existing methods and by 1.8x to 2.7x on ImageNet compared to an oracle baseline.


title: Continuous Conversion of CT Kernel using Switchable CycleGAN with AdaIN

abstract: X-ray computed tomography (CT) uses different filter kernels to highlight different structures. Since the raw sinogram data is usually removed after the reconstruction, in case there are additional need for other types of kernel images that were not previously generated, the patient may need to be scanned again. Accordingly, there exists increasing demand for post-hoc image domain conversion from one kernel to another without sacrificing the image quality. In this paper, we propose a novel unsupervised continuous kernel conversion method using cycle-consistent generative adversarial network (cycleGAN) with adaptive instance normalization (AdaIN). Even without paired training data, not only can our network translate the images between two different kernels, but it can also convert images along the interpolation path between the two kernel domains. We also show that the quality of generated images can be further improved if intermediate kernel domain images are available. Experimental results confirm that our method not only enables accurate kernel conversion that is comparable to supervised learning methods, but also generates intermediate kernel images in the unseen domain that are useful for hypopharyngeal cancer diagnosis.


title: Coulomb nuclear interference effect in dipion production in ultraperipheral heavy ion collisions

abstract: We study exclusive $\pi^+ \pi^-$ pair production near $\rho^0$ resonance peak in ultraperipheral heavy ion collisions. Pion pair can either be produced via two photon fusion process or from the decay of $\rho^0$ in photon-nuclear reaction. At very low pair transverse momentum, the electromagnetic and nuclear amplitudes become comparable. We show that the Coulomb nuclear interference amplitude gives rise to sizable $\cos \phi$ and $\cos 3\phi$ azimuthal asymmetries, which can be used to constrain the phase of the dipole-nucleus scattering amplitude.


title: True-data Testbed for 5G/B5G Intelligent Network

abstract: Future beyond fifth-generation (B5G) and sixth-generation (6G) mobile communications will shift from facilitating interpersonal communications to supporting Internet of Everything (IoE), where intelligent communications with full integration of big data and artificial intelligence (AI) will play an important role in improving network efficiency and providing high-quality service. As a rapid evolving paradigm, the AI-empowered mobile communications demand large amounts of data acquired from real network environment for systematic test and verification. Hence, we build the world's first true-data testbed for 5G/B5G intelligent network (TTIN), which comprises 5G/B5G on-site experimental networks, data acquisition & data warehouse, and AI engine & network optimization. In the TTIN, true network data acquisition, storage, standardization, and analysis are available, which enable system-level online verification of B5G/6G-orientated key technologies and support data-driven network optimization through the closed-loop control mechanism. This paper elaborates on the system architecture and module design of TTIN. Detailed technical specifications and some of the established use cases are also showcased.


title: Nose to Glass: Looking In to Get Beyond

abstract: Brought into the public discourse through investigative work by journalists and scholars, awareness of algorithmic harms is at an all-time high. An increasing amount of research has been conducted under the banner of enhancing responsible artificial intelligence (AI), with the goal of addressing, alleviating, and eventually mitigating the harms brought on by the roll out of algorithmic systems. Nonetheless, implementation of such tools remains low. Given this gap, this paper offers a modest proposal: that the field, particularly researchers concerned with responsible research and innovation, may stand to gain from supporting and prioritising more ethnographic work. This embedded work can flesh out implementation frictions and reveal organisational and institutional norms that existing work on responsible artificial intelligence AI has not yet been able to offer. In turn, this can contribute to more insights about the anticipation of risks and mitigation of harm. This paper reviews similar empirical work typically found elsewhere, commonly in science and technology studies and safety science research, and lays out challenges of this form of inquiry.


title: Dark sector production and baryogenesis from not quite black holes

abstract: Primordial black holes have been considered as an attractive dark matter candidate, whereas some of the predictions heavily rely on the near-horizon physics that remains to be tested experimentally. As a concrete alternative, thermal 2-2-holes closely resemble black holes without event horizons. Being a probable endpoint of gravitational collapse, they not only provide a resolution to the information loss problem, but also naturally give rise to stable remnants. Previously, we have considered primordial 2-2-hole remnants as dark matter. Due to the strong constraints from a novel phenomenon associated with remnant mergers, only small remnants with close to the Planck mass can constitute all of dark matter. In this paper, we examine the scenario that the majority of dark matter consists of particles produced by the evaporation of primordial 2-2-holes, whereas the remnant contribution is secondary. The products with light enough mass may contribute to the number of relativistic degrees of freedom in the early universe, which we also calculate. Moreover, 2-2-hole evaporation can produce particles that are responsible for the baryon asymmetry. We find that baryogenesis through direct B-violating decays or through leptogenesis can both be realized. Overall, the viable parameter space for the Planck remnant case is similar to primordial black holes with Planck remnants. Heavier remnants, on the other hand, lead to different predictions, and the viable parameter space remains large even when the remnant abundance is small.


title: Electron Condensation in a Jellium Coupled to a Finite Photonic Cavity

abstract: We describe the process of electron condensation into a localized state in a structureless jellium that is coupled to a finite cavity. It is shown that there exists a temperature T_0 below which electrons within the jellium localize. This process is driven by enhancement of correlations between the electrons that are coupled to the cavity.


title: Superconductor Qubits Hamiltonian Approximations Effect on Quantum State Evolution and Control

abstract: Quantum state on Bloch sphere for superconducting charge qubit, phase qubit and flux qubit for all time in absence of external drive is stable to initial state. By driving the qubits, approximation of charge and flux Hamiltonian lead to quantum state rotation in Bloch sphere around an axis completely differ from rotation vector of exact Hamiltonian. The trajectory of quantum state for phase qubit for approximated and exact Hamiltonian is the same but the expectation of quantum observable has considerable errors as two other qubits. microwave drive control is designed for approximated Hamiltonian and exerted on actual systems and shows completely different trajectory with respect to desired trajectory. Finally a nonlinear control with external $\mu$V voltage control and nA current control is designed for general qubit which completely stabilizes quantum state toward a desired state.


title: Simultaneous inference for time-varying models

abstract: A general class of time-varying regression models is considered in this paper. We estimate the regression coefficients by using local linear M-estimation. For these estimators, weak Bahadur representations are obtained and are used to construct simultaneous confidence bands. For practical implementation, we propose a bootstrap based method to circumvent the slow logarithmic convergence of the theoretical simultaneous bands. Our results substantially generalize and unify the treatments for several time-varying regression and auto-regression models. The performance for ARCH and GARCH models is studied in simulations and a few real-life applications of our study are presented through analysis of some popular financial datasets.


title: Glauber-Exclusion dynamics : rapid mixing regime

abstract: We show that for any attractive Glauber-Exclusion process on the one-dimensional lattice of size $N$ with periodic boundary condition, if the corresponding hydrodynamic limit equation has a reaction term with a strictly convex potential, then the total-variation mixing time is of order $O(\log N)$. In particular, the result covers the full high-temperature regime in the original model introduced by De Masi, Ferrari and Lebowitz (1985).


title: A natural mechanism for approximate Higgs alignment in the 2HDM

abstract: The 2HDM possesses a neutral scalar interaction eigenstate whose tree-level properties coincide with the Standard Model (SM) Higgs boson. In light of the LHC Higgs data which suggests that the observed Higgs boson is SM-like, it follows that the mixing of the SM Higgs interaction eigenstate with the other neutral scalar interaction eigenstates of the 2HDM should be suppressed, corresponding to the so-called Higgs alignment limit. The exact Higgs alignment limit can arise naturally due to a global symmetry of the scalar potential. If this symmetry is softly broken, then the Higgs alignment limit becomes approximate (although still potentially consistent with the current LHC Higgs data). In this paper, we obtain the approximate Higgs alignment suggested by the LHC Higgs data as a consequence of a softly broken global symmetry of the Higgs Lagrangian. However, this can only be accomplished if the Yukawa sector of the theory is extended. We propose an extended 2HDM with vector-like top quark partners, where explicit mass terms in the top sector provide the source of the soft symmetry breaking of a generalized CP symmetry. In this way, we can realize approximate Higgs alignment without a significant fine-tuning of the model parameters. We then explore the implications of the current LHC bounds on vector-like top quark partners for the success of our proposed scenario.


title: Transformation Driven Visual Reasoning

abstract: This paper defines a new visual reasoning paradigm by introducing an important factor, i.e.~transformation. The motivation comes from the fact that most existing visual reasoning tasks, such as CLEVR in VQA, are solely defined to test how well the machine understands the concepts and relations within static settings, like one image. We argue that this kind of \textbf{state driven visual reasoning} approach has limitations in reflecting whether the machine has the ability to infer the dynamics between different states, which has been shown as important as state-level reasoning for human cognition in Piaget's theory. To tackle this problem, we propose a novel \textbf{transformation driven visual reasoning} task. Given both the initial and final states, the target is to infer the corresponding single-step or multi-step transformation, represented as a triplet (object, attribute, value) or a sequence of triplets, respectively. Following this definition, a new dataset namely TRANCE is constructed on the basis of CLEVR, including three levels of settings, i.e.~Basic (single-step transformation), Event (multi-step transformation), and View (multi-step transformation with variant views). Experimental results show that the state-of-the-art visual reasoning models perform well on Basic, but are still far from human-level intelligence on Event and View. We believe the proposed new paradigm will boost the development of machine visual reasoning. More advanced methods and real data need to be investigated in this direction. The resource of TVR is available at https://hongxin2019.github.io/TVR.


title: Positive-Unlabelled Survival Data Analysis

abstract: In this paper, we consider a novel framework of positive-unlabeled data in which as positive data survival times are observed for subjects who have events during the observation time as positive data and as unlabeled data censoring times are observed but whether the event occurs or not are unknown for some subjects. We consider two cases: (1) when censoring time is observed in positive data, and (2) when it is not observed. For both cases, we developed parametric models, nonparametric models, and machine learning models and the estimation strategies for these models. Simulation studies show that under this data setup, traditional survival analysis may yield severely biased results, while the proposed estimation method can provide valid results.


title: On the diversity and frequency of code related to mathematical formulas in real-world Java projects

abstract: In this paper, the term formula code refers to fragments of source code that implement a mathematical formula. We present empirical studies that analyze the diversity and frequency of formula code in open-source-software projects. In an exploratory study, we investigated what kinds of formulas are implemented in real-world Java projects and derived syntactical patterns and constraints. We refined these patterns for sum and product formulas to automatically detect formula code in software archives and to reconstruct the implemented formula in mathematical notation. In a quantitative study of a large sample of engineered Java projects on GitHub we analyzed the frequency of formula code and estimated that one of 700 lines of code in this sample implements a sum or product formula. For a sample of scientific-computing projects, we found that one of 100 lines of code implements a sum or product formula. To assess the need for tool support, we investigated the helpfulness of comments for program understanding in a sample of formula-code fragments and performed an online survey. Our findings provide first insights into the characteristics of formula code, that can motivate further studies on the role of formula code in software projects and the design of formula-related tools.


title: Being Central on the Cheap: Stability in Heterogeneous Multiagent Centrality Games

abstract: We study strategic network formation games in which agents attempt to form (costly) links in order to maximize their network centrality. Our model derives from Jackson and Wolinsky's symmetric connection model, but allows for heterogeneity in agent utilities by replacing decay centrality (implicit in the Jackson-Wolinsky model) by a variety of classical centrality and game-theoretic measures of centrality. We are primarily interested in characterizing the asymptotically pairwise stable networks, i.e. those networks that are pairwise stable for all sufficiently small, positive edge costs. We uncover a rich typology of stability: - we give an axiomatic approach to network centrality that allows us to predict the stable network for a rich set of combination of centrality utility functions, yielding stable networks with features reminiscent of structural properties such as "core periphery" and "rich club" networks. - We show that a simple variation on the model renders it universal, i.e. every network may be a stable network. - We also show that often we can infer a significant amount about agent utilities from the structure of stable networks.

categories: cs.GT cond-mat.dis-nn cs.AI cs.DM math.CO


title: Planetesimal formation around the snow line: I. Monte Carlo simulations of silicate dust pile-up in a turbulent disk

abstract: Context: The formation of rocky planetesimals is a long-standing problem in planet formation theory. One of the possibilities is that it results from gravitational instability as a result of pile-up of small silicate dust particles released from sublimating icy pebbles that pass the snow line. Aims: We want to understand and quantify the role of the water snow line for the formation of rock-rich and ice-rich planetesimals. In this paper, we focus on the formation of rock-rich planetesimals. A companion paper examines the combined formation of both rock-rich and ice-rich planetesimals. Methods: We develop a new Monte Carlo code to calculate the radial evolution of silicate particles in a turbulent accretion disk, accounting for the back-reaction (i.e., inertia) of the particles on their radial drift velocity and diffusion. Results depend in particular on the particle injection width (determined from the radial sublimation width of icy pebbles), the pebble scale height and the pebble mass flux through the disk. The scale height evolution of the silicate particles, which is the most important factor for the runaway pile-up, is automatically calculated in this Lagrange method. Results: From the numerical results, we derive semi-analytical relations for the scale height of the silicate dust particles and the particles-to-gas density ratio at the midplane, as functions of a pebble-to-gas mass flux ratio and the $\alpha$ parameters for disk gas accretion and vertical/radial diffusion. We find that the runaway pile-up of the silicate particles (formation of rocky planetesimals) occurs if the pebble-to-gas mass flux ratio is $> [(\alpha_{Dz}/\alpha_{acc})/3 \times 10^{-2}]^{1/2}$ where $\alpha_{Dz}$ and $\alpha_{acc}$ are the $\alpha$ parameters for vertical turbulent diffusion and disk gas accretion.


title: Reconstructing HI power spectrum with minimal parameters using the dark matter distribution beyond halos

abstract: Intensity mapping of 21-cm line by several radio telescope experiments will probe the large-scale structure of the Universe in the post-reionization epoch. It requires a theoretical framework of neutral hydrogen (HI) clustering, such as modelling of HI power spectrum for Baryon Acoustic Oscillations (BAO) analysis. We propose a new method for reconstructing the HI map from dark matter distribution using N-body simulations. Several studies attempt to compute the HI power spectrum with N-body simulations by pasting HI gas at the dark matter halo centre, assuming the relation between the halo and HI masses. On the other hand, the method proposed in this paper reproduces the HI power spectrum from simulated dark matter distribution truncated at specific scales from the halo centre. With this method, the slope of HI power spectrum is reproduced well at the BAO scales, $k<1 h/{\rm Mpc}$. Furthermore, we find the fluctuation of spin temperature, which is often ignored at the post-reionization epoch, alters the power spectrum of brightness temperature by at most 8% in the power spectrum. Finally, we discuss how our method works by comparing the density profiles of HI and dark matter around the dark matter halos.


title: Hessian Inverse Approximation as Covariance for Random Perturbation in Black-Box Problems

abstract: In stochastic optimization problems using noisy zeroth-order (ZO) oracles only, the randomized counterpart of the Kiefer-Wolfowitz-type method is widely used to estimate the gradient. Existing algorithms generate randomized perturbation from a zero-mean and unit-covariance distribution. In contrast, this work considers the generalization where the perturbations have a possibly non-identity covariance constructed from the history of the ZO queries. We propose to feed the second-order approximation into the covariance matrix of the random perturbation, so it is dubbed as Hessian-aided random perturbation (HARP). HARP collects four zeroth-order queries per iteration to form approximations for both the gradient and the Hessian. We show the convergence (in an almost surely sense) and derive the convergence rate for HARP under mild assumptions. We demonstrate, with theoretical guarantees and numerical experiments, that HARP is less sensitive to ill-conditioning and more query-efficient than other gradient approximation schemes whose random perturbation has an identity covariance.


title: Modelling the pulsatile flow rate and pressure response of a roller-type peristaltic pump

abstract: The unique working mechanics of roller-type peristaltic pumps have allowed their applications to span a wide variety of sectors and industries. The roller-type pump's accurate dosing and hydrostatic capabilities can theoretically allow for the pump to be used for hydraulic actuation (as an electro-hydrostatic actuator) for low pressure applications. This however requires accurate control of the peristaltic pump and its flow rate. The associated pressure pulsations will also have an impact on the pump's selection criteria. Accurate control of roller-type peristaltic pumps commonly rely on flow-meters, which increases the cost of the pump and can complicate control strategies. Current modelling approaches either do not rely on first principle modelling and require expensive simulation software, or do not apply for larger Reynolds numbers at larger flow rates. The most applicable model focusses on the flow rate for each roller individually. This implies that the model requires alterations in order to accommodate pumps with varying numbers of rollers. This paper presents an alternative modelling methodology towards the volume flow rate, pulsatile flow rate qualities, and pressure pulsations commonly found on peristaltic pumps. The model instead focusses on the flow rate at the inlet and the outlet of the pump, rather than on each individual roller. This model is highly scalable and allows for varying number of rollers. The model is validated using a 3D printed peristaltic pump and pulsatile flow rate test bench. The pump is capable of accommodating roller housings with varying numbers of rollers (3 or 2) in order to validate the model.


title: Polarimetric and radiative transfer modelling of HD 172555

abstract: The debris disc around HD 172555 was recently imaged in near-infrared polarised scattered light by the Very Large Telescope's Spectro-Polarimetric High-contrast Exoplanet REsearch instrument. Here we present optical aperture polarisation measurements of HD 172555 by the HIgh Precision Polarimetric Instrument (HIPPI), and its successor HIPPI-2 on the Anglo-Australian Telescope. We seek to refine constraints on the disc's constituent dust grains by combining our polarimetric measurements with available infrared and millimetre photometry to model the scattered light and continuum emission from the disc. We model the disc using the 3D radiative transfer code Hyperion, assuming the orientation and extent of the disc as obtained from the SPHERE observation. After correction for the interstellar medium contribution, our multi-wavelength HIPPI/-2 observations (both magnitude and orientation) are consistent with the recent SPHERE polarisation measurement with a fractional polarisation $p = 62.4 \pm 5.2$~ppm at 722.3 nm, and a position angle $\theta = 67 \pm 3^{\circ}$. The multi-wavelength polarisation can be adequately replicated by compact, spherical dust grains (i.e. from Mie theory) that are around 1.2 $\mu$m in size, assuming astronomical silicate composition, or 3.9 $\mu$m assuming a composition derived from radiative transfer modelling of the disc. We were thus able to reproduce both the spatially resolved disc emission and polarisation with a single grain composition model and size distribution.


title: Achievements and Challenges in Explaining Deep Learning based Computer-Aided Diagnosis Systems

abstract: Remarkable success of modern image-based AI methods and the resulting interest in their applications in critical decision-making processes has led to a surge in efforts to make such intelligent systems transparent and explainable. The need for explainable AI does not stem only from ethical and moral grounds but also from stricter legislation around the world mandating clear and justifiable explanations of any decision taken or assisted by AI. Especially in the medical context where Computer-Aided Diagnosis can have a direct influence on the treatment and well-being of patients, transparency is of utmost importance for safe transition from lab research to real world clinical practice. This paper provides a comprehensive overview of current state-of-the-art in explaining and interpreting Deep Learning based algorithms in applications of medical research and diagnosis of diseases. We discuss early achievements in development of explainable AI for validation of known disease criteria, exploration of new potential biomarkers, as well as methods for the subsequent correction of AI models. Various explanation methods like visual, textual, post-hoc, ante-hoc, local and global have been thoroughly and critically analyzed. Subsequently, we also highlight some of the remaining challenges that stand in the way of practical applications of AI as a clinical decision support tool and provide recommendations for the direction of future research.


title: Anticipatory Ethics and the Role of Uncertainty

abstract: Making conjectures about future consequences of a technology is an exercise in trying to reduce various forms of uncertainty. Both to produce and reason about these conjectures requires understanding their potential limitations. In other words, we need systematic ways of considering uncertainty associated with given conjectures for downstream consequences. In this work, we frame the task of considering future consequences as an anticipatory ethics problem, where the goal is to develop scenarios that reflect plausible outcomes and their ethical implications following a technology's introduction into society. In order to shed light on how various forms of uncertainty might inform how we reason about a resulting scenario, we provide a characterization of the types of uncertainty that arise in a potential scenario-building process.


title: Universal Semantics for the Stochastic Lambda-Calculus

abstract: We define sound and adequate denotational and operational semantics for the stochastic lambda calculus. These two semantic approaches build on previous work that used similar techniques to reason about higher-order probabilistic programs, but for the first time admit an adequacy theorem relating the operational and denotational views. This resolves the main issue left open in (Bacci et al. 2018).


title: A Reversed and Shift Sparse Array Scheme based on the Difference and Sum Co-array

abstract: The reversed and shift (RAS) sparse array scheme, which is based on the difference and sum co-array (DSCA) and remarkably enhances the capability of identifying sources, is proposed. For the original nested array (NA) or co-prime array (CPA), there exists a large overlap between its difference co-array and sum co-array, which prevents it from obtaining high degrees of freedom (DOFs). Motivated by this fact, the RAS scheme is designed for reducing the overlap while increasing the DOFs for direction of arrival (DOA) estimation. The proposed scheme is effective for both NA and CPA. The closed-form expression for the relationship between the number of physical sensors and the number of consecutive DSCA sensors is derived. Compared with some representative DSCA based sparse arrays, the proposed one can achieve longer consecutive virtual array. Simulation experiments are carried out to exhibit the enhanced DOA estimation performance of RAS scheme.


title: Constrained high-index saddle dynamics for the solution landscape with equality constraints

abstract: We propose a constrained high-index saddle dynamics (CHiSD) method to search for index-$k$ saddle points of an energy functional subject to equality constraints. With Riemannian manifold tools, the CHiSD is derived in a minimax framework, and its linear stability at an index-$k$ saddle point is proved. To ensure the manifold property, the CHiSD is numerically implemented using retractions and vector transport. Then we present a numerical approach by combining CHiSD with downward and upward search algorithms to construct the solution landscape in the presence of equality constraints. We apply the Thomson problem and the Bose-Einstein condensation as numerical examples to demonstrate the efficiency of the proposed method.


title: Explainable Tensorized Neural Ordinary Differential Equations forArbitrary-step Time Series Prediction

abstract: We propose a continuous neural network architecture, termed Explainable Tensorized Neural Ordinary Differential Equations (ETN-ODE), for multi-step time series prediction at arbitrary time points. Unlike the existing approaches, which mainly handle univariate time series for multi-step prediction or multivariate time series for single-step prediction, ETN-ODE could model multivariate time series for arbitrary-step prediction. In addition, it enjoys a tandem attention, w.r.t. temporal attention and variable attention, being able to provide explainable insights into the data. Specifically, ETN-ODE combines an explainable Tensorized Gated Recurrent Unit (Tensorized GRU or TGRU) with Ordinary Differential Equations (ODE). The derivative of the latent states is parameterized with a neural network. This continuous-time ODE network enables a multi-step prediction at arbitrary time points. We quantitatively and qualitatively demonstrate the effectiveness and the interpretability of ETN-ODE on five different multi-step prediction tasks and one arbitrary-step prediction task. Extensive experiments show that ETN-ODE can lead to accurate predictions at arbitrary time points while attaining best performance against the baseline methods in standard multi-step time series prediction.


title: Fiber as a temperature sensor with portable Correlation-OTDR as interrogator

abstract: In this paper, we report on the integration of a Correlation-OTDR into a portable unit (30 cm x 30 cm), based on a multi-processor system on chip (MPSoC) and a small formfactor pluggable (SFP) 2.5G transceiver. Going beyond telecommunication applications, this system is demonstrated for temperature measurements, based on the change of propagation delay with temperature in a short section of optical fiber. The temperature measurement accuracy is investigated as a function of the fiber length from 4 to 25 meters.


title: Oxidising and carburising catalyst conditioning for the controlled growth and transfer of large crystal monolayer hexagonal boron nitride

abstract: Hexagonal boron nitride (h-BN) is well-established as a requisite support, encapsulant and barrier for 2D material technologies, but also recently as an active material for applications ranging from hyperbolic metasurfaces to room temperature single-photon sources. Cost-effective, scalable and high quality growth techniques for h-BN layers are critically required. We utilise widely-available iron foils for the catalytic chemical vapour deposition (CVD) of h BN and report on the significant role of bulk dissolved species in h-BN CVD, and specifically, the balance between dissolved oxygen and carbon. A simple pre-growth conditioning step of the iron foils enables us to tailor an error-tolerant scalable CVD process to give exceptionally large h-BN monolayer domains. We also develop a facile method for the improved transfer of as-grown h-BN away from the iron surface by means of the controlled humidity oxidation and subsequent rapid etching of a thin interfacial iron oxide; thus, avoiding the impurities from the bulk of the foil. We demonstrate wafer-scale (2 inch) production and utilise this h-BN as a protective layer for graphene towards integrated (opto) electronic device fabrication.


title: Inverse scattering transform for the Tzitz\'{e}ica equation

abstract: The inverse scattering transform is extended to investigate the Tzitz\'{e}ica equation. A set of sectionally analytic eigenfunctions and auxiliary eigenfunctions are introduced. We note that in this procedure, the auxiliary eigenfunctions play an important role. Besides, the symmetries of the analytic eigenfunctions and scattering data are discussed. The asymptotic behaviors of the Jost eigenfunctions are derived systematically. A Riemann-Hilbert problem is constructed to study the inverse scattering problem. Lastly, some novel exact solutions are obtained for reflectionless potentials.


title: Twisted generating functions and the nearby Lagrangian conjecture

abstract: We prove that, for closed exact embedded Lagrangian submanifolds of cotangent bundles, the homomorphism of homotopy groups induced by the stable Lagrangian Gauss map vanishes. In particular, we prove that this map is null-homotopic for all spheres. The key tool that we introduce in order to prove this is the notion of twisted generating function and we show that every closed exact Lagrangian can be described using such an object, by extending a doubling argument developed in the setting of sheaf theory. Floer theory and sheaf theory constrain the type of twisted generating functions that can appear to a class which is closely related to Waldhausen's tube space, and our main result follows by a theorem of B\"okstedt which computes the rational homotopy type of the tube space.


title: Saliency-based segmentation of dermoscopic images using color information

abstract: Skin lesion segmentation is one of the crucial steps for an efficient non-invasive computer-aided early diagnosis of melanoma. This paper investigates how color information, besides saliency, can be used to determine the pigmented lesion region automatically. Unlike most existing segmentation methods using only the saliency in order to discriminate against the skin lesion from the surrounding regions, we propose a novel method employing a binarization process coupled with new perceptual criteria, inspired by the human visual perception, related to the properties of saliency and color of the input image data distribution. As a means of refining the accuracy of the proposed method, the segmentation step is preceded by a pre-processing aimed at reducing the computation burden, removing artifacts, and improving contrast. We have assessed the method on two public databases, including 1497 dermoscopic images. We have also compared its performance with classical and recent saliency-based methods designed explicitly for dermoscopic images. The qualitative and quantitative evaluation indicates that the proposed method is promising since it produces an accurate skin lesion segmentation and performs satisfactorily compared to other existing saliency-based segmentation methods.


title: Vibrational density of states of amorphous solids with long-ranged power-law correlated disorder in elasticity

abstract: A theory of vibrational excitations based on power-law spatial correlations in the elastic constants (or equivalently in the internal stress) is derived, in order to determine the vibrational density of states $D(\omega)$ of disordered solids. The results provide the first prediction of a boson peak in amorphous materials where spatial correlations in the internal stresses (or elastic constants) are of power-law form, as is often the case in experimental systems, leading to logarithmic enhancement of (Rayleigh) phonon attenuation. A logarithmic correction of the form $\sim -\omega^{2}\ln\omega$ is predicted to occur in the plot of the reduced excess DOS for frequencies around the boson peak in 3D. Moreover, the theory provides scaling laws of the density of states in the low-frequency region, including a $\sim\omega^{4}$ regime in 3D, and provides information about how the boson peak intensity depends on the strength of power-law decay of fluctuations in elastic constants or internal stress. Analytical expressions are also derived for the dynamic structure factor for longitudinal excitations, which include a logarithmic correction factor, and numerical calculations are presented supporting the assumptions used in the theory.

categories: cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.soft cond-mat.stat-mech


title: Regularization with Latent Space Virtual Adversarial Training

abstract: Virtual Adversarial Training (VAT) has shown impressive results among recently developed regularization methods called consistency regularization. VAT utilizes adversarial samples, generated by injecting perturbation in the input space, for training and thereby enhances the generalization ability of a classifier. However, such adversarial samples can be generated only within a very small area around the input data point, which limits the adversarial effectiveness of such samples. To address this problem we propose LVAT (Latent space VAT), which injects perturbation in the latent space instead of the input space. LVAT can generate adversarial samples flexibly, resulting in more adverse effects and thus more effective regularization. The latent space is built by a generative model, and in this paper, we examine two different type of models: variational auto-encoder and normalizing flow, specifically Glow. We evaluated the performance of our method in both supervised and semi-supervised learning scenarios for an image classification task using SVHN and CIFAR-10 datasets. In our evaluation, we found that our method outperforms VAT and other state-of-the-art methods.


title: Giant orbital diamagnetism of three-dimensional Dirac electrons in Sr$ _3$PbO antiperovskite

abstract: In Dirac semimetals, inter-band mixing has been known theoretically to give rise to a giant orbital diamagnetism when the Fermi level is close to the Dirac point. In Bi$ _{1-x}$Sb$ _x$ and other Dirac semimetals, an enhanced diamagnetism in the magnetic susceptibility $\chi$ has been observed and interpreted as a manifestation of such giant orbital diamagnetism. Experimentally proving their orbital origin, however, has remained challenging. Cubic antiperovskite Sr$ _3$PbO is a three-dimensional Dirac electron system and shows the giant diamagnetism in $\chi$ as in the other Dirac semimetals. $ ^{207}$Pb NMR measurements are conducted in this study to explore the microscopic origin of diamagnetism. From the analysis of the Knight shift $K$ as a function of $\chi$ and the relaxation rate $T_1^{-1}$ for samples with different hole densities, the spin and the orbital components in $K$ are successfully separated. The results establish that the enhanced diamagnetism in Sr$ _3$PbO originates from the orbital contribution of Dirac electrons, which is fully consistent with the theory of giant orbital diamagnetism.


title: TinaFace: Strong but Simple Baseline for Face Detection

abstract: Face detection has received intensive attention in recent years. Many works present lots of special methods for face detection from different perspectives like model architecture, data augmentation, label assignment and etc., which make the overall algorithm and system become more and more complex. In this paper, we point out that \textbf{there is no gap between face detection and generic object detection}. Then we provide a strong but simple baseline method to deal with face detection named TinaFace. We use ResNet-50 \cite{he2016deep} as backbone, and all modules and techniques in TinaFace are constructed on existing modules, easily implemented and based on generic object detection. On the hard test set of the most popular and challenging face detection benchmark WIDER FACE \cite{yang2016wider}, with single-model and single-scale, our TinaFace achieves 92.1\% average precision (AP), which exceeds most of the recent face detectors with larger backbone. And after using test time augmentation (TTA), our TinaFace outperforms the current state-of-the-art method and achieves 92.4\% AP. The code will be available at \url{https://github.com/Media-Smart/vedadet}.


title: Competing Advanced Process Control via an Industrial Automation Cloud Platform

abstract: This paper proposes an innovative approach for the advanced control of an industrial process via an automation cloud platform. Increased digital transformation and advances in Industrial Internet of Things (IIoT) technologies make it possible for multiple vendors to compete to control an industrial process. An industrial automation cloud platform facilitates the interaction between advanced process control (APC) vendors and the process. A selector, which forms part of the platform, is used to determine the best controller for a process for any given time period. The article starts with a general overview of platform businesses, platforms aimed at industry, and the steps required to build such platforms. Issues that need to be addressed to make APC via an automation platform practically viable are discussed including what process information to provide to APC vendors, continuous evaluation of controllers even when not in control of the process, bumpless transfer, closed-loop stability, constraint handling, and platform security and trust. A case study is given of competing APCs via an industrial automation cloud platform. The process used in the study is a surge tank from a bulk tailings treatment plant, the aim of which is to keep the density of the tank out flow constant while maintaining a steady tank level. A platform facilitates the competition of three vendors for control of this process. It is shown that the cloud platform approach can provide the plant access to a superior controller without the need for directly procuring the services of an exclusive vendor.


title: Determination of egg storage time at room temperature using a low-cost NIR spectrometer and machine learning techniques

abstract: Nowadays, consumers are more concerned about freshness and quality of food. Poultry egg storage time is a freshness and quality indicator in industrial and consumer applications, even though egg marking is not always required outside the European Union. Other authors have already published works using expensive laboratory equipment in order to determine the storage time and freshness in eggs. Oppositely, this paper presents a novel method based on low-cost devices for rapid and non-destructive prediction of egg storage time at room temperature ($23\pm1$\deg C). H&N brown flock with 49-week-old hens were used as source for the sampled eggs. Those samples were daily scanned with a low-cost smartphone-connected near infrared reflectance (NIR) spectrometer for a period of 22 days starting to run from the egg laid. The resulting dataset of 660 samples was randomly splitted according to a 10-fold cross validation in order to be used in a contrast and optimization process of two machine learning algorithms. During the optimization, several models were tested to develop a robust calibration model. The best model use a Savitzky Golay preprocessing technique, and an Artificial Neural Network with ten neurons in one hidden layer. Regressing the storage time of the eggs, tests achieved a coefficient of determination (R-squared) of $0.8319\pm0.0377$ and a root mean squared error (RMSE) of 1.97. Although further work is needed, this technique has shown industrial potential and consumer utility to determine the egg's freshness by using a low-cost spectrometer connected to a smartphone.


title: Perturbative chiral nucleon-nucleon potential for the $^3P_0$ partial wave

abstract: We study perturbativeness of chiral nuclear forces in the $^3P_0$ channel. In previous works, the focus has been on one-pion exchange, and the applicable window of perturbative pion exchanges has been shown to span from threshold to the center-of-mass momentum $k \simeq$ 180 MeV. We will examine, instead, whether cancellation of short and long-range parts can sufficiently soften the $^3P_0$ chiral force to make it more amenable to perturbation theory. The result is encouraging, as the combined $^3P_0$ force is shown to be perturbative up to $k \simeq$ 280 MeV, covering many nuclear-structure calculations.


title: Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluation

abstract: Argument Mining is defined as the task of automatically identifying and extracting argumentative components (e.g., premises, claims, etc.) and detecting the existing relations among them (i.e., support, attack, rephrase, no relation). One of the main issues when approaching this problem is the lack of data, and the size of the publicly available corpora. In this work, we use the recently annotated US2016 debate corpus. US2016 is the largest existing argument annotated corpus, which allows exploring the benefits of the most recent advances in Natural Language Processing in a complex domain like Argument (relation) Mining. We present an exhaustive analysis of the behavior of transformer-based models (i.e., BERT, XLNET, RoBERTa, DistilBERT and ALBERT) when predicting argument relations. Finally, we evaluate the models in five different domains, with the objective of finding the less domain dependent model. We obtain a macro F1-score of 0.70 with the US2016 evaluation corpus, and a macro F1-score of 0.61 with the Moral Maze cross-domain corpus.


title: On the Composition of the Long Tail of Business Processes: Implications from a Process Mining Study

abstract: Digital transformation forces companies to rethink their processes to meet current customer needs. Business Process Management (BPM) can provide the means to structure and tackle this change. However, most approaches to BPM face restrictions on the number of processes they can optimize at a time due to complexity and resource restrictions. Investigating this shortcoming, the concept of the long tail of business processes suggests a hybrid approach that entails managing important processes centrally, while incrementally improving the majority of processes at their place of execution. This study scrutinizes this observation as well as corresponding implications. First, we define a system of indicators to automatically prioritize processes based on execution data. Second, we use process mining to analyze processes from multiple companies to investigate the distribution of process value in terms of their process variants. Third, we examine the characteristics of the process variants contained in the short head and the long tail to derive and justify recommendations for their management. Our results suggest that the assumption of a long-tailed distribution holds across companies and indicators and also applies to the overall improvement potential of processes and their variants. Across all cases, process variants in the long tail were characterized by fewer customer contacts, lower execution frequencies, and a larger number of involved stakeholders, making them suitable candidates for distributed improvement.


title: On the Terracini locus of projective varieties

abstract: We introduce and study properties of the Terracini locus of projective varieties X, which is the locus of finite subsets S of X such that 2S fails to impose independent conditions to a linear system L. Terracini loci are relevant in the study of interpolation problems over double points in special position, but they also enter naturally in the study of special loci contained in secant varieties to projective varieties. We find some criteria which exclude that a set S belongs to the Terracini locus. Furthermore, in the case where X is a Veronese variety, we bound the dimension of the Terracini locus and we determine examples in which the locus has codimension 1 in the symmetric product of X.


title: Bose-Einstein condensate soliton qubit states for metrological applications

abstract: By utilizing Bose-Einstein condensate solitons, optically manipulated and trapped in a double-well potential, coupled through nonlinear Josephson effect, we propose novel quantum metrology applications with two soliton qubit states. In addition to steady-state solutions in different scenarios, phase space analysis, in terms of population imbalance - phase difference variables, is also performed to demonstrate macroscopic quantum self-trapping regimes. Schr\"odinger-cat states, maximally path-entangled ($N00N$) states, and macroscopic soliton qubits are predicted and exploited for the distinguishability of obtained macroscopic states in the framework of binary (non-orthogonal) state discrimination problem. For arbitrary phase estimation in the framework of linear quantum metrology approach, these macroscopic soliton states are revealed to have a scaling up to the Heisenberg limit (HL). The examples are illustrated for HL estimation of angular frequency between the ground and first excited macroscopic states of the condensate, which opens new perspectives for current frequency standards technologies.


title: Extrapolation for multilinear compact operators and applications

abstract: This paper is devoted to studying the Rubio de Francia extrapolation for multilinear compact operators. It allows one to extrapolate the compactness of $T$ from just one space to the full range of weighted spaces, whenever an $m$-linear operator $T$ is bounded on weighted Lebesgue spaces. This result is indeed established in terms of the multilinear Muckenhoupt weights $A_{\vec{p}, \vec{r}}$, and the limited range of the $L^p$ scale. To show extrapolation theorems above, by means of a new weighted Fr\'{e}chet-Kolmogorov theorem, we present the weighted interpolation for multilinear compact operators. To prove the latter, we also need to bulid a weighted interpolation theorem in mixed-norm Lebesgue spaces. As applications, we obtain the weighted compactness of commutators of many multilinear operators, including multilinear $\omega$-Calder\'{o}n-Zygmund operators, multilinear Fourier multipliers, bilinear rough singular integrals and bilinear Bochner-Riesz means. Beyond that, we establish the weighted compactness of higher order Calder\'{o}n commutators, and commutators of Riesz transforms related to Schr\"{o}dinger operators.


title: Fiber-Wise Linear Differential Operators

abstract: We define a new notion of fiber-wise linear differential operator on the total space of a vector bundle $E$. Our main result is that fiber-wise linear differential operators on $E$ are equivalent to (polynomial) derivations of an appropriate line bundle over $E^\ast$. We believe this might represent a first step towards a definition of multiplicative (resp. infinitesimally multiplicative) differential operators on a Lie groupoid (resp. a Lie algebroid). We also discuss the linearization of a differential operator around a submanifold.


title: Enhancement of maximum superconducting temperature by applying pressure and reducing the charge transfer gap

abstract: Recent Scanning Tunneling Spectra(STS) measurement on underdoped cuprate discovers the increase of the maximum superconducting transition temperature $T_c$ when the size of charge transfer gap (CTG) is reduced. Applying pressure is another well known method to increase maximum $T_c$. However, these pressure experiments also found another puzzle that $T_c$ is enhanced in underdoped and optimal doped samples but suppressed in overdoped. Here we present a possible mechanism based on the charge fluctuation to explain both these two effects simultaneously. Starting from 3-band Hubbard model, we retrieve the charge fluctuation(CF) between oxygen 2$p^6$ band and copper 3$d^{10}$ band which is ignored in the $t-J$ model. This model is studied via variational Monte Carlo method(VMC).


title: Neural Networks for Pulmonary Disease Diagnosis using Auditory and Demographic Information

abstract: Pulmonary diseases impact millions of lives globally and annually. The recent outbreak of the pandemic of the COVID-19, a novel pulmonary infection, has more than ever brought the attention of the research community to the machine-aided diagnosis of respiratory problems. This paper is thus an effort to exploit machine learning for classification of respiratory problems and proposes a framework that employs as much correlated information (auditory and demographic information in this work) as a dataset provides to increase the sensitivity and specificity of a diagnosing system. First, we use deep convolutional neural networks (DCNNs) to process and classify a publicly released pulmonary auditory dataset, and then we take advantage of the existing demographic information within the dataset and show that the accuracy of the pulmonary classification increases by 5% when trained on the auditory information in conjunction with the demographic information. Since the demographic data can be extracted using computer vision, we suggest using another parallel DCNN to estimate the demographic information of the subject under test visioned by the processing computer. Lastly, as a proposition to bring the healthcare system to users' fingertips, we measure deployment characteristics of the auditory DCNN model onto processing components of an NVIDIA TX2 development board.


title: Average rank of quadratic twists with a rational point of almost minimal height

abstract: Given a family of quadratic twists of a fixed elliptic curve defined over $\mathbb{Q}$, we investigate the average rank in the subfamily of twists having a nontorsion rational point of almost minimal height. We show in particular that the average analytic rank is greater than one.


title: Mesoscopic quantum superposition states of weakly-coupled matter-wave solitons

abstract: The Josephson junctions (JJs) are at the heart of modern quantum technologies and metrology. In this work we establish quantum features of an atomic soliton Josephson junction (SJJ) device, which consists of two weakly-coupled condensates with negative scattering length. The condensates are trapped in a double-well potential and elongated in one dimension. Starting with classical field theory we map for the first time a two-soliton problem onto the effective two-mode Hamiltonian and perform a second quantization procedure. Compared to the conventional Bosonic Josephson junction (BJJ) condensate system, we show that the SJJ-model in quantum domain exhibits unusual features due to its effective nonlinear strength proportional to the square of total particle number, $N^2$. A novel self-tuning effect for the effective tunneling parameter is also demonstrated in the SJJ-model, which depends on the particle number and rapidly vanishes as the JJ population imbalance increases. The formation of entangled Fock state superposition is predicted for the quantum SJJ-model, revealing dominant $N00N$-state components at the "edges" for $n=0, N$ particle number. We have shown that the obtained quantum state is more resistant to few particle losses from the condensates if tiny components of entangled Fock states are present in the vicinity of the major $N00N$-state component. This peculiarity of the quantum SJJ-model establishes an important difference from its semiclassical analogue obtained in the framework of Hartree approach.


title: Stability analysis of three exoplanet systems

abstract: The orbital solutions of published multi-planet systems are not necessarily dynamically stable on timescales comparable to the lifetime of the system as a whole. For this reason, dynamical tests of the architectures of proposed exoplanetary systems are a critical tool to probe the stability and feasibility of the candidate planetary systems, with the potential to point the way towards refined orbital parameters of those planets. Such studies can even help in the identification of additional companions in such systems. Here we examine the dynamical stability of three planetary systems, orbiting HD 67087, HD 110014, and HD 133131A. We use the published radial velocity measurements of the target stars to determine the best-fit orbital solutions for these planetary systems using the Systemic console. We then employ the n-body integrator Mercury to test the stability of a range of orbital solutions lying within 3-$\sigma$ of the nominal best-fit for a duration of 100 Myr. From the results of the n-body integrations, we infer the best-fit orbital parameters using the Bayesian package Astroemperor. We find that both HD 110014 and HD 133131A have long-term stable architectures that lie within the 1-$\sigma$ uncertainties of the nominal best-fit to their previously determined orbital solutions. However, the HD 67087 system exhibits a strong tendency toward instability on short timescales. We compare these results to the predictions made from consideration of the angular momentum deficit criterion, and find that its predictions are consistent with our findings.


title: On multifluid perturbations in scalar-tensor cosmology

abstract: In this paper the scalar-tensor theory is applied to the study of perturbations in a multi-fluid universe, using the 1+3 covariant approach. Both scalar and harmonic decompositions are instituted on the perturbation equations. In particular, as an application, we study perturbations on a background FRW cosmology consisting of both radiation and dust in the presence of a scalar field. We consider both radiation-dominated and dust-dominated epochs, respectively, and study the results. During the analysis, quasi-static approximation is instituted. It is observed that the fluctuations of the energy density decrease with increasing redshift, for different values of $n$ of a power law $R^{n}$ model


title: Polyhedral Friction Cone Estimator for Object Manipulation

abstract: A polyhedral friction cone is a set of reaction wrenches that an object can experience whilst in contact with its environment. This polyhedron is a powerful tool to control an object's motion and interaction with the environment. It can be derived analytically, upon knowledge of object and environment geometries, contact point locations and friction coefficients. We propose to estimate the polyhedral friction cone so that a priori knowledge of these quantities is no longer required. Additionally, we introduce a solution to transform the estimated friction cone to avoid re-estimation while the object moves. We present an analysis of the estimated polyhedral friction cone and demonstrate its application for manipulating an object in simulation and with a real robot.


title: Unsupervised Word Translation Pairing using Refinement based Point Set Registration

abstract: Cross-lingual alignment of word embeddings play an important role in knowledge transfer across languages, for improving machine translation and other multi-lingual applications. Current unsupervised approaches rely on similarities in geometric structure of word embedding spaces across languages, to learn structure-preserving linear transformations using adversarial networks and refinement strategies. However, such techniques, in practice, tend to suffer from instability and convergence issues, requiring tedious fine-tuning for precise parameter setting. This paper proposes BioSpere, a novel framework for unsupervised mapping of bi-lingual word embeddings onto a shared vector space, by combining adversarial initialization and refinement procedure with point set registration algorithm used in image processing. We show that our framework alleviates the shortcomings of existing methodologies, and is relatively invariant to variable adversarial learning performance, depicting robustness in terms of parameter choices and training losses. Experimental evaluation on parallel dictionary induction task demonstrates state-of-the-art results for our framework on diverse language pairs.


title: On Bosonic Wightman Quantum Field Theories

abstract: We prove that field operators in a Wightman quantum field theory generally have self-adjoint extensions. If the theory is bosonic and the field operators also obey canonical commutation relations (CCRs), then the Weyl form of the CCRs exits. This entails that the field operators emerge from the corresponding CCR algebra, which is a unique C$^\ast$-algebra and which is determined by the two-point Wightman function.


title: t-EVA: Time-Efficient t-SNE Video Annotation

abstract: Video understanding has received more attention in the past few years due to the availability of several large-scale video datasets. However, annotating large-scale video datasets are cost-intensive. In this work, we propose a time-efficient video annotation method using spatio-temporal feature similarity and t-SNE dimensionality reduction to speed up the annotation process massively. Placing the same actions from different videos near each other in the two-dimensional space based on feature similarity helps the annotator to group-label video clips. We evaluate our method on two subsets of the ActivityNet (v1.3) and a subset of the Sports-1M dataset. We show that t-EVA can outperform other video annotation tools while maintaining test accuracy on video classification.


title: Everyone Knows that Everyone Knows: Gossip Protocols for Super Experts

abstract: A gossip protocol is a procedure for sharing secrets in a network. The basic action in a gossip protocol is a pairwise message exchange (telephone call) wherein the calling agents exchange all the secrets they know. An agent who knows all secrets is an expert. The usual termination condition is that all agents are experts. Instead, we explore protocols wherein the termination condition is that all agents know that all agents are experts. We call such agents super experts. We also investigate gossip protocols that are common knowledge among the agents. Additionally, we model that agents who are super experts do not make and do not answer calls, and that this is common knowledge. We investigate conditions under which protocols terminate, both in the synchronous case, where there is a global clock, and in the asynchronous case, where there is not. We show that a commonly known protocol with engaged agents may terminate faster than the same commonly known protocol without engaged agents.


title: Analysis of a model for the dynamics of microswimmer suspensions

abstract: In this paper, a model that was recently derived in Reinken et al. [11] to describe the dynamics of microswimmer suspensions is studied. In particular, the global existence of weak solutions, their weak-strong uniqueness and a connection to a different model that was proposed in Wensink et al. [18] is shown.


title: SLURP: A Spoken Language Understanding Resource Package

abstract: Spoken Language Understanding infers semantic meaning directly from audio data, and thus promises to reduce error propagation and misunderstandings in end-user applications. However, publicly available SLU resources are limited. In this paper, we release SLURP, a new SLU package containing the following: (1) A new challenging dataset in English spanning 18 domains, which is substantially bigger and linguistically more diverse than existing datasets; (2) Competitive baselines based on state-of-the-art NLU and ASR systems; (3) A new transparent metric for entity labelling which enables a detailed error analysis for identifying potential areas of improvement. SLURP is available at https: //github.com/pswietojanski/slurp.


title: A Distributed Optimization Scheme for State Estimation of Nonlinear Networks with Norm-bounded Uncertainties

abstract: This paper investigates the state estimation problem for a class of complex networks, in which the dynamics of each node is subject to Gaussian noise, system uncertainties and nonlinearities. Based on a regularized least-squares approach, the estimation problem is reformulated as an optimization problem, solving for a solution in a distributed way by utilizing a decoupling technique. Then, based on this solution, a class of estimators is designed to handle the system dynamics and constraints. A novel feature of this design lies in the unified modeling of uncertainties and nonlinearities, the decoupling of nodes, and the construction of recursive approximate covariance matrices for the optimization problem. Furthermore, the feasibility of the proposed estimators and the boundedness of the mean-square errors are ensured under a developed criterion, which is easier to check than some typical estimation strategies including the linear matrix inequalities-based and the variance-constrained ones. Finally, the effectiveness of the theoretical results is verified by a numerical simulation.


title: Evolution of nematic fluctuations in CaK(Fe$_{1-x}$Ni$_{x}$)$_{4}$As$_{4}$ with spin-vortex crystal magnetic order

abstract: The CaK(Fe$_{1-x}$Ni$_{x}$)$_{4}$As$_{4}$ superconductors resemble the archetypal 122-type iron-based materials but have a crystal structure with distinctly lower symmetry. This family hosts one of the few examples of the so-called spin-vortex crystal magnetic order, a non-collinear magnetic configuration that preserves tetragonal symmetry, in contrast to the orthorhombic collinear stripe-type magnetic configuration common to the 122-type systems. Thus, nematic order is completely absent from its phase diagram. To investigate the evolution of nematic fluctuations in such a case, we present elastoresistance and elastic modulus measurements in CaK(Fe$_{1-x}$Ni$_{x}$)$_{4}$As$_{4}$ ($x = 0-0.05$) combined with phenomenological modeling and density functional theory. We find clear experimental signatures of considerable nematic fluctuations, including softening of the Young's modulus $Y_{[110]}$ and a Curie-Weiss type divergence of the B2g elastoresistance coefficient in CaK(Fe$_{0.951}$Ni$_{0.049}$)$_4$As$_4$. Overall, nematic fluctuations within this series bear strong similarities to the hole-doped Ba$_{1-x}$K$_x$Fe$_2$As$_2$ series, including a substitution-induced sign change. Our theoretical analysis addresses the effect of the specific crystal symmetry of the 1144-type structure in determining its magnetic ground state and on the nematic fluctuations.


title: Hamiltonian models of lattice fermions solvable by the meron-cluster algorithm

abstract: We introduce a half-filled Hamiltonian of spin-half lattice fermions that can be studied with the efficient meron-cluster algorithm in any dimension. As with the usual bipartite half-filled Hubbard models, the na\"ive $U(2)$ symmetry is enhanced to $SO(4)$. On the other hand our model has a novel spin-charge flip ${\mathbb Z}^C_2$ symmetry which is an important ingredient of free massless fermions. In this work we focus on one spatial dimension, and show that our model can be viewed as a lattice-regularized two-flavor chiral-mass Gross-Neveu model. Our model remains solvable in the presence of the Hubbard coupling $U$, which maps to a combination of Gross-Neveu and Thirring couplings in one dimension. Using the meron-cluster algorithm we find that the ground state of our model is a valence bond solid when $U=0$. From our field theory analysis, we argue that the valence bond solid forms inevitably because of an interesting frustration between spin and charge sectors in the renormalization group flow enforced by the ${\mathbb Z}^C_2$ symmetry. This state spontaneously breaks translation symmetry by one lattice unit, which can be identified with a $\mathbb{Z}_2^\chi$ chiral symmetry in the continuum. We show that increasing $U$ induces a quantum phase transition to a critical phase described by the $SU(2)_1$ Wess-Zumino-Witten theory. The quantum critical point between these two phases is known to exhibit a novel symmetry enhancement between spin and dimer. Here we verify the scaling relations of these correlation functions near the critical point numerically. Our study opens up the exciting possibility of numerical access to similar novel phase transitions in higher dimensions in fermionic lattice models using the meron-cluster algorithm.


title: Handling Object Symmetries in CNN-based Pose Estimation

abstract: In this paper, we investigate the problems that Convolutional Neural Networks (CNN)-based pose estimators have with symmetric objects. We considered the value of the CNN's output representation when continuously rotating the object and found that it has to form a closed loop after each step of symmetry. Otherwise, the CNN (which is itself a continuous function) has to replicate an uncontinuous function. On a 1-DOF toy example we show that commonly used representations do not fulfill this demand and analyze the problems caused thereby. In particular, we find that the popular min-over-symmetries approach for creating a symmetry-aware loss tends not to work well with gradient-based optimization, i.e. deep learning. We propose a representation called "closed symmetry loop" (csl) from these insights, where the angle of relevant vectors is multiplied by the symmetry order and then generalize it to 6-DOF. The representation extends our algorithm from [Richter-Klug, ICVS, 2019] including a method to disambiguate symmetric equivalents during the final pose estimation. The algorithm handles continuous rotational symmetry (e.g. a bottle) and discrete rotational symmetry (e.g. a 4-fold symmetric box). It is evaluated on the T-LESS dataset, where it reaches state-of-the-art for unrefining RGB-based methods.


title: Encoding Syntactic Constituency Paths for Frame-Semantic Parsing with Graph Convolutional Networks

abstract: We study the problem of integrating syntactic information from constituency trees into a neural model in Frame-semantic parsing sub-tasks, namely Target Identification (TI), FrameIdentification (FI), and Semantic Role Labeling (SRL). We use a Graph Convolutional Network to learn specific representations of constituents, such that each constituent is profiled as the production grammar rule it corresponds to. We leverage these representations to build syntactic features for each word in a sentence, computed as the sum of all the constituents on the path between a word and a task-specific node in the tree, e.g. the target predicate for SRL. Our approach improves state-of-the-art results on the TI and SRL of ~1%and~3.5% points, respectively (+2.5% additional points are gained with BERT as input), when tested on FrameNet 1.5, while yielding comparable results on the CoNLL05 dataset to other syntax-aware systems.


title: Thermodynamic relations at the coupling boundary in adaptive resolution simulations for open systems

abstract: The adaptive resolution simulation (AdResS) technique couples regions with different molecular resolutions and allows the exchange of molecules between different regions in an adaptive fashion. The latest development of the technique allows to abruptly couple the atomistically resolved region with a region of non-interacting point-like particles. The abrupt set-up was derived having in mind the idea of the atomistically resolved region as an open system embedded in a large reservoir at a given macroscopic state. In this work, starting from the idea of open system, we derive thermodynamic relations for AdResS which justify conceptually and numerically the claim of AdResS as a technique for simulating open systems. In particular, we derive the relation between the chemical potential of the AdResS set-up and that of its reference fully atomistic simulation. The implication of this result is that the grand potential of AdResS can be explicitly written and thus, from a statistical mechanics point of view, the atomistically resolved region of AdResS can be identified with a well defined open system.

categories: cond-mat.stat-mech cond-mat.soft physics.chem-ph physics.comp-ph


title: Accurate Spectral Collocation Solutions to some Bratu's Type Boundary Value Problems

abstract: We solve by Chebyshev spectral collocation some genuinely nonlinear Liouville-Bratu-Gelfand type, 1D and a 2D boundary value problems. The problems are formulated on the square domain $[-1, 1]\times[-1, 1]$ and the boundary condition attached is a homogeneous Dirichlet one. We pay a particular attention to the bifurcation branch on which a solution is searched and try to estimate empirically the attraction basin for each bifurcation variety. The first eigenvector approximating the corresponding the first eigenfunction of the linear problem is used as an initial guess in solving the non-linear algebraic system of Chebyshev collocation to find the "small" solution. For the same value of the bifurcation parameter we use another initial guess, namely lowest basis function (1 point approximation), to find the "big" solution. The Newton-Kantorovich method solves very fast the non-linear algebraic system in no more than eight iterations. Beyond being exact, the method is numerically stable, robust and easy to implement. Actually, the MATLAB code essentially contains three programming lines. It by far surpasses in simplicity and accuracy various methods used to solve some well-known problems. We end up by providing some numerical and graphical outcomes in order to underline the validity and the effectiveness of our method, i.e., norms of Newton updates in solving the algebraic systems and the decreasing rate of Chebyshev coeffcients of solution.


title: Why Charles Can Pen-test: an Evolutionary Approach to Vulnerability Testing

abstract: Discovering vulnerabilities in applications of real-world complexity is a daunting task: a vulnerability may affect a single line of code, and yet it compromises the security of the entire application. Even worse, vulnerabilities may manifest only in exceptional circumstances that do not occur in the normal operation of the application. It is widely recognized that state-of-the-art penetration testing tools play a crucial role, and are routinely used, to dig up vulnerabilities. Yet penetration testing is still primarily a human-driven activity, and its effectiveness still depends on the skills and ingenuity of the security analyst driving the tool. In this paper, we propose a technique for the automatic discovery of vulnerabilities in event-based systems, such as web and mobile applications. Our approach is based on a collaborative, co-evolutionary and contract-driven search strategy that iteratively (i) executes a pool of test cases, (ii) identifies the most promising ones, and (iii) generates new test cases from them. The approach makes a synergistic combination of evolutionary algorithms where several "species" contribute to solving the problem: one species, the test species, evolves to find the target test case, i.e., the set of instruction whose execution lead to the vulnerable statement, whereas the other species, called contract species, evolve to select the parameters for the procedure calls needed to trigger the vulnerability. To assess the effectiveness of our approach, we implemented a working prototype and ran it against both a case study and a benchmark web application. The experimental results confirm that our tool automatically discovers and executes a number of injection flaw attacks that are out of reach for state-of-the-art web scanners.


title: Classification of High-resolution Solar H{\alpha} Spectra using t-distributed Stochastic Neighbor Embedding

abstract: The H{\alpha} spectral line is a well-studied absorption line revealing properties of the highly structured and dynamic solar chromosphere. Typical features with distinct spectral signatures in H{\alpha} include filaments and prominences, bright active-region plages, superpenumbrae around sunspots, surges, flares, Ellerman bombs, filigree, and mottles and rosettes, among others. This study is based on high-spectral resolution H{\alpha} spectra obtained with the echelle spectrograph of the Vacuum Tower Telescope (VTT) located at Observatorio del Teide (ODT), Tenerife, Spain. The t-distributed Stochastic Neighbor Embedding (t-SNE) is a machine learning algorithm, which is used for nonlinear dimensionality reduction. In this application, it projects H{\alpha} spectra onto a two-dimensional map, where it becomes possible to classify the spectra according to results of Cloud Model (CM) inversions. The CM parameters optical depth, Doppler width, line-of-sight velocity, and source function describe properties of the cloud material. Initial results of t-SNE indicate its strong discriminatory power to separate quiet-Sun and plage profiles from those that are suitable for CM inversions. In addition, a detailed study of various t-SNE parameters is conducted, the impact of seeing conditions on the classification is assessed, results for various types of input data are compared, and the identified clusters are linked to chromospheric features. Although t-SNE proves to be efficient in clustering high-dimensional data, human inference is required at each step to interpret the results. This exploratory study provides a framework and ideas on how to tailor a classification scheme towards specific spectral data and science questions.


title: Oscillatory shear flows of dense suspensions at imposed pressure: Rheology and micro-structure

abstract: Oscillatory shear has been widely used to study the rheological properties of suspensions under unsteady shear. Furthermore, recent works have shown that oscillatory flows can improve the flowability of dense suspensions. While most studies have been done under constant volume we here study oscillatory shear flows of a two-dimensional suspensions using a normal pressure-controlled set-up. To characterise the rheology, we introduce both a complex macroscopic friction coefficient $\mu^{*}$, following the convention of the complex viscosity $\eta^{*}$, and a shear-rate averaged viscous number $J'$. The rheology and microstructure of dense suspensions are studied by systematically varying both the strain magnitude $\gamma_0$ and $J'$ using numerical simulations. We study both suspensions composed of frictional ($\mu_p=0.4$) or frictionless ($\mu_p=0$) particles and find that the critical values, as $J' \to 0$, of both the complex macroscopic friction and the number of contacts, both total and sliding, decrease with decreasing $\gamma_0$. For suspensions composed of frictional particles we also find that the critical (i.e.~the shear jamming) packing fraction $\phi_c$ increase with decreasing $\gamma_0$. In both cases, frictional and frictionless, we find that the rheological response approaching the shear jamming turns from a viscous to an elastic response as $\gamma_0$ is lowered below $\sim0.33$.


title: Development and Realization of Validation Benchmarks

abstract: In the field of modeling, the word validation refers to simple comparisons between model outputs and experimental data. Usually, this comparison constitutes plotting the model results against data on the same axes to provide a visual assessment of agreement or lack thereof. However, there are a number of concerns with such naive comparisons. First, these comparisons tend to provide qualitative rather than quantitative assessments and are clearly insufficient for making decisions regarding model validity. Second, they often disregard or only partly account for existing uncertainties in the experimental observations or the model input parameters. Third, such comparisons can not reveal whether the model is appropriate for the intended purposes, as they mainly focus on the agreement in the observable quantities. These pitfalls give rise to the need for an uncertainty-aware framework that includes a validation metric. This metric shall provide a measure for comparison of the system response quantities of an experiment with the ones from a computational model, while accounting for uncertainties in both. To address this need, we have developed a statistical framework that incorporates a probabilistic modeling technique using a fully Bayesian approach. A Bayesian perspective yields an optimal bias-variance trade-off against the experimental data and provide an integrative metric for model validation that incorporates parameter and conceptual uncertainty. Additionally, to accelerate the analysis for computationally demanding flow and transport models in porous media, the framework is equipped with a model reduction technique, namely Bayesian Sparse Polynomial Chaos Expansion. We demonstrate the capabilities of the aforementioned Bayesian validation framework by applying it to an application for validation as well as uncertainty quantification of fluid flow in fractured porous media.


title: Maker-Breaker Games on Random Hypergraphs

abstract: In this paper, we study Maker-Breaker games on the random hypergraph $H_{n,s,p}$, obtained from the complete $s$-graph by keeping every edge independently with probability $p$. We determine the threshold probability for the property of Maker winning the game as a function of $s$, the uniformity of the underlying hypergraph, as well as $m$, $b$, the number of vertices that Maker and Breaker are respectively allowed to pick each turn. In addition, we show that depending on those $m,b,s$, there are two types of thresholds: either being Maker-win is a local property and the threshold is weak, or it is related to global properties of the random hypergraph and the threshold is semi-sharp. We conjecture that in the latter case, the threshold is actually sharp.


title: Formalising Ordinal Partition Relations Using Isabelle/HOL

abstract: This is an overview of a formalisation project in the proof assistant Isabelle/HOL of a number of research results in infinitary combinatorics and set theory (more specifically in ordinal partition relations) by Erd\H{o}s--Milner, Specker, Larson and Nash-Williams, leading to Larson's proof of the unpublished result by E.C. Milner asserting that for all $m \in \mathbb{N}$, $\omega^\omega\arrows(\omega^\omega, m)$. This material has been recently formalised by Paulson and is available on the Archive of Formal Proofs; here we discuss some of the most challenging aspects of the formalisation process. This project is also a demonstration of working with Zermelo-Fraenkel set theory in higher-order logic.


title: Message-Aware Graph Attention Networks for Large-Scale Multi-Robot Path Planning

abstract: The domains of transport and logistics are increasingly relying on autonomous mobile robots for the handling and distribution of passengers or resources. At large system scales, finding decentralized path planning and coordination solutions is key to efficient system performance. Recently, Graph Neural Networks (GNNs) have become popular due to their ability to learn communication policies in decentralized multi-agent systems. Yet, vanilla GNNs rely on simplistic message aggregation mechanisms that prevent agents from prioritizing important information. To tackle this challenge, in this paper, we extend our previous work that utilizes GNNs in multi-agent path planning by incorporating a novel mechanism to allow for message-dependent attention. Our Message-Aware Graph Attention neTwork (MAGAT) is based on a key-query-like mechanism that determines the relative importance of features in the messages received from various neighboring robots. We show that MAGAT is able to achieve a performance close to that of a coupled centralized expert algorithm. Further, ablation studies and comparisons to several benchmark models show that our attention mechanism is very effective across different robot densities and performs stably in different constraints in communication bandwidth. Experiments demonstrate that our model is able to generalize well in previously unseen problem instances, and that it achieves a 47\% improvement over the benchmark success rate, even in very large-scale instances that are $\times$100 larger than the training instances.


title: Unigram-Normalized Perplexity as a Language Model Performance Measure with Different Vocabulary Sizes

abstract: Although Perplexity is a widely used performance metric for language models, the values are highly dependent upon the number of words in the corpus and is useful to compare performance of the same corpus only. In this paper, we propose a new metric that can be used to evaluate language model performance with different vocabulary sizes. The proposed unigram-normalized Perplexity actually presents the performance improvement of the language models from that of simple unigram model, and is robust on the vocabulary size. Both theoretical analysis and computational experiments are reported.


title: Comparative Analysis of Oscillating Wave Energy Converter Performance in Southern Coast of the Caspian Sea

abstract: The importance of renewable energy supplies, particularly ocean wave energy, has become undeniable globally in the last two decades. Iran is not an exception due to the long barrier with deep water in the north and south of the country. Because of this potential, the first step is chosen in order to locate a suitable site for installing wave energy converters (WECs). The next step is an applicable design for converters based on conditional and geometrical parameters. In this study, locations with maximum potential are chosen, and conditional parameters are used as input data to design the oscillating converter geometrically. Next, geometric parameters are simulated by the ABAQUS program, and for verifying it, three case study sites in the Caspian sea are considered and designed in the WEC-Sim module in MATLAB to evaluate conditional and geometrical parameters simultaneously. Finally, both results are compared with each other. It is found that the Nowshahr port has more potential than Anzali and Amirabad port, and after considering the proposed design, the converter's productivity raised by 63 percent. It is also written that the flap's optimal width is recommended to be between 18 and 23 meters. Moreover, changes in damping incident forces have a direct relationship with the system's efficiency, and the value of this force is more on Nowshahr in pitch degree of freedom. Finally, according to the software outputs, it can be concluded that the force applied to the power take-off system behind the converter flap, which is the most crucial force in evaluating the performance of the converter as the leading indicator, is derived and compared between studied sites.