title: Multi-task twin support vector machine with Universum data

abstract: Multi-task learning (MTL) has emerged as a promising topic of machine learning in recent years, aiming to enhance the performance of numerous related learning tasks by exploiting beneficial information. During the training phase, most of the existing multi-task learning models concentrate entirely on the target task data and ignore the non-target task data contained in the target tasks. To address this issue, Universum data, that do not correspond to any class of a classification problem, may be used as prior knowledge in the training model. This study looks at the challenge of multi-task learning using Universum data to employ non-target task data, which leads to better performance. It proposes a multi-task twin support vector machine with Universum data (UMTSVM) and provides two approaches to its solution. The first approach takes into account the dual formulation of UMTSVM and tries to solve a quadratic programming problem. The second approach formulates a least-squares version of UMTSVM and refers to it as LS-UMTSVM to further increase the generalization performance. The solution of the two primal problems in LS-UMTSVM is simplified to solving just two systems of linear equations, resulting in an incredibly simple and quick approach. Numerical experiments on several popular multi-task data sets and medical data sets demonstrate the efficiency of the proposed methods.


title: Ultraprecise off-axis atom localization with hybrid fields

abstract: Atom localization enables a high-precision imaging of the atomic position, which has provided vast applications in fundamental and applied science. In the present work, we propose a scheme for realizing two-dimensional off-axis atom localization in a three-level Lambda-type system. Benefiting from the use of a hybrid coupling field which consists of one Gaussian beam and one Laguerre-Gaussian beam, our scheme shows that the atoms can be localized at arbitrary position with a high spatial resolution. Taking account of realistic experimental parameters, our numerical simulation predicts that the atoms can be precisely localized with a spatial resolution of ~200 nm in the range of a radial distance of a few micrometers to the beam core. Our results provide a more flexible way to localize atoms in a two-dimensional system, possibly paving one-step closer to the nanometer-scale atom lithography and ultraprecise microscopy.


title: Magnetic fields and hot gas in M101

abstract: Studies of nearby spiral galaxies in radio and X-ray wavelengths reveal the structure and energy balance of the magnetic fields and the hot interstellar medium (ISM). In some spiral galaxies, large-scale ordered magnetic fields have been found between the spiral stellar arms (the so-called magnetic arms). One of the considered explanations of their origin is magnetic reconnection, which according to theoretical studies can efficiently heat the low-density ISM. We present, for the first time, high-resolution C-band (5GHz) radio maps of the nearby face-on spiral galaxy M101 to study the magnetic fields and verify the existence of the magnetic arms. The analysis of the archival XMM-Newton X-ray data is performed to search for signatures of gas heating by magnetic reconnection effects in the disk and the halo of this galaxy. We combine the Very Large Array (VLA) and Effelsberg radio maps of M101 to restore the large-scale emission lost in the interferometric observations. From the obtained maps, we derive magnetic field strengths and energy densities, and compare them with the properties of the hot gas found with the spectral analysis of the X-ray data. Most of the X-ray emission likely comes from the hot gas in the halo of M101. Its temperature is highest above the massive stellar arm and an inter-arm region with enhanced polarised radio emission, as well as in the inter-arm area where neither Halpha nor HI emission is visible. In regions outside of the spiral arms lower strengths, energy densities and higher orders of the magnetic fields were observed. Although M101 does not possess well-defined magnetic arms, a rudimentary magnetic arm was identified in one of the inter-arm regions. We found weak signatures of additional heating of the ISM there, as well as in the galactic halo, which could be explained by the action of magnetic reconnection.


title: Adaptive Sampling-based Particle Filter for Visual-inertial Gimbal in the Wild

abstract: In this paper, we present a Computer Vision (CV) based tracking and fusion algorithm, dedicated to a 3D printed gimbal system on drones operating in nature. The whole gimbal system can stabilize the camera orientation robustly in a challenging nature scenario by using skyline and ground plane as references. Our main contributions are the following: a) a light-weight Resnet-18 backbone network model was trained from scratch, and deployed onto the Jetson Nano platform to segment the image into binary parts (ground and sky); b) our geometry assumption from nature cues delivers the potential for robust visual tracking by using the skyline and ground plane as a reference; c) a spherical surface-based adaptive particle sampling, can fuse orientation from multiple sensor sources flexibly. The whole algorithm pipeline is tested on our customized gimbal module including Jetson and other hardware components. The experiments were performed on top of a building in the real landscape.


title: Diagnostic Tool for Out-of-Sample Model Evaluation

abstract: Assessment of model fitness is a key part of machine learning. The standard paradigm is to learn models by minimizing a chosen loss function averaged over training data, with the aim of achieving small losses on future data. In this paper, we consider the use of a finite calibration data set to characterize the future, out-of-sample losses of a model. We propose a simple model diagnostic tool that provides finite-sample guarantees under weak assumptions. The tool is simple to compute and to interpret. Several numerical experiments are presented to show how the proposed method quantifies the impact of distribution shifts, aids the analysis of regression, and enables model selection as well as hyper-parameter tuning.


title: Traffic Congestion Prediction Using Machine Learning Techniques

abstract: The prediction of traffic congestion can serve a crucial role in making future decisions. Although many studies have been conducted regarding congestion, most of these could not cover all the important factors (e.g., weather conditions). We proposed a prediction model for traffic congestion that can predict congestion based on day, time and several weather data (e.g., temperature, humidity). To evaluate our model, it has been tested against the traffic data of New Delhi. With this model, congestion of a road can be predicted one week ahead with an average RMSE of 1.12. Therefore, this model can be used to take preventive measure beforehand.


title: Near-surface InAs 2DEG on a GaAs substrate: characterization and superconducting proximity effect

abstract: We have studied a near-surface two-dimensional electron gas based on an InAs quantum well on a GaAs substrate. In devices without a dielectric layer we estimated large electron mobilities on the order of $10^5$ cm$^2$/Vs. We have observed quantized conductance in a quantum point contact, and determined the g-factor. Using samples with an epitaxial Al layer, we defined multiple Josephson junctions and found the critical current to be gate tunable. Based on multiple Andreev reflections the semiconductor-superconductor interface is transparent, with an induced gap of 125 ${\mu}$eV. Our results demonstrate the viability of this platform for hybrid topological superconductor devices.


title: Relativistic Normal Coupled-cluster Theory Analysis of Second- and Third-order Electric Polarizabilities of Zn I

abstract: We present precise values of electric polarizabilities for the ground state of Zn due to second-order dipole and quadrupole interactions, and due to third-order dipole-quadrupole interactions. These quantities are evaluated in the linear response theory framework by employing a relativistic version of the normal coupled-cluster (NCC) method. The calculated dipole polarizability value is compared with available experimental and other theoretical results including those are obtained using the ordinary coupled-cluster (CC) methods in both finite-field and expectation value evaluation approaches. We also give a term-by-term comparison of contributions from our CC and NCC calculations in order to show differences in the results from these two methods. Moreover, we present results from other lower-order methods to understand the role of electron correlation effects in the determination of the above quantities. A machine learning based scheme to generate optimized basis functions for atomic calculations is developed and applied here. From the analysis of the dipole polarizability result, accuracy of the calculated quadrupole and third-order polarizability values are ascertained, for which no experimental values are currently available.


title: Gaia Data Release 3: Properties of the line broadening parameter derived with the Radial Velocity Spectrometer (RVS)

abstract: The third release of the Gaia catalogue contains the radial velocities for 33,812,183 stars having effective temperatures ranging from 3100 K to 14,500 K. The measurements are based on the comparison of the observed RVS spectrum (wavelength coverage: 846--870 nm, median resolving power: 11,500) to synthetic data broadened to the adequate Along-Scan Line Spread Function. The additional line-broadening, fitted as it would only be due to axial rotation, is also produced by the pipeline and is available in the catalogue (field name gaia_source:vbroad). To describe the properties of the line-broadening information extracted from the RVS and published in the catalogue, as well as to analyse the limitations imposed by the adopted method, wavelength range, and instrument. We use simulations to express the link existing between the line broadening measurement provided in Gaia Data Release 3 and Vsin(i). We then compare the observed values to the measurements published by various catalogues and surveys (GALAH, APOGEE, LAMOST, ...). While we recommend being cautious in the interpretation of the vbroad measurement, we also find a reasonable global agreement between the Gaia Data Release 3 line broadening values and those found in the other catalogues. We discuss and establish the validity domain of the published vbroad values. The estimate tends to be overestimated at the lower vsini end, and at $T_\mathrm{eff}>7500\,\mathrm{K}$ its quality and significance degrade rapidly when $G_\mathrm{RVS}>10$. Despite all the known and reported limitations, the Gaia Data Release 3 line broadening catalogue contains the measurements obtained for 3,524,677 stars with $T_\mathrm{eff}$\ ranging from 3500 to 14,500 K, and $G_\mathrm{RVS}<12$. It gathers the largest stellar sample ever considered for the purpose, and allows a first mapping of the \Gaia\ line broadening parameter across the HR diagram.


title: Human-AI communication for human-human communication: Applying interpretable unsupervised anomaly detection to executive coaching

abstract: In this paper, we discuss the potential of applying unsupervised anomaly detection in constructing AI-based interactive systems that deal with highly contextual situations, i.e., human-human communication, in collaboration with domain experts. We reached this approach of utilizing unsupervised anomaly detection through our experience of developing a computational support tool for executive coaching, which taught us the importance of providing interpretable results so that expert coaches can take both the results and contexts into account. The key idea behind this approach is to leave room for expert coaches to unleash their open-ended interpretations, rather than simplifying the nature of social interactions to well-defined problems that are tractable by conventional supervised algorithms. In addition, we found that this approach can be extended to nurturing novice coaches; by prompting them to interpret the results from the system, it can provide the coaches with educational opportunities. Although the applicability of this approach should be validated in other domains, we believe that the idea of leveraging unsupervised anomaly detection to construct AI-based interactive systems would shed light on another direction of human-AI communication.


title: AdvSmo: Black-box Adversarial Attack by Smoothing Linear Structure of Texture

abstract: Black-box attacks usually face two problems: poor transferability and the inability to evade the adversarial defense. To overcome these shortcomings, we create an original approach to generate adversarial examples by smoothing the linear structure of the texture in the benign image, called AdvSmo. We construct the adversarial examples without relying on any internal information to the target model and design the imperceptible-high attack success rate constraint to guide the Gabor filter to select appropriate angles and scales to smooth the linear texture from the input images to generate adversarial examples. Benefiting from the above design concept, AdvSmo will generate adversarial examples with strong transferability and solid evasiveness. Finally, compared to the four advanced black-box adversarial attack methods, for the eight target models, the results show that AdvSmo improves the average attack success rate by 9% on the CIFAR-10 and 16% on the Tiny-ImageNet dataset compared to the best of these attack methods.


title: Identity Documents Authentication based on Forgery Detection of Guilloche Pattern

abstract: In cases such as digital enrolment via mobile and online services, identity document verification is critical in order to efficiently detect forgery and therefore build user trust in the digital world. In this paper, an authentication model for identity documents based on forgery detection of guilloche patterns is proposed. The proposed approach is made up of two steps: feature extraction and similarity measure between a pair of feature vectors of identity documents. The feature extraction step involves learning the similarity between a pair of identity documents via a convolutional neural network (CNN) architecture and ends by extracting highly discriminative features between them. While, the similarity measure step is applied to decide if a given identity document is authentic or forged. In this work, these two steps are combined together to achieve two objectives: (i) extracted features should have good anticollision (discriminative) capabilities to distinguish between a pair of identity documents belonging to different classes, (ii) checking out the conformity of the guilloche pattern of a given identity document and its similarity to the guilloche pattern of an authentic version of the same country. Experiments are conducted in order to analyze and identify the most proper parameters to achieve higher authentication performance. The experimental results are performed on the MIDV-2020 dataset. The results show the ability of the proposed approach to extract the relevant characteristics of the processed pair of identity documents in order to model the guilloche patterns, and thus distinguish them correctly. The implementation code and the forged dataset are provided here (https://drive.google.com/id-FDGP-1)


title: Bridging the gap: Generating a design space model of Socially Assistive Robots (SARs) for Older Adults using Participatory Design (PD)

abstract: Participatory Design (PD) methods are effective in understanding older adults' perspectives, concerns, and wishes and generating ideas for new intelligent aids. The aim of our study was first to map perceptions and explore the needs of older users from socially assistive robots (SARs) and then, to integrate new tools and experiences for end users to express their needs as part of a PD process. The outcome of the process is a design space model of functional, behavioral, and visual relationships and elicited emotions. This process enables to explore, map, and understand the needs of older users before and after experiencing with SARs, and to learn how they impact robotic designs, behavior, and functionality. First, by interviewing older adults, caregivers, and relatives we learned older adults' daily routines, habits, and wishes. Then, we reconstructed those needs into design requirements and further detailed them with older adults using focus groups. Based on the functional, behavioral, and visual design factors that emerged from this phase, we built experimental human-robot tasks, on a commercially available robot, to examine feasibility and acceptance of the technology in one-on-one interactions. Participants' responses throughout the study led to the creation of the design space model mapping relationships and elicited emotions.


title: Understanding convolution on graphs via energies

abstract: Graph Neural Networks (GNNs) typically operate by message-passing, where the state of a node is updated based on the information received from its neighbours. Most message-passing models act as graph convolutions, where features are mixed by a shared, linear transformation before being propagated over the edges. On node-classification tasks, graph convolutions have been shown to suffer from two limitations: poor performance on heterophilic graphs, and over-smoothing. It is common belief that both phenomena occur because such models behave as low-pass filters, meaning that the Dirichlet energy of the features decreases along the layers incurring a smoothing effect that ultimately makes features no longer distinguishable. In this work, we rigorously prove that simple graph-convolutional models can actually enhance high frequencies and even lead to an asymptotic behaviour we refer to as over-sharpening, opposite to over-smoothing. We do so by showing that linear graph convolutions with symmetric weights minimize a multi-particle energy that generalizes the Dirichlet energy; in this setting, the weight matrices induce edge-wise attraction (repulsion) through their positive (negative) eigenvalues, thereby controlling whether the features are being smoothed or sharpened. We also extend the analysis to non-linear GNNs, and demonstrate that some existing time-continuous GNNs are instead always dominated by the low frequencies. Finally, we validate our theoretical findings through ablations and real-world experiments.


title: Chaotic behavior of countable products of homeomorphism groups

abstract: Relationships between a chaotic behavior and closely related properties of topological transitivity, sensitivity to initial conditions, density of closed orbits of homeomorphism groups and their countable products are investigated. We construct numerous new examples of chaotic groups of homeomorphisms of countable products of various metrizable topological spaces, including infinite-dimensional topological manifolds, whose factors can be as noncompact surfaces, so triangulable closed manifolds of an arbitrary dimension.


title: SEnti-Analyzer: Joint Sentiment Analysis For Text-Based and Verbal Communication in Software Projects

abstract: Social aspects in software development teams are of particular importance for a successful project closure. To analyze sentiments in software projects, there are several tools and approaches available. These tools analyze text-based communication based on the used words to predict whether they appear to be positive, negative, or neutral for the receiver of the message. In the research project ComContA, we investigate so-called sentiment analysis striving to analyze the content of text-based communication in development teams with regard to the statement's polarity. That is, we analyze whether the communication appears to be adequate (i.e., positive or neutral) or negative. In a workshop paper, we presented a tool called SEnti-Analyzer that allows to apply sentiment analysis to verbal communication in meetings of software projects. In this technical report, we present the extended functionalities of the SEnti-Analyzer by also allowing the analysis of text-based communication, we improve the prediction of the tool by including established sentiment analysis tools, and we evaluate the tool with respect to its accuracy. We evaluate the tool by comparing the prediction of the SEnti-Analyzer to pre-labeled established data sets used for sentiment analysis in software engineering and to perceptions of computer scientists. Our results indicate that in almost all cases at least two of the three votes coincide, but in only about half of the cases all three votes coincide. Our results raise the question of the "ultimate truth" of sentiment analysis outcomes: What do we want to predict with sentiment analysis tools? The pre-defined labels of established data sets? The perception of computer scientists? Or the perception of single computer scientists which appears to be the most meaningful objective?


title: Numerical Semigroups with unique Apery expansions II

abstract: In this paper, we carry out a fairly comprehensive study of special classes of numerical semigroups, and their tangent cones, generated by the sequence of partial sums of an arithmetic progression, in embedding dimension $5$. These classes have unique expansions of the Apery set elements.


title: Closed-Form and Asymptotic BER Analysis of the Fluctuating Double-Rayleigh with Line-of-Sight Fading Channel

abstract: Recently, a generalization of the double-Rayleigh with line-of-sight channel fading model taking into account shadowing of the line-of-sight component has been proposed. In this research, a closed-form analysis of the average bit error rate for MPSK/MQAM modulations is performed. The derived solution is accompanied by proposed numerically efficient approximation and all possible asymptotic expressions that correspond to extreme channel parameters. Lastly, a numerical simulation was performed that demonstrated the correctness of the derived results.


title: ProtoCLIP: Prototypical Contrastive Language Image Pretraining

abstract: Contrastive Language Image Pretraining (CLIP) has received widespread attention, since its learned representations can be transferred well to various downstream tasks. During the training process of the CLIP model, the InfoNCE objective aligns positive image-text pairs and separates negative ones. We show an underlying representation grouping effect during this process: the InfoNCE objective indirectly groups semantically similar representations together via randomly emerged within-modal anchors. Based on this understanding, in this paper, Prototypical Contrastive Language Image Pretraining (ProtoCLIP) is introduced to enhance such grouping by boosting its efficiency and increasing its robustness against the modality gap. Specifically, ProtoCLIP sets up prototype-level discrimination between image and text spaces, which efficiently transfers higher-level structural knowledge. Further, Prototypical Back Translation (PBT) is proposed to decouple representation grouping from representation alignment, resulting in effective learning of meaningful representations under large modality gap. The PBT also enables us to introduce additional external teachers with richer prior language knowledge. ProtoCLIP is trained with an online episodic training strategy, which makes it can be scaled up to unlimited amounts of data. We train our ProtoCLIP on Conceptual Captions and achieved an +5.81% ImageNet linear probing improvement and an +2.01% ImageNet zero-shot classification improvement. On the larger YFCC-15M dataset, ProtoCLIP matches the performance of CLIP with 33% of training time. Codes are available at https://github.com/megvii-research/protoclip.


title: Extended Wertheim theory predicts the anomalous chain length distributions of divalent patchy particles under extreme confinement

abstract: Colloidal patchy particles with divalent attractive interaction can self-assemble into linear polymer chains. Their equilibrium properties in 2D and 3D are well described by Wertheim's thermodynamic perturbation theory which predicts a well-defined exponentially decaying equilibrium chain length distribution. In experimental realizations, due to gravity, particles sediment to the bottom of the suspension forming a monolayer of particles with a gravitational height smaller than the particle diameter. In accordance with experiments, an anomalously high monomer concentration is observed in simulations which is not well understood. To account for this observation, we interpret the polymerization as taking place in a highly confined quasi-2D plane and extend the Wertheim thermodynamic perturbation theory by defining addition reactions constants as functions of the chain length. We derive the theory, test it on simple square well potentials, and apply it to the experimental case of synthetic colloidal patchy particles immersed in a binary liquid mixture that are described by an accurate effective critical Casimir patchy particle potential. The important interaction parameters entering the theory are explicitly computed using the integral method in combination with Monte Carlo sampling. Without any adjustable parameter, the predictions of the chain length distribution are in excellent agreement with explicit simulations of self-assembling particles. We discuss generality of the approach, and its application range.


title: Conformally Schwarzschild cosmological black holes

abstract: We thoroughly investigate conformally Schwarzschild spacetimes in different coordinate systems to seek for physically reasonable models of a cosmological black hole. We assume that a conformal factor depends only on the time coordinate and that the spacetime is asymptotically flat Friedmann-Lema\^{\i}tre-Robertson-Walker universe filled by a perfect fluid obeying a linear equation state $p=w\rho$ with $w>-1/3$. In this class of spacetimes, the McClure-Dyer spacetime, constructed in terms of the isotropic coordinates, and the Thakurta spacetime, constructed in terms of the standard Schwarzschild coordinates, are identical and do not describe a cosmological black hole. In contrast, the Sultana-Dyer and Culetu classes of spacetimes, constructed in terms of the Kerr-Schild and Painlev\'{e}-Gullstrand coordinates, respectively, describe a cosmological black hole. In the Sultana-Dyer case, the corresponding matter field in general relativity can be interpreted as a combination of a homogeneous perfect fluid and an inhomogeneous null fluid, which is valid everywhere in the spacetime unlike Sultana and Dyer's interpretation. In the Culetu case, the matter field can be interpreted as a combination of a homogeneous perfect fluid and an inhomogeneous anisotropic fluid. However, in both cases, the total energy-momentum tensor violates all the standard energy conditions at a finite value of the radial coordinate in late times. As a consequence, the Sultana-Dyer and Culetu black holes for $-1/3<w\le 1$ cannot describe the evolution of a primordial black hole after its horizon entry.


title: Neural Networks as Paths through the Space of Representations

abstract: Deep neural networks implement a sequence of layer-by-layer operations that are each relatively easy to understand, but the resulting overall computation is generally difficult to understand. We consider a simple hypothesis for interpreting the layer-by-layer construction of useful representations: perhaps the role of each layer is to reformat information to reduce the "distance" to the desired outputs. With this framework, the layer-wise computation implemented by a deep neural network can be viewed as a path through a high-dimensional representation space. We formalize this intuitive idea of a "path" by leveraging recent advances in *metric* representational similarity. We extend existing representational distance methods by computing geodesics, angles, and projections of representations, going beyond mere layer distances. We then demonstrate these tools by visualizing and comparing the paths taken by ResNet and VGG architectures on CIFAR-10. We conclude by sketching additional ways that this kind of representational geometry can be used to understand and interpret network training, and to describe novel kinds of similarities between different models.


title: A Systematic Comparison of Phonetic Aware Techniques for Speech Enhancement

abstract: Speech enhancement has seen great improvement in recent years using end-to-end neural networks. However, most models are agnostic to the spoken phonetic content. Recently, several studies suggested phonetic-aware speech enhancement, mostly using perceptual supervision. Yet, injecting phonetic features during model optimization can take additional forms (e.g., model conditioning). In this paper, we conduct a systematic comparison between different methods of incorporating phonetic information in a speech enhancement model. By conducting a series of controlled experiments, we observe the influence of different phonetic content models as well as various feature-injection techniques on enhancement performance, considering both causal and non-causal models. Specifically, we evaluate three settings for injecting phonetic information, namely: i) feature conditioning; ii) perceptual supervision; and iii) regularization. Phonetic features are obtained using an intermediate layer of either a supervised pre-trained Automatic Speech Recognition (ASR) model or by using a pre-trained Self-Supervised Learning (SSL) model. We further observe the effect of choosing different embedding layers on performance, considering both manual and learned configurations. Results suggest that using a SSL model as phonetic features outperforms the ASR one in most cases. Interestingly, the conditioning setting performs best among the evaluated configurations.


title: Realizing orders as group rings

abstract: An order is a commutative ring that as an abelian group is finitely generated and free. A commutative ring is reduced if it has no non-zero nilpotent elements. In this paper we use a new tool, namely, the fact that every reduced order has a universal grading, to answer questions about realizing orders as group rings. In particular, we address the Isomorphism Problem for group rings in the case where the ring is a reduced order. We prove that any non-zero reduced order $R$ can be written as a group ring in a unique ``maximal'' way, up to isomorphism. More precisely, there exist a ring $A$ and a finite abelian group $G$, both uniquely determined up to isomorphism, such that $R\cong A[G]$ as rings, and such that if $B$ is a ring and $H$ is a group, then $R\cong B[H]$ as rings if and only if there is a finite abelian group $J$ such that $B\cong A[J]$ as rings and $J\times H\cong G$ as groups. Computing $A$ and $G$ for given $R$ can be done by means of an algorithm that is not quite polynomial-time. We also give a description of the automorphism group of $R$ in terms of $A$ and $G$.


title: Lorentz symmetry breaking and supersymmetry

abstract: We discuss three manners to implement Lorentz symmetry breaking in a superfield theory formulated within the superfield formalism, that is, deformation of the supersymmetry algebra, introducing of an extra superfield whose components can depend on Lorentz-violating (LV) vectors (tensors), and adding of new terms proportional to LV vectors (tensors) to the superfield action. We illustrate these methodologies with examples of quantum calculations.


title: Integer-valued polynomials on discrete valuation rings of global fields with prescribed lengths of factorizations

abstract: Let $V$ be a valuation ring of a global field $K$. We show that for all positive integers $k$ and $1 < n_1 \leq \ldots \leq n_k$ there exists an integer-valued polynomial on $V$, that is, an element of $\text{Int}(V) = \{ f \in K[X] \mid f(V) \subseteq V \}$, which has precisely $k$ essentially different factorizations into irreducible elements of $\text{Int}(V)$ whose lengths are exactly $n_1,\ldots,n_k$. In fact, we show more, namely that the same result holds true for every discrete valuation domain $V$ with finite residue field such that the quotient field of $V$ admits a valuation ring independent of $V$ whose maximal ideal is principal or whose residue field is finite. If the quotient field of $V$ is a purely transcendental extension of an arbitrary field, this property is satisfied. This solves an open problem proposed by Cahen, Fontana, Frisch and Glaz in these cases.


abstract: Reinforcement learning (RL) provides a powerful framework for decision-making, but its application in practice often requires a carefully designed reward function. Adversarial Imitation Learning (AIL) sheds light on automatic policy acquisition without access to the reward signal from the environment. In this work, we propose Auto-Encoding Adversarial Imitation Learning (AEAIL), a robust and scalable AIL framework. To induce expert policies from demonstrations, AEAIL utilizes the reconstruction error of an auto-encoder as a reward signal, which provides more information for optimizing policies than the prior discriminator-based ones. Subsequently, we use the derived objective functions to train the auto-encoder and the agent policy. Experiments show that our AEAIL performs superior compared to state-of-the-art methods on both state and image based environments. More importantly, AEAIL shows much better robustness when the expert demonstrations are noisy.


title: First measurement of projected phase correlations and large-scale structure constraints

abstract: Phase correlations are an efficient way to extract astrophysical information that is largely independent from the power spectrum. We develop an estimator for the line correlation function (LCF) of projected fields, given by the correlation between the harmonic-space phases at three equidistant points on a great circle. We make a first, 6.5$\sigma$ measurement of phase correlations on data from the 2MPZ survey. Finally, we show that the LCF can significantly improve constraints on parameters describing the galaxy-halo connection that are typically degenerate using only two-point data.


title: Spin wave stiffness and damping in a frustrated chiral helimagnet Co$_8$Zn$_8$Mn$_4$ as measured by small-angle neutron scattering

abstract: Multiple intriguing low temperature phenomena have recently been discovered in the family of chiral cubic Co-Zn-Mn compounds with $\beta-$Mn-type structure. In particular, Co$_8$Zn$_8$Mn$_4$ displays a reduction of the helical spiral pitch on cooling, along with lattice shape transformations of metastable skyrmions and the manifestation of peculiar magnetic textures due to strong magnetocrystalline anisotropy. Here we report on temperature-dependent measurements of helimagnon excitations in the field polarized regime Co$_8$Zn$_8$Mn$_4$ using the spin wave small-angle neutron scattering (SWSANS) technique. By applying a new analytical expression to interpret the data, quantitative estimates for both spin wave stiffness and damping are extracted across a wide temperature range between 70 K and 250 K. We speculate that their non-trivial temperature-dependencies arise due to the effects of magnetic frustration arising from Mn magnetic moments, which is further reflected in continuous variations of both exchange and Dzyaloshinskii-Moriya interactions.


title: An improved discrete Rellich inequality on the half-line

abstract: Based on a new idea of factorization, we prove an improved discrete Rellich inequality and discuss its optimality. We also give a conjecture on improved higher order discrete Hardy-like inequalities and formulate an open problem for the discrete Rellich inequality on the full space.


title: Optical Spin Initialisation and Readout with a Cavity-Coupled Quantum Dot in an In-Plane Magnetic Field

abstract: The spin of a charged semiconductor quantum dot (QD) coupled to an optical cavity is a promising candidate for high fidelity spin-photon interfaces; the cavity selectively modifies the decay rates of optical transitions such that spin initialisation, manipulation, and readout are all possible in a single magnetic field geometry. By performing cavity QED calculations, we show that a cavity with a single, linearly-polarised mode can simultaneously support both high-fidelity optical spin initialisation and readout in a single, in-plane (Voigt geometry) magnetic field. Furthermore, we demonstrate that single mode cavities always outperform bi-modal cavities in experimentally favourable driving regimes. Our analysis, when combined with established methods of control in a Voigt geometry field, provides optimal parameter regimes for high-fidelity initialisation and readout, and coherent control in both cavity configurations, providing insights for the design and development of QD spin-photon interfaces.


title: An Interior-Point-Inspired algorithm for Linear Programs arising in Discrete Optimal Transport

abstract: Discrete Optimal Transport problems give rise to very large linear programs (LP) with a particular structure of the constraint matrix. In this paper we present a hybrid algorithm that mixes an interior point method (IPM) and column generation, specialized for the LP originating from the Kantorovich Optimal Transport problem. Knowing that optimal solutions of such problems display a high degree of sparsity, we propose a column-generation-like technique to force all intermediate iterates to be as sparse as possible. The algorithm is implemented nearly matrix-free. Indeed, most of the computations avoid forming the huge matrices involved and solve the Newton system using only a much smaller Schur complement of the normal equations. We prove theoretical results about the sparsity pattern of the optimal solution, exploiting the graph structure of the underlying problem. We use these results to mix iterative and direct linear solvers efficiently, in a way that avoids producing preconditioners or factorizations with excessive fill-in and at the same time guaranteeing a low number of conjugate gradient iterations. We compare the proposed method with two state-of-the-art solvers and show that it can compete with the best network optimization tools in terms of computational time and memory usage. We perform experiments with problems reaching more than four billion variables and demonstrate the robustness of the proposed method.


title: Agent-based Graph Neural Networks

abstract: We present a novel graph neural network we call AgentNet, which is designed specifically for graph-level tasks. AgentNet is inspired by sublinear algorithms, featuring a computational complexity that is independent of the graph size. The architecture of AgentNet differs fundamentally from the architectures of traditional graph neural networks. In AgentNet, some trained \textit{neural agents} intelligently walk the graph, and then collectively decide on the output. We provide an extensive theoretical analysis of AgentNet: We show that the agents can learn to systematically explore their neighborhood and that AgentNet can distinguish some structures that are even indistinguishable by 2-WL. Moreover, AgentNet is able to separate any two graphs which are sufficiently different in terms of subgraphs. We confirm these theoretical results with synthetic experiments on hard-to-distinguish graphs and real-world graph classification tasks. In both cases, we compare favorably not only to standard GNNs but also to computationally more expensive GNN extensions.


title: Weakly-Supervised Temporal Action Localization by Progressive Complementary Learning

abstract: Weakly Supervised Temporal Action Localization (WSTAL) aims to localize and classify action instances in long untrimmed videos with only video-level category labels. Due to the lack of snippet-level supervision for indicating action boundaries, previous methods typically assign pseudo labels for unlabeled snippets. However, since some action instances of different categories are visually similar, it is non-trivial to exactly label the (usually) one action category for a snippet, and incorrect pseudo labels would impair the localization performance. To address this problem, we propose a novel method from a category exclusion perspective, named Progressive Complementary Learning (ProCL), which gradually enhances the snippet-level supervision. Our method is inspired by the fact that video-level labels precisely indicate the categories that all snippets surely do not belong to, which is ignored by previous works. Accordingly, we first exclude these surely non-existent categories by a complementary learning loss. And then, we introduce the background-aware pseudo complementary labeling in order to exclude more categories for snippets of less ambiguity. Furthermore, for the remaining ambiguous snippets, we attempt to reduce the ambiguity by distinguishing foreground actions from the background. Extensive experimental results show that our method achieves new state-of-the-art performance on two popular benchmarks, namely THUMOS14 and ActivityNet1.3.


title: Well-posedness of a time-harmonic elasticity problem in a half-strip

abstract: In this paper we establish that the time-harmonic elasticity problem in a half-strip with non-homogeneous Dirichlet conditions on its boundary section and traction-free conditions on its upper and lower boundaries, has a unique weak solution when this solution is searched under the form of the sum of a linear combination of outgoing waves and an exponentialy decreasing function (in the sense of weighted Sobolev spaces).


title: Conformally coupled theories and their deformed compact objects: from black holes, radiating spacetimes to eternal wormholes

abstract: We study a higher order conformally coupled scalar tensor theory endowed with a covariant geometric constraint relating the scalar curvature with the Gauss-Bonnet scalar. It is a particular Horndeski theory including a canonical kinetic term but without shift or parity symmetry for the scalar. The theory also stems from a Kaluza-Klein reduction of a well defined higher dimensional metric theory. Properties of an asymptotically flat spherically symmetric black hole are analyzed, and new slowly rotating and radiating extensions are found. Through disformal transformations of the static configurations, gravitating monopole-like solutions and eternal wormholes are presented. The latter are shown to extract from spacetime possible naked singularities, yielding completely regular and asymptotically flat spacetimes.


title: Spectral modelling of Type IIb Supernovae

abstract: We use the new NLTE lightcurve and spectral synthesis code JEKYLL to evolve a macroscopically mixed ejecta model of a type IIb Supernova (SN) originating from a star with an initial mass of 12 solar masses through the photospheric and nebular phase. We compare to SN 2011dh, and find that both the spectra and the lightcurves are well reproduced. Our work further strengthens the evidence that this SN originated from a star with an initial mass of about 12 solar masses that had lost all but tiny (<0.1 solar masses) fraction of its hydrogen envelope. We also investigate the effects of the macroscopic mixing by comparing macroscopically and microscopically mixed models, and by varying the clumping geometry. In the photospheric phase, we find strong effects on the effective opacity in the macroscopically mixed regions, which affects the model lightcurves. The diffusion peak is considerably narrower in the macroscopically mixed case, and differs strongly if the radioactive material in the helium envelope is allowed to expand more than in our standard model. The effect is mainly geometrical, and is driven by the expansion of the clumps containing radioactive material. These findings has implications for lightcurve modelling of stripped-envelope SNe in general, and the effect would increase the estimated ejecta masses. In the nebular phase, we find strong effects on the collisional cooling rates in the macroscopically mixed regions, which affects lines driven by collisional cooling, in particular the [Ca II] 7291, 7323 and [O I] 6300, 6364 lines. As these lines are often used for mass determinations, it highlights the importance of how the calcium- and oxygen-rich material is mixed. As shown in this and earlier work, both NLTE and macroscopic mixing are essential ingredients to accurately model the lightcurves and spectra of Type IIb SNe throughout their evolution.


title: Assessing the complexity of orbital parameters after asymmetric kick in binary pulsars

abstract: The dynamical characterization of the Millisecond Pulsar (MSP) parameters is a key issue in understanding these systems. We present an analytical analysis of the orbital parameters of binary MSPs with long periods (Porb > 2 d) and circular (e < 0.1) orbits, produced by an asymmetric kick model imparted during the Accretion Induced Collapse (AIC) of white dwarfs process. It turns out that the distribution of orbits peaks up to P_orb;f < 90 d with strong circularization. Considering the different assumptions about the distribution of companions He stars 3M< Mcom < 5M, the binary will affect the setups of the balance condition of minimum energy. Our analytical approach is just the first approach to the more complete models required for describing all binary parameters after an asymmetric kick. Therefore, we have also run some numerical simulations in order to compare their results with the analytical studies. We aim to initiate the first exploration of the full complexity of the problem, when combining a variable kick time and a variable kick vector direction. Indeed, the numerical simulations show patterns resembling the complex behavior found in chaotic scattering problems. Although we deal with a deterministic problem and bounded orbits, the regular characteristic orbits are found in more realistic phases during the AIC process. In addition, the overall process can show complex behaviors strongly associated with the internal kick mechanisms. This would lead us to identify the nature of regular orbits and their orbital morphology.


title: Some canonical metrics {\em via} Aubin's local deformations

abstract: In this paper, using special metric deformations introduced by Aubin, we construct Riemannian metrics satisfying non-vanishing conditions concerning the Weyl tensor, on every closed manifolds. In particular, in dimension four, we show that there are no topological obstructions for the existence of metrics with non-vanishing Bach tensor.


title: Object Type Clustering using Markov Directly-Follow Multigraph in Object-Centric Process Mining

abstract: Object-centric process mining is a new paradigm with more realistic assumptions about underlying data by considering several case notions, e.g., an order handling process can be analyzed based on order, item, package, and route case notions. Including many case notions can result in a very complex model. To cope with such complexity, this paper introduces a new approach to cluster similar case notions based on Markov Directly-Follow Multigraph, which is an extended version of the well-known Directly-Follow Graph supported by many industrial and academic process mining tools. This graph is used to calculate a similarity matrix for discovering clusters of similar case notions based on a threshold. A threshold tuning algorithm is also defined to identify sets of different clusters that can be discovered based on different levels of similarity. Thus, the cluster discovery will not rely on merely analysts' assumptions. The approach is implemented and released as a part of a python library, called processmining, and it is evaluated through a Purchase to Pay (P2P) object-centric event log file. Some discovered clusters are evaluated by discovering Directly Follow-Multigraph by flattening the log based on the clusters. The similarity between identified clusters is also evaluated by calculating the similarity between the behavior of the process models discovered for each case notion using inductive miner based on footprints conformance checking.


title: Dynamical detection of mean-field topological phases in an interacting Chern insulator

abstract: Interactions generically have important effects on the topological quantum phases. For a quantum anomalous Hall (QAH) insulator, the presence of interactions can qualitatively change the topological phase diagram which, however, is typically hard to measure in the experiment. Here we propose a novel scheme based on quench dynamics to detect the mean-field topological phase diagram of an interacting Chern insulator described by QAH-Hubbard model, with nontrivial dynamical quantum physics being uncovered. We focus on the dynamical properties of the system at a weak to intermediate Hubbard interaction which mainly induces a ferromagnetic order under the mean-field level. Remarkably, three characteristic times $t_s$, $t_c$, and $t^*$ are found in the quench dynamics. The first two capture the emergence of dynamical self-consistent particle density and dynamical topological phase transition respectively, while the last one gives a linear scaling time on the topological phase boundaries. A more interesting result is that $t_s>t^*>t_c$ ($t^*<t_s<t_c$) occurs in repulsive (attractive) interaction and the Chern number is determined by any two characteristic time scales when the system is quenched from an initial nearly fully polarized state to the topologically nontrivial regimes, showing a dynamical way to determine equilibrium mean-field topological phase diagram via the time scales. Experimentally,the measurement of $t_s$ is challenging while $t_c$ and $t^*$ can be directly readout by measuring the spin polarizations of four Dirac points and the time-dependent particle density, respectively. Our work reveals the novel interacting effects on the topological phases and shall promote the experimental observation.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.quant-gas quant-ph


title: On social simulation in 4D relativistic spacetime

abstract: Agent-based modeling and simulation allow us to study social phenomena in hypothetical scenarios. If we stretch our imagination, one of the interesting scenarios would be our interstellar future. To model an interstellar society, we need to consider relativistic physics, which is not straightforward to implement in existing agent-based simulation frameworks. In this paper, we present the mathematics and algorithmic details needed for simulating agent-based models in 4D relativistic spacetime. These algorithms form the basis of our open-source computational framework, "Relativitization".


title: Event-triggered and distributed model predictive control for guaranteed collision avoidance in UAV swarms

abstract: Distributed model predictive control (DMPC) is often used to tackle path planning for unmanned aerial vehicle (UAV) swarms. However, it requires considerable computations on-board the UAV, leading to increased weight and power consumption. In this work, we propose to offload path planning computations to multiple ground-based computation units. As simultaneously communicating and recomputing all trajectories is not feasible for a large swarm with tight timing requirements, we develop a novel event-triggered DMPC that selects a subset of most relevant UAV trajectories to be replanned. The resulting architecture reduces UAV weight and power consumption, while the active redundancy provides robustness against computation unit failures. Moreover, the DMPC guarantees feasible and collision-free trajectories for UAVs with linear dynamics. In simulations, we demonstrate that our method can reliably plan trajectories, while saving 60% of network traffic and required computational power. Hardware-in-the-loop experiments show that it is suitable to control real quadcopter swarms.


title: Monte Carlo Methods for Industry 4.0 Applications

abstract: The fourth industrial revolution and the digital transformation, commonly known as Industry 4.0, is exponentially progressing in recent years. Connected computers, devices, and intelligent machines communicate with each other and interact with the environment to require only a minimum of human intervention. An important issue in Industry 4.0 is the evaluation of the quality of the process in terms of KPIs. Monte Carlo simulations can play an important role to improve the estimations. However, there is still a lack of clear workflow to conduct the Monte Carlo simulations for selecting different Monte Carlo methods. This paper, therefore, proposes a simulation flow for conducting Monte Carlo methods comparison in Industry 4.0 applications. Based on the simulation flow, we compare Cumulative Monte Carlo and Markov Chain Monte Carlo methods. The experimental results show the way to use the Monte Carlo methods in Industry 4.0 and possible limitations of the two simulation methods.


title: Connecting a French Dictionary from the Beginning of the 20th Century to Wikidata

abstract: The \textit{Petit Larousse illustr\'e} is a French dictionary first published in 1905. Its division in two main parts on language and on history and geography corresponds to a major milestone in French lexicography as well as a repository of general knowledge from this period. Although the value of many entries from 1905 remains intact, some descriptions now have a dimension that is more historical than contemporary. They are nonetheless significant to analyze and understand cultural representations from this time. A comparison with more recent information or a verification of these entries would require a tedious manual work. In this paper, we describe a new lexical resource, where we connected all the dictionary entries of the history and geography part to current data sources. For this, we linked each of these entries to a wikidata identifier. Using the wikidata links, we can automate more easily the identification, comparison, and verification of historically-situated representations. We give a few examples on how to process wikidata identifiers and we carried out a small analysis of the entities described in the dictionary to outline possible applications. The resource, i.e. the annotation of 20,245 dictionary entries with wikidata links, is available from GitHub url{https://github.com/pnugues/petit_larousse_1905/


title: Heterogeneous Graph Neural Networks for Software Effort Estimation

abstract: Software effort can be measured by story point [35]. Current approaches for automatically estimating story points focus on applying pre-trained embedding models and deep learning for text regression to solve this problem which required expensive embedding models. We propose HeteroSP, a tool for estimating story points from textual input of Agile software project issues. We select GPT2SP [12] and Deep-SE [8] as the baselines for comparison. First, from the analysis of the story point dataset [8], we conclude that software issues are actually a mixture of natural language sentences with quoted code snippets and have problems related to large-size vocabulary. Second, we provide a module to normalize the input text including words and code tokens of the software issues. Third, we design an algorithm to convert an input software issue to a graph with different types of nodes and edges. Fourth, we construct a heterogeneous graph neural networks model with the support of fastText [6] for constructing initial node embedding to learn and predict the story points of new issues. We did the comparison over three scenarios of estimation, including within project, cross-project within the repository, and cross-project cross repository with our baseline approaches. We achieve the average Mean Absolute Error (MAE) as 2.38, 2.61, and 2.63 for three scenarios. We outperform GPT2SP in 2/3 of the scenarios while outperforming Deep-SE in the most challenging scenario with significantly less amount of running time. We also compare our approaches with different homogeneous graph neural network models and the results show that the heterogeneous graph neural networks model outperforms the homogeneous models in story point estimation. For time performance, we achieve about 570 seconds as the time performance in both three processes: node embedding initialization, model construction, and story point estimation.


title: ROSE: A RObust and SEcure DNN Watermarking

abstract: Protecting the Intellectual Property rights of DNN models is of primary importance prior to their deployment. So far, the proposed methods either necessitate changes to internal model parameters or the machine learning pipeline, or they fail to meet both the security and robustness requirements. This paper proposes a lightweight, robust, and secure black-box DNN watermarking protocol that takes advantage of cryptographic one-way functions as well as the injection of in-task key image-label pairs during the training process. These pairs are later used to prove DNN model ownership during testing. The main feature is that the value of the proof and its security are measurable. The extensive experiments watermarking image classification models for various datasets as well as exposing them to a variety of attacks, show that it provides protection while maintaining an adequate level of security and robustness.


title: On three types of $L$-fuzzy $\beta$-covering-based rough sets

abstract: In this paper, we mainly construct three types of $L$-fuzzy $\beta$-covering-based rough set models and study the axiom sets, matrix representations and interdependency of these three pairs of $L$-fuzzy $\beta$-covering-based rough approximation operators. Firstly, we propose three pairs of $L$-fuzzy $\beta$-covering-based rough approximation operators by introducing the concepts such as $\beta$-degree of intersection and $\beta$-subsethood degree, which are generalizations of degree of intersection and subsethood degree, respectively. And then, the axiom set for each of these $L$-fuzzy $\beta$-covering-based rough approximation operator is investigated. Thirdly, we give the matrix representations of three types of $L$-fuzzy $\beta$-covering-based rough approximation operators, which make it valid to calculate the $L$-fuzzy $\beta$-covering-based lower and upper rough approximation operators through operations on matrices. Finally, the interdependency of the three pairs of rough approximation operators based on $L$-fuzzy $\beta$-covering is studied by using the notion of reducible elements and independent elements. In other words, we present the necessary and sufficient conditions under which two $L$-fuzzy $\beta$-coverings can generate the same lower and upper rough approximation operations.


title: Test Case Prioritization Using Partial Attention

abstract: Test case prioritization (TCP) aims to reorder the regression test suite with a goal of increasing the fault detection rate. Various TCP techniques have been proposed based on different prioritization strategies. Among them, the greedy-based techniques are the most widely-used TCP techniques. However, existing greedy-based techniques usually reorder all candidate test cases in prioritization iterations, resulting in both efficiency and effectiveness problems. In this paper, we propose a generic partial attention mechanism, which adopts the previous priority values (i.e., the number of additionally-covered code units) to avoid considering all candidate test cases. Incorporating the mechanism with the additional-greedy strategy, we implement a novel coverage-based TCP technique based on partition ordering (OCP). OCP first groups the candidate test cases into different partitions and updates the partitions on the descending order. We conduct a comprehensive experiment on 19 versions of Java programs and 30 versions of C programs to compare the effectiveness and efficiency of OCP with six state-of-the-art TCP techniques: total-greedy, additional-greedy, lexicographical-greedy, unify-greedy, art-based, and search-based. The experimental results show that OCP achieves a better fault detection rate than the state-of-the-arts. Moreover, the time costs of OCP are found to achieve 85%-99% improvement than most state-of-the-arts.


title: Can you meaningfully consent in eight seconds? Identifying Ethical Issues with Verbal Consent for Voice Assistants

abstract: Determining how voice assistants should broker consent to share data with third party software has proven to be a complex problem. Devices often require users to switch to companion smartphone apps in order to navigate permissions menus for their otherwise hands-free voice assistant. More in line with smartphone app stores, Alexa now offers "voice-forward consent", allowing users to grant skills access to personal data mid-conversation using speech. While more usable and convenient than opening a companion app, asking for consent 'on the fly' can undermine several concepts core to the informed consent process. The intangible nature of voice interfaces further blurs the boundary between parts of an interaction controlled by third-party developers from the underlying platforms. This provocation paper highlights key issues with current verbal consent implementations, outlines directions for potential solutions, and presents five open questions to the research community. In so doing, we hope to help shape the development of usable and effective verbal consent for voice assistants and similar conversational user interfaces.


title: Oxygen vacancy formation and electronic reconstruction in strained LaNiO$_3$ and LaNiO$_3$/LaAlO$_3$ superlattices

abstract: By using DFT+U, we explore the formation of oxygen vacancies and their impact on the electronic and magnetic structure in strained bulk LaNiO3 and (LaNiO3)$_1$/(LaAlO3)$_1$(001) superlattices. For bulk LaNiO3, we find that epitaxial strain induces a substantial anisotropy in the oxygen vacancy formation energy. In particular, tensile strain promotes the selective reduction of apical oxygen, which may explain why the recently observed superconductivity of infinite-layer nickelates is limited to strained films. For (LaNiO3)$_1$/(LaAlO3)$_1$(001) superlattices, the simulations reveal that the NiO2 layer is most prone to vacancy formation, whereas the AlO2 layer exhibits generally the highest formation energies. The reduction is consistently endothermic, and a largely repulsive vacancy-vacancy interaction is identified as a function of the vacancy concentration. The released electrons are accommodated exclusively in the NiO2 layer, reducing the vacancy formation energy in the AlO2 layer by 70% with respect to bulk LaAlO3. By varying the vacancy concentration from 0% to 8.3% in the NiO2 layer at tensile strain, we observe an unexpected transition from a localized site-disproportionated (0.5%) to a delocalized (2.1%) charge accommodation, a re-entrant site disproportionation leading to a metal-to-insulator transition despite a half-filled majority-spin Ni $e_g$ manifold (4.2%), and finally a magnetic phase transition (8.3%). While a band gap of up to 0.5 eV opens at 4.2% for compressive strain, it is smaller for tensile strain or the system is metallic, which is in sharp contrast to the defect-free superlattice. The strong interplay of electronic reconstructions and structural modifications induced by oxygen vacancies in this system highlights the key role of an explicit supercell treatment and exemplifies the complex response to defects in artificial transition metal oxides.


title: Assessing mutualistic metacommunity capacity by integrating spatial and interaction networks

abstract: We develop a spatially realistic model of mutualistic metacommunities that exploits the joint structure of spatial and interaction networks. This model exhibits a sharp transition between a stable non-null equilibrium state and a global extinction state. This behaviour allows defining a threshold on colonisation/extinction parameters for the long-term metacommunity persistence. This threshold, the 'metacommunity capacity', extends the metapopulation capacity concept and can be calculated from the spatial and interaction networks without simulating the whole dynamics. In several applications we illustrate how the joint structure of the spatial and the interaction networks affects metacommunity capacity. It results that a weakly modular spatial network and a power-law degree distribution of the interaction network provide the most favourable configuration for the long-term persistence of a mutualistic metacommunity. Our model that encodes several explicit ecological assumptions should pave the way for a larger exploration of spatially realistic metacommunity models involving multiple interaction types.


title: KeyCLD: Learning Constrained Lagrangian Dynamics in Keypoint Coordinates from Images

abstract: We present KeyCLD, a framework to learn Lagrangian dynamics from images. Learned keypoints represent semantic landmarks in images and can directly represent state dynamics. We show that interpreting this state as Cartesian coordinates, coupled with explicit holonomic constraints, allows expressing the dynamics with a constrained Lagrangian. KeyCLD is trained unsupervised end-to-end on sequences of images. Our method explicitly models the mass matrix, potential energy and the input matrix, thus allowing energy based control. We demonstrate learning of Lagrangian dynamics from images on the dm_control pendulum, cartpole and acrobot environments. KeyCLD can be learned on these systems, whether they are unactuated, underactuated or fully actuated. Trained models are able to produce long-term video predictions, showing that the dynamics are accurately learned. We compare with Lag-VAE, Lag-caVAE and HGN, and investigate the benefit of the Lagrangian prior and the constraint function. KeyCLD achieves the highest valid prediction time on all benchmarks. Additionally, a very straightforward energy shaping controller is successfully applied on the fully actuated systems. Please refer to our project page for code and additional results: https://rdaems.github.io/keycld/


title: Semigroup of paths on a family of complexes with uniform ellipticity

abstract: This is the third part of a cycle of papers devoted to the construction of a finitely presented infinite nil-semigroup satisfying the identity $x^9 = 0$. This construction answers the problem of L. N. Shevrin and M. V. Sapir, posed, for example, in the Sverdlovsk notebook. A semigroup is realized as a set of path encodings on a family of special uniformly elliptic complexes. In the first paper of the cycle Finitely defined nil semigroup: complexes with uniform ellipticity, a sequence of complexes was constructed with a set of geometric properties. In the second work of the series Deterministic Coloring of a Family of Complexes a finite letter encoding was introduced on the vertices and edges of the constructed complexes. The deterministic property of such a coloring was proved, which makes it possible to introduce a finite set of defining relations on the set of words-codings of paths on complexes. In this paper, we describe an algorithm for reducing an arbitrary semigroup word to canonical form. It is also proved that a word containing a subword with period 9 can be reduced to zero using defining relations. Word encodings corresponding to sufficiently long paths are not reduced to zero and do not change their length, that is, the introduced semigroup is infinite.


title: Information Bleaching, No-Hiding Theorem and Indefinite Causal Order

abstract: The information bleaching refers to any physical process that removes quantum information from the initial state of the physical system. The no-hiding theorem proves that if information is lost from the initial system, then it cannot remain in the bipartite quantum correlation and must be found in the remainder of the Hilbert space. We show that when hiding map acts on the input state in the presence of indefinite causal order, then it is possible to hide quantum information in the correlation. One may ask, does it then violate the no-hiding theorem? We analyse this question and argue that in the extended Hilbert space, it will still respect the no-hiding theorem. We also discuss how to mask quantum information using superposition of two hiding maps. Our results can have interesting implications in preserving the fidelity of information, preservation of quantum coherence and work extraction in the presence of two hiding maps with indefinite causal order. Furthermore, we apply the hiding maps in the presence of indefinite causal order on half of an entangled pair and show that entanglement cannot be preserved. Finally, we discuss that even though quantum entanglement is destroyed, the entanglement fidelity under indefinite causal order is non-zero and can approach close to one.


title: Particle tracking velocimetry and trajectory curvature statistics for particle-laden liquid metal flow in the wake of a cylindrical obstacle

abstract: This paper presents the analysis of the particle-laden liquid metal wake flow around a cylindrical obstacle at different obstacle Reynolds numbers. Particles in liquid metal are visualized using dynamic neutron radiography. We present the results of particle tracking velocimetry of the obstacle wake flow using an improved version of our image processing and particle tracking code MHT-X. The latter now utilizes divergence-free interpolation of the particle image velocimetry field used for motion prediction and particle trajectory reconstruction. We demonstrate significant improvement over the previously obtained results by showing the capabilities to assess both temporal and spatial characteristics of turbulent liquid metal flow, and validating the precision and accuracy of our methods against theoretical expectations, numerical simulations and experiments reported in literature. We obtain the expected vortex shedding frequency scaling with the obstacle Reynolds number and correctly identify the universal algebraic growth laws predicted and observed for trajectory curvature in isotropic homogeneous two-dimensional turbulence. Particle residence times within the obstacle wake and velocity statistics are also derived and found to be physically sound. Finally, we outline potential improvements to our methodology and plans for further research using neutron imaging of particle-laden flow.


title: Minimizing properties of networks via global and local calibrations

abstract: In this note we prove that minimal networks enjoy minimizing properties for the length functional. A minimal network is, roughly speaking, a subset of $\mathbb{R}^2$ composed of straight segments joining at triple junctions forming angles equal to $\tfrac23 \pi$; in particular such objects are just critical points of the length functional a priori. We show that a minimal network $\Gamma_*$: i) minimizes mass among currents with coefficients in a suitable group having the same boundary of $\Gamma_*$, ii) identifies the interfaces of a partition of a neighborhood of $\Gamma_*$ solving the minimal partition problem among partitions with same boundary traces. Consequences and sharpness of such results are discussed. The proofs reduce to rather simple and direct arguments based on the exhibition of (global or local) calibrations associated to the minimal network.


title: When It's Not Worth the Paper It's Written On: A Provocation on the Certification of Skills in the Alexa and Google Assistant Ecosystems

abstract: The increasing reach and functionality of voice assistants has allowed them to become a general-purpose platform for tasks like playing music, accessing information, and controlling smart home devices. In order to maintain the quality of third-party skills and to protect children and other members of the public from inappropriate or malicious skills, platform providers have developed content policies and certification procedures that skills must undergo prior to public release. Unfortunately, research suggests that these measures have been ineffective at curating voice assistant platforms, with documented instances of skills with significant security and privacy problems. This provocation paper outlines how the underlying architectures of these platforms had turned skill certification into a seemingly intractable problem, as well as how current certification methods fall short of their full potential. We present a roadmap for improving the state of skill certification on contemporary voice assistant platforms, including research directions and actions that need to be taken by platform vendors. Promoting this change in domestic voice assistants is especially important, as developers of commercial and industrial assistants or other similar contexts increasingly look to these devices for norms and conventions.


title: Variational determination of arbitrarily many eigenpairs in one quantum circuit

abstract: The state-of-the-art quantum computing hardware has entered the noisy intermediate-scale quantum (NISQ) era. Having been constrained by the limited number of qubits and shallow circuit depth, NISQ devices have nevertheless demonstrated the potential of applications on various subjects. One example is the variational quantum eigensolver (VQE) that was first introduced for computing ground states. Although VQE has now been extended to the study of excited states, the algorithms previously proposed involve a recursive optimization scheme which requires many extra operations with significantly deeper quantum circuits to ensure the orthogonality of different trial states. Here we propose a new algorithm to determine many low energy eigenstates simultaneously. By introducing ancillary qubits to purify the trial states so that they keep orthogonal to each other throughout the whole optimization process, our algorithm allows these states to be efficiently computed in one quantum circuit. Our algorithm reduces significantly the complexity of circuits and the readout errors, and enables flexible post-processing on the eigen-subspace from which the eigenpairs can be accurately determined. We demonstrate this algorithm by applying it to the transverse Ising model. By comparing the results obtained using this variational algorithm with the exact ones, we find that the eigenvalues of the Hamiltonian converge quickly with the increase of the circuit depth. The accuracies of the converged eigenvalues are of the same order, which implies that the difference between any two eigenvalues can be more accurately determined than the eigenvalues themselves.


title: World of Bugs: A Platform for Automated Bug Detection in 3D Video Games

abstract: We present World of Bugs (WOB), an open platform that aims to support Automated Bug Detection (ABD) research in video games. We discuss some open problems in ABD and how they relate to the platform's design, arguing that learning-based solutions are required if further progress is to be made. The platform's key feature is a growing collection of common video game bugs that may be used for training and evaluating ABD approaches.


title: Deep Reinforcement Learning for Turbulence Modeling in Large Eddy Simulations

abstract: Over the last years, supervised learning (SL) has established itself as the state-of-the-art for data-driven turbulence modeling. In the SL paradigm, models are trained based on a dataset, which is typically computed a priori from a high-fidelity solution by applying the respective filter function, which separates the resolved and the unresolved flow scales. For implicitly filtered large eddy simulation (LES), this approach is infeasible, since here, the employed discretization itself acts as an implicit filter function. As a consequence, the exact filter form is generally not known and thus, the corresponding closure terms cannot be computed even if the full solution is available. The reinforcement learning (RL) paradigm can be used to avoid this inconsistency by training not on a previously obtained training dataset, but instead by interacting directly with the dynamical LES environment itself. This allows to incorporate the potentially complex implicit LES filter into the training process by design. In this work, we apply a reinforcement learning framework to find an optimal eddy-viscosity for implicitly filtered large eddy simulations of forced homogeneous isotropic turbulence. For this, we formulate the task of turbulence modeling as an RL task with a policy network based on convolutional neural networks that adapts the eddy-viscosity in LES dynamically in space and time based on the local flow state only. We demonstrate that the trained models can provide long-term stable simulations and that they outperform established analytical models in terms of accuracy. In addition, the models generalize well to other resolutions and discretizations. We thus demonstrate that RL can provide a framework for consistent, accurate and stable turbulence modeling especially for implicitly filtered LES.


title: Global existence and optimal decay rate of weak solutions to the co-rotation Hooke dumbbell model

abstract: In this paper, we mainly study global existence and optimal $L^2$ decay rate of weak solutions to the co-rotation Hooke dumbbell model. This micro-macro model is a coupling of the Navier-Stokes equation with a nonlinear Fokker-Planck equation. Based on the defect measure propagation method, we prove that the co-rotation Hooke dumbbell model admits a global weak solution provided the initial data under different integrable conditions. Moreover, we obtain optimal time decay rate in $L^2$ for the weak solutions obtained by the Fourier splitting method.


title: Penalty Weights in QUBO Formulations: Permutation Problems

abstract: Optimisation algorithms designed to work on quantum computers or other specialised hardware have been of research interest in recent years. Many of these solver can only optimise problems that are in binary and quadratic form. Quadratic Unconstrained Binary Optimisation (QUBO) is therefore a common formulation used by these solvers. There are many combinatorial optimisation problems that are naturally represented as permutations e.g., travelling salesman problem. Encoding permutation problems using binary variables however presents some challenges. Many QUBO solvers are single flip solvers, it is therefore possible to generate solutions that cannot be decoded to a valid permutation. To create bias towards generating feasible solutions, we use penalty weights. The process of setting static penalty weights for various types of problems is not trivial. This is because values that are too small will lead to infeasible solutions being returned by the solver while values that are too large may lead to slower convergence. In this study, we explore some methods of setting penalty weights within the context of QUBO formulations. We propose new static methods of calculating penalty weights which lead to more promising results than existing methods.


title: W-boson mass anomaly and vacuum structure in vector dark matter model with a singlet scalar mediator

abstract: Motivated by the deviation of the W boson mass reported by the CDF collaboration, we study an extension of the Standard Model (SM) including a vector dark matter (VDM) candidate and a scalar mediator. In the model, the one-loop corrections induced by the new scalar, shift the W boson mass. We identify the parameter space of the model consistent with dark matter (DM) relic abundance, W mass boson anomaly, invisible Higgs decay at LHC, and direct detection of DM. It is shown that the W-mass anomaly can be explained for the large part of parameter space of VDM mass and scalar mediator mass between $100-124~\rm GeV$ by the model. We also investigate the renormalization group equations (RGE) at one-loop order for the model. We show that the contribution of new scalar mediator to RGE, guarantees positivity and vacuum stability of SM Higgs up to Planck scale.


title: f-divergences and their applications in lossy compression and bounding generalization error

abstract: In this paper, we provide three applications for $f$-divergences: (i) we introduce Sanov's upper bound on the tail probability of the sum of independent random variables based on super-modular $f$-divergence and show that our generalized Sanov's bound strictly improves over ordinary one, (ii) we consider the lossy compression problem which studies the set of achievable rates for a given distortion and code length. We extend the rate-distortion function using mutual $f$-information and provide new and strictly better bounds on achievable rates in the finite blocklength regime using super-modular $f$-divergences, and (iii) we provide a connection between the generalization error of algorithms with bounded input/output mutual $f$-information and a generalized rate-distortion problem. This connection allows us to bound the generalization error of learning algorithms using lower bounds on the $f$-rate-distortion function. Our bound is based on a new lower bound on the rate-distortion function that (for some examples) strictly improves over previously best-known bounds.


title: An efficient analytical scheme for fuzzy conformable fractional differential equations arising in physical sciences

abstract: This article describes the fuzzy conformable fractional derivative which is based on generalized Hukuhara differentiability. On these topics, we prove a number of properties concerning this type of differentiability. In addition, fuzzy conformable Laplace transforms are used to obtain analytical solutions to the fractional differential equation. Through the use of several practical examples, such as the fuzzy conformable fractional growth equation, the fuzzy conformable fractional one-compartment model, and the fuzzy conformable fractional Newton's law of cooling, we demonstrate the effectiveness and efficiency of the approaches.


title: Artificial optoelectronic spiking neuron based on a resonant tunnelling diode coupled to a vertical cavity surface emitting laser

abstract: Excitable optoelectronic devices represent one of the key building blocks for implementation of artificial spiking neurons in neuromorphic (brain-inspired) photonic systems. This work introduces and experimentally investigates an opto-electro-optical (O/E/O) artificial neuron built with a resonant tunnelling diode (RTD) coupled to a photodetector as a receiver and a vertical cavity surface emitting laser as a the transmitter. We demonstrate a well defined excitability threshold, above which this neuron produces 100 ns optical spiking responses with characteristic neural-like refractory period. We utilise its fan-in capability to perform in-device coincidence detection (logical AND) and exclusive logical OR (XOR) tasks. These results provide first experimental validation of deterministic triggering and tasks in an RTD-based spiking optoelectronic neuron with both input and output optical (I/O) terminals. Furthermore, we also investigate in theory the prospects of the proposed system for its nanophotonic implementation with a monolithic design combining a nanoscale RTD element and a nanolaser; therefore demonstrating the potential of integrated RTD-based excitable nodes for low footprint, high-speed optoelectronic spiking neurons in future neuromorphic photonic hardware.

categories: cs.ET cs.NE physics.app-ph physics.optics


title: COVYT: Introducing the Coronavirus YouTube and TikTok speech dataset featuring the same speakers with and without infection

abstract: More than two years after its outbreak, the COVID-19 pandemic continues to plague medical systems around the world, putting a strain on scarce resources, and claiming human lives. From the very beginning, various AI-based COVID-19 detection and monitoring tools have been pursued in an attempt to stem the tide of infections through timely diagnosis. In particular, computer audition has been suggested as a non-invasive, cost-efficient, and eco-friendly alternative for detecting COVID-19 infections through vocal sounds. However, like all AI methods, also computer audition is heavily dependent on the quantity and quality of available data, and large-scale COVID-19 sound datasets are difficult to acquire -- amongst other reasons -- due to the sensitive nature of such data. To that end, we introduce the COVYT dataset -- a novel COVID-19 dataset collected from public sources containing more than 8 hours of speech from 65 speakers. As compared to other existing COVID-19 sound datasets, the unique feature of the COVYT dataset is that it comprises both COVID-19 positive and negative samples from all 65 speakers. We analyse the acoustic manifestation of COVID-19 on the basis of these perfectly speaker characteristic balanced `in-the-wild' data using interpretable audio descriptors, and investigate several classification scenarios that shed light into proper partitioning strategies for a fair speech-based COVID-19 detection.


title: Cannibal dark matter decoupled from standard model: cosmological constraints

abstract: An internally thermalized dark matter (DM) with only gravitational interaction with the standard model (SM) particles at low temperatures, may undergo number-changing self-scatterings in the early Universe, eventually freezing out to the observed DM abundance. If these reactions, such as a $3 \rightarrow 2$ process, take place when the DM is non-relativistic, DM cannibalizes itself to cool much slower than standard non-relativistic matter during the cannibal phase. As shown in earlier studies, if the cannibal phase takes place during the matter-dominated epoch, there are very strong constraints from structure formation. Considering scenarios in which the cannibal phase freezes out in the radiation-dominated epoch instead, we show that cannibal DM decoupled from the SM can be viable, consistent with all present cosmological constraints. To this end, we solve the coupled evolution equations of the DM temperature and density, and determine its abundance for different DM self-couplings. We then evaluate the constraints on these parameters from the cosmic-microwave background power spectrum, the big-bang nucleosynthesis limits on the relativistic degrees of freedom, the Lyman-$\alpha$ limits on the DM free-streaming length and the theoretical upper bound on the $3 \rightarrow 2$ annihilation rate from $S-$matrix unitarity. We find that depending upon the DM self-couplings, a scalar cannibal DM with mass in the range of around 80 eV to 700 TeV can make up the observed DM density and satisfy all the constraints, when the initial DM temperature ($T_{\rm DM}$) is lower than the SM one ($T_{\rm SM}$), with $T_{\rm SM}/9100 \lesssim T_{\rm DM} \lesssim \,T_{\rm SM}/1.1$.


title: Important stellar perturbers found during the StePPeD database update based on Gaia EDR3 data

abstract: Context. In 2020, the initial version of the Stellar Potential Perturbers Database (StePPeD) was presented with the aim to deliver up-to-date information on the stars and stellar systems that may perturb a long-period comet motion. We used the minimal distance between a star and the Sun as a selecting tool when compiling a list of interesting objects with close encounters with the Solar System, and our selection for that study was based on Gaia DR2 data. Aims. When the Gaia EDR3 data release was published, it became necessary to update this database. Additionally, we performed Monte Carlo simulations to obtain uncertainties on the parameters of the closest approach to the Sun of each object. Methods. We recalculated the close approach parameters of all stars in the previous StePPeD release, which resulted in removing approximately one-third of the total. Then we searched for new candidates in the whole Gaia EDR3 catalogue. We also take into account the duplicity of the found stars and additionally searched for double stars passing near the Sun which had been overlooked in previous papers. We also found the necessary mass estimates for new objects and updated this information for previously selected stars. Results. After a careful checking of all the collected data, we composed a new list of 155 potential stellar perturbers of the long-period comet motion. We applied a new threshold of 2 pc for the minimum star-Sun distance. This list consists of 146 single stars and nine multiple systems. For each object, we also estimated the uncertainty of the parameters of their closest approach to the Sun. Among these stars, we found a new potential strong past perturber, HD 7977, and confirmed the plausibility of a similar action on the part of Gliese 710 in the future.


title: Automated GI tract segmentation using deep learning

abstract: The job of Radiation oncologists is to deliver x-ray beams pointed toward the tumor and at the same time avoid the stomach and intestines. With MR-Linacs (magnetic resonance imaging and linear accelerator systems), oncologists can visualize the position of the tumor and allow for precise dose according to tumor cell presence which can vary from day to day. The current job of outlining the position of the stomach and intestines to adjust the X-ray beams direction for the dose delivery to the tumor while avoiding the organs. This is a time-consuming and labor-intensive process that can easily prolong treatments from 15 minutes to an hour a day unless deep learning methods can automate the segmentation process. This paper discusses an automated segmentation process using deep learning to make this process faster and allow more patients to get effective treatment.


title: Dynamic Restrained Uncertainty Weighting Loss for Multitask Learning of Vocal Expression

abstract: We propose a novel Dynamic Restrained Uncertainty Weighting Loss to experimentally handle the problem of balancing the contributions of multiple tasks on the ICML ExVo 2022 Challenge. The multitask aims to recognize expressed emotions and demographic traits from vocal bursts jointly. Our strategy combines the advantages of Uncertainty Weight and Dynamic Weight Average, by extending weights with a restraint term to make the learning process more explainable. We use a lightweight multi-exit CNN architecture to implement our proposed loss approach. The experimental H-Mean score (0.394) shows a substantial improvement over the baseline H-Mean score (0.335).


title: Neutrino-nucleus CC0$\pi$ cross-section tuning in GENIE v3

abstract: This article summarizes the state of the art of $\nu_\mu$ and $\bar{\nu}_\mu$ CC0$\pi$ cross-section measurements on carbon and argon and discusses the relevant nuclear models, parametrizations and uncertainties in GENIE v3. The CC0$\pi$ event topology is common in experiments at a few-GeV energy range. Although its main contribution comes from quasi-elastic interactions, this topology is still not well understood. The GENIE global analysis framework is exploited to analyze CC0$\pi$ datasets from MiniBooNE, T2K and MINERvA. A partial tune for each experiment is performed, providing a common base for the discussion of tensions between datasets. The results offer an improved description of nuclear CC0$\pi$ datasets as well as data-driven uncertainties for each experiment. This work is a step towards a GENIE global tune that improves our understanding of neutrino interactions on nuclei. It follows from earlier GENIE work on the analysis of neutrino scattering datasets on hydrogen and deuterium.


title: Bayesian nonparametric scalar-on-image regression via Potts-Gibbs random partition models

abstract: Scalar-on-image regression aims to investigate changes in a scalar response of interest based on high-dimensional imaging data. We propose a novel Bayesian nonparametric scalar-on-image regression model that utilises the spatial coordinates of the voxels to group voxels with similar effects on the response to have a common coefficient. We employ the Potts-Gibbs random partition model as the prior for the random partition in which the partition process is spatially dependent, thereby encouraging groups representing spatially contiguous regions. In addition, Bayesian shrinkage priors are utilised to identify the covariates and regions that are most relevant for the prediction. The proposed model is illustrated using the simulated data sets.


title: Bounds for the chromatic index of signed multigraphs

abstract: The paper studies edge-coloring of signed multigraphs and extends classical Theorems of Shannon and K\"onig to signed multigraphs. We prove that the chromatic index of a signed multigraph $(G,\sigma_G)$ is at most $\lfloor \frac{3}{2} \Delta(G) \rfloor$. Furthermore, the chromatic index of a balanced signed multigraph $(H,\sigma_H)$ is at most $\Delta(H) + 1$ and the balanced signed multigraphs with chromatic index $\Delta(H)$ are characterized.


title: Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformer

abstract: Visual question answering (VQA) in surgery is largely unexplored. Expert surgeons are scarce and are often overloaded with clinical and academic workloads. This overload often limits their time answering questionnaires from patients, medical students or junior residents related to surgical procedures. At times, students and junior residents also refrain from asking too many questions during classes to reduce disruption. While computer-aided simulators and recording of past surgical procedures have been made available for them to observe and improve their skills, they still hugely rely on medical experts to answer their questions. Having a Surgical-VQA system as a reliable 'second opinion' could act as a backup and ease the load on the medical experts in answering these questions. The lack of annotated medical data and the presence of domain-specific terms has limited the exploration of VQA for surgical procedures. In this work, we design a Surgical-VQA task that answers questionnaires on surgical procedures based on the surgical scene. Extending the MICCAI endoscopic vision challenge 2018 dataset and workflow recognition dataset further, we introduce two Surgical-VQA datasets with classification and sentence-based answers. To perform Surgical-VQA, we employ vision-text transformers models. We further introduce a residual MLP-based VisualBert encoder model that enforces interaction between visual and text tokens, improving performance in classification-based answering. Furthermore, we study the influence of the number of input image patches and temporal visual features on the model performance in both classification and sentence-based answering.


title: S2RL: Do We Really Need to Perceive All States in Deep Multi-Agent Reinforcement Learning?

abstract: Collaborative multi-agent reinforcement learning (MARL) has been widely used in many practical applications, where each agent makes a decision based on its own observation. Most mainstream methods treat each local observation as an entirety when modeling the decentralized local utility functions. However, they ignore the fact that local observation information can be further divided into several entities, and only part of the entities is helpful to model inference. Moreover, the importance of different entities may change over time. To improve the performance of decentralized policies, the attention mechanism is used to capture features of local information. Nevertheless, existing attention models rely on dense fully connected graphs and cannot better perceive important states. To this end, we propose a sparse state based MARL (S2RL) framework, which utilizes a sparse attention mechanism to discard irrelevant information in local observations. The local utility functions are estimated through the self-attention and sparse attention mechanisms separately, then are combined into a standard joint value function and auxiliary joint value function in the central critic. We design the S2RL framework as a plug-and-play module, making it general enough to be applied to various methods. Extensive experiments on StarCraft II show that S2RL can significantly improve the performance of many state-of-the-art methods.


title: Born's rule and permutation invariance

abstract: It is shown that the probability density satisfies a hyperbolic equation of motion with the unique characteristic that in its many-particle form it contains derivatives acting at spatially remote regions. Based on this feature we explore inter-particle correlations and the relation between the quantum equilibrium condition and the permutation invariance of the probability density. Some remarks with respect to the quantum to classical transition are also presented.


title: Generational Differences in Automobility: Comparing America's Millennials and Gen Xers Using Gradient Boosting Decision Trees

abstract: Whether the Millennials are less auto-centric than the previous generations has been widely discussed in the literature. Most existing studies use regression models and assume that all factors are linear-additive in contributing to the young adults' driving behaviors. This study relaxes this assumption by applying a non-parametric statistical learning method, namely the gradient boosting decision trees (GBDT). Using U.S. nationwide travel surveys for 2001 and 2017, this study examines the non-linear dose-response effects of lifecycle, socio-demographic and residential factors on daily driving distances of Millennial and Gen-X young adults. Holding all other factors constant, Millennial young adults had shorter predicted daily driving distances than their Gen-X counterparts. Besides, residential and economic factors explain around 50% of young adults' daily driving distances, while the collective contributions for life course events and demographics are about 33%. This study also identifies the density ranges for formulating effective land use policies aiming at reducing automobile travel demand.


title: Transformer Neural Networks Attending to Both Sequence and Structure for Protein Prediction Tasks

abstract: The increasing number of protein sequences decoded from genomes is opening up new avenues of research on linking protein sequence to function with transformer neural networks. Recent research has shown that the number of known protein sequences supports learning useful, task-agnostic sequence representations via transformers. In this paper, we posit that learning joint sequence-structure representations yields better representations for function-related prediction tasks. We propose a transformer neural network that attends to both sequence and tertiary structure. We show that such joint representations are more powerful than sequence-based representations only, and they yield better performance on superfamily membership across various metrics.