title: DRo: A data-scarce mechanism to revolutionize the performance of Deep Learning based Security Systems

abstract: Supervised Deep Learning requires plenty of labeled data to converge, and hence perform optimally for task-specific learning. Therefore, we propose a novel mechanism named DRo (for Deep Routing) for data-scarce domains like security. The DRo approach builds upon some of the recent developments in Deep-Clustering. In particular, it exploits the self-augmented training mechanism using synthetically generated local perturbations. DRo not only allays the challenges with sparse-labeled data but also offers many unique advantages. We also developed a system named DRoID that uses the DRo mechanism for enhancing the performance of an existing Malware Detection System that uses (low information features like the) Android implicit Intent(s) as the only features. We conduct experiments on DRoID using a popular and standardized Android malware dataset and found that the DRo mechanism could successfully reduce the false-alarms generated by the downstream classifier by 67.9%, and also simultaneously boosts its accuracy by 11.3%. This is significant not only because the gains achieved are unparalleled but also because the features used were never considered rich enough to train a classifier on; and hence no decent performance could ever be reported by any malware classification system till-date using these features in isolation. Owing to the results achieved, the DRo mechanism claims a dominant position amongst all known systems that aims to enhance the classification performance of deep learning models with sparse-labeled data.


title: First order Hardy inequalities revisited

abstract: In this paper, we consider the first order Hardy inequalities using simple equalities. This basic setting not only permits to derive quickly many well-known Hardy inequalities with optimal constants, but also supplies improved or new estimates in miscellaneous situations, such as multipolar potential, the exponential weight, hyperbolic space, Heisenberg group, the edge Laplacian, or the Grushin type operator.


title: Compute and Energy Consumption Trends in Deep Learning Inference

abstract: The progress of some AI paradigms such as deep learning is said to be linked to an exponential growth in the number of parameters. There are many studies corroborating these trends, but does this translate into an exponential increase in energy consumption? In order to answer this question we focus on inference costs rather than training costs, as the former account for most of the computing effort, solely because of the multiplicative factors. Also, apart from algorithmic innovations, we account for more specific and powerful hardware (leading to higher FLOPS) that is usually accompanied with important energy efficiency optimisations. We also move the focus from the first implementation of a breakthrough paper towards the consolidated version of the techniques one or two year later. Under this distinctive and comprehensive perspective, we study relevant models in the areas of computer vision and natural language processing: for a sustained increase in performance we see a much softer growth in energy consumption than previously anticipated. The only caveat is, yet again, the multiplicative factor, as future AI increases penetration and becomes more pervasive.


title: Exploring Task Difficulty for Few-Shot Relation Extraction

abstract: Few-shot relation extraction (FSRE) focuses on recognizing novel relations by learning with merely a handful of annotated instances. Meta-learning has been widely adopted for such a task, which trains on randomly generated few-shot tasks to learn generic data representations. Despite impressive results achieved, existing models still perform suboptimally when handling hard FSRE tasks, where the relations are fine-grained and similar to each other. We argue this is largely because existing models do not distinguish hard tasks from easy ones in the learning process. In this paper, we introduce a novel approach based on contrastive learning that learns better representations by exploiting relation label information. We further design a method that allows the model to adaptively learn how to focus on hard tasks. Experiments on two standard datasets demonstrate the effectiveness of our method.


title: Combinatorial models for topological Reeb spaces

abstract: There are two rather distinct approaches to Morse theory nowadays: smooth and discrete. We propose to study a real valued function by assembling all associated sections in a topological category. From this point of view, Reeb functions on stratified spaces are introduced, including both smooth and combinatorial examples. As a consequence of the simplicial approach taken, the theory comes with a spectral sequence for computing (generalized) homology. We also model the homotopy type of Reeb graphs/ topological Reeb spaces as simplicial sets, which are combinatorial in nature, as opposed to the typical description in terms of quotient spaces.


title: Strong current-state and initial-state opacity of discrete-event systems

abstract: Opacity, as an important property in information-flow security, characterizes the ability of a system to keep some secret information from an intruder. In discrete-event systems, based on a standard setting in which an intruder has the complete knowledge of the system's structure, the standard versions of current-state opacity and initial-state opacity cannot perfectly characterize high-level privacy requirements. To overcome such a limitation, in this paper we propose two stronger versions of opacity in partially-observed discrete-event systems, called \emph{strong current-state opacity} and \emph{strong initial-state opacity}. Strong current-state opacity describes that an intruder never makes for sure whether a system is in a secret state at the current time, that is, if a system satisfies this property, then for each run of the system ended by a secret state, there exists a non-secret run whose observation is the same as that of the previous run. Strong initial-state opacity captures that the visit of a secret state at the initial time cannot be inferred by an intruder at any instant. Specifically, a system is said to be strongly initial-state opaque if for each run starting from a secret state, there exists a non-secret run of the system that has the same observation as the previous run has. To verify these two properties, we propose two information structures using a novel concurrent-composition technique, which has exponential-time complexity $O(|X|^4|\Sigma_o||\Sigma_{uo}||\Sigma|2^{|X|})$, where $|X|$ (resp., $|\Sigma|$, $|\Sigma_o|$, $|\Sigma_{uo}|$) is the number of states (resp., events, observable events, unobservable events) of a system.


title: Provability Logic: models within models in Peano Arithmetic

abstract: In 1994 Jech gave a model theoretic proof of G\"odel's second incompleteness theorem for Zermelo-Fraenkel set theory in the following form: ZF does not prove that ZF has a model. Kotlarski showed that Jech's proof can be adapted to Peano Arithmetic with the role of models being taken by complete consistent extensions. In this note we take another step in the direction of replacing proof-theoretic by model-theoretic arguments. We show, without passing through the arithmetized completeness theorem, that the existence of a model of PA of complexity $\Sigma^0_2$ is independent of PA, where a model is identified with the set of formulas with parameters which hold in the model. Our approach is based on a new interpretation of the provability logic of Peano Arithmetic with the modal operator interpreted as truth in every $\Sigma^0_2$-model.


title: Stylistic Retrieval-based Dialogue System with Unparallel Training Data

abstract: The ability of a dialog system to express consistent language style during conversations has a direct, positive impact on its usability and on user satisfaction. Although previous studies have demonstrated that style transfer is feasible with a large amount of parallel data, it is often impossible to collect such data for different styles. In this paper, instead of manually constructing conversation data with a certain style, we propose a flexible framework that adapts a generic retrieval-based dialogue system to mimic the language style of a specified persona without any parallel data. Our approach is based on automatic generation of stylized data by learning the usage of jargon, and then rewriting the generic conversations to a stylized one by incorporating the jargon. In experiments we implemented dialogue systems with five distinct language styles, and the result shows our framework significantly outperforms baselines in terms of the average score of responses' relevance and style degree, and content diversity. A/B testing on a commercial chatbot shows that users are more satisfied with our system. This study demonstrates the feasibility of building stylistic dialogue systems by simple data augmentation.


title: Single-Read Reconstruction for DNA Data Storage Using Transformers

abstract: As the global need for large-scale data storage is rising exponentially, existing storage technologies are approaching their theoretical and functional limits in terms of density and energy consumption, making DNA based storage a potential solution for the future of data storage. Several studies introduced DNA based storage systems with high information density (petabytes/gram). However, DNA synthesis and sequencing technologies yield erroneous outputs. Algorithmic approaches for correcting these errors depend on reading multiple copies of each sequence and result in excessive reading costs. The unprecedented success of Transformers as a deep learning architecture for language modeling has led to its repurposing for solving a variety of tasks across various domains. In this work, we propose a novel approach for single-read reconstruction using an encoder-decoder Transformer architecture for DNA based data storage. We address the error correction process as a self-supervised sequence-to-sequence task and use synthetic noise injection to train the model using only the decoded reads. Our approach exploits the inherent redundancy of each decoded file to learn its underlying structure. To demonstrate our proposed approach, we encode text, image and code-script files to DNA, produce errors with high-fidelity error simulator, and reconstruct the original files from the noisy reads. Our model achieves lower error rates when reconstructing the original data from a single read of each DNA strand compared to state-of-the-art algorithms using 2-3 copies. This is the first demonstration of using deep learning models for single-read reconstruction in DNA based storage which allows for the reduction of the overall cost of the process. We show that this approach is applicable for various domains and can be generalized to new domains as well.


title: Efficient Re-parameterization Residual Attention Network For Nonhomogeneous Image Dehazing

abstract: This paper proposes an end-to-end Efficient Re-parameterizationResidual Attention Network(ERRA-Net) to directly restore the nonhomogeneous hazy image. The contribution of this paper mainly has the following three aspects: 1) A novel Multi-branch Attention (MA) block. The spatial attention mechanism better reconstructs high-frequency features, and the channel attention mechanism treats the features of different channels differently. Multi-branch structure dramatically improves the representation ability of the model and can be changed into a single path structure after re-parameterization to speed up the process of inference. Local Residual Connection allows the low-frequency information in the nonhomogeneous area to pass through the block without processing so that the block can focus on detailed features. 2) A lightweight network structure. We use cascaded MA blocks to extract high-frequency features step by step, and the Multi-layer attention fusion tail combines the shallow and deep features of the model to get the residual of the clean image finally. 3)We propose two novel loss functions to help reconstruct the hazy image ColorAttenuation loss and Laplace Pyramid loss. ERRA-Net has an impressive speed, processing 1200x1600 HD quality images with an average runtime of 166.11 fps. Extensive evaluations demonstrate that ERSANet performs favorably against the SOTA approaches on the real-world hazy images.


title: Hint of a truncated primordial spectrum from the CMB large-scale anomalies

abstract: Several satellite missions have uncovered a series of potential anomalies in the fluctuation spectrum of the cosmic microwave background temperature, including: (1) an unexpectedly low level of correlation at large angles, manifested via the angular correlation function, C(theta); and (2) missing power in the low multipole moments of the angular power spectrum, C_ell. Their origin is still debated, however, due to a persistent lack of clarity concerning the seeding of quantum fluctuations in the early Universe. A likely explanation for the first of these appears to be a cutoff, k_min=(3.14 +/- 0.36) x 10^{-4} Mpc^{-1}, in the primordial power spectrum, P(k). Our goal in this paper is twofold: (1) we examine whether the same k_min can also self-consistently explain the missing power at large angles, and (2) we confirm that the of this cutoff in P(k) does not adversely affect the remarkable consistency between the prediction of Planck-LCDM and the Planck measurements at ell > 30. We use the publicly available code CAMB to calculate the angular power spectrum, based on a line-of-sight approach. The code is modified slightly to include the additional parameter (i.e., k_min) characterizing the primordial power spectrum. In addition to this cutoff, the code optimizes all of the usual standard-model parameters. In fitting the angular power spectrum, we find an optimized cutoff, k_min = 2.04^{+1.4}_{-0.79} x 10^{-4} Mpc^{-1}, when using the whole range of ell's, and k_min=3.3^{+1.7}_{-1.3} x 10^{-4} Mpc^{-1}, when fitting only the range ell < 30, where the Sachs-Wolfe effect is dominant. These are fully consistent with the value inferred from C(theta), suggesting that both of these large-angle anomalies may be due to the same truncation in P(k).


title: Boson Stars and Oscillatons: A Review

abstract: Compact objects occupy a pivotal role in the exploration of Nature. The interest spans from the role of compact objects in astrophysics to their detection through various methods (gravitational waves interferometry, microlensing, imaging). While the existence of compact objects made of fermions (neutron stars and white dwarfs) has been assessed, a parallel search for localized solitons made of bosons is ongoing, stemming from Wheeler's original proposal of electromagnetic "geons". Boson fields can clump up and form compact objects such as boson stars (for complex scalar fields), oscillons and oscillatons (for real scalar fields), or Proca stars (for massive vector fields), which can show up in searches as black hole mimickers, dark matter sources, and a variety of other phenomena. I review some crucial properties of these bosonic systems, including recent progress in the field.


title: Norm related inequalities for fractional integrals

abstract: Fractional spline wavelet systems are considered in the work. Molecular structure of elements of such systems admits estimates connecting norms of fractional integrals' images and pre--images in Besov spaces.


title: ART-SLAM: Accurate Real-Time 6DoF LiDAR SLAM

abstract: Real-time six degree-of-freedom pose estimation with ground vehicles represents a relevant and well studied topic in robotics, due to its many applications, such as autonomous driving and 3D mapping. Although some systems exist already, they are either not accurate or they struggle in real-time setting. In this paper, we propose a fast, accurate and modular LiDAR SLAM system for both batch and online estimation. We first apply downsampling and outlier removal, to filter out noise and reduce the size of the input point clouds. Filtered clouds are then used for pose tracking and floor detection, to ground-optimize the estimated trajectory. The availability of a pre-tracker, working in parallel with the filtering process, allows to obtain pre-computed odometries, to be used as aids when performing tracking. Efficient loop closure and pose optimization, achieved through a g2o pose graph, are the last steps of the proposed SLAM pipeline. We compare the performance of our system with state-of-the-art point cloud based methods, LOAM, LeGO-LOAM, A-LOAM, LeGO-LOAM-BOR and HDL, and show that the proposed system achieves equal or better accuracy and can easily handle even cases without loops. The comparison is done evaluating the estimated trajectory displacement using the KITTI and RADIATE datasets.


title: Inverse design of reconfigurable piezoelectric topological phononic plates

abstract: We present a methodology to perform inverse analysis on reconfigurable topological insulators for flexural waves in plate-like structures. First the unit cell topology of a phononic plate is designed, which offers two-fold degeneracy in the band structure by topology optimization. In the second step, piezoelectric patches bonded over the substrate plate are connected to an external circuit and used appropriately to break space inversion symmetry. The space inversion symmetry breaking opens a topological band gap by mimicking quantum valley Hall effect. Numerical simulations demonstrate that the topologically protected edge state exhibits wave propagation without backscattering and is immune to disorders. Predominantly, the proposed idea enables real-time reconfigurability of the topological interfaces in waveguide applications.


title: Facial Anatomical Landmark Detection using Regularized Transfer Learning with Application to Fetal Alcohol Syndrome Recognition

abstract: Fetal alcohol syndrome (FAS) caused by prenatal alcohol exposure can result in a series of cranio-facial anomalies, and behavioral and neurocognitive problems. Current diagnosis of FAS is typically done by identifying a set of facial characteristics, which are often obtained by manual examination. Anatomical landmark detection, which provides rich geometric information, is important to detect the presence of FAS associated facial anomalies. This imaging application is characterized by large variations in data appearance and limited availability of labeled data. Current deep learning-based heatmap regression methods designed for facial landmark detection in natural images assume availability of large datasets and are therefore not wellsuited for this application. To address this restriction, we develop a new regularized transfer learning approach that exploits the knowledge of a network learned on large facial recognition datasets. In contrast to standard transfer learning which focuses on adjusting the pre-trained weights, the proposed learning approach regularizes the model behavior. It explicitly reuses the rich visual semantics of a domain-similar source model on the target task data as an additional supervisory signal for regularizing landmark detection optimization. Specifically, we develop four regularization constraints for the proposed transfer learning, including constraining the feature outputs from classification and intermediate layers, as well as matching activation attention maps in both spatial and channel levels. Experimental evaluation on a collected clinical imaging dataset demonstrate that the proposed approach can effectively improve model generalizability under limited training samples, and is advantageous to other approaches in the literature.


title: A Socially Aware Reinforcement Learning Agent for The Single Track Road Problem

abstract: We present the single track road problem. In this problem two agents face each-other at opposite positions of a road that can only have one agent pass at a time. We focus on the scenario in which one agent is human, while the other is an autonomous agent. We run experiments with human subjects in a simple grid domain, which simulates the single track road problem. We show that when data is limited, building an accurate human model is very challenging, and that a reinforcement learning agent, which is based on this data, does not perform well in practice. However, we show that an agent that tries to maximize a linear combination of the human's utility and its own utility, achieves a high score, and significantly outperforms other baselines, including an agent that tries to maximize only its own utility.


title: Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation

abstract: Although pre-training models have achieved great success in dialogue generation, their performance drops dramatically when the input contains an entity that does not appear in pre-training and fine-tuning datasets (unseen entity). To address this issue, existing methods leverage an external knowledge base to generate appropriate responses. In real-world scenario, the entity may not be included by the knowledge base or suffer from the precision of knowledge retrieval. To deal with this problem, instead of introducing knowledge base as the input, we force the model to learn a better semantic representation by predicting the information in the knowledge base, only based on the input context. Specifically, with the help of a knowledge base, we introduce two auxiliary training objectives: 1) Interpret Masked Word, which conjectures the meaning of the masked entity given the context; 2) Hypernym Generation, which predicts the hypernym of the entity based on the context. Experiment results on two dialogue corpus verify the effectiveness of our methods under both knowledge available and unavailable settings.


title: ArtiBoost: Boosting Articulated 3D Hand-Object Pose Estimation via Online Exploration and Synthesis

abstract: Estimating the articulated 3D hand-object pose from a single RGB image is a highly ambiguous and challenging problem, requiring large-scale datasets that contain diverse hand poses, object types, and camera viewpoints. Most real-world datasets lack these diversities. In contrast, data synthesis can easily ensure those diversities separately. However, constructing both valid and diverse hand-object interactions and efficiently learning from the vast synthetic data is still challenging. To address the above issues, we propose ArtiBoost, a lightweight online data enhancement method. ArtiBoost can cover diverse hand-object poses and camera viewpoints through sampling in a Composited hand-object Configuration and Viewpoint space (CCV-space) and can adaptively enrich the current hard-discernable items by loss-feedback and sample re-weighting. ArtiBoost alternatively performs data exploration and synthesis within a learning pipeline, and those synthetic data are blended into real-world source data for training. We apply ArtiBoost on a simple learning baseline network and witness the performance boost on several hand-object benchmarks. Our models and code are available at https://github.com/lixiny/ArtiBoost.


title: Illuminating Diverse Neural Cellular Automata for Level Generation

abstract: We present a method of generating diverse collections of neural cellular automata (NCA) to design video game levels. While NCAs have so far only been trained via supervised learning, we present a quality diversity (QD) approach to generating a collection of NCA level generators. By framing the problem as a QD problem, our approach can train diverse level generators, whose output levels vary based on aesthetic or functional criteria. To efficiently generate NCAs, we train generators via Covariance Matrix Adaptation MAP-Elites (CMA-ME), a quality diversity algorithm which specializes in continuous search spaces. We apply our new method to generate level generators for several 2D tile-based games: a maze game, Sokoban, and Zelda. Our results show that CMA-ME can generate small NCAs that are diverse yet capable, often satisfying complex solvability criteria for deterministic agents. We compare against a Compositional Pattern-Producing Network (CPPN) baseline trained to produce diverse collections of generators and show that the NCA representation yields a better exploration of level-space.


title: HyAR: Addressing Discrete-Continuous Action Reinforcement Learning via Hybrid Action Representation

abstract: Discrete-continuous hybrid action space is a natural setting in many practical problems, such as robot control and game AI. However, most previous Reinforcement Learning (RL) works only demonstrate the success in controlling with either discrete or continuous action space, while seldom take into account the hybrid action space. One naive way to address hybrid action RL is to convert the hybrid action space into a unified homogeneous action space by discretization or continualization, so that conventional RL algorithms can be applied. However, this ignores the underlying structure of hybrid action space and also induces the scalability issue and additional approximation difficulties, thus leading to degenerated results. In this paper, we propose Hybrid Action Representation (HyAR) to learn a compact and decodable latent representation space for the original hybrid action space. HyAR constructs the latent space and embeds the dependence between discrete action and continuous parameter via an embedding table and conditional Variantional Auto-Encoder (VAE). To further improve the effectiveness, the action representation is trained to be semantically smooth through unsupervised environmental dynamics prediction. Finally, the agent then learns its policy with conventional DRL algorithms in the learned representation space and interacts with the environment by decoding the hybrid action embeddings to the original action space. We evaluate HyAR in a variety of environments with discrete-continuous action space. The results demonstrate the superiority of HyAR when compared with previous baselines, especially for high-dimensional action spaces.


title: DynSTGAT: Dynamic Spatial-Temporal Graph Attention Network for Traffic Signal Control

abstract: Adaptive traffic signal control plays a significant role in the construction of smart cities. This task is challenging because of many essential factors, such as cooperation among neighboring intersections and dynamic traffic scenarios. First, to facilitate cooperation of traffic signals, existing work adopts graph neural networks to incorporate the temporal and spatial influences of the surrounding intersections into the target intersection, where spatial-temporal information is used separately. However, one drawback of these methods is that the spatial-temporal correlations are not adequately exploited to obtain a better control scheme. Second, in a dynamic traffic environment, the historical state of the intersection is also critical for predicting future signal switching. Previous work mainly solves this problem using the current intersection's state, neglecting the fact that traffic flow is continuously changing both spatially and temporally and does not handle the historical state. In this paper, we propose a novel neural network framework named DynSTGAT, which integrates dynamic historical state into a new spatial-temporal graph attention network to address the above two problems. More specifically, our DynSTGAT model employs a novel multi-head graph attention mechanism, which aims to adequately exploit the joint relations of spatial-temporal information. Then, to efficiently utilize the historical state information of the intersection, we design a sequence model with the temporal convolutional network (TCN) to capture the historical information and further merge it with the spatial information to improve its performance. Extensive experiments conducted in the multi-intersection scenario on synthetic data and real-world data confirm that our method can achieve superior performance in travel time and throughput against the state-of-the-art methods.


title: Who shapes crisis communication on Twitter? An analysis of influential German-language accounts during the COVID-19 pandemic

abstract: Twitter is becoming an increasingly important platform for disseminating information during crisis situations, such as the COVID-19 pandemic. Effective crisis communication on Twitter can shape the public perception of the crisis, influence adherence to preventative measures, and thus affect public health. Influential accounts are particularly important as they reach large audiences quickly. This study identifies influential German-language accounts from almost 3 million German tweets collected between January and May 2020 by constructing a retweet network and calculating PageRank centrality values. We capture the volatility of crisis communication by structuring the analysis into seven stages based on key events during the pandemic and profile influential accounts into roles. Our analysis shows that news and journalist accounts were influential throughout all phases, while government accounts were particularly important shortly before and after the lockdown was instantiated. We discuss implications for crisis communication during health crises and for analyzing long-term crisis data.


title: LEA-Net: Layer-wise External Attention Network for Efficient Color Anomaly Detection

abstract: The utilization of prior knowledge about anomalies is an essential issue for anomaly detections. Recently, the visual attention mechanism has become a promising way to improve the performance of CNNs for some computer vision tasks. In this paper, we propose a novel model called Layer-wise External Attention Network (LEA-Net) for efficient image anomaly detection. The core idea relies on the integration of unsupervised and supervised anomaly detectors via the visual attention mechanism. Our strategy is as follows: (i) Prior knowledge about anomalies is represented as the anomaly map generated by unsupervised learning of normal instances, (ii) The anomaly map is translated to an attention map by the external network, (iii) The attention map is then incorporated into intermediate layers of the anomaly detection network. Notably, this layer-wise external attention can be applied to any CNN model in an end-to-end training manner. For a pilot study, we validate LEA-Net on color anomaly detection tasks. Through extensive experiments on PlantVillage, MVTec AD, and Cloud datasets, we demonstrate that the proposed layer-wise visual attention mechanism consistently boosts anomaly detection performances of an existing CNN model, even on imbalanced datasets. Moreover, we show that our attention mechanism successfully boosts the performance of several CNN models.


title: Unsupervised Domain Adaptation Schemes for Building ASR in Low-resource Languages

abstract: Building an automatic speech recognition (ASR) system from scratch requires a large amount of annotated speech data, which is difficult to collect in many languages. However, there are cases where the low-resource language shares a common acoustic space with a high-resource language having enough annotated data to build an ASR. In such cases, we show that the domain-independent acoustic models learned from the high-resource language through unsupervised domain adaptation (UDA) schemes can enhance the performance of the ASR in the low-resource language. We use the specific example of Hindi in the source domain and Sanskrit in the target domain. We explore two architectures: i) domain adversarial training using gradient reversal layer (GRL) and ii) domain separation networks (DSN). The GRL and DSN architectures give absolute improvements of 6.71% and 7.32%, respectively, in word error rate over the baseline deep neural network model when trained on just 5.5 hours of data in the target domain. We also show that choosing a proper language (Telugu) in the source domain can bring further improvement. The results suggest that UDA schemes can be helpful in the development of ASR systems for low-resource languages, mitigating the hassle of collecting large amounts of annotated speech data.


title: The Infinite-Dimensional Standard and Strict Bounded Real Lemmas in Continuous Time: The storage function approach

abstract: The bounded real lemma (BRL) is a classical result in systems theory, which provides a linear matrix inequality criterium for dissipativity, via the Kalman-Yakubovich-Popov (KYP) inequality. The BRL has many applications, among others in H-infinity control. Extensions to infinite dimensional systems, although already present in the work of Yakubovich, have only been studied systematically in the last few decades. In this context various notions of stability, observability and controllability exist, and depending on the hypothesis one may have to allow the KYP-inequality to have unbounded solutions which forces one to consider the KYP-inequality in a spatial form. In the present paper we consider the BRL for continuous time, infinite dimensional, linear well-posed systems. Via an adaptation of Willems' storage function approach we present a unified way to address both the standard and strict forms of the BRL. We avoid making use of the Cayley transform and work only in continuous time. While for the standard bounded real lemma, we obtain analogous results as there exist for the discrete time case, when treating the strict case additional conditions are required, at least at this stage. This might be caused by the fact that the Cayley transform does not preserve exponential stability, an important property in the strict case, when transferring a continuous-time system to a discrete-time system.


title: A Complex Constrained Total Variation Image Denoising Algorithm with Application to Phase Retrieval

abstract: This paper considers the constrained total variation (TV) denoising problem for complex-valued images. We extend the definition of TV seminorms for real-valued images to dealing with complex-valued ones. In particular, we introduce two types of complex TV in both isotropic and anisotropic forms. To solve the constrained denoising problem, we adopt a dual approach and derive an accelerated gradient projection algorithm. We further generalize the proposed denoising algorithm as a key building block of the proximal gradient scheme to solve a vast class of complex constrained optimization problems with TV regularizers. As an example, we apply the proposed algorithmic framework to phase retrieval. We combine the complex TV regularizer with the conventional projection-based method within the constraint complex TV model. Initial results from both simulated and optical experiments demonstrate the validity of the constrained TV model in extracting sparsity priors within complex-valued images, while also utilizing physically tractable constraints that help speed up convergence.


title: Tagged-particle motion in quasi-confined colloidal hard-sphere liquids

abstract: We investigate the tagged-particle motion in a strongly interacting quasi-confined liquid using periodic boundary conditions along the confining direction. Within a mode-coupling theory of the glass transition (MCT) we calculate the self-nonergodicity parameters and the self-intermediate scattering function and compare them with event-driven molecular dynamics simulations. We observe non-monotonic behavior for the in-plane mean-square displacement and further correlation functions which refer to higher mode indices encoding information about the perpendicular motion. The in-plane velocity-autocorrelation function reveals persistent anti-correlations with a negative algebraic power-law decay $t^{-2}$ at all packing fractions.


title: Comparative study of Hermitian and non-Hermitian topological dielectric photonic crystals

abstract: The effects of gain and loss on the band structures of a bulk topological dielectric photonic crystal (PC) with $C_{6v}$ symmetry and the PC-air-PC interface are studied based on first-principle calculation. To illustrate the importance of parity-time (PT) symmetry, three systems are considered, namely the PT-symmetric, PT-asymmetric, and lossy systems. We find that the system with gain and loss distributed in a PT symmetric manner exhibits a phase transition from a PT exact phase to a PT broken phase as the strength of the gain and loss increases, while for the PT-asymmetric and lossy systems, no such phase transition occurs. Furthermore, based on the Wilson loop calculation, the topology of the PT-symmetric system in the PT exact phase is demonstrated to keep unchanged as the Hermitian system. At last, different kinds of edge states in Hermitian systems under the influences of gain and loss are studied and we find that while the eigenfrequencies of nontrivial edge states become complex conjugate pairs, they keep real for the trivial defect states.


title: A few remarks on non-Baire sets in category bases

abstract: In this paper, we first establish some equivalent formulations of non-Baire sets in category bases. We then introduce the notion of an uniform non-Baire family of sets and show that there is an uniform non-Baire family inducing a decomposition of the whole space. This phenomenon is then interpreted in the context of the famous Banah-Mazur game.


title: Quantum Spectral Curve for AdS$_3$/CFT$_2$: a proposal

abstract: We conjecture the Quantum Spectral Curve equations for string theory on $AdS_3 \times S^3 \times T^4$ with RR charge and its CFT$_2$ dual. We show that in the large-length regime, under additional mild assumptions, the QSC reproduces the Asymptotic Bethe Ansatz equations for the massive sector of the theory, including the exact dressing phases found in the literature. The structure of the QSC shares many similarities with the previously known AdS$_5$ and AdS$_4$ cases, but contains a critical new feature - the branch cuts are no longer quadratic. Nevertheless, we show that much of the QSC analysis can be suitably generalised producing a self-consistent system of equations. While further tests are necessary, particularly outside the massive sector, the simplicity and self-consistency of our construction suggests the completeness of the QSC.


title: Porphyrin-functionalization of CsPbBrI$_{2}$/SiO$_{2}$ core-shell nanocrystals enhances the stability and efficiency in electroluminescent devices

abstract: Surface ligand exchange on all-inorganic perovskite nanocrystals of composition CsPbBrI$_{2}$ reveals improved optoelectronic properties due to strong interactions of the nanocrystal with mono-functionalized porphyrin derivatives. The interaction is verified experimentally with an array of spectroscopic measurements as well as computationally by exploiting density functional theory calculations. The enhanced current efficiency is attributed to a lowering of the charging energy by a factor of 2 to 3, which is determined by combining electronic and optical measurements on a selection of ligands. The coupled organic-inorganic nanostructures are successfully deployed in a light emitting device with higher current efficacy and improved charge carrier balance, magnifying the efficiency almost fivefold compared to the native ligand.


title: Spatially resolved fluorescence of caesium lead halide perovskite supercrystals reveals quasi-atomic behavior of nanocrystals

abstract: We correlate spatially resolved fluorescence (-lifetime) measurements with X-ray nanodiffraction to reveal surface defects in supercrystals of self-assembled caesium lead halide perovskite nanocrystals and study their effect on the fluorescence properties. Upon comparison with density functional modelling, we show that a loss in structural coherence, an increasing atomic misalignment between adjacent nanocrystals, and growing compressive strain near the surface of the supercrystal are responsible for the observed fluorescence blueshift and decreased fluorescence lifetimes. Such surface defect-related optical properties extend the frequently assumed analogy between atoms and nanocrystals as so-called quasi-atoms. Our results emphasize the importance of minimizing strain during the self-assembly of perovskite nanocrystals into supercrystals for lighting application such as superfluorescent emitters.


title: On completely non-Baire union in category bases

abstract: In this paper, we intend to show that under not too restrictive conditions, results much stronger than the one obtained earlier by Hejduk could be established in category bases.


title: The Effects of Circumstellar Dust Scattering on the Light Curves and Polarizations of Type Ia Supernovae

abstract: Observational signatures of the circumstellar material (CSM) around Type Ia supernovae (SNe Ia) provide a unique perspective on their progenitor systems. The pre-supernova evolution of the SN progenitors may naturally eject CSM in most of the popular scenarios of SN Ia explosions. In this study, we investigate the influence of dust scattering on the light curves and polarizations of SNe Ia. A Monte Carlo method is constructed to numerically solve the process of radiative transfer through the CSM. Three types of geometric distributions of the CSM are considered: spherical shell, axisymmetric disk, and axisymmetric shell. We show that both the distance of the dust from the SN and the geometric distribution of the dust affect the light curve and color evolutions of SN. We found that the geometric location of the hypothetical circumstellar dust may not be reliably constrained based on photometric data alone, even for the best observed cases such as SN 2006X and SN 2014J, due to the degeneracy of CSM parameters. Our model results show that a time sequence of broadband polarimetry with appropriate time coverage from a month to about one year after explosion can provide unambiguous limits on the presence of circumstellar dust around SNe Ia.


title: Fluctuation theorems and thermodynamic uncertainty relations

abstract: Fluctuation theorems are fundamental results in non-equilibrium thermodynamics. Considering the fluctuation theorem with respect to the entropy production and an observable, we derive a new thermodynamic uncertainty relation which also applies to non-cyclic and time-reversal non-symmetric protocols. Furthermore, we investigate the relation between the thermodynamic uncertainty relation and the correlation between the entropy and the observable.


title: A periodic homogenization problem with defects rare at infinity

abstract: We consider a homogenization problem for the diffusion equation $-\operatorname{div}\left(a_{\varepsilon} \nabla u_{\varepsilon} \right) = f$ when the coefficient $a_{\varepsilon}$ is a non-local perturbation of a periodic coefficient. The perturbation does not vanish but becomes rare at infinity in a sense made precise in the text. We prove the existence of a corrector, identify the homogenized limit and study the convergence rates of $u_{\varepsilon}$ to its homogenized limit.


title: Check Your Other Door! Creating Backdoor Attacks in the Frequency Domain

abstract: Deep Neural Networks (DNNs) are ubiquitous and span a variety of applications ranging from image classification to real-time object detection. As DNN models become more sophisticated, the computational cost of training these models becomes a burden. For this reason, outsourcing the training process has been the go-to option for many DNN users. Unfortunately, this comes at the cost of vulnerability to backdoor attacks. These attacks aim to establish hidden backdoors in the DNN so that it performs well on clean samples, but outputs a particular target label when a trigger is applied to the input. Existing backdoor attacks either generate triggers in the spatial domain or naively poison frequencies in the Fourier domain. In this work, we propose a pipeline based on Fourier heatmaps to generate a spatially dynamic and invisible backdoor attack in the frequency domain. The proposed attack is extensively evaluated on various datasets and network architectures. Unlike most existing backdoor attacks, the proposed attack can achieve high attack success rates with low poisoning rates and little to no drop in performance while remaining imperceptible to the human eye. Moreover, we show that the models poisoned by our attack are resistant to various state-of-the-art (SOTA) defenses, so we contribute two possible defenses that can evade the attack.


title: On the spectrum of non degenerate magnetic Laplacian

abstract: We consider a compact Riemannian manifold with a Hermitian line bundle whose curvature is non degenerate. Under a general condition, the Laplacian acting on high tensor powers of the bundle exhibits gaps and clusters of eigenvalues. We prove that for each cluster, the number of eigenvalues that it contains, is given by a Riemann-Roch number. We also give a pointwise description of the Schwartz kernel of the spectral projectors onto the eigenstates of each cluster, similar to the Bergman kernel asymptotics of positive line bundles. Another result is that gaps and clusters also appear in local Weyl laws.


title: Towards Robust Monocular Visual Odometry for Flying Robots on Planetary Missions

abstract: In the future, extraterrestrial expeditions will not only be conducted by rovers but also by flying robots. The technical demonstration drone Ingenuity, that just landed on Mars, will mark the beginning of a new era of exploration unhindered by terrain traversability. Robust self-localization is crucial for that. Cameras that are lightweight, cheap and information-rich sensors are already used to estimate the ego-motion of vehicles. However, methods proven to work in man-made environments cannot simply be deployed on other planets. The highly repetitive textures present in the wastelands of Mars pose a huge challenge to descriptor matching based approaches. In this paper, we present an advanced robust monocular odometry algorithm that uses efficient optical flow tracking to obtain feature correspondences between images and a refined keyframe selection criterion. In contrast to most other approaches, our framework can also handle rotation-only motions that are particularly challenging for monocular odometry systems. Furthermore, we present a novel approach to estimate the current risk of scale drift based on a principal component analysis of the relative translation information matrix. This way we obtain an implicit measure of uncertainty. We evaluate the validity of our approach on all sequences of a challenging real-world dataset captured in a Mars-like environment and show that it outperforms state-of-the-art approaches.


title: Martingale solutions of two and three dimensional stochastic convective Brinkman-Forchheimer equations forced by L\'evy noise

abstract: The convective Brinkman-Forchheimer equations given by $$ \frac{\partial \boldsymbol{u}}{\partial t}-\mu \Delta\boldsymbol{u}+(\boldsymbol{u}\cdot\nabla)\boldsymbol{u}+\alpha\boldsymbol{u}+\beta|\boldsymbol{u}|^{r-1}\boldsymbol{u}+\nabla p=\boldsymbol{f}, \ \nabla\cdot\boldsymbol{u}=0, $$ where $\mu,\alpha,\beta>0$ and $r\in[1,\infty)$ describe the motion of incompressible fluid flows in a saturated porous medium. In bounded domains (for $d=2,3$ and $r\in[1,\infty)$), the existence of a weak martingale solution for stochastic convective Brinkman-Forchheimer equations forced by L\'evy noise consisting of a $\mathrm{Q}$-Wiener process and a compensated time homogeneous Poisson random measure is established in this work. Using the classical Faedo-Galerkin approximation, a compactness method and a version of the Skorokhod embedding theorem for nonmetric spaces, we prove the existence of a weak martingale solution. For $d=2$, $r\in[1,\infty)$ and $d=3$, $r\in[3,\infty)$, we prove that the martingale solution has stronger regularity properties such as it satisfies the energy equality (It\^o's formula) and hence the trajectories are equal almost everywhere to an $\mathbb{H}$-valued c\`adl\`ag function defined on $[0, T ]$, ${\mathbb{P}}$-a.s. Furthermore, for $d=2$, $r\in[1,\infty)$ and $d=3$, $r\in[3,\infty)$ ($2\beta\mu\geq 1$ for $r=3$), we show the pathwise uniqueness of solutions and use the classical Yamada-Watanabe argument to derive the existence of a strong solution and uniqueness in law.


title: Spin-polarized zero-bias peak from a single magnetic impurity at an s-wave superconductor: first-principles study

abstract: Magnetic impurities at surfaces of superconductors can induce bound states referred to as Yu-Shiba-Rusinov (YSR) states within superconducting gaps. Understanding of YSR states with spin-orbit coupling (SOC) plays a pivotal role in studies of Majorana zero modes. Spin polarization of a zero-bias peak (ZBP) is used to determine its topological nature. Here we investigate the YSR states of single magnetic impurities at the surface of Pb using the fully relativistic first-principles simulations including band structure of Pb and five 3$d$ orbitals of the impurity in the superconducting state. We show that for single Fe and Co impurities, strong SOC can induce a ZBP with rotation of the impurity magnetic moment and that the ZBP has large spin polarization in contrast to effective model studies. Conditions for a ZBP from a single magnetic impurity are discussed. Our results are relevant to longer atomic chains considering their canting and noncollinear magnetism.


title: AdS from CFT for scalar QED

abstract: We construct an explicit bulk dual in anti-de Sitter space, with couplings of order $1/N$, for the $SU(N)$-singlet sector of QED in $d$ space-time dimensions ($2 < d < 4$) coupled to $N$ scalar fields. We begin from the bulk dual for the theory of $N$ complex free scalar fields that we constructed in our previous work, and couple this to $U(1)$ gauge fields living on the boundary in order to get the bulk dual of scalar QED (in which the $U(1)$ gauge fields become the boundary value of the bulk vector fields). As in our previous work, the bulk dual is non-local but we can write down an explicit action for it. We focus on the CFTs arising at low energies (or, equivalently, when the $U(1)$ gauge coupling goes to infinity). For $d=3$ we discuss also the addition of a Chern-Simons term for $U(1)$, modifying the boundary conditions for the bulk gauge field. We also discuss the generalization to QCD, with $U(N_c)$ gauge fields coupled to $N$ scalar fields in the fundamental representation (in the large $N$ limit with fixed $N_c$).


title: On the consistency and asymptotic normality of multiparameter persistent Betti numbers

abstract: The persistent Betti numbers are used in topological data analysis to infer the scales at which topological features appear and disappear in the filtration of a topological space. Most commonly by means of the corresponding barcode or persistence diagram. While this approach to data science has been very successful, it suffers from sensitivity to outliers, and it does not allow for additional filtration parameters. Such parameters naturally appear when a cloud of data points comes together with additional measurements taken at the locations of the data. For these reasons, multiparameter persistent homology has recently received significant attention. In particular, the multicover and \v{C}ech bifiltration have been introduced to overcome the aforementioned shortcomings. In this work, we establish the strong consistency and asymptotic normality of the multiparameter persistent Betti numbers in growing domains. Our asymptotic results are established for a general framework encompassing both the marked \v{C}ech bifiltration, as well as the multicover bifiltration constructed on the null model of an independently marked Poisson point process. In a simulation study, we explain how the asymptotic normality can be used to derive tests for the goodness of fit. The statistical power of such tests is illustrated through different alternatives exhibiting more clustering, or more repulsion than the null model.


title: On Pless symmetry codes, ternary QR codes, and related Hadamard matrices and designs

abstract: It is proved that a code $L(q)$ which is monomially equivalent to the Pless symmetry code $C(q)$ of length $2q+2$ contains the (0,1)-incidence matrix of a Hadamard 3-$(2q+2,q+1,(q-1)/2)$ design $D(q)$ associated with a Paley-Hadamard matrix of type II. Similarly, any ternary extended quadratic residue code contains the incidence matrix of a Hadamard 3-design associated with a Paley-Hadamard matrix of type I. If $q=5, 11, 17, 23$, then the full permutation automorphism group of $L(q)$ coincides with the full automorphism group of $D(q)$, and a similar result holds for the ternary extended quadratic residue codes of lengths 24 and 48. All Hadamard matrices of order 36 formed by codewords of the Pless symmetry code $C(17)$ are enumerated and classified up to equivalence. There are two equivalence classes of such matrices: the Paley-Hadamard matrix $H$ of type I with a full automorphism group of order 19584, and a second regular Hadamard matrix $H'$ such that the symmetric 2-$(36,15,6)$ design $D$ associated with $H'$ has trivial full automorphism group, and the incidence matrix of $D$ spans a ternary code equivalent to $C(17)$.


title: One-dimensional purely Lee-Huang-Yang fluids dominated by quantum fluctuations in two-component Bose-Einstein condensates

abstract: Lee-Huang-Yang (LHY) fluids are an exotic quantum matter dominated purely by quantum fluctuations. Recently, the three-dimensional LHY fluids were observed in ultracold atoms experiments, while their low-dimensional counterparts have not been well known. Herein, based on the Gross-Pitaevskii equation of one-dimensional LHY quantum fluids in two-component Bose-Einstein condensates, we reveal analytically and numerically the formation, properties, and dynamics of matter-wave structures therein. Considering a harmonic trap, approximate analytical results are obtained based on variational approximation, and higher-order nonlinear localized modes with nonzero nodes are constructed numerically. Stability regions of all the LHY nonlinear localized modes are identified by linear-stability analysis and direct perturbed numerical simulations. Movements and oscillations of single localized mode, and collisions between two modes, under the influence of different initial kicks are also studied in dynamical evolutions. The predicted results are available to quantum-gas experiments, providing a new insight into LHY physics in low-dimensional settings.


title: An Improved Hybrid Recommender System: Integrating Document Context-Based and Behavior-Based Methods

abstract: One of the main challenges in recommender systems is data sparsity which leads to high variance. Several attempts have been made to improve the bias-variance trade-off using auxiliary information. In particular, document modeling-based methods have improved the model's accuracy by using textual data such as reviews, abstracts, and storylines when the user-to-item rating matrix is sparse. However, such models are insufficient to learn optimal representation for users and items. User-based and item-based collaborative filtering, owing to their efficiency and interpretability, have been long used for building recommender systems. They create a profile for each user and item respectively as their historically interacted items and the users who interacted with the target item. This work combines these two approaches with document context-aware recommender systems by considering users' opinions on these items. Another advantage of our model is that it supports online personalization. If a user has new interactions, it needs to refresh the user and item history representation vectors instead of updating model parameters. The proposed algorithm is implemented and tested on three real-world datasets that demonstrate our model's effectiveness over the baseline methods.


title: A Study of Dense Suspensions Climbing Against Gravity

abstract: Dense suspensions have previously been shown to produce a range of anomalous and gravity-defying behaviors when subjected to strong vibrations in the direction of gravity. These behaviors have previously been interpreted via analogies to inverted pendulums and ratchets, language that implies an emergent solid-like structure within the fluid. It is therefore tempting to link these flow instabilities to shear jamming (SJ), but this is too restrictive since the instabilities can also be observed in systems that shear thicken but do not shear jam. As an alternative perspective, we re-frame earlier ideas about "racheting" as a "negative viscosity" effect, in which the cycle-averaged motion of a vibrated fluid is oriented opposite to the direction implied by the cycle-averaged stresses. Using ideas from the Wyart and Cates modeling framework, we show that such a "negative viscosity" can be achieved in shear flows driven by oscillating stress with both square and sinusoidal wave forms. We extend this same modeling approach to study falling films in a vibrating gravitational field, where we similarly find it is possible to attain an overall flow opposite to the direction of gravity. Preliminary experimental findings are also provided in support of the modeling work.


title: A Digital Forensics Investigation of a Smart Scale IoT Ecosystem

abstract: The introduction of Internet of Things (IoT) ecosystems into personal homes and businesses prompts the idea that such ecosystems contain residual data, which can be used as digital evidence in court proceedings. However, the forensic examination of IoT ecosystems introduces a number of investigative problems for the digital forensics community. One of these problems is the limited availability of practical processes and techniques to guide the preservation and analysis of residual data from these ecosystems. Focusing on a detailed case study of the iHealth Smart Scale ecosystem, we present an empirical demonstration of practical techniques to recover residual data from different evidence sources within a smart scale ecosystem. We also document the artifacts that can be recovered from a smart scale ecosystem, which could inform a digital (forensic) investigation. The findings in this research provides a foundation for future studies regarding the development of processes and techniques suitable for extracting and examining residual data from IoT ecosystems.


title: Superconductivity, nematicity, and charge density wave in high-Tc cuprates: A common thread

abstract: To address the issues of superconducting and charge properties in high-T$_c$ cuprates, we perform a quantum Monte Carlo study of an extended three-band Emery model, which explicitly includes attractive interaction $V_{OO}$ between oxygen orbitals. In the physically relevant parameter range, we find that $V_{OO}$ acts to strongly enhance the long-range part of d-wave pairing correlation, with a clear tendency to form long-range superconducting order in the thermodynamic limit. Simultaneously, increasing $|V_{OO}|$ renders a rapid increase of the nematic charge structure factor at most of wavevectors, especially near $\textbf{q}=(0,0)$, indicating a dramatic enhancement of nematicity and charge density waves. Our findings suggest that the attraction between oxygen orbitals in high-T$_c$ cuprates is a common thread linking their superconducting and charge properties.


title: Anomalous Self-assembly of Architecturally Semiflexible Block Copolymers

abstract: Block copolymer self-assembly is a fundamental process in which incompatible blocks spontaneously form organized microstructures with broad practical applications. Classical understanding is that the domain spacing is limited by the contour length of the polymer backbone. Here, using a combination of molecular design, chemical synthesis, small/wide-angle X-ray scattering, transmission electron microscopy, and electron tomography, we discover that this molecular picture does not hold for architecturally semiflexible block copolymers. For strongly segregated linear-semiflexible bottlebrush-linear triblock copolymers, the size of the bottlebrush domain can be twice the bottlebrush backbone contour length. The mechanism of such anomalous self-assembly likely is that the interfacial repulsion between the incompatible blocks is large enough to pull a part of the linear end-blocks into the bottlebrush domain. This effectively increases the bottlebrush domain size. Moreover, the semiflexible bottlebrush widens the regime for cylinder morphology that is associated with the volume fraction of the end blocks $f_C^{SFB}\in(0.10,>0.40)$. This window is much wider than that for flexible linear block copolymers, $f_C^{F} \in(0.14,0.35)$, and that predicted by recent self-consistent field theory for linear-bottlebrush block copolymers of the same chemistry and molecular architecture. Our experimental findings reveal previously unrecognized mechanisms for the self-assembly of architecturally complex block copolymers.


title: Generalized Iterative Formula for Bell Inequalities

abstract: Bell inequalities are a vital tool to detect the nonlocal correlations, but the construction of them for multipartite systems is still a complicated problem. In this work, inspired via a decomposition of $(n+1)$-partite Bell inequalities into $n$-partite ones, we present a generalized iterative formula to construct nontrivial $(n+1)$-partite ones from the $n$-partite ones. Our iterative formulas recover the well-known Mermin-Ardehali-Belinski{\u{\i}}-Klyshko (MABK) and other families in the literature as special cases. Moreover, a family of ``dual-use'' Bell inequalities is proposed, in the sense that for the generalized Greenberger-Horne-Zeilinger states these inequalities lead to the same quantum violation as the MABK family and, at the same time, the inequalities are able to detect the non-locality in the entire entangled region. Furthermore, we present generalizations of the the I3322 inequality to any $n$-partite case which are still tight, and of the $46$ \'{S}liwa's inequalities to the four-partite tight ones, by applying our iteration method to each inequality and its equivalence class.


title: TEASEL: A Transformer-Based Speech-Prefixed Language Model

abstract: Multimodal language analysis is a burgeoning field of NLP that aims to simultaneously model a speaker's words, acoustical annotations, and facial expressions. In this area, lexicon features usually outperform other modalities because they are pre-trained on large corpora via Transformer-based models. Despite their strong performance, training a new self-supervised learning (SSL) Transformer on any modality is not usually attainable due to insufficient data, which is the case in multimodal language learning. This work proposes a Transformer-Based Speech-Prefixed Language Model called TEASEL to approach the mentioned constraints without training a complete Transformer model. TEASEL model includes speech modality as a dynamic prefix besides the textual modality compared to a conventional language model. This method exploits a conventional pre-trained language model as a cross-modal Transformer model. We evaluated TEASEL for the multimodal sentiment analysis task defined by CMU-MOSI dataset. Extensive experiments show that our model outperforms unimodal baseline language models by 4% and outperforms the current multimodal state-of-the-art (SoTA) model by 1% in F1-score. Additionally, our proposed method is 72% smaller than the SoTA model.


title: Constructing Phrase-level Semantic Labels to Form Multi-Grained Supervision for Image-Text Retrieval

abstract: Existing research for image text retrieval mainly relies on sentence-level supervision to distinguish matched and mismatched sentences for a query image. However, semantic mismatch between an image and sentences usually happens in finer grain, i.e., phrase level. In this paper, we explore to introduce additional phrase-level supervision for the better identification of mismatched units in the text. In practice, multi-grained semantic labels are automatically constructed for a query image in both sentence-level and phrase-level. We construct text scene graphs for the matched sentences and extract entities and triples as the phrase-level labels. In order to integrate both supervision of sentence-level and phrase-level, we propose Semantic Structure Aware Multimodal Transformer (SSAMT) for multi-modal representation learning. Inside the SSAMT, we utilize different kinds of attention mechanisms to enforce interactions of multi-grain semantic units in both sides of vision and language. For the training, we propose multi-scale matching losses from both global and local perspectives, and penalize mismatched phrases. Experimental results on MS-COCO and Flickr30K show the effectiveness of our approach compared to some state-of-the-art models.


title: A Decidability-Based Loss Function

abstract: Nowadays, deep learning is the standard approach for a wide range of problems, including biometrics, such as face recognition and speech recognition, etc. Biometric problems often use deep learning models to extract features from images, also known as embeddings. Moreover, the loss function used during training strongly influences the quality of the generated embeddings. In this work, a loss function based on the decidability index is proposed to improve the quality of embeddings for the verification routine. Our proposal, the D-loss, avoids some Triplet-based loss disadvantages such as the use of hard samples and tricky parameter tuning, which can lead to slow convergence. The proposed approach is compared against the Softmax (cross-entropy), Triplets Soft-Hard, and the Multi Similarity losses in four different benchmarks: MNIST, Fashion-MNIST, CIFAR10 and CASIA-IrisV4. The achieved results show the efficacy of the proposal when compared to other popular metrics in the literature. The D-loss computation, besides being simple, non-parametric and easy to implement, favors both the inter-class and intra-class scenarios.


title: Inhomogeneities in the $2$-Flavor Chiral Gross-Neveu Model

abstract: We investigate the finite-temperature and -density chiral Gross-Neveu model with an axial U$_A$(1) symmetry in $1+1$ dimensions on the lattice. In the limit where the number of flavors $N_\mathrm{f}$ tends to infinity the continuum model has been solved analytically and shows two phases: a symmetric high-temperature phase with a vanishing condensate and a low-temperature phase in which the complex condensate forms a chiral spiral which breaks translation invariance. In the lattice simulations we employ chiral SLAC fermions with exact axial symmetry. Similarly to $N_\mathrm{f}\to\infty$, we find for $8$ flavors, where quantum and thermal fluctuations are suppressed, two distinct regimes in the $(T,\mu)$ phase diagram, characterized by qualitatively different behavior of the two-point functions of the condensate fields. More surprisingly, at $N_\mathrm{f}=2$, where fluctuations are no longer suppressed, the model still behaves similarly to the $N_\mathrm{f}\to\infty$ model and we conclude that the chiral spiral leaves its footprints even on systems with a small number of flavors. For example, at low temperature the two-point functions are still dominated by chiral spirals with pitches proportional to the inverse chemical potential, although in contrast to large-$N_\mathrm{f}$ their amplitudes decrease with distance. We argue that these results should not be interpreted as the spontaneous breaking of a continuous symmetry, which is forbidden in two dimensions. Finally, using Dyson-Schwinger equations we calculate the decay of the U$_A$(1)-invariant fermion four-point function in search for a BKT phase at zero temperature.


title: An Unsupervised Deep-Learning Method for Fingerprint Classification: the CCAE Network and the Hybrid Clustering Strategy

abstract: The fingerprint classification is an important and effective method to quicken the process and improve the accuracy in the fingerprint matching process. Conventional supervised methods need a large amount of pre-labeled data and thus consume immense human resources. In this paper, we propose a new and efficient unsupervised deep learning method that can extract fingerprint features and classify fingerprint patterns automatically. In this approach, a new model named constraint convolutional auto-encoder (CCAE) is used to extract fingerprint features and a hybrid clustering strategy is applied to obtain the final clusters. A set of experiments in the NIST-DB4 dataset shows that the proposed unsupervised method exhibits the efficient performance on fingerprint classification. For example, the CCAE achieves an accuracy of 97.3% on only 1000 unlabeled fingerprints in the NIST-DB4.


title: Extracting Event Temporal Relations via Hyperbolic Geometry

abstract: Detecting events and their evolution through time is a crucial task in natural language understanding. Recent neural approaches to event temporal relation extraction typically map events to embeddings in the Euclidean space and train a classifier to detect temporal relations between event pairs. However, embeddings in the Euclidean space cannot capture richer asymmetric relations such as event temporal relations. We thus propose to embed events into hyperbolic spaces, which are intrinsically oriented at modeling hierarchical structures. We introduce two approaches to encode events and their temporal relations in hyperbolic spaces. One approach leverages hyperbolic embeddings to directly infer event relations through simple geometrical operations. In the second one, we devise an end-to-end architecture composed of hyperbolic neural units tailored for the temporal relation extraction task. Thorough experimental assessments on widely used datasets have shown the benefits of revisiting the tasks on a different geometrical space, resulting in state-of-the-art performance on several standard metrics. Finally, the ablation study and several qualitative analyses highlighted the rich event semantics implicitly encoded into hyperbolic spaces.


title: Squirmer hydrodynamics near a periodic surface topography

abstract: The behaviour of microscopic swimmers has previously been explored near large scale confining geometries and in the presence of very small-scale surface roughness. Here we consider an intermediate case of how a simple microswimmer, the tangential spherical squirmer, behaves adjacent to singly- and doubly-periodic sinusoidal surface topographies that spatially oscillate with an amplitude that is an order of magnitude less than the swimmer size and wavelengths within an order of magnitude of this scale. The nearest neighbour regularised Stokeslet method is used for numerical explorations after validating its accuracy for a spherical tangential squirmer that swims stably near a flat surface. The same squirmer is then introduced to the different surface topographies. The key governing factor in the resulting swimming behaviour is the size of the squirmer relative to the surface topography wavelength. When the squirmer is much larger, or much smaller, than the surface topography wavelength then directional guidance is not observed. Once the squirmer size is on the scale of the topography wavelength limited guidance is possible, often with local capture in the topography troughs. However, complex dynamics can also emerge, especially when the initial configuration is not close to alignment along topography troughs or above topography crests. In contrast to sensitivity in alignment and the topography wavelength, reductions in the amplitude of the surface topography or variations in the shape of the periodic surface topography do not have extensive impacts on the squirmer behaviour. Our findings more generally highlight that detailed numerical explorations are necessary to determine how surface topographies may interact with a given swimmer that swims stably near a flat surface and whether surface topographies may be designed to provide such swimmers with directional guidance.


title: Estimating a new panel MSK dataset for comparative analyses of national absorptive capacity systems, economic growth, and development in low and middle income economies

abstract: Within the national innovation system literature, empirical analyses are severely lacking for developing economies. Particularly, the low- and middle-income countries (LMICs) eligible for the World Bank's International Development Association (IDA) support, are rarely part of any empirical discourse on growth, development, and innovation. One major issue hindering panel analyses in LMICs, and thus them being subject to any empirical discussion, is the lack of complete data availability. This work offers a new complete panel dataset with no missing values for LMICs eligible for IDA's support. I use a standard, widely respected multiple imputation technique (specifically, Predictive Mean Matching) developed by Rubin (1987). This technique respects the structure of multivariate continuous panel data at the country level. I employ this technique to create a large dataset consisting of many variables drawn from publicly available established sources. These variables, in turn, capture six crucial country-level capacities: technological capacity, financial capacity, human capital capacity, infrastructural capacity, public policy capacity, and social capacity. Such capacities are part and parcel of the National Absorptive Capacity Systems (NACS). The dataset (MSK dataset) thus produced contains data on 47 variables for 82 LMICs between 2005 and 2019. The dataset has passed a quality and reliability check and can thus be used for comparative analyses of national absorptive capacities and development, transition, and convergence analyses among LMICs.


title: Laser-assisted charged Higgs pair production in Inert Higgs Doublet Model (IHDM)

abstract: The production of a pair of charged Higgs bosons from $e^{+}e^{-}$ annihilation in the presence of a circularly polarized laser field is investigated in Inert Higgs doublet Model (IHDM) at ${e}^{+}{e}^{-}$ colliders. We have derived the analytical expression for the laser-assisted differential cross section by using the Dirac-Volkov formalism at leading order including the $Z$ and $\gamma$ diagrams. Since the laser-free cross section of this process depends, in the lowest order, only on the mass of the charged Higgs boson and the energy of the center of mass, we have analyzed the dependence of the total laser-assisted cross section on these parameters and also on the laser parameters such as the number of photons exchanged, the laser field intensity and its frequency. The results found indicate that the electromagnetic field decreases the order of magnitude of the total cross section as much as the laser field intensity increases or by decreasing its frequency. Moreover, it becomes high for low charged Higgs masses and low center of mass energies.


title: Report From The Trenches: A Case Study In Modernizing Software Development Practices

abstract: One factor of success in software development companies is their ability to deliver good quality products, fast. For this, they need to improve their software development practices. We work with a medium-sized company modernizing its development practices. The company introduced several practices recommended in agile development. If the benefits of these practices are well documented, the impact of such changes on the developers is less well known. We follow this modernization before and during the COVID-19 outbreak. This paper presents an empirical study of the perceived benefit and drawback of these practices as well as the impact of COVID-19 on the company's employees. One of the conclusions, is the additional difficulties created by obsolete technologies to adapt the technology itself and the development practices it encourages to modern standards.


title: SDG Target Interactions: The Philippine Analysis of Indivisible and Cancelling Targets

abstract: The United Nations developed the 17 Sustainable Development Goals (SDGs), with 169 targets, to serve as a plan for solving the world's problems and achieving a more sustainable future. This is modeled as a graph with the targets as nodes, and with the interaction between targets as the edges of the graph. An exhaustive binary comparison is done to analyze the intra- and inter-goal target interactions, entailing over 14000 comparisons. The task is to assign a 'color' to an edge: positive (indivisible), zero (consistent) or negative (cancelling). This is done via a panel of experts who will evaluate the target interactions, through a web application that was developed for coloring the edges. This is an on-going study, and so far, of the 1256 edges colored, only 36 are cancelling (negative), or 2.86%; more than 97% are positive interactions. So far, the "most negative" interactions involve: "Climate Change"; "Life Below Water"; "Peace, Justice and Strong Institutions"; and "Decent Work and Economic Growth". Most useful for planning might be the 'graph of beautiful targets' feature, which shows target with non-negative interactions, and how they connect to each other. These are the targets that may be worked on simultaneously, and currently has more than 130 nodes. This study can help researchers analyze which targets enable or constrain each other, what mitigation can be done to avoid conflicts, and can be configured for sub-national or regional study. Web app at: http://sdg-interactions.herokuapp.com/


title: Randomized-gauge test for machine learning of Ising model order parameter

abstract: Recently, machine learning has been applied successfully for identifying phases and phase transitions of the Ising models. The continuous phase transition is characterized by spontaneous symmetry breaking, which can not be detected in general from a single spin configuration. To investigate if neural networks can extract correlations among spin snapshots, we propose a new test using the random-gauge Ising model. We show that neural networks can extract the order parameter or the energy of the random-gauge model as in the ferromagnetic case. We also discuss how and where the information of random gauge is encoded in neural networks and attempt to reconstruct the gauge from the neural network parameters. We find that the fully connected network encodes the effect of random gauge to its weights naturally. In contrast, the convolutional network copes with the randomness by assigning different network parts to local gauge patterns. This observation indicates that although the latter demonstrates higher performance than the former for the present randomized-gauge test, the former is more effective and suitable for dealing with models with spatial randomness.


title: DSSL: Deep Surroundings-person Separation Learning for Text-based Person Retrieval

abstract: Many previous methods on text-based person retrieval tasks are devoted to learning a latent common space mapping, with the purpose of extracting modality-invariant features from both visual and textual modality. Nevertheless, due to the complexity of high-dimensional data, the unconstrained mapping paradigms are not able to properly catch discriminative clues about the corresponding person while drop the misaligned information. Intuitively, the information contained in visual data can be divided into person information (PI) and surroundings information (SI), which are mutually exclusive from each other. To this end, we propose a novel Deep Surroundings-person Separation Learning (DSSL) model in this paper to effectively extract and match person information, and hence achieve a superior retrieval accuracy. A surroundings-person separation and fusion mechanism plays the key role to realize an accurate and effective surroundings-person separation under a mutually exclusion constraint. In order to adequately utilize multi-modal and multi-granular information for a higher retrieval accuracy, five diverse alignment paradigms are adopted. Extensive experiments are carried out to evaluate the proposed DSSL on CUHK-PEDES, which is currently the only accessible dataset for text-base person retrieval task. DSSL achieves the state-of-the-art performance on CUHK-PEDES. To properly evaluate our proposed DSSL in the real scenarios, a Real Scenarios Text-based Person Reidentification (RSTPReid) dataset is constructed to benefit future research on text-based person retrieval, which will be publicly available.


title: Adversarial Representation Learning With Closed-Form Solvers

abstract: Adversarial representation learning aims to learn data representations for a target task while removing unwanted sensitive information at the same time. Existing methods learn model parameters iteratively through stochastic gradient descent-ascent, which is often unstable and unreliable in practice. To overcome this challenge, we adopt closed-form solvers for the adversary and target task. We model them as kernel ridge regressors and analytically determine an upper-bound on the optimal dimensionality of representation. Our solution, dubbed OptNet-ARL, reduces to a stable one one-shot optimization problem that can be solved reliably and efficiently. OptNet-ARL can be easily generalized to the case of multiple target tasks and sensitive attributes. Numerical experiments, on both small and large scale datasets, show that, from an optimization perspective, OptNet-ARL is stable and exhibits three to five times faster convergence. Performance wise, when the target and sensitive attributes are dependent, OptNet-ARL learns representations that offer a better trade-off front between (a) utility and bias for fair classification and (b) utility and privacy by mitigating leakage of private information than existing solutions.


title: Link Scheduling using Graph Neural Networks

abstract: Efficient scheduling of transmissions is a key problem in wireless networks. The main challenge stems from the fact that optimal link scheduling involves solving a maximum weighted independent set (MWIS) problem, which is known to be NP-hard. In practical schedulers, centralized and distributed greedy heuristics are commonly used to approximately solve the MWIS problem. However, most of these greedy heuristics ignore important topological information of the wireless network. To overcome this limitation, we propose fast heuristics based on graph convolutional networks (GCNs) that can be implemented in centralized and distributed manners. Our centralized heuristic is based on tree search guided by a GCN and 1-step rollout. In our distributed MWIS solver, a GCN generates topology-aware node embeddings that are combined with per-link utilities before invoking a distributed greedy solver. Moreover, a novel reinforcement learning scheme is developed to train the GCN in a non-differentiable pipeline. Test results on medium-sized wireless networks show that our centralized heuristic can reach a near-optimal solution quickly, and our distributed heuristic based on a shallow GCN can reduce by nearly half the suboptimality gap of the distributed greedy solver with minimal increase in complexity. The proposed schedulers also exhibit good generalizability across graph and weight distributions.


title: Fast scrambling dynamics and many-body localization transition in an all-to-all disordered quantum spin model

abstract: We study the quantum thermalization and information scrambling dynamics of an experimentally realizable quantum spin model with homogeneous XX-type all-to-all interactions and random local potentials. We identify the thermalization-localization transition by changing the disorder strength, under a proper all-to-all interaction strength. The scrambling dynamics in the localization phase shows novel behaviors distinct from that of local models. The operator scrambling grows almost equally fast in both phases. In the thermal phase, we show there exhibits fast scrambling without appealing to the semi-classical limit. We also briefly discuss the experimental realization of the model using superconducting qubit quantum simulators.


title: Accelerated ground-state cooling of an optomechanical resonator via shortcuts to adiabaticity

abstract: Ground-state cooling of mechanical resonators is an important task in quantum optomechanics, because it is a necessary prerequisite for creation, manipulation, and application of macroscopic mechanical coherence. Here, we propose a transient-state scheme to accelerate ground-state cooling of a mechanical resonator in a three-mode loop-coupled optomechanical system via shortcuts to adiabaticity (STA). We consider four kinds of coupling protocols and calculate the evolution of the mean phonon number of the mechanical resonator in both the adiabatic and STA cases. We verify that the ground-state cooling of the mechanical resonator can be achieved with the STA method in a much shorter period. The STA method can also be generalized to accelerate other adiabatic processes in cavity optomechanics, and hence this work will open up a new realm of fast optomechanical manipulations.


title: BioLCNet: Reward-modulated Locally Connected Spiking Neural Networks

abstract: Brain-inspired computation and information processing alongside compatibility with neuromorphic hardware have made spiking neural networks (SNN) a promising method for solving learning tasks in machine learning (ML). Spiking neurons are only one of the requirements for building a bio-plausible learning model. Network architecture and learning rules are other important factors to consider when developing such artificial agents. In this work, inspired by the human visual pathway and the role of dopamine in learning, we propose a reward-modulated locally connected spiking neural network, BioLCNet, for visual learning tasks. To extract visual features from Poisson-distributed spike trains, we used local filters that are more analogous to the biological visual system compared to convolutional filters with weight sharing. In the decoding layer, we applied a spike population-based voting scheme to determine the decision of the network. We employed Spike-timing-dependent plasticity (STDP) for learning the visual features, and its reward-modulated variant (R-STDP) for training the decoder based on the reward or punishment feedback signal. For evaluation, we first assessed the robustness of our rewarding mechanism to varying target responses in a classical conditioning experiment. Afterwards, we evaluated the performance of our network on image classification tasks of MNIST and XOR MNIST datasets.


title: Encoding Distributional Soft Actor-Critic for Autonomous Driving in Multi-lane Scenarios

abstract: In this paper, we propose a new reinforcement learning (RL) algorithm, called encoding distributional soft actor-critic (E-DSAC), for decision-making in autonomous driving. Unlike existing RL-based decision-making methods, E-DSAC is suitable for situations where the number of surrounding vehicles is variable and eliminates the requirement for manually pre-designed sorting rules, resulting in higher policy performance and generality. We first develop an encoding distributional policy iteration (DPI) framework by embedding a permutation invariant module, which employs a feature neural network (NN) to encode the indicators of each vehicle, in the distributional RL framework. The proposed DPI framework is proved to exhibit important properties in terms of convergence and global optimality. Next, based on the developed encoding DPI framework, we propose the E-DSAC algorithm by adding the gradient-based update rule of the feature NN to the policy evaluation process of the DSAC algorithm. Then, the multi-lane driving task and the corresponding reward function are designed to verify the effectiveness of the proposed algorithm. Results show that the policy learned by E-DSAC can realize efficient, smooth, and relatively safe autonomous driving in the designed scenario. And the final policy performance learned by E-DSAC is about three times that of DSAC. Furthermore, its effectiveness has also been verified in real vehicle experiments.


title: Multiscale Analysis of Count Data through Topic Alignment

abstract: Topic modeling is a popular method used to describe biological count data. With topic models, the user must specify the number of topics $K$. Since there is no definitive way to choose $K$ and since a true value might not exist, we develop techniques to study the relationships across models with different $K$. This can show how many topics are consistently present across different models, if a topic is only transiently present, or if a topic splits in two when $K$ increases. This strategy gives more insight into the process generating the data than choosing a single value of $K$ would. We design a visual representation of these cross-model relationships, which we call a topic alignment, and present three diagnostics based on it. We show the effectiveness of these tools for interpreting the topics on simulated and real data, and we release an accompanying R package, alto, available at https://lasy.github.io/alto.


title: Unsupervised Domain Adaptive Learning via Synthetic Data for Person Re-identification

abstract: Person re-identification (re-ID) has gained more and more attention due to its widespread applications in intelligent video surveillance. Unfortunately, the mainstream deep learning methods still need a large quantity of labeled data to train models, and annotating data is an expensive work in real-world scenarios. In addition, due to domain gaps between different datasets, the performance is dramatically decreased when re-ID models pre-trained on label-rich datasets (source domain) are directly applied to other unlabeled datasets (target domain). In this paper, we attempt to remedy these problems from two aspects, namely data and methodology. Firstly, we develop a data collector to automatically generate synthetic re-ID samples in a computer game, and construct a data labeler to simultaneously annotate them, which free humans from heavy data collections and annotations. Based on them, we build two synthetic person re-ID datasets with different scales, "GSPR" and "mini-GSPR" datasets. Secondly, we propose a synthesis-based multi-domain collaborative refinement (SMCR) network, which contains a synthetic pretraining module and two collaborative-refinement modules to implement sufficient learning for the valuable knowledge from multiple domains. Extensive experiments show that our proposed framework obtains significant performance improvements over the state-of-the-art methods on multiple unsupervised domain adaptation tasks of person re-ID.


title: On the optimization of the first weighted eigenvalue

abstract: For $N\geq 2$, a bounded smooth domain $\Omega$ in $\mathbb{R}^N$, and $g_0, V_0 \in L^1_{loc}(\Omega)$, we study the optimization of the first eigenvalue for the following weighted eigenvalue problem: \begin{align*} -\Delta_p \phi + V |\phi|^{p-2}\phi = \lambda g |\phi|^{p-2}\phi \text{ in } \Omega, \quad \phi=0 \text{ on } \partial \Omega, \end{align*} where $g$ and $V$ vary over the rearrangement classes of $g_0$ and $V_0$, respectively. We prove the existence of a minimizing pair $(\underline{g},\underline{V})$ and a maximizing pair $(\overline{g},\overline{V})$ for $g_0$ and $V_0$ lying in certain Lebesgue spaces. We obtain various qualitative properties such as polarization invariance, Steiner symmetry of the minimizers as well as the associated eigenfunctions for the case $p=2$. For annular domains, we prove that the minimizers and the corresponding eigenfunctions possess the foliated Schwarz symmetry.


title: Non-positively curved Ricci surfaces with catenoidal ends

abstract: A Ricci surface is defined as a Riemannian surface $(M,g_M)$ whose Gauss curvature satisfies the differential equation $K\Delta K + g_M(dK,dK) + 4K^3=0$. Andrei Moroianu and Sergiu Moroianu proved that a Ricci surface with non-positive Gauss curvature admits locally a minimal immersion into $\mathbb{R}^3$. In this paper, we are interested in studying non-compact orientable Ricci surfaces with catenoidal ends. We use an analogue of the Weierstrass data to obtain some classification results for such Ricci surfaces. We also give an existence result for positive genus Ricci surfaces with catenoidal ends.


title: An interdisciplinary approach to high school curriculum development: Swarming Powered by Neuroscience

abstract: This article discusses how to create an interactive virtual training program at the intersection of neuroscience, robotics, and computer science for high school students. A four-day microseminar, titled Swarming Powered by Neuroscience (SPN), was conducted virtually through a combination of presentations and interactive computer game simulations, delivered by subject matter experts in neuroscience, mathematics, multi-agent swarm robotics, and education. The objective of this research was to determine if taking an interdisciplinary approach to high school education would enhance the students learning experiences in fields such as neuroscience, robotics, or computer science. This study found an improvement in student engagement for neuroscience by 16.6%, while interest in robotics and computer science improved respectively by 2.7% and 1.8%. The curriculum materials, developed for the SPN microseminar, can be used by high school teachers to further evaluate interdisciplinary instructions across life and physical sciences and computer science.


title: Improved Algorithms for Misspecified Linear Markov Decision Processes

abstract: For the misspecified linear Markov decision process (MLMDP) model of Jin et al. [2020], we propose an algorithm with three desirable properties. (P1) Its regret after $K$ episodes scales as $K \max \{ \varepsilon_{\text{mis}}, \varepsilon_{\text{tol}} \}$, where $\varepsilon_{\text{mis}}$ is the degree of misspecification and $\varepsilon_{\text{tol}}$ is a user-specified error tolerance. (P2) Its space and per-episode time complexities remain bounded as $K \rightarrow \infty$. (P3) It does not require $\varepsilon_{\text{mis}}$ as input. To our knowledge, this is the first algorithm satisfying all three properties. For concrete choices of $\varepsilon_{\text{tol}}$, we also improve existing regret bounds (up to log factors) while achieving either (P2) or (P3) (existing algorithms satisfy neither). At a high level, our algorithm generalizes (to MLMDPs) and refines the Sup-Lin-UCB algorithm, which Takemura et al. [2021] recently showed satisfies (P3) for contextual bandits. We also provide an intuitive interpretation of their result, which informs the design of our algorithm.


title: Towards a variational Jordan-Lee-Preskill quantum algorithm

abstract: Rapid developments of quantum information technology show promising opportunities for simulating quantum field theory in near-term quantum devices. In this work, we formulate the theory of (time-dependent) variational quantum simulation of the 1+1 dimensional $\lambda \phi^4$ quantum field theory including encoding, state preparation, and time evolution, with several numerical simulation results. These algorithms could be understood as near-term variational quantum circuit (quantum neural network) analogs of the Jordan-Lee-Preskill algorithm, the basic algorithm for simulating quantum field theory using universal quantum devices. Besides, we highlight the advantages of encoding with harmonic oscillator basis based on the LSZ reduction formula and several computational efficiency such as when implementing a bosonic version of the unitary coupled cluster ansatz to prepare initial states. We also discuss how to circumvent the "spectral crowding" problem in the quantum field theory simulation and appraise our algorithm by both state and subspace fidelities.


title: Level and Gorenstein Projective Dimension

abstract: We investigate the relationship between the level of a bounded complex over a commutative ring with respect to the class of Gorenstein projective modules and other invariants of the complex or ring, such as projective dimension, Gorenstein projective dimension, and Krull dimension. The results build upon work done by J. Christensen [6], H. Altmann et al. [1], and Avramov et al. [3] for levels with respect to the class of finitely generated projective modules.


title: Federated Ensemble Model-based Reinforcement Learning in Edge Computing

abstract: Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the supervised learning models, federated reinforcement learning (FRL) was proposed to handle sequential decision-making problems in edge computing systems. However, the existing FRL algorithms directly combine model-free RL with FL, thus often leading to high sample complexity and lacking theoretical guarantees. To address the challenges, we propose a novel FRL algorithm that effectively incorporates model-based RL and ensemble knowledge distillation into FL for the first time. Specifically, we utilise FL and knowledge distillation to create an ensemble of dynamics models for clients, and then train the policy by solely using the ensemble model without interacting with the environment. Furthermore, we theoretically prove that the monotonic improvement of the proposed algorithm is guaranteed. The extensive experimental results demonstrate that our algorithm obtains much higher sample efficiency compared to classic model-free FRL algorithms in the challenging continuous control benchmark environments under edge computing settings. The results also highlight the significant impact of heterogeneous client data and local model update steps on the performance of FRL, validating the insights obtained from our theoretical analysis.


title: Meson-Baryon Couplings Revisited

abstract: The theoretical evaluation of the coupling constants gpiNN , gKNLambda and gKNSigma is undertaken using QCD sum rules. These quantities were previously calculated with exponential (Borel) kernels used to suppress the unknown contributions of the hadronic continua. This method however introduces arbitrariness and instability in the calculation. In order to avoid these I redo the calculation using polynomial kernels tailored to vanish at the baryonic resonance masses. The results are gpiNN = 12.5 +- 1.0, gKNSigma = 5.45 +- .4, gKNSigma= -(12.7 - 15.0) which are close to experiment and to the predictions of SU(3) and which , with the corresponding Goldberger-Treiman Discrepancy satisfy quite well the Dashen-Weinstein relation.