title: Multi-scale Attentive Image De-raining Networks via Neural Architecture Search

abstract: Multi-scale architectures and attention modules have shown effectiveness in many deep learning-based image de-raining methods. However, manually designing and integrating these two components into a neural network requires a bulk of labor and extensive expertise. In this article, a high-performance multi-scale attentive neural architecture search (MANAS) framework is technically developed for image deraining. The proposed method formulates a new multi-scale attention search space with multiple flexible modules that are favorite to the image de-raining task. Under the search space, multi-scale attentive cells are built, which are further used to construct a powerful image de-raining network. The internal multiscale attentive architecture of the de-raining network is searched automatically through a gradient-based search algorithm, which avoids the daunting procedure of the manual design to some extent. Moreover, in order to obtain a robust image de-raining model, a practical and effective multi-to-one training strategy is also presented to allow the de-raining network to get sufficient background information from multiple rainy images with the same background scene, and meanwhile, multiple loss functions including external loss, internal loss, architecture regularization loss, and model complexity loss are jointly optimized to achieve robust de-raining performance and controllable model complexity. Extensive experimental results on both synthetic and realistic rainy images, as well as the down-stream vision applications (i.e., objection detection and segmentation) consistently demonstrate the superiority of our proposed method. The code is publicly available at https://github.com/lcai-gz/MANAS.


title: The Parallelism Tradeoff: Limitations of Log-Precision Transformers

abstract: Despite their omnipresence in modern NLP, characterizing the computational power of transformer neural nets remains an interesting open question. We prove that transformers whose arithmetic precision is logarithmic in the number of input tokens (and whose feedforward nets are computable using space linear in their input) can be simulated by constant-depth logspace-uniform threshold circuits. This provides insight on the power of transformers using known results in complexity theory. For example, if $\mathsf L \neq \mathsf P$ (i.e., not all poly-time problems can be solved using logarithmic space), then transformers cannot even accurately solve linear equalities or check membership in an arbitrary context-free grammar with empty productions. Our result intuitively emerges from the transformer architecture's high parallelizability. We thus speculatively introduce the idea of a fundamental parallelism tradeoff: any model architecture as parallelizable as the transformer will obey limitations similar to it. Since parallelism is key to training models at massive scale, this suggests a potential inherent weakness of the scaling paradigm.


title: Integral closures of powers of sums of ideals

abstract: Let $k$ be a field, let $A$ and $B$ be polynomial rings over $k$, and let $S= A \otimes_k B$. Let $I \subseteq A$ and $J \subseteq B$ be monomial ideals. We establish a binomial expansion for rational powers of $I+J \subseteq S$ in terms of those of $I$ and $J$. Particularly, for a positive rational number $u$, we prove that $(I+J)_u = \sum_{0 \le \omega \le u, \ \omega \in \mathbb{Q}} I_\omega J_{u-\omega},$ and that the sum on the right hand side is a finite sum. This finite sum can be made more precise using jumping numbers of rational powers of $I$ and $J$. We further give sufficient conditions for this formula to hold for the integral closures of powers of $I+J$ in terms of those of $I$ and $J$. Under these conditions, we provide explicit formulas for the depth and regularity of $\overline{(I+J)^k}$ in terms of those of powers of $I$ and $J$.


title: Gas permeation through graphdiyne-based nanoporous membranes

abstract: Nanoporous membranes based on two dimensional materials are predicted to provide highly selective gas transport in combination with extreme permeability. Here we investigate membranes made from multilayer graphdiyne, a graphene-like crystal with a larger unit cell. Despite being nearly a hundred of nanometers thick, the membranes allow fast, Knudsen-type permeation of light gases such as helium and hydrogen whereas heavy noble gases like xenon exhibit strongly suppressed flows. Using isotope and cryogenic temperature measurements, the seemingly conflicting characteristics are explained by a high density of straight-through holes (direct porosity of ~0.1%), in which heavy atoms are adsorbed on the walls, partially blocking Knudsen flows. Our work offers important insights into intricate transport mechanisms playing a role at nanoscale.


title: SketchCleanNet -- A deep learning approach to the enhancement and correction of query sketches for a 3D CAD model retrieval system

abstract: Search and retrieval remains a major research topic in several domains, including computer graphics, computer vision, engineering design, etc. A search engine requires primarily an input search query and a database of items to search from. In engineering, which is the primary context of this paper, the database consists of 3D CAD models, such as washers, pistons, connecting rods, etc. A query from a user is typically in the form of a sketch, which attempts to capture the details of a 3D model. However, sketches have certain typical defects such as gaps, over-drawn portions (multi-strokes), etc. Since the retrieved results are only as good as the input query, sketches need cleaning-up and enhancement for better retrieval results. In this paper, a deep learning approach is proposed to improve or clean the query sketches. Initially, sketches from various categories are analysed in order to understand the many possible defects that may occur. A dataset of cleaned-up or enhanced query sketches is then created based on an understanding of these defects. Consequently, an end-to-end training of a deep neural network is carried out in order to provide a mapping between the defective and the clean sketches. This network takes the defective query sketch as the input and generates a clean or an enhanced query sketch. Qualitative and quantitative comparisons of the proposed approach with other state-of-the-art techniques show that the proposed approach is effective. The results of the search engine are reported using both the defective and enhanced query sketches, and it is shown that using the enhanced query sketches from the developed approach yields improved search results.


title: Contrastive Cross-Modal Knowledge Sharing Pre-training for Vision-Language Representation Learning and Retrieval

abstract: Recently, the cross-modal pre-training task has been a hotspot because of its wide application in various down-streaming researches including retrieval, captioning, question answering and so on. However, exiting methods adopt a one-stream pre-training model to explore the united vision-language representation for conducting cross-modal retrieval, which easily suffer from the calculation explosion. Moreover, although the conventional double-stream structures are quite efficient, they still lack the vital cross-modal interactions, resulting in low performances. Motivated by these challenges, we put forward a Contrastive Cross-Modal Knowledge Sharing Pre-training (COOKIE) to grasp the joint text-image representations. Structurally, COOKIE adopts the traditional double-stream structure because of the acceptable time consumption. To overcome the inherent defects of double-stream structure as mentioned above, we elaborately design two effective modules. Concretely, the first module is a weight-sharing transformer that builds on the head of the visual and textual encoders, aiming to semantically align text and image. This design enables visual and textual paths focus on the same semantics. The other one is three specially designed contrastive learning, aiming to share knowledge between different models. The shared cross-modal knowledge develops the study of unimodal representation greatly, promoting the single-modal retrieval tasks. Extensive experimental results on multi-modal matching researches that includes cross-modal retrieval, text matching, and image retrieval reveal the superiors in calculation efficiency and statistical indicators of our pre-training model.


title: Observations of the luminous red nova AT 2021biy in the nearby galaxy NGC 4631

abstract: We present an observational study of the luminous red nova (LRN) AT\,2021biy in the nearby galaxy NGC\,4631. The field of the object was routinely imaged during the pre-eruptive stage by synoptic surveys, but the transient was detected only at a few epochs from $\sim 231$\,days before maximum brightness. The LRN outburst was monitored with unprecedented cadence both photometrically and spectroscopically. AT\,2021biy shows a short-duration blue peak, with a bolometric luminosity of $\sim 1.6 \times 10^{41}$\,erg\,s$^{-1}$, followed by the longest plateau among LRNe to date, with a duration of 210\,days. A late-time hump in the light curve was also observed, possibly produced by a shell-shell collision. AT\,2021biy exhibits the typical spectral evolution of LRNe. Early-time spectra are characterised by a blue continuum and prominent H emission lines. Then, the continuum becomes redder, resembling that of a K-type star with a forest of metal absorption lines during the plateau phase. Finally, late-time spectra show a very red continuum ($T_{\mathrm{BB}} \approx 2050$ K) with molecular features (e.g., TiO) resembling those of M-type stars. Spectropolarimetric analysis indicates that AT\,2021biy has local dust properties similar to those of V838\,Mon in the Milky Way Galaxy. Inspection of archival {\it Hubble Space Telescope} data taken on 2003 August 3 reveals a $\sim 20$\,\msun\ progenitor candidate with log\,$(L/{\rm L}_{\odot}) = 5.0$\,dex and $T_{\rm{eff}} = 5900$\,K at solar metallicity. The above luminosity and colour match those of a luminous yellow supergiant. Most likely, this source is a close binary, with a 17--24\,\msun\ primary component.


title: Can Language Models Make Fun? A Case Study in Chinese Comical Crosstalk

abstract: Language is the principal tool for human communication, in which humor is one of the most attractive parts. Producing natural language like humans using computers, a.k.a, Natural Language Generation (NLG), has been widely used for dialogue systems, chatbots, machine translation, as well as computer-aid creation e.g., idea generations, scriptwriting. However, the humor aspect of natural language is relatively under-investigated, especially in the age of pre-trained language models. In this work, we aim to preliminarily test whether NLG can generate humor as humans do. We build a new dataset consisting of numerous digitized Chinese Comical Crosstalk scripts (called C$^3$ in short), which is for a popular Chinese performing art called `Xiangsheng' since 1800s. (For convenience for non-Chinese speakers, we called `crosstalk' for `Xiangsheng' in this paper.) We benchmark various generation approaches including training-from-scratch Seq2seq, fine-tuned middle-scale PLMs, and large-scale PLMs (with and without fine-tuning). Moreover, we also conduct a human assessment, showing that 1) large-scale pretraining largely improves crosstalk generation quality; and 2) even the scripts generated from the best PLM is far from what we expect, with only 65% quality of human-created crosstalk. We conclude, humor generation could be largely improved using large-scaled PLMs, but it is still in its infancy. The data and benchmarking code is publicly available in \url{https://github.com/anonNo2/crosstalk-generation}.


title: Exponential Convergence of Sinkhorn Under Regularization Scheduling

abstract: In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we work on understanding the Sinkhorn algorithm under regularization scheduling, and thus modify it with a mechanism that adaptively doubles the regularization parameter $\eta$ periodically. We prove that such modified version of Sinkhorn has an exponential convergence rate as iteration complexity depending on $\log(1/\varepsilon)$ instead of $\varepsilon^{-O(1)}$ from previous analyses [Cut13][ANWR17] in the optimal transport problems with integral supply and demand. Furthermore, with cost and capacity scaling procedures, the general optimal transport problem can be solved with a logarithmic dependence on $1/\varepsilon$ as well.


title: Brief Industry Paper: The Necessity of Adaptive Data Fusion in Infrastructure-Augmented Autonomous Driving System

abstract: This paper is the first to provide a thorough system design overview along with the fusion methods selection criteria of a real-world cooperative autonomous driving system, named Infrastructure-Augmented Autonomous Driving or IAAD. We present an in-depth introduction of the IAAD hardware and software on both road-side and vehicle-side computing and communication platforms. We extensively characterize the IAAD system in the context of real-world deployment scenarios and observe that the network condition that fluctuates along the road is currently the main technical roadblock for cooperative autonomous driving. To address this challenge, we propose new fusion methods, dubbed "inter-frame fusion" and "planning fusion" to complement the current state-of-the-art "intra-frame fusion". We demonstrate that each fusion method has its own benefit and constraint.


title: Golfer: Trajectory Prediction with Masked Goal Conditioning MnM Network

abstract: Transformers have enabled breakthroughs in NLP and computer vision, and have recently began to show promising performance in trajectory prediction for Autonomous Vehicle (AV). How to efficiently model the interactive relationships between the ego agent and other road and dynamic objects remains challenging for the standard attention module. In this work we propose a general Transformer-like architectural module MnM network equipped with novel masked goal conditioning training procedures for AV trajectory prediction. The resulted model, named golfer, achieves state-of-the-art performance, winning the 2nd place in the 2022 Waymo Open Dataset Motion Prediction Challenge and ranked 1st place according to minADE.


title: Deep Learning for Systemic Risk Measures

abstract: The aim of this paper is to study a new methodological framework for systemic risk measures by applying deep learning method as a tool to compute the optimal strategy of capital allocations. Under this new framework, systemic risk measures can be interpreted as the minimal amount of cash that secures the aggregated system by allocating capital to the single institutions before aggregating the individual risks. This problem has no explicit solution except in very limited situations. Deep learning is increasingly receiving attention in financial modelings and risk management and we propose our deep learning based algorithms to solve both the primal and dual problems of the risk measures, and thus to learn the fair risk allocations. In particular, our method for the dual problem involves the training philosophy inspired by the well-known Generative Adversarial Networks (GAN) approach and a newly designed direct estimation of Radon-Nikodym derivative. We close the paper with substantial numerical studies of the subject and provide interpretations of the risk allocations associated to the systemic risk measures. In the particular case of exponential preferences, numerical experiments demonstrate excellent performance of the proposed algorithm, when compared with the optimal explicit solution as a benchmark.


title: PhilaeX: Explaining the Failure and Success of AI Models in Malware Detection

abstract: The explanation to an AI model's prediction used to support decision making in cyber security, is of critical importance. It is especially so when the model's incorrect prediction can lead to severe damages or even losses to lives and critical assets. However, most existing AI models lack the ability to provide explanations on their prediction results, despite their strong performance in most scenarios. In this work, we propose a novel explainable AI method, called PhilaeX, that provides the heuristic means to identify the optimized subset of features to form the complete explanations of AI models' predictions. It identifies the features that lead to the model's borderline prediction, and those with positive individual contributions are extracted. The feature attributions are then quantified through the optimization of a Ridge regression model. We verify the explanation fidelity through two experiments. First, we assess our method's capability in correctly identifying the activated features in the adversarial samples of Android malwares, through the features attribution values from PhilaeX. Second, the deduction and augmentation tests, are used to assess the fidelity of the explanations. The results show that PhilaeX is able to explain different types of classifiers correctly, with higher fidelity explanations, compared to the state-of-the-arts methods such as LIME and SHAP.


title: A Distributionally Robust Resilience Enhancement Strategy for Distribution Networks Considering Decision-Dependent Contingencies

abstract: When performing the resilience enhancement for distribution networks, there are two obstacles to reliably model the uncertain contingencies: 1) decision-dependent uncertainty (DDU) due to various line hardening decisions, and 2) distributional ambiguity due to limited outage information during extreme weather events (EWEs). To address these two challenges, this paper develops scenario-wise decision-dependent ambiguity sets (SWDD-ASs), where the DDU and distributional ambiguity inherent in EWE-induced contingencies are simultaneously captured for each possible EWE scenario. Then, a two-stage trilevel decision-dependent distributionally robust resilient enhancement (DD-DRRE) model is formulated, whose outputs include the optimal line hardening, distributed generation (DG) allocation, and proactive network reconfiguration strategy under the worst-case distributions in SWDD-ASs. Subsequently, the DD-DRRE model is equivalently recast to a mixed-integer linear programming (MILP)-based master problem and multiple scenario-wise subproblems, facilitating the adoption of a customized column-and-constraint generation (C&CG) algorithm. Finally, case studies demonstrate a remarkable improvement in the out-of-sample performance of our model, compared to its prevailing stochastic and robust counterparts. Moreover, the potential values of incorporating the ambiguity and distributional information are quantitatively estimated, providing a useful reference for planners with different budgets and risk-aversion levels.


title: Synthetic gauge field in two interacting ultracold atomic gases without an optical lattice

abstract: A 2D Fock-state lattice (FSL is constructed from the many-body states of two interacting two-mode quantum gases. By periodically driving the interspecies interactions and pulsing the tunneling between the two modes of each gas, a synthetic gauge field is generated. We derive an effective Hamiltonian in the short pulse limit which resembles the Harper-Hofstadter Hamiltonian where the magnetic flux per plaquette is controlled by the ratio of the interaction energy and the driving frequency. The quasispectrum of the Floquet operator of the driving sequence shows the celebrated Hofstadter's butterfly pattern as well as the existence of edge states. From the calculation of the local Chern marker, we establish that the FSL has non-trivial topology and by simulating the dynamics of the edge states, show that they exhibit chirality. Finally, the inclusion of the intraspecies interactions creates an overall harmonic trap in the lattice and introduces the nonlinear effect of macroscopic quantum self-trapping which is shown to hinder the movement along the edge of the lattice. This work introduces a new avenue to explore synthetic gauge fields and provides a link between non-trivial condensed matter systems and quantum gases.


title: Epsilon dichotomy for linear models: the Archimedean case

abstract: Let $G=\mathrm{GL}_{2n}(\mathbb{R})$ or $G=\mathrm{GL}_n(\mathbb{H})$ and $H=\mathrm{GL}_n(\mathbb{C})$ regarded as a subgroup of $G$. Here, $\mathbb{H}$ is the quaternion division algebra over $\mathbb{R}$. For a character $\chi$ on $\mathbb{C}^\times$, we say that an irreducible smooth admissible moderate growth representation $\pi$ of $G$ is $\chi_H$-distinguished if $\mathrm{Hom}_H(\pi, \chi\circ\det_H)\neq0$. We compute the root number of a $\chi_H$-distinguished representation $\pi$ twisted by the representation induced from $\chi$. This proves an Archimedean analogue of the conjecture by Prasad and Takloo-Bighash (J. Reine Angew. Math., 2011). The proof is based on the analysis of the contribution of $H$-orbits in a flag manifold of $G$ to the Schwartz homology of principal series representations. A large part of the argument is developed for general real reductive groups of inner type. In particular, we prove that the Schwartz homology $H_\ast(H, \pi\otimes\chi)$ is finite-dimensional and hence it is Hausdorff for a reductive symmetric pair $(G, H)$ and a finite-dimensional representation $\chi$ of $H$.


title: Gaussian Kernel-based Cross Modal Network for Spatio-Temporal Video Grounding

abstract: Spatial-Temporal Video Grounding (STVG) is a challenging task which aims to localize the spatio-temporal tube of the interested object semantically according to a natural language query. Most previous works not only severely rely on the anchor boxes extracted by Faster R-CNN, but also simply regard the video as a series of individual frames, thus lacking their temporal modeling. Instead, in this paper, we are the first to propose an anchor-free framework for STVG, called Gaussian Kernel-based Cross Modal Network (GKCMN). Specifically, we utilize the learned Gaussian Kernel-based heatmaps of each video frame to locate the query-related object. A mixed serial and parallel connection network is further developed to leverage both spatial and temporal relations among frames for better grounding. Experimental results on VidSTG dataset demonstrate the effectiveness of our proposed GKCMN.


title: Scheduling Planting Time Through Developing an Optimization Model and Analysis of Time Series Growing Degree Units

abstract: Producing higher-quality crops within shortened breeding cycles ensures global food availability and security, but this improvement intensifies logistical and productivity challenges for seed industries in the year-round breeding process due to the storage limitations. In the 2021 Syngenta crop challenge in analytics, Syngenta raised the problem to design an optimization model for the planting time scheduling in the 2020 year-round breeding process so that there is a consistent harvest quantity each week. They released a dataset that contained 2569 seed populations with their planting windows, required growing degree units for harvesting, and their harvest quantities at two sites. To address this challenge, we developed a new framework that consists of a weather time series model and an optimization model to schedule the planting time. A deep recurrent neural network was designed to predict the weather into the future, and a Gaussian process model on top of the time-series model was developed to model the uncertainty of forecasted weather. The proposed optimization models also scheduled the seed population's planting time at the fewest number of weeks with a more consistent weekly harvest quantity. Using the proposed optimization models can decrease the required capacity by 69% at site 0 and up to 51% at site 1 compared to the original planting time.


title: INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactions

abstract: In an information-seeking conversation, a user may ask questions that are under-specified or unanswerable. An ideal agent would interact by initiating different response types according to the available knowledge sources. However, most current studies either fail to or artificially incorporate such agent-side initiative. This work presents InSCIt, a dataset for Information-Seeking Conversations with mixed-initiative Interactions. It contains 4.7K user-agent turns from 805 human-human conversations where the agent searches over Wikipedia and either directly answers, asks for clarification, or provides relevant information to address user queries. The data supports two subtasks, evidence passage identification and response generation, as well as a human evaluation protocol to assess model performance. We report results of two systems based on state-of-the-art models of conversational knowledge identification and open-domain question answering. Both systems significantly underperform humans, suggesting ample room for improvement in future studies.


title: Rationale-Augmented Ensembles in Language Models

abstract: Recent research has shown that rationales, or step-by-step chains of thought, can be used to improve performance in multi-step reasoning tasks. We reconsider rationale-augmented prompting for few-shot in-context learning, where (input -> output) prompts are expanded to (input, rationale -> output) prompts. For rationale-augmented prompting we demonstrate how existing approaches, which rely on manual prompt engineering, are subject to sub-optimal rationales that may harm performance. To mitigate this brittleness, we propose a unified framework of rationale-augmented ensembles, where we identify rationale sampling in the output space as the key component to robustly improve performance. This framework is general and can easily be extended to common natural language processing tasks, even those that do not traditionally leverage intermediate steps, such as question answering, word sense disambiguation, and sentiment analysis. We demonstrate that rationale-augmented ensembles achieve more accurate and interpretable results than existing prompting approaches--including standard prompting without rationales and rationale-based chain-of-thought prompting--while simultaneously improving interpretability of model predictions through the associated rationales.


title: Sequence-aware multimodal page classification of Brazilian legal documents

abstract: The Brazilian Supreme Court receives tens of thousands of cases each semester. Court employees spend thousands of hours to execute the initial analysis and classification of those cases -- which takes effort away from posterior, more complex stages of the case management workflow. In this paper, we explore multimodal classification of documents from Brazil's Supreme Court. We train and evaluate our methods on a novel multimodal dataset of 6,510 lawsuits (339,478 pages) with manual annotation assigning each page to one of six classes. Each lawsuit is an ordered sequence of pages, which are stored both as an image and as a corresponding text extracted through optical character recognition. We first train two unimodal classifiers: a ResNet pre-trained on ImageNet is fine-tuned on the images, and a convolutional network with filters of multiple kernel sizes is trained from scratch on document texts. We use them as extractors of visual and textual features, which are then combined through our proposed Fusion Module. Our Fusion Module can handle missing textual or visual input by using learned embeddings for missing data. Moreover, we experiment with bi-directional Long Short-Term Memory (biLSTM) networks and linear-chain conditional random fields to model the sequential nature of the pages. The multimodal approaches outperform both textual and visual classifiers, especially when leveraging the sequential nature of the pages.


title: Efficient and Effective Local Search for the Set-Union Knapsack Problem and Budgeted Maximum Coverage Problem

abstract: The Set-Union Knapsack Problem (SUKP) and Budgeted Maximum Coverage Problem (BMCP) are two closely related variant problems of the popular knapsack problem. Given a set of weighted elements and a set of items with nonnegative values, where each item covers several distinct elements, these two problems both aim to find a subset of items that maximizes an objective function while satisfying a knapsack capacity (budget) constraint. We propose an efficient and effective local search algorithm called E2LS for these two problems. To our knowledge, this is the first time that an algorithm has been proposed for both of them. E2LS trade-offs the search region and search efficiency by applying a proposed novel operator ADD$^*$ to traverse the refined search region. Such a trade-off mechanism allows E2LS to explore the solution space widely and quickly. The tabu search method is also applied in E2LS to help the algorithm escape from local optima. Extensive experiments on a total of 168 public instances with various scales demonstrate the excellent performance of the proposed algorithm for both the SUKP and BMCP.


title: GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce

abstract: Our goal is to build general representation (embedding) for each user and each product item across Alibaba's businesses, including Taobao and Tmall which are among the world's biggest e-commerce websites. The representation of users and items has been playing a critical role in various downstream applications, including recommendation system, search, marketing, demand forecasting and so on. Inspired from the BERT model in natural language processing (NLP) domain, we propose a GUIM (General User Item embedding with Mixture of representation) model to achieve the goal with massive, structured, multi-modal data including the interactions among hundreds of millions of users and items. We utilize mixture of representation (MoR) as a novel representation form to model the diverse interests of each user. In addition, we use the InfoNCE from contrastive learning to avoid intractable computational costs due to the numerous size of item (token) vocabulary. Finally, we propose a set of representative downstream tasks to serve as a standard benchmark to evaluate the quality of the learned user and/or item embeddings, analogous to the GLUE benchmark in NLP domain. Our experimental results in these downstream tasks clearly show the comparative value of embeddings learned from our GUIM model.


title: Informed Learning by Wide Neural Networks: Convergence, Generalization and Sampling Complexity

abstract: By integrating domain knowledge with labeled samples, informed machine learning has been emerging to improve the learning performance for a wide range of applications. Nonetheless, rigorous understanding of the role of injected domain knowledge has been under-explored. In this paper, we consider an informed deep neural network (DNN) with over-parameterization and domain knowledge integrated into its training objective function, and study how and why domain knowledge benefits the performance. Concretely, we quantitatively demonstrate the two benefits of domain knowledge in informed learning - regularizing the label-based supervision and supplementing the labeled samples - and reveal the trade-off between label and knowledge imperfectness in the bound of the population risk. Based on the theoretical analysis, we propose a generalized informed training objective to better exploit the benefits of knowledge and balance the label and knowledge imperfectness, which is validated by the population risk bound. Our analysis on sampling complexity sheds lights on how to choose the hyper-parameters for informed learning, and further justifies the advantages of knowledge informed learning.


title: A two-step Lagrange-Galerkin scheme for the shallow water equations with a transmission boundary condition and its application to the Bay of Bengal region. Part I: Flat bottom topography

abstract: This study presents a two-step Lagrange-Galerkin scheme for the shallow water equations with a transmission boundary condition (TBC). Firstly, the experimental order of convergence of the scheme is shown to see the second-order accuracy in time. Secondly, the effect of the TBC on a simple domain is discussed; the artificial reflections are kept from the Dirichlet boundaries and removed significantly from the transmission boundaries. Thirdly, the scheme is applied to a complex practical domain, i.e., the Bay of Bengal region, which is non-convex and includes islands. The effect of the TBC is discussed again for the complex domain; the artificial reflections are removed significantly from transmission boundaries, which are set on open sea boundaries. Based on the numerical results, it is revealed that the scheme has the following properties; (i) the same advantages of Lagrange-Galerkin methods (the CFL-free robustness for convection-dominated problems and the symmetry of the matrices for the system of linear equations); (ii) second-order accuracy in time; (iii) mass preservation of the function for the water level from the reference height (until the contact with the transmission boundaries of the wave); and (iv) no significant artificial reflection from the transmission boundaries. The numerical results by the scheme are presented in this paper for the flat bottom topography of the domain. In the next part of this work, Part II, the scheme will be applied to rapidly varying bottom surfaces and a real bottom topography of the Bay of Bengal region.


title: An End-to-End Set Transformer for User-Level Classification of Depression and Gambling Disorder

abstract: This work proposes a transformer architecture for user-level classification of gambling addiction and depression that is trainable end-to-end. As opposed to other methods that operate at the post level, we process a set of social media posts from a particular individual, to make use of the interactions between posts and eliminate label noise at the post level. We exploit the fact that, by not injecting positional encodings, multi-head attention is permutation invariant and we process randomly sampled sets of texts from a user after being encoded with a modern pretrained sentence encoder (RoBERTa / MiniLM). Moreover, our architecture is interpretable with modern feature attribution methods and allows for automatic dataset creation by identifying discriminating posts in a user's text-set. We perform ablation studies on hyper-parameters and evaluate our method for the eRisk 2022 Lab on early detection of signs of pathological gambling and early risk detection of depression. The method proposed by our team BLUE obtained the best ERDE5 score of 0.015, and the second-best ERDE50 score of 0.009 for pathological gambling detection. For the early detection of depression, we obtained the second-best ERDE50 of 0.027.


title: Renormalization group improved $m_s$ and $\vert V_{us}\vert$ determination from hadronic $\tau$ decays

abstract: We determine the strange quark mass ($m_s$) and quark mixing element $\vert V_{us}\vert $, and their joint determination from the Cabibbo suppressed hadronic $\tau$ decays in various perturbative schemes. Compared to the previous analysis based on the optimal renormalization or the renormalization group summed perturbation theory (RGSPT) scheme, we have improved this analysis by replacing the theoretical longitudinal contributions with phenomenological parametrization, and the RGSPT coefficients are used for the dimension-4 Adler functions. The improved analysis results in the extraction of $m_s(2\,\mathrm{GeV})=98\pm19\,\mathrm{MeV}$ and $\vert V_{us}\vert=0.2191\pm0.0043$ from the RGSPT scheme.


title: Unsupervised Recurrent Federated Learning for Edge Popularity Prediction in Privacy-Preserving Mobile Edge Computing Networks

abstract: Nowadays wireless communication is rapidly reshaping entire industry sectors. In particular, mobile edge computing (MEC) as an enabling technology for industrial Internet of things (IIoT) brings powerful computing/storage infrastructure closer to the mobile terminals and, thereby, significant lowers the response latency. To reap the benefit of proactive caching at the network edge, precise knowledge on the popularity pattern among the end devices is essential. However, the complex and dynamic nature of the content popularity over space and time as well as the data-privacy requirements in many IIoT scenarios pose tough challenges to its acquisition. In this article, we propose an unsupervised and privacy-preserving popularity prediction framework for MEC-enabled IIoT. The concepts of local and global popularities are introduced and the time-varying popularity of each user is modelled as a model-free Markov chain. On this basis, a novel unsupervised recurrent federated learning (URFL) algorithm is proposed to predict the distributed popularity while achieve privacy preservation and unsupervised training. Simulations indicate that the proposed framework can enhance the prediction accuracy in terms of a reduced root-mean-squared error by up to $60.5\%-68.7\%$. Additionally, manual labeling and violation of users' data privacy are both avoided.


title: Learning Noise-independent Speech Representation for High-quality Voice Conversion for Noisy Target Speakers

abstract: Building a voice conversion system for noisy target speakers, such as users providing noisy samples or Internet found data, is a challenging task since the use of contaminated speech in model training will apparently degrade the conversion performance. In this paper, we leverage the advances of our recently proposed Glow-WaveGAN and propose a noise-independent speech representation learning approach for high-quality voice conversion for noisy target speakers. Specifically, we learn a latent feature space where we ensure that the target distribution modeled by the conversion model is exactly from the modeled distribution of the waveform generator. With this premise, we further manage to make the latent feature to be noise-invariant. Specifically, we introduce a noise-controllable WaveGAN, which directly learns the noise-independent acoustic representation from waveform by the encoder and conducts noise control in the hidden space through a FiLM module in the decoder. As for the conversion model, importantly, we use a flow-based model to learn the distribution of noise-independent but speaker-related latent features from phoneme posteriorgrams. Experimental results demonstrate that the proposed model achieves high speech quality and speaker similarity in the voice conversion for noisy target speakers.


title: PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes

abstract: Most indoor 3D scene reconstruction methods focus on recovering 3D geometry and scene layout. In this work, we go beyond this to propose PhotoScene, a framework that takes input image(s) of a scene along with approximately aligned CAD geometry (either reconstructed automatically or manually specified) and builds a photorealistic digital twin with high-quality materials and similar lighting. We model scene materials using procedural material graphs; such graphs represent photorealistic and resolution-independent materials. We optimize the parameters of these graphs and their texture scale and rotation, as well as the scene lighting to best match the input image via a differentiable rendering layer. We evaluate our technique on objects and layout reconstructions from ScanNet, SUN RGB-D and stock photographs, and demonstrate that our method reconstructs high-quality, fully relightable 3D scenes that can be re-rendered under arbitrary viewpoints, zooms and lighting.


title: MIA 2022 Shared Task: Evaluating Cross-lingual Open-Retrieval Question Answering for 16 Diverse Languages

abstract: We present the results of the Workshop on Multilingual Information Access (MIA) 2022 Shared Task, evaluating cross-lingual open-retrieval question answering (QA) systems in 16 typologically diverse languages. In this task, we adapted two large-scale cross-lingual open-retrieval QA datasets in 14 typologically diverse languages, and newly annotated open-retrieval QA data in 2 underrepresented languages: Tagalog and Tamil. Four teams submitted their systems. The best system leveraging iteratively mined diverse negative examples and larger pretrained models achieves 32.2 F1, outperforming our baseline by 4.5 points. The second best system uses entity-aware contextualized representations for document retrieval, and achieves significant improvements in Tamil (20.8 F1), whereas most of the other systems yield nearly zero scores.


title: Abstraction and Refinement: Towards Scalable and Exact Verification of Neural Networks

abstract: As a new programming paradigm, deep neural networks (DNNs) have been increasingly deployed in practice, but the lack of robustness hinders their applications in safety-critical domains. While there are techniques for verifying DNNs with formal guarantees, they are limited in scalability and accuracy. In this paper, we present a novel abstraction-refinement approach for scalable and exact DNN verification. Specifically, we propose a novel abstraction to break down the size of DNNs by over-approximation. The result of verifying the abstract DNN is always conclusive if no spurious counterexample is reported. To eliminate spurious counterexamples introduced by abstraction, we propose a novel counterexample-guided refinement that refines the abstract DNN to exclude a given spurious counterexample while still over-approximating the original one. Our approach is orthogonal to and can be integrated with many existing verification techniques. For demonstration, we implement our approach using two promising and exact tools Marabou and Planet as the underlying verification engines, and evaluate on widely-used benchmarks ACAS Xu, MNIST and CIFAR-10. The results show that our approach can boost their performance by solving more problems and reducing up to 86.3% and 78.0% verification time, respectively. Compared to the most relevant abstraction-refinement approach, our approach is 11.6-26.6 times faster.


title: Unsupervised Symbolic Music Segmentation using Ensemble Temporal Prediction Errors

abstract: Symbolic music segmentation is the process of dividing symbolic melodies into smaller meaningful groups, such as melodic phrases. We proposed an unsupervised method for segmenting symbolic music. The proposed model is based on an ensemble of temporal prediction error models. During training, each model predicts the next token to identify musical phrase changes. While at test time, we perform a peak detection algorithm to select segment candidates. Finally, we aggregate the predictions of each of the models participating in the ensemble to predict the final segmentation. Results suggest the proposed method reaches state-of-the-art performance on the Essen Folksong dataset under the unsupervised setting when considering F-Score and R-value. We additionally provide an ablation study to better assess the contribution of each of the model components to the final results. As expected, the proposed method is inferior to the supervised setting, which leaves room for improvement in future research considering closing the gap between unsupervised and supervised methods.


title: Face Image Lighting Enhancement Using a 3D Model

abstract: Image enhancement helps to generate balanced lighting distributions over faces. Our goal is to get an illuminance-balanced enhanced face image from a single view. Traditionally, image enhancement methods ignore the 3D geometry of the face or require a complicated multi-view geometry. Other methods cause color tone shifting or over saturation. Inspired by the new research achievements in face alignment and face 3D modeling, we propose an improved face image enhancement method by leveraging 3D face models. Given a face image as input, our method will first estimate its lighting distribution. Then we build an optimization process to refine the distribution. Finally, we generate an illuminance-balanced face image from a single view. Experiments on the FiveK dataset demonstrate that our method performs well and compares favorably with other methods.


title: Backdoor Attack is a Devil in Federated GAN-based Medical Image Synthesis

abstract: Deep Learning-based image synthesis techniques have been applied in healthcare research for generating medical images to support open research. Training generative adversarial neural networks (GAN) usually requires large amounts of training data. Federated learning (FL) provides a way of training a central model using distributed data from different medical institutions while keeping raw data locally. However, FL is vulnerable to backdoor attack, an adversarial by poisoning training data, given the central server cannot access the original data directly. Most backdoor attack strategies focus on classification models and centralized domains. In this study, we propose a way of attacking federated GAN (FedGAN) by treating the discriminator with a commonly used data poisoning strategy in backdoor attack classification models. We demonstrate that adding a small trigger with size less than 0.5 percent of the original image size can corrupt the FL-GAN model. Based on the proposed attack, we provide two effective defense strategies: global malicious detection and local training regularization. We show that combining the two defense strategies yields a robust medical image generation.


title: Hierarchical Dynamic Routing in Complex Networks via Topologically-decoupled and Cooperative Reinforcement Learning Agents

abstract: The transport capacity of a communication network can be characterized by the transition from a free-flow state to a congested state. Here, we propose a dynamic routing strategy in complex networks based on hierarchical bypass selections. The routing decisions are made by the reinforcement learning agents implemented at selected nodes with high betweenness centrality. The learning processes of the agents are decoupled from each other due to the degeneracy of their bypasses. Through interactions mediated by the underlying traffic dynamics, the agents act cooperatively, and coherent actions arise spontaneously. With only a small number of agents, the transport capacities are significantly improved, including in real-world Internet networks at the router level and the autonomous system level. Our strategy is also resilient to link removals.


title: Multilinear rough singular integral operators

abstract: We study $m$-linear homogeneous rough singular integral operators $\mathcal{L}_{\Omega}$ associated with integrable functions $\Omega$ on $\mathbb{S}^{mn-1}$ with mean value zero. We prove boundedness for $\mathcal{L}_{\Omega}$ from $L^{p_1}\times \cdots \times L^{p_m}$ to $L^p$ when $1<p_1,\dots, p_m<\infty$ and $1/p=1/p_1+\cdots +1/p_m$ in the largest possible open set of exponents when $\Omega \in L^q(\mathbb S^{mn-1})$ and $q\ge 2$. This set can be described by a convex polyhedron in $\mathbb R^m$.


title: A Finite Analogue Of Fine's Function $F(a,b;t)$

abstract: We initiate a systematic development of $F_N(a, b; t)$, a finite analogue of Fine's function $F(a, b; t)$. Our results are transformations between $F_N(a, b; t)$ and $F_N(aq^{\ell}, bq^{m}; tq^{n})$, where $\ell,m$ and $n$ take the values $0$ or $1$.


title: Enumeration of tree-type diagrams assembled from oriented chains of edges

abstract: Using recurrent relation and analog of the Lagrange inversion theorem, we obtain an explicit formula for the number of tree-type diagrams assembled from $k$ oriented labeled $q$-regular chains. Using a version of the Pr$\"u$fer code for Cayley trees, we generalize our result to the case when the chains are not necessarily regular.


title: Perspectives and constraints on neural network models of neurobiological processes

abstract: Artificial and natural neural network models are a new toolkit which could be potentially have been used for clarifying of complex brain functions. To attend this goal, such models need to be neurobiologically realistic. However, although neural networks have advanced keenly in recent decades their strict similarity in aspects of brain anatomy and physiology is imperfect. In this work we discuss different types of neural models, including localist, attractor and deep network models, and also identify aspects under which their biological credibility can be improved. These conditions range from the choice of neuron models and of mechanisms of synaptic plasticity and learning to implementation of inhibition and control, along with network architectures (modularity, connectivity). We highlight recent advances in biologically inspired neural network models and their constraints.


title: Sum-of-Max Partition under a Knapsack Constraint

abstract: Sequence partition problems arise in many fields, such as sequential data analysis, information transmission, and parallel computing. In this paper, we study the following partition problem variant: given a sequence of $n$ items $1,\ldots,n$, where each item $i$ is associated with weight $w_i$ and another parameter $s_i$, partition the sequence into several consecutive subsequences, so that the total weight of each subsequence is no more than a threshold $w_0$, and the sum of the largest $s_i$ in each subsequence is minimized. This problem admits a straightforward solution based on dynamic programming, which costs $O(n^2)$ time and can be improved to $O(n\log n)$ time easily. Our contribution is an $O(n)$ time algorithm, which is nontrivial yet easy to implement. We also study the corresponding tree partition problem. We prove that the problem on the tree is NP-complete and we present an $O(w_0 n^2)$ time ($O(w_0^2n^2)$ time, respectively) algorithm for the unit weight (integer weight, respectively) case.


title: Test-time Adaptation with Calibration of Medical Image Classification Nets for Label Distribution Shift

abstract: Class distribution plays an important role in learning deep classifiers. When the proportion of each class in the test set differs from the training set, the performance of classification nets usually degrades. Such a label distribution shift problem is common in medical diagnosis since the prevalence of disease vary over location and time. In this paper, we propose the first method to tackle label shift for medical image classification, which effectively adapt the model learned from a single training label distribution to arbitrary unknown test label distribution. Our approach innovates distribution calibration to learn multiple representative classifiers, which are capable of handling different one-dominating-class distributions. When given a test image, the diverse classifiers are dynamically aggregated via the consistency-driven test-time adaptation, to deal with the unknown test label distribution. We validate our method on two important medical image classification tasks including liver fibrosis staging and COVID-19 severity prediction. Our experiments clearly show the decreased model performance under label shift. With our method, model performance significantly improves on all the test datasets with different label shifts for both medical image diagnosis tasks.


title: The ABC of scale invariance at the level of action integrals, and the software tool Kanon

abstract: A central and common aspect of renormalizable field theories is scale invariance of the action integral. This note introduces the software tool \emph{Kanon}, which allows to assemble arbitrary action integrals interactively, and to determine their critical dimension and scale invariance. The tool contains more than 60 well-known models with comments and references to the literature.

categories: cond-mat.soft cond-mat.stat-mech hep-ph hep-th


title: Some Unified Results on Isotonic Regression Estimators of Order Restricted Parameters of a General Bivariate Location/Scale Model

abstract: We consider component-wise estimation of order restricted location/scale parameters $\theta_1$ and $\theta_2$ ($\theta_1\leq \theta_2$) of a general bivariate distribution under the squared error loss function. To find improvements over the best location/scale equivariant estimators (BLEE/BSEE) of $\theta_1$ and $\theta_2$, we study isotonic regression of suitable location/scale equivariant estimators (LEE/SEE) of $\theta_1$ and $\theta_2$ with general weights. Let $\mathcal{D}_{1,\nu}$ and $\mathcal{D}_{2,\beta}$ denote suitable classes of isotonic regression estimators of $\theta_1$ and $\theta_2$, respectively. Under the squared error loss function, we characterize admissible estimators within classes $\mathcal{D}_{1,\nu}$ and $\mathcal{D}_{2,\beta}$, and identify estimators that dominate the BLEE/BSEE of $\theta_1$ and $\theta_2$. Our study unifies and extends several studies reported in the literature for specific probability distributions having independent marginals. Additionally, some new and interesting results are obtained. A simulation study is also considered to compare the risk performances of various estimators.


title: Investigating the UV-excess in star clusters with $N$-body simulations: predictions for future CSST observations

abstract: We study the origin of the UV-excess in star clusters by performing N-body simulations of six clusters with N=10k and N=100k (single stars & binary systems) and metallicities of Z=0.01, 0.001, and 0.0001, using PETAR. All models initially have a 50 percent primordial binary fraction. Using GalevNB we convert the simulated data into synthetic spectra and photometry for the China Space Station Telescope (CSST) and Hubble Space Telescope (HST). From the spectral energy distributions we identify three stellar populations that contribute to the UV-excess: (1) second asymptotic giant branch stars, which contribute to the UV flux at early times; (2) naked helium stars, and (3) white dwarfs, which are long-term contributors to the FUV spectra. Binary stars consisting of a white dwarf and a main-sequence star are cataclysmic variable (CV) candidates. The magnitude distribution of CV candidates is bimodal up to 2 Gyr. The bright CV population is particularly bright in FUV-NUV. The FUV-NUV color of our model clusters is 1-2 mag redder than the UV-excess globular clusters in M 87 and in the Milky Way. This discrepancy may be induced by helium enrichment in observed clusters. Our simulations are based on simple stellar evolution; we do not include the effects of variations in helium and light elements or multiple stellar populations. A positive radial color gradient is present in CSST NUV-y for main-sequence stars of all models with a color difference of 0.2-0.5 mag, up to 4 half-mass radii. The CSST NUV-g color correlates strongly with HST FUV-NUV for NUV-g>1 mag, with the linear relation $FUV-NUV=(1.09\pm0.12)\times(NUV-g)+(-1.01\pm0.22)$. This allows for conversion of future CSST NUV-g colors into HST FUV-NUV colors, which are sensitive to UV-excess features. We find that CSST will be able to detect UV-excess in galactic/extra-galactic star clusters with ages >200 Myr.


title: Capital Market Performance and Macroeconomic Dynamics in Nigeria

abstract: The study examined the relationship between capital market performance and the macroeconomic dynamics in Nigeria, and it utilized secondary data spanning 1993 to 2020. The data was analyzed using vector error correction model (VECM) technology. The result revealed a significant long run relationship between capital market performance and macroeconomic dynamics in Nigeria. We observed long run causality running from the exchange rate, inflation, money supply, and unemployment rate to capital market performance indicator in Nigeria. The result supports the Arbitrage Pricing Theory (APT) proposition in the Nigerian context. The theory stipulates that the linear relationship between an asset expected returns and the macroeconomic factors whose dynamics affect the asset risk can forecast an asset's returns. In other words, the result of this study supports the proposition that the dynamics in the exchange rate, inflation, money supply, and unemployment rate influence the capital market performance. The study validates the recommendations of Arbitrage Pricing Theory (APT) in Nigeria.


title: Computer-assisted Pronunciation Training -- Speech synthesis is almost all you need

abstract: The research community has long studied computer-assisted pronunciation training (CAPT) methods in non-native speech. Researchers focused on studying various model architectures, such as Bayesian networks and deep learning methods, as well as on the analysis of different representations of the speech signal. Despite significant progress in recent years, existing CAPT methods are not able to detect pronunciation errors with high accuracy (only 60\% precision at 40\%-80\% recall). One of the key problems is the low availability of mispronounced speech that is needed for the reliable training of pronunciation error detection models. If we had a generative model that could mimic non-native speech and produce any amount of training data, then the task of detecting pronunciation errors would be much easier. We present three innovative techniques based on phoneme-to-phoneme (P2P), text-to-speech (T2S), and speech-to-speech (S2S) conversion to generate correctly pronounced and mispronounced synthetic speech. We show that these techniques not only improve the accuracy of three machine learning models for detecting pronunciation errors but also help establish a new state-of-the-art in the field. Earlier studies have used simple speech generation techniques such as P2P conversion, but only as an additional mechanism to improve the accuracy of pronunciation error detection. We, on the other hand, consider speech generation to be the first-class method of detecting pronunciation errors. The effectiveness of these techniques is assessed in the tasks of detecting pronunciation and lexical stress errors. Non-native English speech corpora of German, Italian, and Polish speakers are used in the evaluations. The best proposed S2S technique improves the accuracy of detecting pronunciation errors in AUC metric by 41\% from 0.528 to 0.749 compared to the state-of-the-art approach.


title: Ultrafast adiabatic passages in ultrastrongly coupled light-matter systems

abstract: We have obtained the solutions of the multimode quantum Rabi model when all modes have identical frequencies $\omega$, including dark states $|\phi_K\rangle$ with at least $K$ $(K=1,2,3,\ldots)$ photons. Extended to the multiqubit case, they lie close to another dark state $\vert \psi\rangle$ with at most one photon in the spectrum. Taking advantages of such solutions, we find a linear and symmetry-protected adiabatic passage through $\vert \psi\rangle$ to fast generate arbitrary single-photon $M$-mode $W$ states $\vert W_M\rangle$ with exactly the same speed. The effective minimum energy gap during the adiabatic evolution is further enlarged to $0.63\omega$ when Stark shifts are included, such that arbitrary $\vert W_M\rangle$ can be ultrafast generated in $1.55\times 2\pi\omega^{-1}$ with fidelity $99\%$, indepedent of $M$. This work reveals the existence of linear ultrafast adiabatic passages in light-matter systems.


title: Environment Sensing Considering the Occlusion Effect: A Multi-View Approach

abstract: In this paper, we consider the problem of sensing the environment within a wireless cellular framework. Specifically, multiple user equipments (UEs) send sounding signals to one or multiple base stations (BSs) and then a centralized processor retrieves the environmental information from all the channel information obtained at the BS(s). Taking into account the occlusion effect that is common in the wireless context, we make full use of the different views of the environment from different users and/or BS(s), and propose an effective sensing algorithm called GAMP-MVSVR (generalized-approximate-message-passing-based multi-view sparse vector reconstruction). In the proposed algorithm, a multi-layer factor graph is constructed to iteratively estimate the scattering coefficients of the cloud points and their occlusion relationship. In each iteration, the occlusion relationship between the cloud points of the sparse environment is recalculated according to a simple occlusion detection rule, and in turn, used to estimate the scattering coefficients of the cloud points. Our proposed algorithm can achieve improved sensing performance with multi-BS collaboration in addition to the multi-views from the UEs. The simulation results verify its convergence and effectiveness.


title: On a generalization of Jones polynomial and its categorification for Legendrian Knots

abstract: In this article, we explore a polynomial invariant for Legendrian knots which is a natural extension of Jones polynomial for (topological) knots. To this end, a new type of skein relation is introduced for the front projections of Legendrian knots. Further, we give a categorification of the polynomial invariant for Legendrian knots which is a natural extension of Khovanov homology for knots. The Thurston-Bennequin invariant of Legendrian knot appears naturally in the construction of the homology as the grade-shift. The constructions of the polynomial invariant and its categorification are natural in the sense that if we treat Legendrian knots as only knots (that is, we forget the geometry on the knots), then we recover the Jones polynomial and Khovanov homology respectively. In the end, we discuss strengths and limitations of these invariants.


title: Measurement of $\rm ^4_{\Lambda}H$ and $\rm ^4_{\Lambda}He$ binding energy in Au+Au collisions at $\sqrt{s_\mathrm{NN}}$ = 3 GeV

abstract: Measurements of mass and $\Lambda$ binding energy of $\rm ^4_{\Lambda}H$ and $\rm ^4_{\Lambda}He$ in Au+Au collisions at $\sqrt{s_{_{\rm NN}}}=3$ GeV are presented, with an aim to address the charge symmetry breaking (CSB) problem in hypernuclei systems with atomic number A = 4. The $\Lambda$ binding energies are measured to be $\rm 2.22\pm0.06(stat.) \pm0.14(syst.)$ MeV and $\rm 2.38\pm0.13(stat.) \pm0.12(syst.)$ MeV for $\rm ^4_{\Lambda}H$ and $\rm ^4_{\Lambda}He$, respectively. The measured $\Lambda$ binding-energy difference is $\rm 0.16\pm0.14(stat.)\pm0.10(syst.)$ MeV for ground states. Combined with the $\gamma$-ray transition energies, the binding-energy difference for excited states is $\rm -0.16\pm0.14(stat.)\pm0.10(syst.)$ MeV, which is negative and comparable to the value of the ground states within uncertainties. These new measurements on the $\Lambda$ binding-energy difference in A = 4 hypernuclei systems are consistent with the theoretical calculations that result in $\rm \Delta B_{\Lambda}^4(1_{exc}^{+})\approx -\Delta B_{\Lambda}^4(0_{g.s.}^{+})<0$ and present a new method for the study of CSB effect using relativistic heavy-ion collisions.


title: FRAME: Evaluating Rationale-Label Consistency Metrics for Free-Text Rationales

abstract: Following how humans communicate, free-text rationales aim to use natural language to explain neural language model (LM) behavior. However, free-text rationales' unconstrained nature makes them prone to hallucination, so it is important to have metrics for free-text rationale quality. Existing free-text rationale metrics measure how consistent the rationale is with the LM's predicted label, but there is no protocol for assessing such metrics' reliability. Thus, we propose FRAME, a framework for evaluating rationale-label consistency (RLC) metrics for free-text rationales. FRAME is based on three axioms: (1) good metrics should yield highest scores for reference rationales, which maximize RLC by construction; (2) good metrics should be appropriately sensitive to semantic perturbation of rationales; and (3) good metrics should be robust to variation in the LM's task performance. Across three text classification datasets, we show that existing RLC metrics cannot satisfy all three FRAME axioms, since they are implemented via model pretraining which muddles the metric's signal. Then, we introduce a non-pretraining RLC metric that greatly outperforms baselines on (1) and (3), while performing competitively on (2). Finally, we discuss the limitations of using RLC to evaluate free-text rationales.


title: A novel technique for the measurement of the avalanche fluctuations of a GEM stack using a gating foil

abstract: We have developed a novel technique for the measurement of the size of avalanche fluctuations of gaseous detectors using a gating device (gating foil) prepared for the time projection chamber in the international linear collider experiment (ILD-TPC). In addition to the gating function, the gating foil is capable of controlling the average fraction of drift electrons detected after gas amplification. The signal charge width and shape (skewness) for electron-ion pairs created by a pulsed UV laser as a function of the transmission rate of the gating foil can be used to determine the relative variance of gas gain for single electrons. We present the measurement principle and the result obtained using a stack of gas electron multipliers (GEMs) operated in a gas mixture of Ar-CF$_4$(3%)-isobutane(2%) at atmospheric pressure. Also discussed is the influence of the avalanche fluctuations on the spatial resolution of the ILD-TPC.


title: Analysis of Age of Information in Dual Updating Systems

abstract: We study the average Age of Information (AoI) and peak AoI (PAoI) of a dual-queue status update system that monitors a common stochastic process. Although the double queue parallel transmission is instrumental in reducing AoI, the out of order of data arrivals also imposes a significant challenge to the performance analysis. We consider two settings: the M-M system where the service time of two servers is exponentially distributed; the M-D system in which the service time of one server is exponentially distributed and that of the other is deterministic. For the two dual-queue systems, closed-form expressions of average AoI and PAoI are derived by resorting to the graphic method and state flow graph analysis method. Our analysis reveals that compared with the single-queue system with an exponentially distributed service time, the average PAoI and the average AoI of the M-M system can be reduced by 33.3% and 37.5%, respectively. For the M-D system, the reduction in average PAoI and the average AoI are 27.7% and 39.7%, respectively. Numerical results show that the two dual-queue systems also outperform the M/M/2 single queue dual-server system with optimized arrival rate in terms of average AoI and PAoI.


title: Enabling Harmonious Human-Machine Interaction with Visual-Context Augmented Dialogue System: A Review

abstract: The intelligent dialogue system, aiming at communicating with humans harmoniously with natural language, is brilliant for promoting the advancement of human-machine interaction in the era of artificial intelligence. With the gradually complex human-computer interaction requirements (e.g., multimodal inputs, time sensitivity), it is difficult for traditional text-based dialogue system to meet the demands for more vivid and convenient interaction. Consequently, Visual Context Augmented Dialogue System (VAD), which has the potential to communicate with humans by perceiving and understanding multimodal information (i.e., visual context in images or videos, textual dialogue history), has become a predominant research paradigm. Benefiting from the consistency and complementarity between visual and textual context, VAD possesses the potential to generate engaging and context-aware responses. For depicting the development of VAD, we first characterize the concepts and unique features of VAD, and then present its generic system architecture to illustrate the system workflow. Subsequently, several research challenges and representative works are detailed investigated, followed by the summary of authoritative benchmarks. We conclude this paper by putting forward some open issues and promising research trends for VAD, e.g., the cognitive mechanisms of human-machine dialogue under cross-modal dialogue context, and knowledge-enhanced cross-modal semantic interaction.


title: Real-space pairing through a confined local nematic state in cuprate superconductors

abstract: The pairing mechanism of high temperature superconductivity in cuprates is regarded as one of the most challenging issues that we are facing now. The core issue is about how the Cooper pairs are formed. There are plenty pictures concerning the pairing manner, and some of them postulate local pairing of charge freedom through the strong correlation effect. Here we report the spin resolved tunnelling measurements on extremely underdoped Bi2Sr2-xLaxCuO6-delta. Our data reveal that, when holes are doped into the system, the antiferromagnetic order is destroyed together with the filling up of the charge transfer gap by some density of states (DOS) with a maximum at about 200 meV. Consequently, an electronic structure with 4a0x4a0 basic plaquettes gradually emerges, and they become more populated versus further hole doping. In the central part of each plaquette, there are three unidirectional bars (along the Cu-O bond) enlightened by the enhanced peaks of coherence-like DOS at about +-25 meV, and the intensity is especially pronounced at oxygen sites. For the first time, we reveal an internal nematic pattern of these pairing related states which exhibit a feature of precursor gap for superconductivity. We argue that this confined nematic state within one 4a0x4a0 plaquette constitutes naturally the local pairing format. Our work shed new light in unraveling the longstanding puzzle of pairing mechanism in cuprate superconductors.


title: Learning Cross-Image Object Semantic Relation in Transformer for Few-Shot Fine-Grained Image Classification

abstract: Few-shot fine-grained learning aims to classify a query image into one of a set of support categories with fine-grained differences. Although learning different objects' local differences via Deep Neural Networks has achieved success, how to exploit the query-support cross-image object semantic relations in Transformer-based architecture remains under-explored in the few-shot fine-grained scenario. In this work, we propose a Transformer-based double-helix model, namely HelixFormer, to achieve the cross-image object semantic relation mining in a bidirectional and symmetrical manner. The HelixFormer consists of two steps: 1) Relation Mining Process (RMP) across different branches, and 2) Representation Enhancement Process (REP) within each individual branch. By the designed RMP, each branch can extract fine-grained object-level Cross-image Semantic Relation Maps (CSRMs) using information from the other branch, ensuring better cross-image interaction in semantically related local object regions. Further, with the aid of CSRMs, the developed REP can strengthen the extracted features for those discovered semantically-related local regions in each branch, boosting the model's ability to distinguish subtle feature differences of fine-grained objects. Extensive experiments conducted on five public fine-grained benchmarks demonstrate that HelixFormer can effectively enhance the cross-image object semantic relation matching for recognizing fine-grained objects, achieving much better performance over most state-of-the-art methods under 1-shot and 5-shot scenarios. Our code is available at: https://github.com/JiakangYuan/HelixFormer


title: ANEC: An Amharic Named Entity Corpus and Transformer Based Recognizer

abstract: Named Entity Recognition is an information extraction task that serves as a preprocessing step for other natural language processing tasks, such as machine translation, information retrieval, and question answering. Named entity recognition enables the identification of proper names as well as temporal and numeric expressions in an open domain text. For Semitic languages such as Arabic, Amharic, and Hebrew, the named entity recognition task is more challenging due to the heavily inflected structure of these languages. In this paper, we present an Amharic named entity recognition system based on bidirectional long short-term memory with a conditional random fields layer. We annotate a new Amharic named entity recognition dataset (8,070 sentences, which has 182,691 tokens) and apply Synthetic Minority Over-sampling Technique to our dataset to mitigate the imbalanced classification problem. Our named entity recognition system achieves an F_1 score of 93%, which is the new state-of-the-art result for Amharic named entity recognition.


title: Universal local linear kernel estimators in nonparametric regression

abstract: New local linear estimators are proposed for a wide class of nonparametric regression models. The estimators are uniformly consistent regardless of satisfying traditional conditions of depen\-dence of design elements. The estimators are the solutions of a specially weighted least-squares method. The design can be fixed or random and does not need to meet classical regularity or independence conditions. As an application, several estimators are constructed for the mean of dense functional data. The theoretical results of the study are illustrated by simulations. An example of processing real medical data from the epidemiological cross-sectional study ESSE-RF is included. We compare the new estimators with the estimators best known for such studies.


title: Object Representations as Fixed Points: Training Iterative Refinement Algorithms with Implicit Differentiation

abstract: Iterative refinement -- start with a random guess, then iteratively improve the guess -- is a useful paradigm for representation learning because it offers a way to break symmetries among equally plausible explanations for the data. This property enables the application of such methods to infer representations of sets of entities, such as objects in physical scenes, structurally resembling clustering algorithms in latent space. However, most prior works differentiate through the unrolled refinement process, which can make optimization challenging. We observe that such methods can be made differentiable by means of the implicit function theorem, and develop an implicit differentiation approach that improves the stability and tractability of training by decoupling the forward and backward passes. This connection enables us to apply advances in optimizing implicit layers to not only improve the optimization of the slot attention module in SLATE, a state-of-the-art method for learning entity representations, but do so with constant space and time complexity in backpropagation and only one additional line of code.


title: Long-Tail Prediction Uncertainty Aware Trajectory Planning for Self-driving Vehicles

abstract: A typical trajectory planner of autonomous driving commonly relies on predicting the future behavior of surrounding obstacles. Recently, deep learning technology has been widely adopted to design prediction models due to their impressive performance. However, such models may fail in the "long-tail" driving cases where the training data is sparse or unavailable, leading to planner failures. To this end, this work proposes a trajectory planner to consider the prediction model uncertainty arising from insufficient data for safer performance. Firstly, an ensemble network structure estimates the prediction model's uncertainty due to insufficient training data. Then a trajectory planner is designed to consider the worst-case arising from prediction uncertainty. The results show that the proposed method can improve the safety of trajectory planning under the prediction uncertainty caused by insufficient data. At the same time, with sufficient data, the framework will not lead to overly conservative results. This technology helps to improve the safety and reliability of autonomous vehicles under the long-tail data distribution of the real world.


title: Robust magnetic order upon ultrafast excitation of an antiferromagnet

abstract: The ultrafast manipulation of magnetic order due to optical excitation is governed by the intricate flow of energy and momentum between the electron, lattice and spin subsystems. While various models are commonly employed to describe these dynamics, a prominent example being the microscopic three temperature model (M3TM), systematic, quantitative comparisons to both the dynamics of energy flow and magnetic order are scarce. Here, we apply a M3TM to the ultrafast magnetic order dynamics of the layered antiferromagnet GdRh$_2$Si$_2$. The femtosecond dynamics of electronic temperature, surface ferromagnetic order, and bulk antiferromagnetic order were explored at various pump fluences employing time- and angle-resolved photoemission spectroscopy and time-resolved resonant magnetic soft x-ray diffraction, respectively. After optical excitation, both the surface ferromagnetic order and the bulk antiferromagnetic order dynamics exhibit two-step demagnetization behaviors with two similar timescales (<1 ps, ~10 ps), indicating a strong exchange coupling between localized 4f and itinerant conduction electrons. Despite a good qualitative agreement, the M3TM predicts larger demagnetization than our experimental observation, which can be phenomenologically described by a transient, fluence-dependent increased N\'eel temperature. Our results indicate that effects beyond a mean-field description have to be considered for a quantitative description of ultrafast magnetic order dynamics.


title: Pavlov Learning Machines

abstract: As well known, Hebb's learning traces its origin in Pavlov's Classical Conditioning, however, while the former has been extensively modelled in the past decades (e.g., by Hopfield model and countless variations on theme), as for the latter modelling has remained largely unaddressed so far; further, a bridge between these two pillars is totally lacking. The main difficulty towards this goal lays in the intrinsically different scales of the information involved: Pavlov's theory is about correlations among \emph{concepts} that are (dynamically) stored in the synaptic matrix as exemplified by the celebrated experiment starring a dog and a ring bell; conversely, Hebb's theory is about correlations among pairs of adjacent neurons as summarized by the famous statement {\em neurons that fire together wire together}. In this paper we rely on stochastic-process theory and model neural and synaptic dynamics via Langevin equations, to prove that -- as long as we keep neurons' and synapses' timescales largely split -- Pavlov mechanism spontaneously takes place and ultimately gives rise to synaptic weights that recover the Hebbian kernel.


title: Relaxation electrodynamics of superinsulators

abstract: Superinsulators offer a unique laboratory realizing strong interaction phenomena like confinement and asymptotic freedom in quantum materials. Recent experiments evidenced that superinsulators are the mirror-twins of superconductors with reversed electric and magnetic field effects. Cooper pairs and Cooper holes in the superinsulator are confined into neutral electric pions by electric strings, with the Cooper pairs playing the role of quarks. Here we report the non-equilibrium relaxation of the electric pions in superinsulating films. We find that the time delay $t_{\mathrm{sh}}$ of the current passage in the superinsulator is related to the applied voltage $V$ via the power law, $t_{\mathrm{sh}}\propto (V-V_{\mathrm p})^{-\mu}$, where $V_{\mathrm p}$ is the effective threshold voltage. Two distinct critical exponents, $\mu=1/2$ and $\mu=3/4$, correspond to jumps from the electric Meissner state to the mixed state and to the superinsulating resistive state with broken charge confinement, respectively. The $\mu=1/2$ value establishes a direct experimental evidence for the electric strings' linear potential confining the charges of opposite signs in the electric Meissner state and effectively rules out disorder-induced localization as a mechanism for superinsulation. We further report the memory effects and their corresponding dynamic critical exponents arising upon the sudden reversal of the applied voltage. Our observations open routes for exploring fundamental strong interaction charge confinement via desktop experiments.


title: Two-Timescale Design for STAR-RIS Aided NOMA Systems

abstract: Simultaneously transmitting and reflecting reconfigurable intelligent surfaces (STAR-RISs) have emerged as a promising technology for achieving full-space coverage. Prior works on STAR-RISs mostly assumed the full and instantaneous channel state information (CSI) is available, which, however, is practically difficult to obtain due to the large number of elements. To address it, we investigate STAR-RIS aided NOMA systems, where two efficient two-timescale transmission protocols are proposed for different channel setups to maximize the average sum-rate. Specifically, 1) for line-of-sight (LoS) dominant channels, we propose the beamforming-then-estimate (BTE) Protocol, where the long-term STAR-RIS coefficients are optimized based on the statistical CSI, while the short-term power allocation at the base station (BS) is designed based on the effective channels; 2) for the rich scattering environment, we propose an alternative partition-then-estimate (PTE) Protocol, where the BS determines the long-term STAR-RIS surface-partition strategy; then the BS estimates the instantaneous subsurface channels and designs its power allocation and STAR-RIS phase-shifts accordingly. Simulation results validate the superiority of our proposed transmission protocols as compared to various benchmarks. It is shown that the BTE Protocol outperforms the PTE Protocol when the number of STAR-RIS elements is large and/or the LoS channel components are dominant, and vice versa.


title: Prediction and validation of the strongly modulated forced response of two beams undergoing frictional impacts

abstract: We consider two cantilevered beams undergoing frictional impacts at the free end. The beams are designed to be of similar geometry so that they have distinct but close natural frequencies. Under harmonic base excitation near the primary resonance with the higher-frequency fundamental bending mode, the system shows a strongly modulated non-periodic response. The purpose of this work is to analyze to what extent the non-periodic vibro-impact dynamics can be predicted. To this end, we use a recently developed modeling and simulation approach. The approach relies on component mode synthesis, the massless boundary concept and an appropriate time stepping scheme. Unilateral contact and dry friction are modeled as set-valued laws and imposed locally within the spatially resolved contact area. A linear model updating is carried out based on the natural frequencies and damping ratios identified in the regime without impacts. The nonlinear simulation of the steady-state response to forward and backward stepped sine excitation is compared against measurements. The results are in very good agreement, especially in the light of the uncertainty associated with the observed material loss in the contact region and the nonlinear behavior of the clamping.


title: Boundary-Guided Camouflaged Object Detection

abstract: Camouflaged object detection (COD), segmenting objects that are elegantly blended into their surroundings, is a valuable yet challenging task. Existing deep-learning methods often fall into the difficulty of accurately identifying the camouflaged object with complete and fine object structure. To this end, in this paper, we propose a novel boundary-guided network (BGNet) for camouflaged object detection. Our method explores valuable and extra object-related edge semantics to guide representation learning of COD, which forces the model to generate features that highlight object structure, thereby promoting camouflaged object detection of accurate boundary localization. Extensive experiments on three challenging benchmark datasets demonstrate that our BGNet significantly outperforms the existing 18 state-of-the-art methods under four widely-used evaluation metrics. Our code is publicly available at: https://github.com/thograce/BGNet.


title: Computational and experimental analysis of the impact of a sphere on a beam and the resulting modal energy distribution

abstract: We consider the common problem setting of an elastic sphere impacting on a flexible beam. In contrast to previous studies, we analyze the modal energy distribution induced by the impact, having in mind the particular application of impact vibration absorbers. Also, the beam is analyzed in the clamped-clamped configuration, in addition to the free-free configuration usually considered. We demonstrate that the designed test rig permits to obtain well-repeatable measurements. The measurements are confronted with predictions obtained using two different approaches, state-of-the-art Finite Element Analysis and a recently developed computational approach involving a reduced-order model. The innovative aspect of the latter approach is to achieve a massless contact boundary using component mode synthesis, which reduces the mathematical model order and numerical oscillations. We show that the novel computational approach reduces the numerical effort by 3-4 orders of magnitude compared to state-of-the-art Finite Element Analysis, without compromising the excellent agreement with the measurements.


title: Benchmarks for Industrial Inspection Based on Structured Light

abstract: Robustness and accuracy are two critical metrics for industrial inspection. In this paper, we propose benchmarks that can evaluate the structured light method's performance. Our evaluation metric was learning from a lot of inspection tasks from the factories. The metric we proposed consists of four detailed criteria such as flatness, length, height and sphericity. Then we can judge whether the structured light method/device can be applied to a specified inspection task by our evaluation metric quickly. A structured light device built for TypeC pin needles inspection performance is evaluated via our metrics in the final experimental section.


title: Learning fast and agile quadrupedal locomotion over complex terrain

abstract: In this paper, we propose a robust controller that achieves natural and stably fast locomotion on a real blind quadruped robot. With only proprioceptive information, the quadruped robot can move at a maximum speed of 10 times its body length, and has the ability to pass through various complex terrains. The controller is trained in the simulation environment by model-free reinforcement learning. In this paper, the proposed loose neighborhood control architecture not only guarantees the learning rate, but also obtains an action network that is easy to transfer to a real quadruped robot. Our research finds that there is a problem of data symmetry loss during training, which leads to unbalanced performance of the learned controller on the left-right symmetric quadruped robot structure, and proposes a mirror-world neural network to solve the performance problem. The learned controller composed of the mirror-world network can make the robot achieve excellent anti-disturbance ability. No specific human knowledge such as a foot trajectory generator are used in the training architecture. The learned controller can coordinate the robot's gait frequency and locomotion speed, and the locomotion pattern is more natural and reasonable than the artificially designed controller. Our controller has excellent anti-disturbance performance, and has good generalization ability to reach locomotion speeds it has never learned and traverse terrains it has never seen before.


title: Arigat\=o: Effects of Adaptive Guidance on Engagement and Performance in Augmented Reality Learning Environments

abstract: Experiential learning (ExL) is the process of learning through experience or more specifically "learning through reflection on doing". In this paper, we propose a simulation of these experiences, in Augmented Reality (AR), addressing the problem of language learning. Such systems provide an excellent setting to support "adaptive guidance", in a digital form, within a real environment. Adaptive guidance allows the instructions and learning content to be customised for the individual learner, thus creating a unique learning experience. We developed an adaptive guidance AR system for language learning, we call Arigat\=o (Augmented Reality Instructional Guidance & Tailored Omniverse), which offers immediate assistance, resources specific to the learner's needs, manipulation of these resources, and relevant feedback. Considering guidance, we employ this prototype to investigate the effect of the amount of guidance (fixed vs. adaptive-amount) and the type of guidance (fixed vs. adaptive-associations) on the engagement and consequently the learning outcomes of language learning in an AR environment. The results for the amount of guidance show that compared to the adaptive-amount, the fixed-amount of guidance group scored better in the immediate and delayed (after 7 days) recall tests. However, this group also invested a significantly higher mental effort to complete the task. The results for the type of guidance show that the adaptive-associations group outperforms the fixed-associations group in the immediate, delayed (after 7 days) recall tests, and learning efficiency. The adaptive-associations group also showed significantly lower mental effort and spent less time to complete the task.


title: Cram\'er-Rao Bounds of Near-Field Positioning Based on Electromagnetic Propagation Model

abstract: The adoption of large-scale antenna arrays at high-frequency bands is widely envisioned in the beyond 5G wireless networks. This leads to the near-field regime where the wavefront is no longer planar but spherical, bringing new opportunities and challenges for communications and positioning. In this paper, we improve the near-field positioning technology from the classical spherical wavefront model (SWM) to the more accurate and true electromagnetic propagation model (EPM). A generic near-field positioning model with different observation capabilities for three electric field types (vector, scalar, and overall scalar electric field) is developed based on the complete EPM. For these three observed electric field types, the Cram\'er-Rao bound (CRB) is adopted to evaluate the achievable estimation accuracy. The expressions of the CRBs for different electric field observations are derived by combining electromagnetic propagation concepts with estimation theory. Closed-form expressions can be further obtained as the terminal is assumed to be on the central perpendicular line (CPL) of the receiving antenna surface. Moreover, the above discussions are extended to the system with multiple receiving antennas. In this case, the CRBs using various electric field types are derived, and the effect of different numbers of receiving antennas is deeply investigated. Numerical results are provided to quantify the CRBs and validate the analytical results. Also, the impact of different system parameters, including electric field type, wavelength, size of the receiving antenna, and number of antennas, is evaluated.


title: Inside the West Wing: Lobbying as a contest

abstract: When a government makes many different policy decisions, lobbying can be viewed as a contest between the government and many different special interest groups. The government fights lobbying by interest groups with its own political capital. In this world, we find that a government wants to `sell protection' -- give favourable treatment in exchange for contributions -- to certain interest groups. It does this in order to build its own `war chest' of political capital, which improves its position in fights with other interest groups. And it does so until it wins all remaining contests with certainty. This stands in contrast to existing models that often view lobbying as driven by information or agency problems.


title: Construction of quaternary Hermitian LCD codes

abstract: We introduce a general construction of many Hermitian LCD $[n, k]$ codes from a given Hermitian LCD $[n, k]$ code. Furthermore, we present some results on punctured codes and shortened codes of quaternary Hermitian LCD codes. As an application, we improve some of the previously known lower bounds on the largest minimum weights of quaternary Hermitian LCD codes of length $12 \le n \le 30$.


title: Subspaces Fixed by a Nilpotent Matrix

abstract: The linear spaces that are fixed by a given nilpotent $n \times n$ matrix form a subvariety of the Grassmannian. We classify these varieties for small $n$. Mutiah, Weekes and Yacobi conjectured that their radical ideals are generated by certain linear forms known as shuffle equations. We prove this conjecture for $n \leq 7$, and we disprove it for $n=8$. The question remains open for nilpotent matrices arising from the affine Grassmannian.


title: Oscillatory translational instabilities of localized spot patterns in the Schnakenberg reaction-diffusion system on general 2-D domains

abstract: For a bounded 2-D planar domain $\Omega$, we investigate the impact of domain geometry on oscillatory translational instabilities of $N$-spot equilibrium solutions for a singularly perturbed Schnakenberg reaction-diffusion system with $\mO(\eps^2) \ll \mO(1)$ activator-inhibitor diffusivity ratio. An $N$-spot equilibrium is characterized by an activator concentration that is exponentially small everywhere in $\Omega$ except in $N$ well-separated localized regions of $\mO(\eps)$ extent. We use the method of matched asymptotic analysis to analyze Hopf bifurcation thresholds above which the equilibrium becomes unstable to translational perturbations, which result in $\mO(\eps^2)$-frequency oscillations in the locations of the spots. We find that stability to these perturbations is governed by a nonlinear matrix-eigenvalue problem, the eigenvector of which is a $2N$-vector that characterizes the possible modes (directions) of oscillation. The $2N\times 2N$ matrix contains terms associated with a certain Green's function on $\Omega$, which encodes geometric effects. For the special case of a perturbed disk with radius in polar coordinates $r = 1 + \sigma f(\theta)$ with \red{$0< \varepsilon \ll \sigma \ll 1$}, $\theta \in [0,2\pi)$, and $f(\theta)$ $2\pi$-periodic, we show that only the mode-$2$ coefficients of the Fourier series of $f$ impact the bifurcation threshold at leading order in $\sigma$. We further show that when $f(\theta) = \cos2\theta$, the dominant mode of oscillation is in the direction parallel to the longer axis of the perturbed disk. Numerical investigations on the full Schnakenberg PDE are performed for various domains $\Omega$ and $N$-spot equilibria to confirm asymptotic results and also to demonstrate how domain geometry impacts thresholds and dominant oscillation modes.


title: An AIoT-enabled Autonomous Dementia Monitoring System

abstract: An autonomous Artificial Internet of Things (AIoT) system for elderly dementia patients monitoring in a smart home is presented. The system mainly implements two functions based on the activity inference of the sensor data, which are real time abnormal activity monitoring and trend prediction of disease related activities. Specifically, CASAS dataset is employed to train a Random Forest (RF) model for activity inference. Then, another RF model trained by the output data of activity inference is used for abnormal activity monitoring. Particularly, RF is chosen for these tasks because of its balanced trade offs between accuracy, time efficiency, flexibility, and interpretability. Moreover, Long Short Term Memory (LSTM) is utilised to forecast the disease related activity trend of a patient. Consequently, the accuracy of two RF classifiers designed for activity inference and abnormal activity detection is greater than 99 percent and 94 percent, respectively. Furthermore, using the duration of sleep as an example, the LSTM model achieves accurate and evident future trends prediction.


title: Examination of Boltzmann's H-Function: Dimensionality and Interaction Sensitivity Dependence, and a comment on his H-Theorem

abstract: Boltzmann's H-Theorem, formulated 150 years ago in terms of H-function that also bears his name, is one of the most celebrated theorems of science and paved the way for the development of nonequilibrium statistical mechanics. Nevertheless, quantitative studies of the H-function, denoted by H(t), in realistic systems are relatively scarce because of the difficulty of obtaining the time-dependent momentum distribution analytically. Also, the earlier attempts proceeded through the solution of Boltzmann's kinetic equation, which was hard. Here we investigate, by direct molecular dynamics simulations and analytic theory, the time dependence of H(t). We probe the sensitivity of nonequilibrium relaxation to interaction potential and dimensionality by using the H-function H(t). We evaluate H(t) for three different potentials in all three dimensions and find that it exhibits surprisingly strong sensitivity to these factors. The relaxation of H(t) is long in 1D, but short in 3D. We obtain, for the first time, a closed-form analytic expression for H(t) using the solution of the Fokker-Planck equation for the velocity space probability distribution and compare its predictions with the simulation results. Interestingly, H(t) is found to exhibit linear response when vastly different initial nonequilibrium conditions are employed. The oft-quoted relation of H-function with Clausius's entropy theorem is discussed.


title: Corner-based implicit patches

abstract: Multi-sided surfaces are often defined by side interpolants (also called ribbons), i.e. the surface has to connect to the ribbons with a prescribed degree of smoothness. The I-patch is such a family of implicit surfaces capable of interpolating an arbitrary number of ribbons and can be used in design and approximation. While in the case of parametric surfaces describing ribbons is a well-discussed problem, defining implicit ribbons is a different task. This paper will introduce corner I-patches, a new representation that describes implicit surfaces based on corner interpolants. Those may be defined with much simpler surfaces, while the shape of the patch will depend on a handful of scalar parameters. Continuity between patches will be enforced via constraints on these parameters. Corner I-patches have several favorable properties that can be exploited for example in volume rendering or approximation.