title: Projection Of Temperature And Precipitation For 2020-2100 For Tehran Region Using Post-processing Of General Circulation Models Output And Artificial Neural Network Approach

abstract: Multi-model projections in climate studies are performed to quantify uncertainty and improve reliability in climate projections. The challenging issue is that there is no unique way to obtain performance metrics, nor is there any consensus about which method would be the best method of combining models. The goal of this study was to investigate whether combining climate model projections by artificial neural network (ANN) approach could improve climate projections and therefore reduce the range of uncertainty. The equally-weighted model averaging (the mean model) and single climate model projections (the best model) were also considered as references for the ANN combination approach. Simulations of present-day climate and future projections from 15 General Circulation Models (GCMs) for temperature and precipitation were employed. Results indicated that combining GCM projections by the ANN combination approach significantly improved the simulations of present-day temperature and precipitation than the best model and the mean model. The identity of the best model changed between the two variables and among stations. Therefore, there was not a unique model which could represent the best model for all variables and/or stations over the study region. The mean model was also not skillful in giving a reliable projection of historical climate. Simulation of temperature indicated that the ANN approach had the best skill at simulating present-day monthly means than other approaches in all stations. Simulation of present-day precipitation, however, indicated that the ANN approach was not the best approach in all stations although it performed better than the mean model. Multi-model projections of future climate conditions performed by the ANN approach projected an increase in temperature and reduction in precipitation in all stations and for all scenarios.


title: Rule-based Morphological Inflection Improves Neural Terminology Translation

abstract: Current approaches to incorporating terminology constraints in machine translation (MT) typically assume that the constraint terms are provided in their correct morphological forms. This limits their application to real-world scenarios where constraint terms are provided as lemmas. In this paper, we introduce a modular framework for incorporating lemma constraints in neural MT (NMT) in which linguistic knowledge and diverse types of NMT models can be flexibly applied. It is based on a novel cross-lingual inflection module that inflects the target lemma constraints based on the source context. We explore linguistically motivated rule-based and data-driven neural-based inflection modules and design English-German health and English-Lithuanian news test suites to evaluate them in domain adaptation and low-resource MT settings. Results show that our rule-based inflection module helps NMT models incorporate lemma constraints more accurately than a neural module and outperforms the existing end-to-end approach with lower training costs.


title: An Effective Early Multi-core System Shared Cache Design Method Based on Reuse-distance Analysis

abstract: In this paper, we proposed an effective and efficient multi-core shared-cache design optimization approach based on reuse-distance analysis of the data traces of target applications. Since data traces are independent of system hardware architectures, a designer can easily compute the best cache design at the early system design phase using our approach. We devise a very efficient and yet accurate method to derive the aggregated reuse-distance histograms of concurrent applications for accurate cache performance analysis and optimization. Essentially, the actual shared-cache contention results of concurrent applications are embedded in the aggregated reuse-distance histograms and therefore the approach is very effective. The experimental results show that the average error rate of shared-cache miss-count estimations of our approach is less than 2.4%. Using a simple scanning search method, one can easily determine the true optimal cache configurations at the early system design phase.


title: Uncertainty Analysis Of Future Projections Of Temperature, Precipitation, And Solar Radiation Under Global Warming Effect In Tehran, Iran

abstract: In order to investigate the scope of uncertainty in projections of GCMs for Tehran province, a multi-model projection composed of 15 models is employed. The projected changes in minimum temperature, maximum temperature, precipitation, and solar radiation under the A1B scenario for Tehran province are investigated for 2011-2030, 2046-2065, and 2080-2099. GCM projections for the study region are downscaled by the LARS-WG5 model. Uncertainty among the projections is evaluated from three perspectives: large-scale climate scenarios downscaled values, and mean decadal changes. 15 GCMs unanimously project an increasing trend in the temperature for the study region. Also, uncertainty in the projections for the summer months is greater than projection uncertainty for other months. The mean absolute surface temperature increase for the three periods is projected to be about 0.8{\deg}C, 2.4{\deg}C, and 3.8{\deg}C in the summers, respectively. The uncertainty of the multi-model projections for precipitation in summer seasons, and the radiation in the springs and falls is higher than other seasons for the study region. Model projections indicate that for the three future periods and relative to their baseline period, springtime precipitation will decrease about 5\%, 10\%, and 20\%, and springtime radiation will increase about 0.5\%, 1.5\%, and 3\%, respectively. The projected mean decadal changes indicate an increase in temperature and radiation and a decrease in precipitation. Furthermore, the performance of the GCMs in simulating the baseline climate by the MOTP method does not indicate any distinct pattern among the GCMs for the study region.


title: ReLU Regression with Massart Noise

abstract: We study the fundamental problem of ReLU regression, where the goal is to fit Rectified Linear Units (ReLUs) to data. This supervised learning task is efficiently solvable in the realizable setting, but is known to be computationally hard with adversarial label noise. In this work, we focus on ReLU regression in the Massart noise model, a natural and well-studied semi-random noise model. In this model, the label of every point is generated according to a function in the class, but an adversary is allowed to change this value arbitrarily with some probability, which is {\em at most} $\eta < 1/2$. We develop an efficient algorithm that achieves exact parameter recovery in this model under mild anti-concentration assumptions on the underlying distribution. Such assumptions are necessary for exact recovery to be information-theoretically possible. We demonstrate that our algorithm significantly outperforms naive applications of $\ell_1$ and $\ell_2$ regression on both synthetic and real data.


title: Style Pooling: Automatic Text Style Obfuscation for Improved Classification Fairness

abstract: Text style can reveal sensitive attributes of the author (e.g. race or age) to the reader, which can, in turn, lead to privacy violations and bias in both human and algorithmic decisions based on text. For example, the style of writing in job applications might reveal protected attributes of the candidate which could lead to bias in hiring decisions, regardless of whether hiring decisions are made algorithmically or by humans. We propose a VAE-based framework that obfuscates stylistic features of human-generated text through style transfer by automatically re-writing the text itself. Our framework operationalizes the notion of obfuscated style in a flexible way that enables two distinct notions of obfuscated style: (1) a minimal notion that effectively intersects the various styles seen in training, and (2) a maximal notion that seeks to obfuscate by adding stylistic features of all sensitive attributes to text, in effect, computing a union of styles. Our style-obfuscation framework can be used for multiple purposes, however, we demonstrate its effectiveness in improving the fairness of downstream classifiers. We also conduct a comprehensive study on style pooling's effect on fluency, semantic consistency, and attribute removal from text, in two and three domain style obfuscation.


title: The Picard group of the category of $C_n$-equivariant stable homotopy theory

abstract: For a finite group $G$, there is a map $RO(G) \to {\rm Pic}(Sp^G)$ from the real representation ring of $G$ to the Picard group of $G$-spectra. This map is not known to be surjective in general, but we prove that when $G$ is cyclic this map is indeed surjective and in that case we describe ${\rm Pic}(Sp^G)$ explicitly. We also show that for an arbitrary finite group $G$ homology and cohomology with coefficients in a cohomological Mackey functor do not see the part of ${\rm Pic}(Sp^G)$ coming from the Picard group of the Burnside ring. Hence these homology and cohomology calculations can be graded on a smaller group.


title: A Fast PC Algorithm with Reversed-order Pruning and A Parallelization Strategy

abstract: The PC algorithm is the state-of-the-art algorithm for causal structure discovery on observational data. It can be computationally expensive in the worst case due to the conditional independence tests are performed in an exhaustive-searching manner. This makes the algorithm computationally intractable when the task contains several hundred or thousand nodes, particularly when the true underlying causal graph is dense. We propose a critical observation that the conditional set rendering two nodes independent is non-unique, and including certain redundant nodes do not sacrifice result accuracy. Based on this finding, the innovations of our work are two-folds. First, we innovate on a reserve order linkage pruning PC algorithm which significantly increases the algorithm's efficiency. Second, we propose a parallel computing strategy for statistical independence tests by leveraging tensor computation, which brings further speedup. We also prove the proposed algorithm does not induce statistical power loss under mild graph and data dimensionality assumptions. Experimental results show that the single-threaded version of the proposed algorithm can achieve a 6-fold speedup compared to the PC algorithm on a dense 95-node graph, and the parallel version can make a 825-fold speed-up. We also provide proof that the proposed algorithm is consistent under the same set of conditions with conventional PC algorithm.


title: ACFNet: Adaptively-Cooperative Fusion Network for RGB-D Salient Object Detection

abstract: The reasonable employment of RGB and depth data show great significance in promoting the development of computer vision tasks and robot-environment interaction. However, there are different advantages and disadvantages in the early and late fusion of the two types of data. Besides, due to the diversity of object information, using a single type of data in a specific scenario tends to result in semantic misleading. Based on the above considerations, we propose an adaptively-cooperative fusion network (ACFNet) with ResinRes structure for salient object detection. This structure is designed to flexibly utilize the advantages of feature fusion in early and late stages. Secondly, an adaptively-cooperative semantic guidance (ACG) scheme is designed to suppress inaccurate features in the guidance phase. Further, we proposed a type-based attention module (TAM) to optimize the network and enhance the multi-scale perception of different objects. For different objects, the features generated by different types of convolution are enhanced or suppressed by the gated mechanism for segmentation optimization. ACG and TAM optimize the transfer of feature streams according to their data attributes and convolution attributes, respectively. Sufficient experiments conducted on RGB-D SOD datasets illustrate that the proposed network performs favorably against 18 state-of-the-art algorithms.


title: Smoothing effect and large time behavior of solutions to nonlinear elastic wave equations with viscoelastic term

abstract: The Cauchy problem for a nonlinear elastic wave equations with viscoelastic damping terms is considered on the 3 dimensional whole space. Decay and smoothing properties of the solutions are investigated when the initial data are sufficiently small; and asymptotic profiles as $t \to \infty$ are also derived.


title: An Overview of the HFL Model Checking Project

abstract: In this article, we give an overview of our project on higher-order program verification based on HFL (higher-order fixpoint logic) model checking. After a brief introduction to HFL, we explain how it can be applied to program verification, and summarize the current status of the project.


title: Termination Analysis of Programs with Multiphase Control-Flow

abstract: Programs with multiphase control-flow are programs where the execution passes through several (possibly implicit) phases. Proving termination of such programs (or inferring corresponding runtime bounds) is often challenging since it requires reasoning on these phases separately. In this paper we discuss techniques for proving termination of such programs, in particular: (1) using multiphase ranking functions, where we will discuss theoretical aspects of such ranking functions for several kinds of program representations; and (2) using control-flow refinement, in particular partial evaluation of Constrained Horn Clauses, to simplify the control-flow allowing, among other things, to prove termination with simpler ranking functions.


title: Regular Path Clauses and Their Application in Solving Loops

abstract: A well-established approach to reasoning about loops during program analysis is to capture the effect of a loop by extracting recurrences from the loop; these express relationships between the values of variables, or program properties such as cost, on successive loop iterations. Recurrence solvers are capable of computing closed forms for some recurrences, thus deriving precise relationships capturing the complete loop execution. However, many recurrences extracted from loops cannot be solved, due to their having multiple recursive cases or multiple arguments. In the literature, several techniques for approximating the solution of unsolvable recurrences have been proposed. The approach presented in this paper is to define transformations based on regular path expressions and loop counters that (i) transform multi-path loops to single-path loops, giving rise to recurrences with a single recursive case, and (ii) transform multi-argument recurrences to single-argument recurrences, thus enabling the use of recurrence solvers on the transformed recurrences. Using this approach, precise solutions can sometimes be obtained that are not obtained by approximation methods.


title: Reducing Higher-order Recursion Scheme Equivalence to Coinductive Higher-order Constrained Horn Clauses

abstract: Higher-order constrained Horn clauses (HoCHC) are a semantically-invariant system of higher-order logic modulo theories. With semi-decidable unsolvability over a semi-decidable background theory, HoCHC is suitable for safety verification. Less is known about its relation to larger classes of higher-order verification problems. Motivated by program equivalence, we introduce a coinductive version of HoCHC that enjoys a greatest model property. We define an encoding of higher-order recursion schemes (HoRS) into HoCHC logic programs. Correctness of this encoding reduces decidability of the open HoRS equivalence problem -- and, thus, the LambdaY-calculus B\"ohm tree equivalence problem -- to semi-decidability of coinductive HoCHC over a complete and decidable theory of trees.


title: A Fixed-point Theorem for Horn Formula Equations

abstract: We consider constrained Horn clause solving from the more general point of view of solving formula equations. Constrained Horn clauses correspond to the subclass of Horn formula equations. We state and prove a fixed-point theorem for Horn formula equations which is based on expressing the fixed-point computation of a minimal model of a set of Horn clauses on the object level as a formula in first-order logic with a least fixed point operator. We describe several corollaries of this fixed-point theorem, in particular concerning the logical foundations of program verification, and sketch how to generalise it to incorporate abstract interpretations.


title: Knowledge-Assisted Reasoning of Model-Augmented System Requirements with Event Calculus and Goal-Directed Answer Set Programming

abstract: We consider requirements for cyber-physical systems represented in constrained natural language. We present novel automated techniques for aiding in the development of these requirements so that they are consistent and can withstand perceived failures. We show how cyber-physical systems' requirements can be modeled using the event calculus (EC), a formalism used in AI for representing actions and change. We also show how answer set programming (ASP) and its query-driven implementation s(CASP) can be used to directly realize the event calculus model of the requirements. This event calculus model can be used to automatically validate the requirements. Since ASP is an expressive knowledge representation language, it can also be used to represent contextual knowledge about cyber-physical systems, which, in turn, can be used to find gaps in their requirements specifications. We illustrate our approach through an altitude alerting system from the avionics domain.


title: Competition Report: CHC-COMP-21

abstract: CHC-COMP-21 is the fourth competition of solvers for Constrained Horn Clauses. In this year, 7 solvers participated at the competition, and were evaluated in 7 separate tracks on problems in linear integer arithmetic, linear real arithmetic, arrays, and algebraic data-types. The competition was run in March 2021 using the StarExec computing cluster. This report gives an overview of the competition design, explains the organisation of the competition, and presents the competition results.


title: STL2vec: Signal Temporal Logic Embeddings for Control Synthesis With Recurrent Neural Networks

abstract: In this paper, a method for learning a recurrent neural network (RNN) controller that maximizes the robustness of signal temporal logic (STL) specifications is presented. In contrast to previous methods, we consider synthesizing the RNN controller for which the user is able to select an STL specification arbitrarily from multiple STL specifications. To obtain such a controller, we propose a novel notion called STL2vec, which represents a vector representation of the STL specifications and exhibits their similarities. The construction of the STL2vec is useful since it allows us to enhance the efficiency and performance of the RNN controller. We validate our proposed method through the examples of the path planning problem.


title: One-Dimensional Luttinger Liquids in a Two-Dimensional Moir\'e Lattice

abstract: The Luttinger liquid (LL) model of one-dimensional (1D) electronic systems provides a powerful tool for understanding strongly correlated physics including phenomena such as spin-charge separation. Substantial theoretical efforts have attempted to extend the LL phenomenology to two dimensions (2D), especially in models of closely packed arrays of 1D quantum wires, each being described as a LL. Such coupled-wire models have been successfully used to construct 2D anisotropic non-Fermi liquids, quantum Hall states, topological phases, and quantum spin liquids. However, an experimental demonstration of high-quality arrays of 1D LLs suitable for realizing these models remains absent. Here we report the experimental realization of 2D arrays of 1D LLs with crystalline quality in a moir\'e superlattice made of twisted bilayer tungsten ditelluride (tWTe$_{2}$). Originating from the anisotropic lattice of the monolayer, the moir\'e pattern of tWTe$_{2}$ hosts identical, parallel 1D electronic channels, separated by a fixed nanoscale distance, which is tunable by the interlayer twist angle. At a twist angle of ~ 5 degrees, we find that hole-doped tWTe$_{2}$ exhibits exceptionally large transport anisotropy with a resistance ratio of ~ 1000 between two orthogonal in-plane directions. The across-wire conductance exhibits power-law scaling behaviors, consistent with the formation of a 2D anisotropic phase that resembles an array of LLs. Our results open the door for realizing a variety of correlated and topological quantum phases based on coupled-wire models and LL physics.


title: Brezis--Van Schaftingen--Yung Formulae in Ball Banach Function Spaces with Applications to Fractional Sobolev and Gagliardo--Nirenberg Inequalities

abstract: Let $X$ be a ball Banach function space on ${\mathbb R}^n$. In this article, under some mild assumptions about both $X$ and the boundedness of the Hardy--Littlewood maximal operator on the associate space of the convexification of $X$, the authors prove that, for any locally integrable function $f$ with $\|\,|\nabla f|\,\|_{X}<\infty$, $$\sup_{\lambda\in(0,\infty)}\lambda\left \|\left|\left\{y\in{\mathbb R}^n:\ |f(\cdot)-f(y)| >\lambda|\cdot-y|^{\frac{n}{q}+1}\right\}\right|^{\frac{1}{q}} \right\|_X\sim \|\,|\nabla f|\,\|_X$$ with the positive equivalence constants independent of $f$, where the index $q\in(0,\infty)$ is related to $X$ and $|\{y\in{\mathbb R}^n:\ |f(\cdot)-f(y)| >\lambda|\cdot-y|^{\frac{n}{q}+1}\}|$ is the Lebesgue measure of the set under consideration. In particular, when $X:=L^p({\mathbb R}^n)$ with $p\in [1,\infty)$, the above formulae hold true for any given $q\in (0,\infty)$ with $n(\frac{1}{p}-\frac{1}{q})<1$, which when $q=p$ are exactly the recent surprising formulae of H. Brezis, J. Van Schaftingen, and P.-L. Yung, and which in other cases are new. This generalization has a wide range of applications and, particularly, enables the authors to establish new fractional Sobolev and new Gagliardo--Nirenberg inequalities in various function spaces, including Morrey spaces, mixed-norm Lebesgue spaces, variable Lebesgue spaces, weighted Lebesgue spaces, Orlicz spaces, and Orlicz-slice (generalized amalgam) spaces, and, even in all these special cases, the obtained results are new. The proofs of these results strongly depend on the Poincar\'e inequality, the extrapolation, the exact operator norm on $X'$ of the Hardy--Littlewood maximal operator, and the exquisite geometry of $\mathbb{R}^n.$


title: GenCAT: Generating Attributed Graphs with Controlled Relationships between Classes, Attributes, and Topology

abstract: Generating large synthetic attributed graphs with node labels is an important task to support various experimental studies for graph analysis methods. Existing graph generators fail to simultaneously simulate the relationships between labels, attributes, and topology which real-world graphs exhibit. Motivated by this limitation, we propose GenCAT, an attributed graph generator for controlling those relationships, which has the following advantages. (i) GenCAT generates graphs with user-specified node degrees and flexibly controls the relationship between nodes and labels by incorporating the connection proportion for each node to classes. (ii) Generated attribute values follow user-specified distributions, and users can flexibly control the correlation between the attributes and labels. (iii) Graph generation scales linearly to the number of edges. GenCAT is the first generator to support all three of these practical features. Through extensive experiments, we demonstrate that GenCAT can efficiently generate high-quality complex attributed graphs with user-controlled relationships between labels, attributes, and topology.


title: Projected State-action Balancing Weights for Offline Reinforcement Learning

abstract: Offline policy evaluation (OPE) is considered a fundamental and challenging problem in reinforcement learning (RL). This paper focuses on the value estimation of a target policy based on pre-collected data generated from a possibly different policy, under the framework of infinite-horizon Markov decision processes. Motivated by the recently developed marginal importance sampling method in RL and the covariate balancing idea in causal inference, we propose a novel estimator with approximately projected state-action balancing weights for the policy value estimation. We obtain the convergence rate of these weights and show that the proposed value estimator is semi-parametric efficient under technical conditions. In terms of asymptotics, our results scale with both the number of trajectories and the number of decision points at each trajectory. As such, consistency can still be achieved with a limited number of subjects when the number of decision points diverges. In addition, we develop a necessary and sufficient condition for establishing the well-posedness of the Bellman operator in the off-policy setting, which characterizes the difficulty of OPE and may be of independent interest. Numerical experiments demonstrate the promising performance of our proposed estimator.


title: Learning to Teach with Student Feedback

abstract: Knowledge distillation (KD) has gained much attention due to its effectiveness in compressing large-scale pre-trained models. In typical KD methods, the small student model is trained to match the soft targets generated by the big teacher model. However, the interaction between student and teacher is one-way. The teacher is usually fixed once trained, resulting in static soft targets to be distilled. This one-way interaction leads to the teacher's inability to perceive the characteristics of the student and its training progress. To address this issue, we propose Interactive Knowledge Distillation (IKD), which also allows the teacher to learn to teach from the feedback of the student. In particular, IKD trains the teacher model to generate specific soft target at each training step for a certain student. Joint optimization for both teacher and student is achieved by two iterative steps: a course step to optimize student with the soft target of teacher, and an exam step to optimize teacher with the feedback of student. IKD is a general framework that is orthogonal to most existing knowledge distillation methods. Experimental results show that IKD outperforms traditional KD methods on various NLP tasks.


title: On certain supercuspidal representations of $SL_n(F)$ associated with tamely ramified extensions: the formal degree conjecture and the root number conjecture

abstract: Based upon the general theory, developed by the author, on the parametrization of the irreducible representations of the hyper special compact groups corresponding to the regular adjoint orbit, supercuspidal representations of $SL_n(F)$ are explicitly constructed for which the formal degree conjecture and the root number conjecture are verified with respect to certain $L$-parameter defined, by means of Kaletha, that is, the local Langlands correspondence of tori and the Langlands-Schelstad procedure, by the data parametrizing the irreducible representations of the hyper special compact subgroup $SL_n(O_F)$.


title: Fault-tolerant multiqubit geometric entangling gates using photonic cat-state qubits

abstract: We propose a theoretical protocol to implement multiqubit geometric gates (i.e., the M{\o}lmer-S{\o}rensen gate) using photonic cat-state qubits. These cat-state qubits stored in high-$Q$ resonators are promising for hardware-efficient universal quantum computing. Specifically, in the limit of strong two-photon drivings, phase-flip errors of the cat-state qubits are effectively suppressed, leaving only a bit-flip error to be corrected. Because this dominant error commutes with the evolution operator, our protocol preserves the error bias, and, thus, can lower the code-capacity threshold for error correction. A geometric evolution guarantees the robustness of the protocol against stochastic noise along the evolution path. Moreover, by changing detunings of the cavity-cavity couplings at a proper time, the protocol can be robust against parameter imperfections (e.g., the total evolution time) without introducing extra noises into the system. As a result, the gate can produce multi-mode entangled cat states in a short time with high fidelities.


title: Modeling the Regional Effects of Climate Change on Future Urban Ozone Air Quality in Tehran, Iran

abstract: Quantifying the impact of climate change on future air quality is a challenging subject in air quality studies. An ANN model is employed to simulate hourly O3 concentrations. The model is developed based on hourly monitored values of temperature, solar radiation, nitrogen monoxide, and nitrogen dioxide which are monitored during summers (June, July, and August) of 2009-2012 at urban air quality stations in Tehran, Iran. Climate projections by HadCM3 GCM over the study area, driven by IPCC SRES A1B, A2, and B1 emission scenarios, are downscaled by LARS-WG5 model over the periods of 2015-2039 and 2040-2064. The projections are calculated by assuming that current emissions conditions of O3 precursors remain constant in the future. The employed O3 metrics include the number of days exceeding one-hour (1-hr) (120 ppb) and eight-hour (8-hr) (75 ppb) O3 standards and the number of days exceeding 8-hr Air Quality Index (AQI). The projected increases in solar radiation and decreases in precipitation in future summers along with summertime daily maximum temperature rise of about 1.2 and 3 celsius in the first and second climate periods respectively are some indications of more favorable conditions for O3 formation over the study area in the future. Based on pollution conditions of the violation-free summer of 2012, the summertime exceedance days of 8-hr O3 standard are projected to increase in the future by about 4.2 days in the short term and about 12.3 days in the mid-term. Similarly, based on pollution conditions of the polluted summer of 2010 with 58 O3 exceedance days, this metric is projected to increase about 4.5 days in the short term and about 14.1 days in the mid-term. Moreover, the number of Unhealthy and Very Unhealthy days in 8-hr AQI is also projected to increase based on pollution conditions of both summers.


title: CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systems

abstract: As labeling cost for different modules in task-oriented dialog (ToD) systems is high, a major challenge in practice is to learn different tasks with the least amount of labeled data. Recently, prompting methods over pre-trained language models (PLMs) have shown promising results for few-shot learning in ToD. To better utilize the power of PLMs, this paper proposes Comprehensive Instruction (CINS) that exploits PLMs with extra task-specific instructions. We design a schema (definition, constraint, prompt) of instructions and their customized realizations for three important downstream tasks in ToD, i.e. intent classification, dialog state tracking, and natural language generation. A sequence-to-sequence model (T5) is adopted to solve these three tasks in a unified framework. Extensive experiments are conducted on these ToD tasks in realistic few-shot learning scenarios with small validation data. Empirical results demonstrate that the proposed CINS approach consistently improves techniques that finetune PLMs with raw input or short prompts.


title: AI Agents in Emergency Response Applications

abstract: Emergency personnel respond to various situations ranging from fire, medical, hazardous materials, industrial accidents, to natural disasters. Situations such as natural disasters or terrorist acts require a multifaceted response of firefighters, paramedics, hazmat teams, and other agencies. Engineering AI systems that aid emergency personnel proves to be a difficult system engineering problem. Mission-critical "edge AI" situations require low-latency, reliable analytics. To further add complexity, a high degree of model accuracy is required when lives are at stake, creating a need for the deployment of highly accurate, however computationally intensive models to resource-constrained devices. To address all these issues, we propose an agent-based architecture for deployment of AI agents via 5G service-based architecture.


title: Auxetic properties of a newly proposed $\gamma$-graphyne-like material

abstract: In this work, we propose a new auxetic (negative Poisson's ratio values) structure, based on a $\gamma$-graphyne structure, here named $A\gamma G$ $structure$. Graphynes are 2D carbon allotropes with phenylic rings connected by acetylenic groups. The A$\gamma$G structural/mechanical and electronic properties, as well as its thermal stability, were investigated using classical reactive and quantum molecular dynamics simulations. We found that A$\gamma$G has a large bandgap of 2.48 eV and is thermally stable at a large range of temperatures. It presents a Young's modulus that is an order of magnitude smaller than that of graphene or $\gamma$-graphyne. The classical and quantum results are consistent and validate that the A$\gamma$G is auxetic, both when isolated (vacuum) and when deposited on a copper substrate. We believe that this is the densest auxetic structure belonging to the graphyne-like families.


title: Two Nambu-Goldstone zero modes for rotating Bose-Einstein condensates

abstract: We consider rotating finite size vortex arrays in Bose-Einstein condensates that are confined by cylindrically symmetric external potentials. We show that such systems possess two exact Nambu-Goldstone zero modes associated with two spontaneously broken continuous symmetries of the system. We verify our analytical result via direct numerical diagonalizations of the Bogoliubov-de Gennes equations. We conclude by comparing rotating vortex lattices in superfluids to supersolids and discrete time crystals.


title: Utilizing Shannon's Entropy to Create Privacy Aware Architectures

abstract: Privacy is an individual choice to determine which personal details can be collected, used and shared. Individual consent and transparency are the core tenets for earning customers trust and this motivates the organizations to adopt privacy enhancing practices while creating the systems. The goal of a privacy-aware design is to protect information in a way that does not increase an adversary's existing knowledge about an individual beyond what is permissible. This becomes critical when these data elements can be linked with the wealth of auxiliary information available outside the system to identify an individual. Privacy regulations around the world provide directives to protect individual privacy but are generally complex and vague, making their translation into actionable and technical privacy-friendly architectures challenging. In this paper, we utilize Shannon's Entropy to create an objective metric that can help simplify the state-of-the-art Privacy Design Strategies proposed in the literature and aid our key technical design decisions to create privacy aware architectures.


title: What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers

abstract: GPT-3 shows remarkable in-context learning ability of large-scale language models (LMs) trained on hundreds of billion scale data. Here we address some remaining issues less reported by the GPT-3 paper, such as a non-English LM, the performances of different sized models, and the effect of recently introduced prompt optimization on in-context learning. To achieve this, we introduce HyperCLOVA, a Korean variant of 82B GPT-3 trained on a Korean-centric corpus of 560B tokens. Enhanced by our Korean-specific tokenization, HyperCLOVA with our training configuration shows state-of-the-art in-context zero-shot and few-shot learning performances on various downstream tasks in Korean. Also, we show the performance benefits of prompt-based learning and demonstrate how it can be integrated into the prompt engineering pipeline. Then we discuss the possibility of materializing the No Code AI paradigm by providing AI prototyping capabilities to non-experts of ML by introducing HyperCLOVA studio, an interactive prompt engineering interface. Lastly, we demonstrate the potential of our methods with three successful in-house applications.


title: Numerical scheme for nonlinear optical response of metallic nanostructure: Quantum hydrodynamic theory solved by adopting effective Schr\"odinger equation

abstract: Quantum hydrodynamic theory (QHT) can describe some of the characteristic features of quantum electron dynamics that appear in metallic nanostructures, such as spatial nonlocality, electron spill-out, and quantum tunneling. Furthermore, numerical simulations based on QHT are more efficient than fully quantum mechanical approaches, as exemplified by time-dependent density functional theory using a jellium model. However, QHT involves kinetic energy functionals, the practical implementation of which typically induces significant numerical instabilities, particularly in nonlinear optical phenomena. To mitigate this problem, we develop a numerical solution to QHT that is quite stable, even in a nonlinear regime. The key to our approach is to rewrite the dynamical equation of QHT using the effective Schr\"odinger equation. We apply the new method to the linear and nonlinear responses of a metallic nanoparticle and compare the results with fully quantum mechanical calculations. The results demonstrate the numerical stability of our method, as well as the reliability and limitations of QHT.


title: Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining

abstract: Natural language relies on a finite lexicon to express an unbounded set of emerging ideas. One result of this tension is the formation of new compositions, such that existing linguistic units can be combined with emerging items into novel expressions. We develop a framework that exploits the cognitive mechanisms of chaining and multimodal knowledge to predict emergent compositional expressions through time. We present the syntactic frame extension model (SFEM) that draws on the theory of chaining and knowledge from "percept", "concept", and "language" to infer how verbs extend their frames to form new compositions with existing and novel nouns. We evaluate SFEM rigorously on the 1) modalities of knowledge and 2) categorization models of chaining, in a syntactically parsed English corpus over the past 150 years. We show that multimodal SFEM predicts newly emerged verb syntax and arguments substantially better than competing models using purely linguistic or unimodal knowledge. We find support for an exemplar view of chaining as opposed to a prototype view and reveal how the joint approach of multimodal chaining may be fundamental to the creation of literal and figurative language uses including metaphor and metonymy.


title: Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation

abstract: Pre-trained language-vision models have shown remarkable performance on the visual question answering (VQA) task. However, most pre-trained models are trained by only considering monolingual learning, especially the resource-rich language like English. Training such models for multilingual setups demand high computing resources and multilingual language-vision dataset which hinders their application in practice. To alleviate these challenges, we propose a knowledge distillation approach to extend an English language-vision model (teacher) into an equally effective multilingual and code-mixed model (student). Unlike the existing knowledge distillation methods, which only use the output from the last layer of the teacher network for distillation, our student model learns and imitates the teacher from multiple intermediate layers (language and vision encoders) with appropriately designed distillation objectives for incremental knowledge extraction. We also create the large-scale multilingual and code-mixed VQA dataset in eleven different language setups considering the multiple Indian and European languages. Experimental results and in-depth analysis show the effectiveness of the proposed VQA model over the pre-trained language-vision models on eleven diverse language setups.


title: Per Garment Capture and Synthesis for Real-time Virtual Try-on

abstract: Virtual try-on is a promising application of computer graphics and human computer interaction that can have a profound real-world impact especially during this pandemic. Existing image-based works try to synthesize a try-on image from a single image of a target garment, but it inherently limits the ability to react to possible interactions. It is difficult to reproduce the change of wrinkles caused by pose and body size change, as well as pulling and stretching of the garment by hand. In this paper, we propose an alternative per garment capture and synthesis workflow to handle such rich interactions by training the model with many systematically captured images. Our workflow is composed of two parts: garment capturing and clothed person image synthesis. We designed an actuated mannequin and an efficient capturing process that collects the detailed deformations of the target garments under diverse body sizes and poses. Furthermore, we proposed to use a custom-designed measurement garment, and we captured paired images of the measurement garment and the target garments. We then learn a mapping between the measurement garment and the target garments using deep image-to-image translation. The customer can then try on the target garments interactively during online shopping.


title: Zero-Shot Dialogue State Tracking via Cross-Task Transfer

abstract: Zero-shot transfer learning for dialogue state tracking (DST) enables us to handle a variety of task-oriented dialogue domains without the expense of collecting in-domain data. In this work, we propose to transfer the \textit{cross-task} knowledge from general question answering (QA) corpora for the zero-shot DST task. Specifically, we propose TransferQA, a transferable generative QA model that seamlessly combines extractive QA and multi-choice QA via a text-to-text transformer framework, and tracks both categorical slots and non-categorical slots in DST. In addition, we introduce two effective ways to construct unanswerable questions, namely, negative question sampling and context truncation, which enable our model to handle "none" value slots in the zero-shot DST setting. The extensive experiments show that our approaches substantially improve the existing zero-shot and few-shot results on MultiWoz. Moreover, compared to the fully trained baseline on the Schema-Guided Dialogue dataset, our approach shows better generalization ability in unseen domains.


title: Efficient Black-Box Checking via Model Checking with Strengthened Specifications

abstract: Black-box checking (BBC)} is a testing method for cyber-physical systems (CPSs) as well as software systems. BBC consists of active automata learning and model checking; a Mealy machine is learned from the system under test (SUT), and the learned Mealy machine is verified against a specification using model checking. When the Mealy machine violates the specification, the model checker returns an input witnessing the specification violation of the Mealy machine. We use it to refine the Mealy machine or conclude that the SUT violates the specification. Otherwise, we conduct equivalence testing to find an input witnessing the difference between the Mealy machine and the SUT. In the BBC for CPSs, equivalence testing tends to be time-consuming due to the time for the system execution. In this paper, we enhance the BBC utilizing model checking with strengthened specifications. By model checking with a strengthened specification, we have more chance to obtain an input witnessing the specification violation than model checking with the original specification. The refinement of the Mealy machine with such an input tends to reduce the number of equivalence testing, which improves the efficiency. We conducted experiments with an automotive benchmark. Our experiment results demonstrate the merit of our method.


title: Principal component analysis for high-dimensional compositional data

abstract: Dimension reduction for high-dimensional compositional data plays an important role in many fields, where the principal component analysis of the basis covariance matrix is of scientific interest. In practice, however, the basis variables are latent and rarely observed, and standard techniques of principal component analysis are inadequate for compositional data because of the simplex constraint. To address the challenging problem, we relate the principal subspace of the centered log-ratio compositional covariance to that of the basis covariance, and prove that the latter is approximately identifiable with the diverging dimensionality under some subspace sparsity assumption. The interesting blessing-of-dimensionality phenomenon enables us to propose the principal subspace estimation methods by using the sample centered log-ratio covariance. We also derive nonasymptotic error bounds for the subspace estimators, which exhibits a tradeoff between identification and estimation. Moreover, we develop efficient proximal alternating direction method of multipliers algorithms to solve the nonconvex and nonsmooth optimization problems. Simulation results demonstrate that the proposed methods perform as well as the oracle methods with known basis. Their usefulness is illustrated through an analysis of word usage pattern for statisticians.


title: Speech Enhancement by Noise Self-Supervised Rank-Constrained Spatial Covariance Matrix Estimation via Independent Deeply Learned Matrix Analysis

abstract: Rank-constrained spatial covariance matrix estimation (RCSCME) is a method for the situation that the directional target speech and the diffuse noise are mixed. In conventional RCSCME, independent low-rank matrix analysis (ILRMA) is used as the preprocessing method. We propose RCSCME using independent deeply learned matrix analysis (IDLMA), which is a supervised extension of ILRMA. In this method, IDLMA requires deep neural networks (DNNs) to separate the target speech and the noise. We use Denoiser, which is a single-channel speech enhancement DNN, in IDLMA to estimate not only the target speech but also the noise. We also propose noise self-supervised RCSCME, in which we estimate the noise-only time intervals using the output of Denoiser and design the prior distribution of the noise spatial covariance matrix for RCSCME. We confirm that the proposed methods outperform the conventional methods under several noise conditions.


title: Effects of CPT-odd terms of dimensions three and five on electromagnetic propagation in continuous matter

abstract: In this work we study how CPT-odd Maxwell-Carroll-Field-Jackiw (MCFJ) electrodynamics as well as a dimension-5 extension of it affect the optical activity of continuous media. The starting point is dimension-3 MCFJ electrodynamics in matter whose modified Maxwell equations, permittivity tensor, and dispersion relations are recapitulated. Corresponding refractive indices are achieved in terms of the frequency and the vector-valued background field. For a purely timelike background, the refractive indices are real. Their associated propagation modes are circularly polarized and exhibit birefringence. For a purely spacelike background, one refractive index is always real and the other can be complex. The circularly polarized propagating modes may exhibit birefringence and dichroism (associated with absorption). Subsequently, we examine a dimension-five MCFJ-type electrodynamics, previously scrutinized in the literature, in a continuous medium. Following the same procedure, we find the refractive indices from a sixth-order dispersion equation. For a purely timelike background, three distinct refractive indices are obtained, one of them being real and two being complex. They are associated with two circularly polarized propagating modes that exhibit birefringence or dichroism, depending on the frequency range. Scenarios of propagation and absorption analogous to those found in dispersive dielectrics are also observed for spacelike background configurations. We conclude by comparing the dimension-three and five results and by emphasizing the richer phenomenology of the propagating modes in the higher-derivative model. Our results are applicable in the realm of Weyl semimetals.


title: Dynamic Collective Intelligence Learning: Finding Efficient Sparse Model via Refined Gradients for Pruned Weights

abstract: With the growth of deep neural networks (DNN), the number of DNN parameters has drastically increased. This makes DNN models hard to be deployed on resource-limited embedded systems. To alleviate this problem, dynamic pruning methods have emerged, which try to find diverse sparsity patterns during training by utilizing Straight-Through-Estimator (STE) to approximate gradients of pruned weights. STE can help the pruned weights revive in the process of finding dynamic sparsity patterns. However, using these coarse gradients causes training instability and performance degradation owing to the unreliable gradient signal of the STE approximation. In this work, to tackle this issue, we introduce refined gradients to update the pruned weights by forming dual forwarding paths from two sets (pruned and unpruned) of weights. We propose a novel Dynamic Collective Intelligence Learning (DCIL) which makes use of the learning synergy between the collective intelligence of both weight sets. We verify the usefulness of the refined gradients by showing enhancements in the training stability and the model performance on the CIFAR and ImageNet datasets. DCIL outperforms various previously proposed pruning schemes including other dynamic pruning methods with enhanced stability during training.


title: Sixteen Years of Phishing User Studies: What Have We Learned?

abstract: Several previous studies have investigated user susceptibility to phishing attacks. A thorough meta-analysis or systematic review is required to gain a better understanding of these findings and to assess the strength of evidence for phishing susceptibility of a subpopulation, e.g., older users. We aim to determine whether an effect exists; another aim is to determine whether the effect is positive or negative and to obtain a single summary estimate of the effect. OBJECTIVES: We systematically review the results of previous user studies on phishing susceptibility and conduct a meta-analysis. METHOD: We searched four online databases for English studies on phishing. We included all user studies in phishing detection and prevention, whether they proposed new training techniques or analyzed users' vulnerability. FINDINGS: A careful analysis reveals some discrepancies between the findings. More than half of the studies that analyzed the effect of age reported no statistically significant relationship between age and users' performance. Some studies reported older people performed better while some reported the opposite. A similar finding holds for the gender difference. The meta-analysis shows: 1) a significant relationship between participants' age and their susceptibility 2) females are more susceptible than males 3) users training significantly improves their detection ability


title: Evidence of preferential sweeping during snow settling in atmospheric turbulence

abstract: We present a field study of snow settling dynamics based on simultaneous measurements of the atmospheric flow field and snow particle trajectories. Specifically, a super-large-scale particle image velocimetry (SLPIV) system using natural snow particles as tracers is deployed to quantify the velocity field and identify vortex structures in a 22 m $\times$ 39 m field of view centered 18 m above the ground. Simultaneously, we track individual snow particles in a 3 m $\times$ 5 m sample area within the SLPIV using particle tracking velocimetry (PTV). The results reveal the direct linkage among vortex structures in atmospheric turbulence, the spatial distribution of snow particle concentration, and their settling dynamics. In particular, with snow turbulence interaction at near-critical Stokes number, the settling velocity enhancement of snow particles is multifold, and larger than what has been observed in previous field studies. SLPIV measurements show higher concentration of snow particles preferentially located on the downward side of the vortices identified in the atmospheric flow field. PTV, performed on high resolution images around the reconstructed vortices, confirms the latter trend and provides statistical evidence of the acceleration of snow particles, as they move toward the downward side of vortices. Overall, the simultaneous multi-scale particle imaging presented here enables us to directly quantify the salient features of preferential sweeping, supporting it as an underlying mechanism of snow settling enhancement in the atmospheric surface layer.


title: Metasurface Enhanced Spatial Mode Decomposition

abstract: Acquiring precise information about the mode content of a laser is critical for multiplexed optical communications, optical imaging with active wave-front control, and quantum-limited interferometric measurements. Hologram-based mode decomposition devices, such as spatial light modulators, allow a fast, direct measurement of the mode content, but they have limited precision due to cross-coupling between modes. Here we report the first proof-of-principle demonstration of mode decomposition with a metasurface, resulting in significantly enhanced precision. A mode-weight fluctuation of $6\times 10^{-7}$ was be measured with 1 second of averaging at a Fourier frequency of 80 Hz, an improvement of more than three orders of magnitude compared to the state-of-the-art spatial light modulator decomposition. The improvement is attributable to the reduction in cross-coupling enabled by the exceptional small pixel size of the metasurface. We show a systematic study of the limiting sources of noise, and we show that there is a promising path towards complete mode decomposition with similar precision.


title: On the asymptotic behavior of the colored Jones polynomial of the figure-eight knot associated with a real number

abstract: We study the asymptotic behavior of the $N$-dimensional colored Jones polynomial evaluated at $\exp(\xi/N)$ for a real number $\xi$ greater than a certain constant. We prove that, from the asymptotic behavior, we can extract the $\rm{SL}(2;\mathbb{C})$ Chern--Simons invariant and the Reidemeister torsion twisted by the adjoint action both associated with a representation determined by $\xi$.


title: High-precision star formation efficiency measurements in nearby clouds

abstract: On average molecular clouds convert only a small fraction epsilon_ff of their mass into stars per free-fall time, but differing star formation theories make contrasting claims for how this low mean efficiency is achieved. To test these theories, we need precise measurements of both the mean value and the scatter of epsilon_ff, but high-precision measurements have been difficult because they require determining cloud volume densities, from which we can calculate free-fall times. Until recently, most density estimates assume clouds as uniform spheres, while their real structures are often filamentary and highly non-uniform, yielding systematic errors in epsilon_ff estimates and smearing real cloud-to-cloud variations. We recently developed a theoretical model to reduce this error by using column density distributions in clouds to produce more accurate volume density estimates. In this letter, we apply this model to recent observations of 12 nearby molecular clouds. Compared to earlier analyses, our method reduces the typical dispersion of epsilon_ff within individual clouds from 0.35 dex to 0.31 dex, and decreases the median value of epsilon_ff over all clouds from ~ 0.02 to ~ 0.01. However, we find no significant change in the ~ 0.2 dex cloud-to-cloud dispersion of epsilon_ff, suggesting the measured dispersions reflect real structural differences between clouds.


title: Euphemistic Phrase Detection by Masked Language Model

abstract: It is a well-known approach for fringe groups and organizations to use euphemisms -- ordinary-sounding and innocent-looking words with a secret meaning -- to conceal what they are discussing. For instance, drug dealers often use "pot" for marijuana and "avocado" for heroin. From a social media content moderation perspective, though recent advances in NLP have enabled the automatic detection of such single-word euphemisms, no existing work is capable of automatically detecting multi-word euphemisms, such as "blue dream" (marijuana) and "black tar" (heroin). Our paper tackles the problem of euphemistic phrase detection without human effort for the first time, as far as we are aware. We first perform phrase mining on a raw text corpus (e.g., social media posts) to extract quality phrases. Then, we utilize word embedding similarities to select a set of euphemistic phrase candidates. Finally, we rank those candidates by a masked language model -- SpanBERT. Compared to strong baselines, we report 20-50% higher detection accuracies using our algorithm for detecting euphemistic phrases.


title: A structure preserving numerical scheme for Fokker-Planck equations of structured neural networks with learning rules

abstract: In this work, we are concerned with a Fokker-Planck equation related to the nonlinear noisy leaky integrate-and-fire model for biological neural networks which are structured by the synaptic weights and equipped with the Hebbian learning rule. The equation contains a small parameter $\varepsilon$ separating the time scales of learning and reacting behavior of the neural system, and an asymptotic limit model can be derived by letting $\varepsilon\to 0$, where the microscopic quasi-static states and the macroscopic evolution equation are coupled through the total firing rate. To handle the endowed flux-shift structure and the multi-scale dynamics in a unified framework, we propose a numerical scheme for this equation that is mass conservative, unconditionally positivity preserving, and asymptotic preserving. We provide extensive numerical tests to verify the schemes' properties and carry out a set of numerical experiments to investigate the model's learning ability, and explore the solution's behavior when the neural network is excitatory.


title: Streamlined quantum computing with macronode cluster states

abstract: Continuous-variable cluster states allow for fault-tolerant measurement-based quantum computing when used in tandem with the Gottesman-Kitaev-Preskill (GKP) encoding of a qubit into a bosonic mode. For quad-rail-lattice macronode cluster states, whose construction is defined by a fixed, low-depth beam splitter network, we show that a Clifford gate and GKP error correction can be simultaneously implemented in a single teleportation step. We give explicit recipes to realize the Clifford generating set, and we calculate the logical gate-error rates given finite squeezing in the cluster-state and GKP resources. We find that logical error rates of $10^{-2}$-$10^{-3}$, compatible with the thresholds of topological codes, can be achieved with squeezing of 11.9-13.7 dB. The protocol presented eliminates noise present in prior schemes and puts the required squeezing for fault tolerance in the range of current state-of-the-art optical experiments. Finally, we show how to produce distillable GKP magic states directly within the cluster state.


title: Kohn-Luttinger Superconductivity and Inter-Valley Coherence in Rhombohedral Trilayer Graphene

abstract: Motivated by recent experiments on ABC-stacked rhombohedral trilayer graphene (RTG) which observed spin-valley symmetry-breaking and superconductivity, we study instabilities of the RTG metallic state to symmetry breaking orders. We find that interactions select the inter-valley coherent order (IVC) as the preferred ordering channel over a wide range, whose theoretically determined phase boundaries agree well with experiments on both the hole and electron doped sides. The Fermi surfaces near van Hove singularities admit partial nesting between valleys, which promotes both inter-valley superconductivity and IVC fluctuations. We investigate the interplay between these fluctuations and the Hunds (intervalley spin) interaction using a renormalization group approach. For antiferromagnetic Hund's coupling, intervalley pairing appears in the spin-singlet channel with enhanced $T_c$, that scales with the dimensionless coupling $g$ as $T_c\sim\exp(-1/\sqrt{g})$ , compared to the standard $\exp(-1/g)$ scaling. In its simplest form, this scenario assumes a sign change in the Hund's coupling on increasing hole doping. On the other hand, the calculation incorporates breaking of the independent spin rotations between valleys from the start, and strongly selects spin singlet over spin triplet pairing, and naturally occurs in proximity to the IVC, consistent with observations.


title: Topological superfluids in two-dimensional Fermi gas with Rashba spin-orbit coupling

abstract: The realization of spin-orbit coupling (SOC) in ultracold atoms has triggered an intensive exploring of topological superfluids in the degenerate Fermi gases based on mean-field theory, which has not yet been reported in experiments. Here, we demonstrate the topological phase transitions in the system via the numerically exact quantum Monte Carlo method. Without prior assumptions, our unbiased real-space calculation shows that spin-orbit coupling can stabilize an unconventional pairing in the weak SOC regime, in which the Fulde-Ferrell-Larkin-Ovchinnikov pairing coexists with the Bardeen-Cooper-Schrieffer pairing. Furthermore, we use the jumps in the spin polarization at the time-reversal invariant momenta to qualify the topological phase transition, where we find the critical exponent deviated from the mean-field theory. Our results pave the way for the searching of unconventional pairing and topological superfluids with degenerate Fermi gases.


title: Interaction Models and Generalized Score Matching for Compositional Data

abstract: Applications such as the analysis of microbiome data have led to renewed interest in statistical methods for compositional data, i.e., multivariate data in the form of probability vectors that contain relative proportions. In particular, there is considerable interest in modeling interactions among such relative proportions. To this end we propose a class of exponential family models that accommodate general patterns of pairwise interaction while being supported on the probability simplex. Special cases include the family of Dirichlet distributions as well as Aitchison's additive logistic normal distributions. Generally, the distributions we consider have a density that features a difficult to compute normalizing constant. To circumvent this issue, we design effective estimation methods based on generalized versions of score matching. A high-dimensional analysis of our estimation methods shows that the simplex domain is handled as efficiently as previously studied full-dimensional domains.


title: Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model

abstract: The transformer-based pre-trained language models have been tremendously successful in most of the conventional NLP tasks. But they often struggle in those tasks where numerical understanding is required. Some possible reasons can be the tokenizers and pre-training objectives which are not specifically designed to learn and preserve numeracy. Here we investigate the ability of text-to-text transfer learning model (T5), which has outperformed its predecessors in the conventional NLP tasks, to learn numeracy. We consider four numeracy tasks: numeration, magnitude order prediction, finding minimum and maximum in a series, and sorting. We find that, although T5 models perform reasonably well in the interpolation setting, they struggle considerably in the extrapolation setting across all four tasks.


title: DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualization

abstract: Identifying relevant knowledge to be used in conversational systems that are grounded in long documents is critical to effective response generation. We introduce a knowledge identification model that leverages the document structure to provide dialogue-contextualized passage encodings and better locate knowledge relevant to the conversation. An auxiliary loss captures the history of dialogue-document connections. We demonstrate the effectiveness of our model on two document-grounded conversational datasets and provide analyses showing generalization to unseen documents and long dialogue contexts.


title: Follow the Gradient: Crossing the Reality Gap using Differentiable Physics (RealityGrad)

abstract: We propose a novel iterative approach for crossing the reality gap that utilises live robot rollouts and differentiable physics. Our method, RealityGrad, demonstrates for the first time, an efficient sim2real transfer in combination with a real2sim model optimisation for closing the reality gap. Differentiable physics has become an alluring alternative to classical rigid-body simulation due to the current culmination of automatic differentiation libraries, compute and non-linear optimisation libraries. Our method builds on this progress and employs differentiable physics for efficient trajectory optimisation. We demonstrate RealitGrad on a dynamic control task for a serial link robot manipulator and present results that show its efficiency and ability to quickly improve not just the robot's performance in real world tasks but also enhance the simulation model for future tasks. One iteration of RealityGrad takes less than 22 minutes on a desktop computer while reducing the error by 2/3, making it efficient compared to other sim2real methods in both compute and time. Our methodology and application of differentiable physics establishes a promising approach for crossing the reality gap and has great potential for scaling to complex environments.


title: Spectral flow inside essential spectrum III: coupling resonances near essential spectrum

abstract: Given a self-adjoint operator $H_0$ and a relatively $H_0$-compact self-adjoint operator $V,$ the functions $r_j(z) = - \sigma_j^{-1}(z),$ where $\sigma_j(z)$ are eigenvalues of the compact operator $(H_0-z)^{-1}V,$ bear a lot of important information about the pair $H_0$ and $V.$ We call them coupling resonances. In case of rank one (and positive) perturbation $V,$ there is only one coupling resonance function, which is a Herglotz function. This case has been studied in depth in the literature, and appears in different situations, such as Sturm-Liouville theory, random Schr\"odinger operators, harnomic and spectral analyses, etc. The general case is complicated by the fact that the resonance functions are no longer single valued holomorphic functions, and potentially can have quite an erratic behaviour, typical for infinitely-valued holomorphic functions. Of special interest are those coupling resonance functions $r_z$ which approach a real number $r_{\lambda+i0}$ from the interval $[0,1]$ as the spectral parameter $z=\lambda+iy$ approaches a point $\lambda$ of the essential spectrum, since they are responsible for spectral flow through $\lambda$ inside essential spectrum when $H_0$ gets deformed to $H_1 = H_0+V$ via the path $H_0 + rV, r \in [0,1].$ In this paper it is shown that if the pair $H_0,$ $V$ satisfies the limiting absorption principle, then the coupling resonance functions are well-behaved near the essential spectrum in the following sense. Let $I$ be an open interval inside the essential spectrum of $H_0$ and $\epsilon>0.$ Then there exists a compact subset~$K$ of~$I$ such that $| I \setminus K | < \epsilon,$ and $K$ has a "non-tangential" neighbourhood in the upper complex half-plane, such that any coupling resonance function is either single-valued in the neighbourhood, or does not take a real value in the interval $[0,1].$


title: On Meshfree Collocation to Compute the Probability of Default under a Regime-Switching Synchronous-Jump Tempered Stable L\'{e}vy Model

abstract: In the paper [Hainaut, D. and Colwell, D.B., {\rm A structural model for credit risk with switching processes and synchronous jumps}, The European Journal of Finance 22(11) (2016): 1040-1062], the authors exploit a synchronous-jump regime-switching model to compute the default probability of a publicly traded company. Here, we first generalize the proposed L\'{e}vy model to more general setting of tempered stable processes recently introduced into the finance literature. Based on the singularity of the resulting partial integro-differential operator, we propose a general framework based on strictly positive-definite functions to de-singularize the operator. We then analyze an efficient meshfree collocation method based on radial basis functions to approximate the solution of the corresponding system of partial integro-differential equations arising from the structural credit risk model. We show that under some regularity assumptions, our proposed method naturally de-sinularizes the problem in the tempered stable case. Numerical results of applying the method on some standard examples from the literature confirms the accuracy of our theoretical results and numerical algorithm.


title: Optimizing Space Utilization for More Effective Multi-Robot Path Planning

abstract: We perform a systematic exploration of the principle of Space Utilization Optimization (SUO) as a heuristic for planning better individual paths in a decoupled multi-robot path planner, with applications to both one-shot and life-long multi-robot path planning problems. We show that the decentralized heuristic set, SU-I, preserves single path optimality and significantly reduces congestion that naturally happens when many paths are planned without coordination. Integration of SU-I into complete planners brings dramatic reductions in computation time due to the significantly reduced number of conflicts and leads to sizable solution optimality gains in diverse evaluation scenarios with medium and large maps, for both one-shot and life-long problem settings.


title: Decoding the Morphological Evolution of Open Clusters

abstract: Base on Gaia Second Data Release and the combination of nonparametric bivariate density estimation with the least square ellipse fitting, we derive the shape parameters of the sample clusters. By analyzing the dislocation of the sample clusters, the dislocation $d$ is related to the X-axis pointing toward the Galactic center, Y-axis pointing in the direction of Galactic rotation, and the Z-axis (log(|H|/pc)) that is positive toward the Galactic north pole. This finding underlines the important role of the dislocation of clusters in tracking the external environment of the Milky Way. The orientation ($q_{pm}$) of the clusters with $e_{pm}$ $\geq$ 0.4 presents an aggregate distribution in the range of -45$\degr$ to 45$\degr$, about 74\% of them. This probably suggests that these clusters tend to deform heavily in the direction of the Galactic plane. NGC 752 is in a slight stage of expansion in the two-dimensional space and will deform itself morphology along the direction perpendicular to the original stretching direction in the future if no other events occur. The relative degree of deformation of the sample clusters in the short-axis direction decreases as their ages increase. On average, the severely distorted sample clusters in each group account for about 26\% $\pm$ 9\%. This possibly implies a uniform external environment in the range of $|$H$|$ $\leq$ 300 pc if the sample completeness of each group is not taken into account.


title: The positive and negative deficiency indices of formally self-adjoint difference equations

abstract: This paper is concerned with formally self-adjoint difference equations and their positive and negative deficiency indices. It is shown that the order of any formally self-adjoint difference equation is even, and some characterizations of formally self-adjoint difference equations are established. Further, we show that the positive and negative deficiency indices are always equal, which implies the existence of the self-adjoint extensions of the minimal linear relations generated by the difference equations. This is an important and essential difference between formally self-adjoint difference equations and their corresponding differential equations in the spectral theory.


title: On stability and instability of standing waves for 2d-nonlinear Schr\"odinger equations with point interaction

abstract: We study existence and stability properties of ground-state standing waves for two-dimensional nonlinear Schr\"odinger equation with a point interaction and a focusing power nonlinearity. The Schr\"odinger operator with a point interaction describes a one-parameter family of self-adjoint realizations of the Laplacian with delta-like perturbation. The perturbed Laplace operator always has a unique simple negative eigenvalue. We prove that if the frequency of the standing wave is close to the negative eigenvalue, it is stable. Moreover, if the frequency is sufficiently large, we have the stability in the $L^2$-subcritical or critical case, while the instability in the $L^2$-supercritical case.


title: Jammkle: Fibre jamming 3D printed multi-material tendons and their application in a robotic ankle

abstract: Fibre jamming is a relatively new and understudied soft robotic mechanism that has previously found success when used in stiffness-tuneable arms and fingers. However, to date researchers have not fully taken advantage of the freedom offered by contemporary fabrication techniques including multi-material 3D printing in the creation of fibre jamming structures. In this research, we present a novel, modular, multi-material, 3D printed, fibre jamming tendon unit for use in a stiffness-tuneable compliant robotic ankle, or Jammkle. We describe the design and fabrication of the Jammkle and highlight its advantages compared to examples from modern literature. We develop a multiphysics model of the tendon unit, showing good agreement with experimental data. Finally, we demonstrate a practical application by integrating multiple tendon units into a robotic ankle and perform extensive testing and characterisation. We show that the Jammkle outperforms comparative leg structures in terms of compliance, damping, and slip prevention.


title: Aristotelian poetry

abstract: Jing Zhang proved the consistency of $\binom{\omega_2}{\omega_1}\rightarrow\binom{n}{\omega_1}_\omega$ for every $n\in\omega$ with the negative relation $\binom{\omega_2}{\omega_1}\nrightarrow\binom{\omega}{\omega_1}_\omega$. We reduce the consistency strength of this statement to an $\omega_1$-Erdos cardinal.


title: PIP: Physical Interaction Prediction via Mental Simulation with Span Selection

abstract: Accurate prediction of physical interaction outcomes is a crucial component of human intelligence and is important for safe and efficient deployments of robots in the real world. While there are existing vision-based intuitive physics models that learn to predict physical interaction outcomes, they mostly focus on generating short sequences of future frames based on physical properties (e.g. mass, friction and velocity) extracted from visual inputs or a latent space. However, there is a lack of intuitive physics models that are tested on long physical interaction sequences with multiple interactions among different objects. We hypothesize that selective temporal attention during approximate mental simulations helps humans in physical interaction outcome prediction. With these motivations, we propose a novel scheme: Physical Interaction Prediction via Mental Simulation with Span Selection (PIP). It utilizes a deep generative model to model approximate mental simulations by generating future frames of physical interactions before employing selective temporal attention in the form of span selection for predicting physical interaction outcomes. To evaluate our model, we further propose the large-scale SPACE+ dataset of synthetic videos with long sequences of three prime physical interactions in a 3D environment. Our experiments show that PIP outperforms human, baseline, and related intuitive physics models that utilize mental simulation. Furthermore, PIP's span selection module effectively identifies the frames indicating key physical interactions among objects, allowing for added interpretability.


title: Enhancing Unsupervised Anomaly Detection with Score-Guided Network

abstract: Anomaly detection plays a crucial role in various real-world applications, including healthcare and finance systems. Owing to the limited number of anomaly labels in these complex systems, unsupervised anomaly detection methods have attracted great attention in recent years. Two major challenges faced by the existing unsupervised methods are: (i) distinguishing between normal and abnormal data in the transition field, where normal and abnormal data are highly mixed together; (ii) defining an effective metric to maximize the gap between normal and abnormal data in a hypothesis space, which is built by a representation learner. To that end, this work proposes a novel scoring network with a score-guided regularization to learn and enlarge the anomaly score disparities between normal and abnormal data. With such score-guided strategy, the representation learner can gradually learn more informative representation during the model training stage, especially for the samples in the transition field. We next propose a score-guided autoencoder (SG-AE), incorporating the scoring network into an autoencoder framework for anomaly detection, as well as other three state-of-the-art models, to further demonstrate the effectiveness and transferability of the design. Extensive experiments on both synthetic and real-world datasets demonstrate the state-of-the-art performance of these score-guided models (SGMs).


title: Residual 3D Scene Flow Learning with Context-Aware Feature Extraction

abstract: Scene flow estimation is the task to predict the point-wise or pixel-wise 3D displacement vector between two consecutive frames of point clouds or images, which has important application in fields such as service robots and autonomous driving. Although many previous works have explored greatly on scene flow estimation based on point clouds, there are two problems that have not been noticed or well solved before: 1) Points of adjacent frames in repetitive patterns may be wrongly associated due to similar spatial structure in their neighbourhoods; 2) Scene flow between adjacent frames of point clouds with long-distance movement may be inaccurately estimated. To solve the first problem, a novel context-aware set convolution layer is proposed in this paper to exploit contextual structure information of Euclidean space and learn soft aggregation weights for local point features. This design is inspired by human perception of contextual structure information during scene understanding with repetitive patterns. The context-aware set convolution layer is incorporated in a context-aware point feature pyramid module of 3D point clouds for scene flow estimation. For the second problem, an explicit residual flow learning structure is proposed in the residual flow refinement layer to cope with long-distance movement. The experiments and ablation study on FlyingThings3D and KITTI scene flow datasets demonstrate the effectiveness of each proposed component. The qualitative results show that the problems of ambiguous inter-frame association and long-distance movement estimation are well handled. Quantitative results on both FlyingThings3D and KITTI scene flow datasets show that the proposed method achieves state-of-the-art performance, surpassing all other previous works to the best of our knowledge by at least 25%.


title: DIRECT: A Differential Dynamic Programming Based Framework for Trajectory Generation

abstract: This paper introduces a differential dynamic programming (DDP) based framework for polynomial trajectory generation for differentially flat systems. In particular, instead of using a linear equation with increasing size to represent multiple polynomial segments as in literature, we take a new perspective from state-space representation such that the linear equation reduces to a finite horizon control system with a fixed state dimension and the required continuity conditions for consecutive polynomials are automatically satisfied. Consequently, the constrained trajectory generation problem (both with and without time optimization) can be converted to a discrete-time finite-horizon optimal control problem with inequality constraints, which can be approached by a recently developed interior-point DDP (IPDDP) algorithm. Furthermore, for unconstrained trajectory generation with preallocated time, we show that this problem is indeed a linear-quadratic tracking (LQT) problem (DDP algorithm with exact one iteration). All these algorithms enjoy linear complexity with respect to the number of segments. Both numerical comparisons with state-of-the-art methods and physical experiments are presented to verify and validate the effectiveness of our theoretical findings. The implementation code will be open-sourced,


title: CLINS: Continuous-Time Trajectory Estimation for LiDAR-Inertial System

abstract: In this paper, we propose a highly accurate continuous-time trajectory estimation framework dedicated to SLAM (Simultaneous Localization and Mapping) applications, which enables fuse high-frequency and asynchronous sensor data effectively. We apply the proposed framework in a 3D LiDAR-inertial system for evaluations. The proposed method adopts a non-rigid registration method for continuous-time trajectory estimation and simultaneously removing the motion distortion in LiDAR scans. Additionally, we propose a two-state continuous-time trajectory correction method to efficiently and efficiently tackle the computationally-intractable global optimization problem when loop closure happens. We examine the accuracy of the proposed approach on several publicly available datasets and the data we collected. The experimental results indicate that the proposed method outperforms the discrete-time methods regarding accuracy especially when aggressive motion occurs. Furthermore, we open source our code at \url{https://github.com/APRIL-ZJU/clins} to benefit research community.


title: Limits of Lateral Expansion in Two-Dimensional Materials with Line Defects

abstract: The flexibility of two-dimensional (2D) materials enables static and dynamic ripples that are known to cause lateral contraction, shrinking of the material boundary. However, the limits of 2D materials' \emph{lateral expansion} are unknown. Therefore, here we discuss the limits of intrinsic lateral expansion of 2D materials that are modified by compressive line defects. Using thin sheet elasticity theory and sequential multiscale modeling, we find that the lateral expansion is inevitably limited by the onset of rippling. The maximum lateral expansion $\chi_{max}\approx 2.1\cdot t^2\sigma_d$, governed by the elastic thickness $t$ and the defect density $\sigma_d$, remains typically well below one percent. In addition to providing insight to the limits of 2D materials' mechanical limits and applications, the results highlight the potential of line defects in strain engineering, since for graphene they suggest giant pseudomagnetic fields that can exceed $1000$~T.


title: Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation Learning

abstract: Motivated by suggested question generation in conversational news recommendation systems, we propose a model for generating question-answer pairs (QA pairs) with self-contained, summary-centric questions and length-constrained, article-summarizing answers. We begin by collecting a new dataset of news articles with questions as titles and pairing them with summaries of varying length. This dataset is used to learn a QA pair generation model producing summaries as answers that balance brevity with sufficiency jointly with their corresponding questions. We then reinforce the QA pair generation process with a differentiable reward function to mitigate exposure bias, a common problem in natural language generation. Both automatic metrics and human evaluation demonstrate these QA pairs successfully capture the central gists of the articles and achieve high answer accuracy.


title: Parameter calibration with Consensus-based Optimization for interaction dynamics driven by neural networks

abstract: We calibrate parameters of neural networks that model forces in interaction dynamics with the help of the Consensus-based global optimization method (CBO). We state the general framework of interaction particle systems driven by neural networks and test the proposed method with a real dataset from the ESIMAS traffic experiment. The resulting forces are compared to well-known physical interaction forces. Moreover, we compare the performance of the proposed calibration process to the one in [4] which uses a stochastic gradient descent algorithm.


title: Comment on Scattering of electromagnetic plane wave by an impedance strip embedded in homogeneous isotropic chiral medium

abstract: The goal of this paper is to present a previously published work [1] in an errorless form. The work has studied the scattering of electromagnetic plane wave by an impedance strip placed in homogeneous isotropic chiral medium using Kobayashi Potential (KP) method; that has been an important, valuable and attractive investigation in the electromagnetic scattering, especially in KP method. Unfortunately, the study has some basic errors that prevent interesting readers from understanding the investigation. Finally, the formulation of this paper is validated by [2].


title: Analysis of Heterogeneous Structures of Non-separated Scales on Curved Bridge Nodes

abstract: Numerically predicting the performance of heterogenous structures without scale separation represents a significant challenge to meet the critical requirements on computational scalability and efficiency -- adopting a mesh fine enough to fully account for the small-scale heterogeneities leads to prohibitive computational costs while simply ignoring these fine heterogeneities tends to drastically over-stiffen the structure's rigidity. This study proposes an approach to construct new material-aware shape (basis) functions per element on a coarse discretization of the structure with respect to each curved bridge nodes (CBNs) defined along the elements' boundaries. Instead of formulating their derivation by solving a nonlinear optimization problem, the shape functions are constructed by building a map from the CBNs to the interior nodes and are ultimately presented in an explicit matrix form as a product of a B\'ezier interpolation transformation and a boundary-interior transformation. The CBN shape function accomodates more flexibility in closely capturing the coarse element's heterogeneity, overcomes the important and challenging issues of inter-element stiffness and displacement discontinuity across interface between coarse elements, and improves the analysis accuracy by orders of magnitude; they also meet the basic geometric properties of shape functions that avoid aphysical analysis results. Extensive numerical examples, including a 3D industrial example of billions of degrees of freedom, are also tested to demonstrate the approach's performance in comparison with results obtained from classical approaches.


title: Work statistics in non-Hermitian evolutions with Hermitian endpoints

abstract: Non-Hermitian systems with specific forms of Hamiltonians can exhibit novel phenomena. However, it is difficult to study their quantum thermodynamical properties. In particular, the calculation of work statistics can be challenging in non-Hermitian systems due to the change of state norm. To tackle this problem, we modify the two-point measurement method in Hermitian systems. The modified method can be applied to non-Hermitian systems which are Hermitian before and after the evolution. In Hermitian systems, our method is equivalent to the two-point measurement method. When the system is non-Hermitian, our results represent a projection of the statistics in a larger Hermitian system. As an example, we calculate the work statistics in a non-Hermitian Su-Schrieffer-Heeger model. Our results reveal several differences between the work statistics in non-Hermitian systems and the one in Hermitian systems.


title: Majorana-like oscillation for edge states in one-dimensional topological chain with dissipative couplings

abstract: The oscillation of Majorana modes with near zero energy plays a very important role for ascertaining Majorana fermions. The edge states, which also have almost-zero-energy in one-dimensional Su-Schrieffer-Heeger chain (SSHc), have been extensively studied for their topologically protected properties when the on-sites have dissipations induced by independent environments. We here show that common environments shared by each pair of the nearest neighbour sites in the SSHc can result in dissipative couplings between sites, and thus change topologically trivial phase to nontrivial one. The Majorana-like oscillation for the finite-size hybridizations of two non-Hermitian edge states with complex localization lengths can be induced by the dissipative coupling. The controllable topology parameter of the SSHc plays the role of the magnetic field in the nanowire for controlling Majorana oscillation. The measurement for the oscillation is proposed. Our study provides a new way to manipulate edge states and is experimentally feasible within current technology of superconducting quantum circuits.


title: Quadratic Quantum Speedup for Perceptron Training

abstract: Perceptrons, which perform binary classification, are the fundamental building blocks of neural networks. Given a data set of size~$N$ and margin~$\gamma$ (how well the given data are separated), the query complexity of the best-known quantum training algorithm scales as either $(\nicefrac{\sqrt{N}}{\gamma^2})\log(\nicefrac1{\gamma^2)}$ or $\nicefrac{N}{\sqrt{\gamma}}$, which is achieved by a hybrid of classical and quantum search. In this paper, we improve the version space quantum training method for perceptrons such that the query complexity of our algorithm scales as $\sqrt{\nicefrac{N}{\gamma}}$. This is achieved by constructing an oracle for the perceptrons using quantum counting of the number of data elements that are correctly classified. We show that query complexity to construct such an oracle has a quadratic improvement over classical methods. Once such an oracle is constructed, bounded-error quantum search can be used to search over the hyperplane instances. The optimality of our algorithm is proven by reducing the evaluation of a two-level AND-OR tree (for which the query complexity lower bound is known) to a multi-criterion search. Our quantum training algorithm can be generalized to train more complex machine learning models such as neural networks, which are built on a large number of perceptrons.


title: Kinematic footprint of the Milky Way spiral arms in Gaia EDR3

abstract: The Milky Way spiral arms are well established from star counts as well as from the locus of molecular clouds and other young objects, however, they have only recently started to be observed from a kinematics point of view. Using the kinematics of thin disc stars in Gaia EDR3 around the extended solar neighbourhood, we create x-y projections coloured by the radial, residual rotational, and vertical Galactocentric velocities ($U,\Delta V,W$). The maps are rich in substructures and reveal the perturbed state of the Galactic disc. We find that local differences between rotational velocity and the azimuthally averaged velocity, $\Delta V$, display at least five large-scale kinematic spirals; two of them closely follow the locus of the Sagittarius-Carina and Perseus spiral arms, with pitch angles of 9.12$^{\circ}$ and 7.76$^{\circ}$, and vertical thickness of $\sim400$ pc and $\sim600$ pc, respectively. Another kinematic spiral is located behind the Perseus arm and appears as a distortion in rotation velocities left by this massive arm but with no known counterpart in gas/stars overdensity. A weaker signal close to the Sun's position is present in our three velocity maps, and appears to be associated with the Local arm. Our analysis of the stellar velocities in the Galactic disc shows kinematic differences between arms and inter-arms, that are in favour of Milky Way spiral arms that do not corotate with the disc. Moreover, we show that the kinematic spirals are clumpy and flocculent, revealing the underlying nature of the Milky Way spiral arms.


title: Unfolding Projection-free SDP Relaxation of Binary Graph Classifier via GDPA Linearization

abstract: Algorithm unfolding creates an interpretable and parsimonious neural network architecture by implementing each iteration of a model-based algorithm as a neural layer. However, unfolding a proximal splitting algorithm with a positive semi-definite (PSD) cone projection operator per iteration is expensive, due to the required full matrix eigen-decomposition. In this paper, leveraging a recent linear algebraic theorem called Gershgorin disc perfect alignment (GDPA), we unroll a projection-free algorithm for semi-definite programming relaxation (SDR) of a binary graph classifier, where the PSD cone constraint is replaced by a set of "tightest possible" linear constraints per iteration. As a result, each iteration only requires computing a linear program (LP) and one extreme eigenvector. Inside the unrolled network, we optimize parameters via stochastic gradient descent (SGD) that determine graph edge weights in two ways: i) a metric matrix that computes feature distances, and ii) a sparse weight matrix computed via local linear embedding (LLE). Experimental results show that our unrolled network outperformed pure model-based graph classifiers, and achieved comparable performance to pure data-driven networks but using far fewer parameters.


title: Face-NMS: A Core-set Selection Approach for Efficient Face Recognition

abstract: Recently, face recognition in the wild has achieved remarkable success and one key engine is the increasing size of training data. For example, the largest face dataset, WebFace42M contains about 2 million identities and 42 million faces. However, a massive number of faces raise the constraints in training time, computing resources, and memory cost. The current research on this problem mainly focuses on designing an efficient Fully-connected layer (FC) to reduce GPU memory consumption caused by a large number of identities. In this work, we relax these constraints by resolving the redundancy problem of the up-to-date face datasets caused by the greedily collecting operation (i.e. the core-set selection perspective). As the first attempt in this perspective on the face recognition problem, we find that existing methods are limited in both performance and efficiency. For superior cost-efficiency, we contribute a novel filtering strategy dubbed Face-NMS. Face-NMS works on feature space and simultaneously considers the local and global sparsity in generating core sets. In practice, Face-NMS is analogous to Non-Maximum Suppression (NMS) in the object detection community. It ranks the faces by their potential contribution to the overall sparsity and filters out the superfluous face in the pairs with high similarity for local sparsity. With respect to the efficiency aspect, Face-NMS accelerates the whole pipeline by applying a smaller but sufficient proxy dataset in training the proxy model. As a result, with Face-NMS, we successfully scale down the WebFace42M dataset to 60% while retaining its performance on the main benchmarks, offering a 40% resource-saving and 1.64 times acceleration. The code is publicly available for reference at https://github.com/HuangJunJie2017/Face-NMS.


title: EfficientCLIP: Efficient Cross-Modal Pre-training by Ensemble Confident Learning and Language Modeling

abstract: While large scale pre-training has achieved great achievements in bridging the gap between vision and language, it still faces several challenges. First, the cost for pre-training is expensive. Second, there is no efficient way to handle the data noise which degrades model performance. Third, previous methods only leverage limited image-text paired data, while ignoring richer single-modal data, which may result in poor generalization to single-modal downstream tasks. In this work, we propose an EfficientCLIP method via Ensemble Confident Learning to obtain a less noisy data subset. Extra rich non-paired single-modal text data is used for boosting the generalization of text branch. We achieve the state-of-the-art performance on Chinese cross-modal retrieval tasks with only 1/10 training resources compared to CLIP and WenLan, while showing excellent generalization to single-modal tasks, including text retrieval and text classification.


title: $\ast$-$\eta$-Ricci-Yamabe solitons on $\alpha$-Cosymplectic manifolds with a quarter-symmetric metric connection

abstract: The goal of the present paper is to deliberate certain types of metric such as $*$-$\eta$-Ricci-Yamabe soliton on $\alpha$-Cosymplectic manifolds with respect to quarter-symmetric metric connection. Further, we have proved some curvature properties of $\alpha$-Cosymplectic manifolds admitting quarter-symmetric metric connection. Here, we have shown the characteristics of the soliton when the manifold satisfies quarter-symmetric metric connection on $\alpha$-Cosymplectic manifolds. Later, we have acquired Laplace equation from $*$-$\eta$-Ricci-Yamabe soliton equation when the potential vector field $\xi$ of the soliton is of gradient type in terms of quarter-symmetric metric connection. Next, we have developed the nature of the soliton when the vector field is conformal killing admitting quarter-symmetric metric connection. Finally, we present an example of a 5-dimensional $\alpha$-cosymplectic metric as a $*$-$\eta$-Ricci-Yamabe soliton with respect to a quarter-symmetric metric connection to prove our results.