title: Robust Adaptive Beamforming Maximizing the Worst-Case SINR over Distributional Uncertainty Sets for Random INC Matrix and Signal Steering Vector

abstract: The robust adaptive beamforming (RAB) problem is considered via the worst-case signal-to-interference-plus-noise ratio (SINR) maximization over distributional uncertainty sets for the random interference-plus-noise covariance (INC) matrix and desired signal steering vector. The distributional uncertainty set of the INC matrix accounts for the support and the positive semidefinite (PSD) mean of the distribution, and a similarity constraint on the mean. The distributional uncertainty set for the steering vector consists of the constraints on the known first- and second-order moments. The RAB problem is formulated as a minimization of the worst-case expected value of the SINR denominator achieved by any distribution, subject to the expected value of the numerator being greater than or equal to one for each distribution. Resorting to the strong duality of linear conic programming, such a RAB problem is rewritten as a quadratic matrix inequality problem. It is then tackled by iteratively solving a sequence of linear matrix inequality relaxation problems with the penalty term on the rank-one PSD matrix constraint. To validate the results, simulation examples are presented, and they demonstrate the improved performance of the proposed robust beamformer in terms of the array output SINR.


title: How Well Do You Know Your Audience? Toward Socially-aware Question Generation

abstract: When writing, a person may need to anticipate questions from their audience, but different social groups may ask very different types of questions. If someone is writing about a problem they want to resolve, what kind of follow-up question will a domain expert ask, and could the writer better address the expert's information needs by rewriting their original post? In this paper, we explore the task of socially-aware question generation. We collect a data set of questions and posts from social media, including background information about the question-askers' social groups. We find that different social groups, such as experts and novices, consistently ask different types of questions. We train several text-generation models that incorporate social information, and we find that a discrete social-representation model outperforms the text-only model when different social groups ask highly different questions from one another. Our work provides a framework for developing text generation models that can help writers anticipate the information expectations of highly different social groups.


title: Self-Annotated Training for Controllable Image Captioning

abstract: The Controllable Image Captioning (CIC) task aims to generate captions conditioned on designated control signals. Several structure-related control signals are proposed to control the semantic structure of sentences, such as sentence length and Part-of-Speech tag sequences. However, due to the fact that the accuracy-based reward focuses mainly on contents rather than semantic structures, existing reinforcement training methods are not applicable to structure-related CIC models. The lack of reinforcement training leads to exposure bias and the inconsistency between the optimizing function and evaluation metrics. In this paper, we propose a novel reinforcement training method for structure-related control signals: Self-Annotated Training (SAT), to improve both the accuracy and controllability of CIC models. In SAT, a recursive annotation mechanism (RAM) is designed to force the input control signal to match the actual output sentence. Moreover, we propose an extra alignment reward to finetune the CIC model trained after SAT method, which further enhances the controllability of models. On the MSCOCO benchmark, we conduct extensive experiments on different structure-related control signals and on different baseline models, the results of which demonstrate the effectiveness and generalizability of our methods.


title: TESDA: Transform Enabled Statistical Detection of Attacks in Deep Neural Networks

abstract: Deep neural networks (DNNs) are now the de facto choice for computer vision tasks such as image classification. However, their complexity and "black box" nature often renders the systems they're deployed in vulnerable to a range of security threats. Successfully identifying such threats, especially in safety-critical real-world applications is thus of utmost importance, but still very much an open problem. We present TESDA, a low-overhead, flexible, and statistically grounded method for {online detection} of attacks by exploiting the discrepancies they cause in the distributions of intermediate layer features of DNNs. Unlike most prior work, we require neither dedicated hardware to run in real-time, nor the presence of a Trojan trigger to detect discrepancies in behavior. We empirically establish our method's usefulness and practicality across multiple architectures, datasets and diverse attacks, consistently achieving detection coverages of above 95% with operation count overheads as low as 1-2%.


title: Deepest Cuts for Benders Decomposition

abstract: Since its inception, Benders Decomposition (BD) has been successfully applied to a wide range of large-scale mixed-integer (linear) problems. The key element of BD is the derivation of Benders cuts, which are often not unique. In this paper, we introduce a novel unifying Benders cut selection technique based on a geometric interpretation of cut ``depth'', produce deepest Benders cuts based on $\ell_p$-norms, and study their properties. Specifically, we show that deepest cuts resolve infeasibility through minimal deviation (in a distance sense) from the incumbent point, are relatively sparse, and may produce optimality cuts even when classical Benders would require a feasibility cut. Leveraging the duality between separation and projection, we develop a Guided Projections Algorithm for producing deepest cuts while exploiting the combinatorial structure and decomposability of problem instances. We then propose a generalization of our Benders separation problem, which not only brings several well-known cut selection strategies under one umbrella, but also, when endowed with a homogeneous function, enjoys several properties of geometric separation problems. We show that, when the homogeneous function is linear, the separation problem takes the form of the Minimal Infeasible Subsystems (MIS) problem. As such, we provide systematic ways of selecting the normalization coefficients of the MIS method, and introduce a Directed Depth-Maximizing Algorithm for deriving these cuts. Inspired by the geometric interpretation of distance-based cuts and the repetitive nature of two-stage stochastic programs, we introduce a tailored algorithm to further facilitate deriving these cuts. Our computational experiments on various benchmark problems illustrate effectiveness of deepest cuts in reducing both computation time and number of Benders iterations, and producing high quality bounds at early iterations.


title: Adversarial Attacks on Gaussian Process Bandits

abstract: Gaussian processes (GP) are a widely-adopted tool used to sequentially optimize black-box functions, where evaluations are costly and potentially noisy. Recent works on GP bandits have proposed to move beyond random noise and devise algorithms robust to adversarial attacks. This paper studies this problem from the attacker's perspective, proposing various adversarial attack methods with differing assumptions on the attacker's strength and prior information. Our goal is to understand adversarial attacks on GP bandits from theoretical and practical perspectives. We focus primarily on targeted attacks on the popular GP-UCB algorithm and a related elimination-based algorithm, based on adversarially perturbing the function $f$ to produce another function $\tilde{f}$ whose optima are in some target region $\mathcal{R}_{\rm target}$. Based on our theoretical analysis, we devise both white-box attacks (known $f$) and black-box attacks (unknown $f$), with the former including a Subtraction attack and Clipping attack, and the latter including an Aggressive subtraction attack. We demonstrate that adversarial attacks on GP bandits can succeed in forcing the algorithm towards $\mathcal{R}_{\rm target}$ even with a low attack budget, and we test our attacks' effectiveness on a diverse range of objective functions.


title: Accelerating Training and Inference of Graph Neural Networks with Fast Sampling and Pipelining

abstract: Improving the training and inference performance of graph neural networks (GNNs) is faced with a challenge uncommon in general neural networks: creating mini-batches requires a lot of computation and data movement due to the exponential growth of multi-hop graph neighborhoods along network layers. Such a unique challenge gives rise to a diverse set of system design choices. We argue in favor of performing mini-batch training with neighborhood sampling in a distributed multi-GPU environment, under which we identify major performance bottlenecks hitherto under-explored by developers: mini-batch preparation and transfer. We present a sequence of improvements to mitigate these bottlenecks, including a performance-engineered neighborhood sampler, a shared-memory parallelization strategy, and the pipelining of batch transfer with GPU computation. We also conduct an empirical analysis that supports the use of sampling for inference, showing that test accuracies are not materially compromised. Such an observation unifies training and inference, simplifying model implementation. We report comprehensive experimental results with several benchmark data sets and GNN architectures, including a demonstration that, for the ogbn-papers100M data set, our system SALIENT achieves a speedup of 3x over a standard PyTorch-Geometric implementation with a single GPU and a further 8x parallel speedup with 16 GPUs. Therein, training a 3-layer GraphSAGE model with sampling fanout (15, 10, 5) takes 2.0 seconds per epoch and inference with fanout (20, 20, 20) takes 2.4 seconds, attaining test accuracy 64.58%.


title: Sum-of-Squares Geometry Processing

abstract: Geometry processing presents a variety of difficult numerical problems, each seeming to require its own tailored solution. This breadth is largely due to the expansive list of geometric primitives, e.g., splines, triangles, and hexahedra, joined with an ever-expanding variety of objectives one might want to achieve with them. With the recent increase in attention toward higher-order surfaces, we can expect a variety of challenges porting existing solutions that work on triangle meshes to work on these more complex geometry types. In this paper, we present a framework for solving many core geometry processing problems on higher-order surfaces. We achieve this goal through sum-of-squares optimization, which transforms nonlinear polynomial optimization problems into sequences of convex problems whose complexity is captured by a single degree parameter. This allows us to solve a suite of problems on higher-order surfaces, such as continuous collision detection and closest point queries on curved patches, with only minor changes between formulations and geometries.


title: Extended-cycle integrals of modular functions for badly approximable numbers

abstract: Cycle integrals of modular functions are expected to play a role in real quadratic analogue of singular moduli. In this paper, we extend the definition of cycle integrals of modular functions from real quadratic numbers to badly approximable numbers. We also give explicit representations of values of extended-cycle integrals for some cases.


title: Voting Theory in the Lean Theorem Prover

abstract: There is a long tradition of fruitful interaction between logic and social choice theory. In recent years, much of this interaction has focused on computer-aided methods such as SAT solving and interactive theorem proving. In this paper, we report on the development of a framework for formalizing voting theory in the Lean theorem prover, which we have applied to verify properties of a recently studied voting method. While previous applications of interactive theorem proving to social choice (using Isabelle/HOL and Mizar) have focused on the verification of impossibility theorems, we aim to cover a variety of results ranging from impossibility theorems to the verification of properties of specific voting methods (e.g., Condorcet consistency, independence of clones, etc.). In order to formalize voting theoretic axioms concerning adding or removing candidates and voters, we work in a variable-election setting whose formalization makes use of dependent types in Lean.


title: Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER

abstract: Recent advances in prompt-based learning have shown strong results on few-shot text classification by using cloze-style templates. Similar attempts have been made on named entity recognition (NER) which manually design templates to predict entity types for every text span in a sentence. However, such methods may suffer from error propagation induced by entity span detection, high cost due to enumeration of all possible text spans, and omission of inter-dependencies among token labels in a sentence. Here we present a simple demonstration-based learning method for NER, which lets the input be prefaced by task demonstrations for in-context learning. We perform a systematic study on demonstration strategy regarding what to include (entity examples, with or without surrounding context), how to select the examples, and what templates to use. Results on in-domain learning and domain adaptation show that the model's performance in low-resource settings can be largely improved with a suitable demonstration strategy (e.g., a 4-17% improvement on 25 train instances). We also find that good demonstration can save many labeled examples and consistency in demonstration contributes to better performance.


title: Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey

abstract: Pretrained Language Models (PLM) have established a new paradigm through learning informative contextualized representations on large-scale text corpus. This new paradigm has revolutionized the entire field of natural language processing, and set the new state-of-the-art performance for a wide variety of NLP tasks. However, though PLMs could store certain knowledge/facts from training corpus, their knowledge awareness is still far from satisfactory. To address this issue, integrating knowledge into PLMs have recently become a very active research area and a variety of approaches have been developed. In this paper, we provide a comprehensive survey of the literature on this emerging and fast-growing field - Knowledge Enhanced Pretrained Language Models (KE-PLMs). We introduce three taxonomies to categorize existing work. Besides, we also survey the various NLU and NLG applications on which KE-PLM has demonstrated superior performance over vanilla PLMs. Finally, we discuss challenges that face KE-PLMs and also promising directions for future research.


title: Isotope-Selective Laser Ablation Ion-Trap Loading of $\mathbf{^{137}\mathrm{Ba}^+}$ using a $\mathbf{\mathrm{BaCl}_2}$ Target

abstract: The $^{133}\mathrm{Ba}^+$ ion is a promising candidate as a high-fidelity qubit, and the $^{137}\mathrm{Ba}^+$ isotope is promising as a high-fidelity qudit ($d>2$). Barium metal is very reactive, and $^{133}\mathrm{Ba}^+$ is radioactive and can only be sourced in small quantities, so the most commonly used loading method, oven heating, is less suited for barium, and is currently not possible for $^{133}\mathrm{Ba}^+$.Pulsed laser ablation solves both of these problems by utilizing compound barium sources, while also giving some distinct advantages, such as fast loading, less displaced material, and lower heat load near the ion trap. Because of the relatively low abundances of the isotopes of interest, a two-step photoionization technique is used, which gives us the ability to selectively load isotopes. Characterization of the ablation process for our $\mathrm{BaCl}_2$ targets are presented, including observation of neutral and ion ablation-fluence regimes, preparation/conditioning and lifetimes of ablation spots, and plume velocity distributions.We show that using laser ablation on $\mathrm{BaCl}_2$ salt targets with a two-step photoionization method, we can produce and trap barium ions reliably. Further, we demonstrate that with our photoionization method, we can trap $^{137}\mathrm{Ba}^+$ with an enhanced selectivity compared to its natural abundance.


title: Metagenome assembly of high-fidelity long reads with hifiasm-meta

abstract: Current metagenome assemblers developed for short sequence reads or noisy long readswere not optimized for accurate long reads. Here we describe hifiasm-meta, a new metagenome assembler that exploits the high accuracy of recent data. Evaluated on seven empirical datasets, hifiasm-meta reconstructed tens to hundreds of complete circular bacterial genomes per dataset, consistently outperforming other metagenome assemblers.


title: Controllable Semantic Parsing via Retrieval Augmentation

abstract: In practical applications of semantic parsing, we often want to rapidly change the behavior of the parser, such as enabling it to handle queries in a new domain, or changing its predictions on certain targeted queries. While we can introduce new training examples exhibiting the target behavior, a mechanism for enacting such behavior changes without expensive model re-training would be preferable. To this end, we propose ControllAble Semantic Parser via Exemplar Retrieval (CASPER). Given an input query, the parser retrieves related exemplars from a retrieval index, augments them to the query, and then applies a generative seq2seq model to produce an output parse. The exemplars act as a control mechanism over the generic generative model: by manipulating the retrieval index or how the augmented query is constructed, we can manipulate the behavior of the parser. On the MTOP dataset, in addition to achieving state-of-the-art on the standard setup, we show that CASPER can parse queries in a new domain, adapt the prediction toward the specified patterns, or adapt to new semantic schemas without having to further re-train the model.


title: Analysis on numerical stability and convergence of RANS turbulence models from the perspective of coupling modes

abstract: Reynolds-averaged Navier-Stokes simulations are still the main method to study complex flows in engineering. However, traditional turbulence models cannot accurately predict flow fields with separations. In such situation, machine learning methods provide an effective way to build new data-driven turbulence closure models. Nevertheless, a bottleneck that the data-driven turbulence models encounter is how to ensure the stability and convergence of the RANS equations in posterior iterations. This paper studies the effects of different coupling modes on the convergence and stability between the RANS equations and turbulence models. Numerical results demonstrate that the frozen coupling mode, commonly used in machine learning turbulence models, may lead to divergence and instability in posterior iterations; while the mutual coupling mode can maintain good convergence and stability in the process of iterations. This research can provide a new perspective to the coupling mode for machine learning turbulence models with RANS equations in posterior iterations.


title: A Short Study on Compressing Decoder-Based Language Models

abstract: Pre-trained Language Models (PLMs) have been successful for a wide range of natural language processing (NLP) tasks. The state-of-the-art of PLMs, however, are extremely large to be used on edge devices. As a result, the topic of model compression has attracted increasing attention in the NLP community. Most of the existing works focus on compressing encoder-based models (tiny-BERT, distilBERT, distilRoBERTa, etc), however, to the best of our knowledge, the compression of decoder-based models (such as GPT-2) has not been investigated much. Our paper aims to fill this gap. Specifically, we explore two directions: 1) we employ current state-of-the-art knowledge distillation techniques to improve fine-tuning of DistilGPT-2. 2) we pre-train a compressed GPT-2 model using layer truncation and compare it against the distillation-based method (DistilGPT2). The training time of our compressed model is significantly less than DistilGPT-2, but it can achieve better performance when fine-tuned on downstream tasks. We also demonstrate the impact of data cleaning on model performance.


title: Strong quantum nonlocality from hypercubes

abstract: A set of multipartite orthogonal product states is strongly nonlocal if it is locally irreducible in every bipartition. Most known constructions of strongly nonlocal orthogonal product set (OPS) are limited to tripartite systems, and they are lack of intuitive structures. In this work, based on the decomposition for the outermost layer of an $n$-dimensional hypercube for $n= 3,4,5$, we successfully construct strongly nonlocal OPSs in any possible three, four and five-partite systems, which answers an open question given by Halder et al. [Phys. Rev. Lett.122, 040403 (2019)] and Yuan et al. [Phys. Rev. A102, 042228 (2020)] for any possible three, four and five-partite systems. Our results build the connection between hypercubes and strongly nonlocal OPSs, and exhibit the phenomenon of strong quantum nonlocality without entanglement in multipartite systems.


title: Leveraging Knowledge in Multilingual Commonsense Reasoning

abstract: Commonsense reasoning (CSR) requires the model to be equipped with general world knowledge. While CSR is a language-agnostic process, most comprehensive knowledge sources are in few popular languages, especially English. Thus, it remains unclear how to effectively conduct multilingual commonsense reasoning (XCSR) for various languages. In this work, we propose to utilize English knowledge sources via a translate-retrieve-translate (TRT) strategy. For multilingual commonsense questions and choices, we collect related knowledge via translation and retrieval from the knowledge sources. The retrieved knowledge is then translated into the target language and integrated into a pre-trained multilingual language model via visible knowledge attention. Then we utilize a diverse of 4 English knowledge sources to provide more comprehensive coverage of knowledge in different formats. Extensive results on the XCSR benchmark demonstrate that TRT with external knowledge can significantly improve multilingual commonsense reasoning in both zero-shot and translate-train settings, outperforming 3.3 and 3.6 points over the previous state-of-the-art on XCSR benchmark datasets (X-CSQA and X-CODAH).


title: Existence of solutions to gas expansion problem through a sharp corner for 2-D Euler equations with general equation of state

abstract: In this article, we study the gas expansion problem by turning a sharp corner into vacuum for the two-dimensional pseudo-steady compressible Euler equations with a convex equation of state. This problem can be considered as interaction of a centered simple wave with a planar rarefaction wave. In order to obtain the global existence of solution up to vacuum boundary of the corresponding two-dimensional Riemann problem, we consider several Goursat type boundary value problems for 2-D self-similar Euler equations and use the ideas of characteristic decomposition and bootstrap method. Further, we formulate two-dimensional modified shallow water equations newly and solve a dam-break type problem for them as an application of this work. Moreover, we also recover the results from the available literature for certain equation of states which provide a check that the results obtained in this article are actually correct.


title: Seeking Patterns, Not just Memorizing Procedures: Contrastive Learning for Solving Math Word Problems

abstract: Math Word Problem (MWP) solving needs to discover the quantitative relationships over natural language narratives. Recent work shows that existing models memorize procedures from context and rely on shallow heuristics to solve MWPs. In this paper, we look at this issue and argue that the cause is a lack of overall understanding of MWP patterns. We first investigate how a neural network understands patterns only from semantics, and observe that, if the prototype equations are the same, most problems get closer representations and those representations apart from them or close to other prototypes tend to produce wrong solutions. Inspired by it, we propose a contrastive learning approach, where the neural network perceives the divergence of patterns. We collect contrastive examples by converting the prototype equation into a tree and seeking similar tree structures. The solving model is trained with an auxiliary objective on the collected examples, resulting in the representations of problems with similar prototypes being pulled closer. We conduct experiments on the Chinese dataset Math23k and the English dataset MathQA. Our method greatly improves the performance in monolingual and multilingual settings.


title: Heterogeneous Graph-Based Multimodal Brain Network Learning

abstract: Graph neural networks (GNNs) provide powerful insights for brain neuroimaging technology from the view of graphical networks. However, most existing GNN-based models assume that the neuroimaging-produced brain connectome network is a homogeneous graph with single types of nodes and edges. In fact, emerging studies have reported and emphasized the significance of heterogeneity among human brain activities, especially between the two cerebral hemispheres. Thus, homogeneous-structured brain network-based graph methods are insufficient for modelling complicated cerebral activity states. To overcome this problem, in this paper, we present a heterogeneous graph neural network (HebrainGNN) for multimodal brain neuroimaging fusion learning. We first model the brain network as a heterogeneous graph with multitype nodes (i.e., left and right hemispheric nodes) and multitype edges (i.e., intra- and interhemispheric edges). Then, we propose a self-supervised pretraining strategy based on a heterogeneous brain network to address the potential overfitting problem caused by the conflict between a large parameter size and a small medical data sample size. Our results show the superiority of the proposed model over other existing methods in brain-related disease prediction tasks. Ablation experiments show that our heterogeneous graph-based model attaches more importance to hemispheric connections that may be neglected due to their low strength by previous homogeneous graph models. Other experiments also indicate that our proposed model with a pretraining strategy alleviates the problem of limited labelled data and yields a significant improvement in accuracy.


title: On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark

abstract: Dialogue safety problems severely limit the real-world deployment of neural conversational models and have attracted great research interests recently. However, dialogue safety problems remain under-defined and the corresponding dataset is scarce. We propose a taxonomy for dialogue safety specifically designed to capture unsafe behaviors in human-bot dialogue settings, with focuses on context-sensitive unsafety, which is under-explored in prior works. To spur research in this direction, we compile DiaSafety, a dataset with rich context-sensitive unsafe examples. Experiments show that existing safety guarding tools fail severely on our dataset. As a remedy, we train a dialogue safety classifier to provide a strong baseline for context-sensitive dialogue unsafety detection. With our classifier, we perform safety evaluations on popular conversational models and show that existing dialogue systems still exhibit concerning context-sensitive safety problems.


title: Improving Compositional Generalization with Self-Training for Data-to-Text Generation

abstract: Data-to-text generation focuses on generating fluent natural language responses from structured meaning representations (MRs). Such representations are compositional and it is costly to collect responses for all possible combinations of atomic meaning schemata, thereby necessitating few-shot generalization to novel MRs. In this work, we systematically study the compositional generalization of the state-of-the-art T5 models in few-shot data-to-text tasks. We show that T5 models fail to generalize to unseen MRs, and we propose a template-based input representation that considerably improves the model's generalization capability. To further improve the model's performance, we propose an approach based on self-training using fine-tuned BLEURT for pseudo response selection. On the commonly-used SGD and Weather benchmarks, the proposed self-training approach improves tree accuracy by 46%+ and reduces the slot error rates by 73%+ over the strong T5 baselines in few-shot settings.


title: Statistical mechanics of a dielectric polymer chain in the force ensemble

abstract: Constitutive modeling of dielectric elastomers has been of long standing interest in mechanics. Over the last two decades rigorous constitutive models have been developed that couple the electrical response of these polymers with large deformations characteristic of soft solids. A drawback of these models is that unlike classic models of rubber elasticity they do not consider the coupled electromechanical response of single polymer chains which must be treated using statistical mechanics. The objective of this paper is to compute the stretch and polarization of single polymer chains subject to a fixed force and fixed electric field using statistical mechanics. We assume that the dipoles induced by the applied electric field at each link do not interact with each other and compute the partition function using standard techniques. We then calculate the stretch and polarization by taking appropriate derivatives of the partition function and obtain analytical results in various limits. We also perform Markov chain Monte Carlo simulations using the Metropolis and umbrella sampling methods, as well as develop a new sampling method which improves convergence by exploiting a symmetry inherent in dielectric polymer chains. The analytical expressions are shown to agree with the Monte Carlo results over a range of forces and electric fields. Our results complement recent work on the statistical mechanics of electro-responsive chains which obtains analytical expressions in a different ensemble.


title: Implications of Seiberg-Witten map on type-I superconductors

abstract: We incorporate the Seiberg-Witten map of noncommutative theory in the classical London theory of type-I superconductivity when an external magnetic field is applied. After defining the noncommutative Maxwell potentials, we derive the London equation for the supercurrent as a function of the noncommutative parameter, up to second order in gauge fields expansion. Keeping track of the effects of noncommutative gauge fields, we argue that noncommutative magnetic field effects can be cast in the permeability of the superconductor as an emergent property of the material, measurable in possible not-so-far ultra-high-energy experimental setups. Another consequence of the Seiberg-Witten map is the London penetration length that acquires corrections in the expansion. Also, we show that the flux quantization remains consistent relative to the commutative case. Our effective magnetic permeability and London penetration length reduce to the standard ones in the commutative limit.


title: Case-based Reasoning for Better Generalization in Textual Reinforcement Learning

abstract: Text-based games (TBG) have emerged as promising environments for driving research in grounded language understanding and studying problems like generalization and sample efficiency. Several deep reinforcement learning (RL) methods with varying architectures and learning schemes have been proposed for TBGs. However, these methods fail to generalize efficiently, especially under distributional shifts. In a departure from deep RL approaches, in this paper, we propose a general method inspired by case-based reasoning to train agents and generalize out of the training distribution. The case-based reasoner collects instances of positive experiences from the agent's interaction with the world in the past and later reuses the collected experiences to act efficiently. The method can be applied in conjunction with any existing on-policy neural agent in the literature for TBGs. Our experiments show that the proposed approach consistently improves existing methods, obtains good out-of-distribution generalization, and achieves new state-of-the-art results on widely used environments.


title: Fast Projection onto the Capped Simplex with Applications to Sparse Regression in Bioinformatics

abstract: We consider the problem of projecting a vector onto the so-called k-capped simplex, which is a hyper-cube cut by a hyperplane. For an n-dimensional input vector with bounded elements, we found that a simple algorithm based on Newton's method is able to solve the projection problem to high precision with a complexity roughly about O(n), which has a much lower computational cost compared with the existing sorting-based methods proposed in the literature. We provide a theory for partial explanation and justification of the method. We demonstrate that the proposed algorithm can produce a solution of the projection problem with high precision on large scale datasets, and the algorithm is able to significantly outperform the state-of-the-art methods in terms of runtime (about 6-8 times faster than a commercial software with respect to CPU time for input vector with 1 million variables or more). We further illustrate the effectiveness of the proposed algorithm on solving sparse regression in a bioinformatics problem. Empirical results on the GWAS dataset (with 1,500,000 single-nucleotide polymorphisms) show that, when using the proposed method to accelerate the Projected Quasi-Newton (PQN) method, the accelerated PQN algorithm is able to handle huge-scale regression problem and it is more efficient (about 3-6 times faster) than the current state-of-the-art methods.


title: Joint 3D Human Shape Recovery and Pose Estimation from a Single Image with Bilayer Graph

abstract: The ability to estimate the 3D human shape and pose from images can be useful in many contexts. Recent approaches have explored using graph convolutional networks and achieved promising results. The fact that the 3D shape is represented by a mesh, an undirected graph, makes graph convolutional networks a natural fit for this problem. However, graph convolutional networks have limited representation power. Information from nodes in the graph is passed to connected neighbors, and propagation of information requires successive graph convolutions. To overcome this limitation, we propose a dual-scale graph approach. We use a coarse graph, derived from a dense graph, to estimate the human's 3D pose, and the dense graph to estimate the 3D shape. Information in coarse graphs can be propagated over longer distances compared to dense graphs. In addition, information about pose can guide to recover local shape detail and vice versa. We recognize that the connection between coarse and dense is itself a graph, and introduce graph fusion blocks to exchange information between graphs with different scales. We train our model end-to-end and show that we can achieve state-of-the-art results for several evaluation datasets.


title: Second-order Cumulants Ghost Imaging

abstract: In the conventional ghost imaging (GI), the image is retrieved by correlating the reference intensity fluctuation at a charge-coupled device (CCD) with the signal intensity fluctuation at a bucket detector. In this letter, we present the protocol of GI, it is called Second-order Cumulants ghost imaging (SCGI). The image is retrieved by the fluctuation information of correlating intensity fluctuation at two detectors, and the resolution limit can be enhanced than conventional GI. The experimental results of SCGI agreement with theoretical results.


title: A new class of discrete conformal structures on surfaces with boundary

abstract: We introduce a new class of discrete conformal structures on surfaces with boundary, which have nice interpolations in 3-dimensional hyperbolic geometry. Then we prove the global rigidity of the new discrete conformal structures using variational principles, which is a complement of Guo-Luo's rigidity of the discrete conformal structures and Guo's rigidity of vertex scaling on surface with boundary. As a result, new convexities of the volume of generalized hyperbolic pyramids with right-angled hyperbolic hexagonal bases are obtained. Motivated by Chow-Luo's combinatorial Ricci flow and Luo's combinatorial Yamabe flow on closed surfaces, we further introduce combinatorial Ricci flow and combinatorial Calabi flows to deform the new discrete conformal structures on surfaces with boundary. The basic properties of these combinatorial curvature flows are established. These combinatorial curvature flows provide effective algorithms for constructing hyperbolic metrics on surfaces with totally geodesic boundary components of prescribed lengths.


title: Global well-posedness, stability and instability for the non-viscous Oldroyd-B model

abstract: In this paper we consider the 3-dimensional incompressible Oldroyd-B model. First, we establish two results of the global existence for different kinds of the coupling coefficient $k$. Then, we prove that the solutions $(u,\tau)$ are globally steady when $k^m\rightarrow k>0$, though $(u,\tau)$ corresponds to different decays for different kinds of $k>0~$. Finally, we show that the energy of $u(t,x)$ will have a jump when $k\rightarrow 0$ in large time, which implies a non-steady phenomenon. In a word, we find an interesting physical phenomenon of \eqref{1} such that smaller coupling coefficient $k$ will have a better impact for the energy dissipation of $(u,\tau)$, but $k$ can't be too small to zero, or the dissipation will vanish instantly. While the damping term $\tau$ and $\mathbb{D}u$ always bring the well impact for the energy dissipation.


title: The MBHBM$^{\star}$ Project -- II. Molecular Gas Kinematics in the Lenticular Galaxy NGC 3593 Reveal a Supermassive Black Hole

abstract: As part of the Measuring Black Holes in Below Milky Way-mass (M$^\star$) galaxies (MBHBM$^\star$) Project, we present a dynamical measurement of the supermassive black hole (SMBH) mass in the nearby lenticular galaxy NGC 3593, using cold molecular gas $^{12}$CO(2-1) emission observed at an angular resolution of $\approx0''.3$ ($\approx10$ pc) with the Atacama Large Millimeter/submillimeter Array (ALMA). Our ALMA observations reveal a circumnuclear molecular gas disc (CND) elongated along the galaxy major axis and rotating around the SMBH. Using dynamical modelling, the molecular gas kinematics allow us to infer a SMBH mass $M_{\rm BH}=2.40_{-1.05}^{+1.87}\times10^6$ M$_\odot$ (only statistical uncertainties at the $3\sigma$ level). We also detect a massive core of cold molecular gas (CMC) of mass $M_{\rm CMC}=(5.4\pm1.2)\times10^6$ M$_\odot$ and effective (half-mass) radius $r_{\rm CMC,e}=11.2\pm2.8$ pc, co-spatial with a nuclear star cluster (NSC) of mass $M_{\rm NSC}=(1.67\pm0.48)\times10^7$ M$_\odot$ and effective radius $r_{\rm NSC,e}=5.0\pm1.0$~pc (or $0''.15\pm0''.03$). The mass profiles of the CMC and NSC are well described by S\'{e}rsic functions with indices $1-1.4$. Our $M_{\rm BH}$ and $M_{\rm NSC}$ estimates for NGC 3593 agree well with the recently compiled $M_{\rm BH}$-$M_{\rm NSC}$ scaling relation. Although the $M_{\rm NSC}$ uncertainty is twice the inferred $M_{\rm BH}$, the rapid central rise of the rotation velocities of the CND (as the radius decreases) clearly suggests a SMBH. Indeed, our dynamical models show that even if $M_{\rm NSC}$ is at the upper end of its allowed range, the evidence for a black hole does not vanish, but remains with a lower limit of $M_{\rm BH}>3\times10^5$ M$_\odot$.


title: FedMM: Saddle Point Optimization for Federated Adversarial Domain Adaptation

abstract: Federated adversary domain adaptation is a unique distributed minimax training task due to the prevalence of label imbalance among clients, with each client only seeing a subset of the classes of labels required to train a global model. To tackle this problem, we propose a distributed minimax optimizer referred to as FedMM, designed specifically for the federated adversary domain adaptation problem. It works well even in the extreme case where each client has different label classes and some clients only have unsupervised tasks. We prove that FedMM ensures convergence to a stationary point with domain-shifted unsupervised data. On a variety of benchmark datasets, extensive experiments show that FedMM consistently achieves either significant communication savings or significant accuracy improvements over federated optimizers based on the gradient descent ascent (GDA) algorithm. When training from scratch, for example, it outperforms other GDA based federated average methods by around $20\%$ in accuracy over the same communication rounds; and it consistently outperforms when training from pre-trained models with an accuracy improvement from $5.4\%$ to $9\%$ for different networks.


title: Stability of the magnetotail current sheet with normal magnetic field and field-aligned plasma flows

abstract: One of the most important problems of magnetotail dynamics is the substorm onset and the related instability of the magneotail current sheet. Since the simplest 2D current sheet configuration with monotonic $B_z$ was proven to be stable to the tearing mode, the focus of the instability investigation moved to more specific configurations, e.g. kinetic current sheets with strong transient ion currents and current sheets with non-monotonic $B_z$ (local $B_z$ minima or/and peaks). Stability of the latter current sheet configuration has been studied both within kinetic and fluid approaches, whereas the investigation of the transient ion effects were limited to kinetic models only. This paper aims to provide detailed analysis of stability of a multi-fluid current sheet configuration that mimics current sheets with transient ions. Using the system with two field-aligned ion flows that mimic the effect of pressure non-gyrotropy, we construct 1D current sheet with a finite $B_z$. This model describes well recent findings of very thin intense magnetotail current sheets. The stability analysis of this two-ion model confirms the stabilizing effect of finite $B_z$ and shows that the most stable current sheet is the one with exactly counter-streaming ion flows and zero net flow. Such field-aligned flows may substitute the contribution of the pressure tensor nongyrotropy to the stress balance, but cannot overtake the stabilizing effect of $B_z$. Obtained results are discussed in the context of magnetotail dynamical models and spacecraft observations.


title: Wormhole interaction in 2d Horava-Lifshitz quantum gravity

abstract: A lattice regularization for the $2$d projectable Horava-Lifshitz (HL) quantum gravity is known to be the $2$d causal dynamical triangulations (CDT), and the $2$d CDT can be generalized so as to include all possible genus contributions non-perturbatively. We show that in the context of HL gravity, effects coming from such a non-perturbative sum over topologies can be successfully taken into account, if we quantize the $2$d projectable HL gravity with a simple bi-local wormhole interaction. This conference paper is based on the article, Phys. Lett. B 816 (2021), 136205.


title: Learning Cooperation and Online Planning Through Simulation and Graph Convolutional Network

abstract: Multi-agent Markov Decision Process (MMDP) has been an effective way of modelling sequential decision making algorithms for multi-agent cooperative environments. A number of algorithms based on centralized and decentralized planning have been developed in this domain. However, dynamically changing environment, coupled with exponential size of the state and joint action space, make it difficult for these algorithms to provide both efficiency and scalability. Recently, Centralized planning algorithm FV-MCTS-MP and decentralized planning algorithm \textit{Alternate maximization with Behavioural Cloning} (ABC) have achieved notable performance in solving MMDPs. However, they are not capable of adapting to dynamically changing environments and accounting for the lack of communication among agents, respectively. Against this background, we introduce a simulation based online planning algorithm, that we call SiCLOP, for multi-agent cooperative environments. Specifically, SiCLOP tailors Monte Carlo Tree Search (MCTS) and uses Coordination Graph (CG) and Graph Neural Network (GCN) to learn cooperation and provides real time solution of a MMDP problem. It also improves scalability through an effective pruning of action space. Additionally, unlike FV-MCTS-MP and ABC, SiCLOP supports transfer learning, which enables learned agents to operate in different environments. We also provide theoretical discussion about the convergence property of our algorithm within the context of multi-agent settings. Finally, our extensive empirical results show that SiCLOP significantly outperforms the state-of-the-art online planning algorithms.


title: On the randomness analysis of link quality prediction: limitations and benefits

abstract: In wireless multi-hop networks, such as wireless sensor networks, link quality (LQ) is one of the most important metrics and is widely used in higher-layer applications such as routing protocols. An accurate link quality prediction may greatly help to improve the performance of wireless multi-hop networks. Researchers have proposed a lot of link quality prediction models in recent years. However, due to the dynamic and stochastic nature of wireless transmission, the performance of link quality prediction remains challenging. In this article, we mainly analyze the influence of the stochastic nature of wireless transmission on the link quality prediction model and discuss the benefits in the application of wireless multi-hop networks with the performance-limited link quality prediction models.


title: $K_2$ and quantum curves

abstract: A 2015 conjecture of Codesido-Grassi-Mari\~no in topological string theory relates the enumerative invariants of toric CY 3-folds to the spectra of operators attached to their mirror curves. We deduce two consequences of this conjecture for the integral regulators of $K_2$-classes on these curves, and then prove both of them; the results thus give evidence for the CGM conjecture. (While the conjecture and the deduction process both entail forms of local mirror symmetry, the consequences/theorems do not: they only involve the curves themselves.) Our first theorem relates zeroes of the higher normal function to the spectra of the operators for curves of genus one, and suggests a new link between analysis and arithmetic geometry. The second theorem provides dilogarithm formulas for limits of regulator periods at the maximal conifold point in moduli of the curves.

categories: math.AG hep-th math-ph math.KT math.MP math.NT


title: Simplest Streaming Trees

abstract: Decision forests, including random forests and gradient boosting trees, remain the leading machine learning methods for many real-world data problems, especially on tabular data. However, most of the current implementations only operate in batch mode, and therefore cannot incrementally update when more data arrive. Several previous works developed streaming trees and ensembles to overcome this limitation. Nonetheless, we found that those state-of-the-art algorithms suffer from a number of drawbacks, including low accuracy on some problems and high memory usage on others. We therefore developed the simplest possible extension of decision trees: given new data, simply update existing trees by continuing to grow them, and replace some old trees with new ones to control the total number of trees. In a benchmark suite containing 72 classification problems (the OpenML-CC18 data suite), we illustrate that our approach, Stream Decision Forest (SDF), does not suffer from either of the aforementioned limitations. On those datasets, we also demonstrate that our approach often performs as well, and sometimes even better, than conventional batch decision forest algorithm. Thus, SDFs establish a simple standard for streaming trees and forests that could readily be applied to many real-world problems.


title: A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models

abstract: Large pre-trained vision-language (VL) models can learn a new task with a handful of examples and generalize to a new task without fine-tuning. However, these VL models are hard to deploy for real-world applications due to their impractically huge sizes and slow inference speed. To solve this limitation, we study prompt-based low-resource learning of VL tasks with our proposed method, FewVLM, relatively smaller than recent few-shot learners. For FewVLM, we pre-train a sequence-to-sequence transformer model with prefix language modeling (PrefixLM) and masked language modeling (MaskedLM). Furthermore, we analyze the effect of diverse prompts for few-shot tasks. Experimental results on VQA show that FewVLM with prompt-based learning outperforms Frozen which is 31x larger than FewVLM by 18.2% point and achieves comparable results to a 246x larger model, PICa. In our analysis, we observe that (1) prompts significantly affect zero-shot performance but marginally affect few-shot performance, (2) models with noisy prompts learn as quickly as hand-crafted prompts given larger training data, and (3) MaskedLM helps VQA tasks while PrefixLM boosts captioning performance. Our code is publicly available at \url{https://github.com/woojeongjin/FewVLM}


title: Design of Link-Quality-prediction-based Software-Defined Wireless Sensor Networks

abstract: In wireless multi-hop networks, the instability of the wireless links leads to unstable networking. Even in the newly designed Software-Defined Wireless Sensor Networks (SDWSN), similar problems exist. To further improve the stability of SDWSN, we introduce a Link Quality (LQ) prediction model into the SDWSN architecture. The prediction model is used to improve the stability between neighbor nodes, and thus the stability of wireless multi-hop routes. Simulation results show that the LQ prediction model can make reasonable corrections to the reality wireless link model, which can well address the restrictive nature of unstable links. As a result, by reducing the use of unstable wireless links, the stability of the SDWSN network improved.


title: Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals

abstract: The ability to sequence unordered events is an essential skill to comprehend and reason about real world task procedures, which often requires thorough understanding of temporal common sense and multimodal information, as these procedures are often communicated through a combination of texts and images. Such capability is essential for applications such as sequential task planning and multi-source instruction summarization. While humans are capable of reasoning about and sequencing unordered multimodal procedural instructions, whether current machine learning models have such essential capability is still an open question. In this work, we benchmark models' capability of reasoning over and sequencing unordered multimodal instructions by curating datasets from popular online instructional manuals and collecting comprehensive human annotations. We find models not only perform significantly worse than humans but also seem incapable of efficiently utilizing the multimodal information. To improve machines' performance on multimodal event sequencing, we propose sequentiality-aware pretraining techniques that exploit the sequential alignment properties of both texts and images, resulting in > 5% significant improvements.


title: Thermal transport of amorphous carbon and boron-nitride monolayers

abstract: Two-dimensional (2D) materials like graphene and h-BN usually show high thermal conductivity, which enables rich applications in thermal dissipation and nanodevices. Disorder, on the other hand, is often present in 2D materials. Structural disorder induces localization of electrons and phonons and alters the electronic, mechanical, thermal, and magnetic properties. Here we calculate the in-plane thermal conductivity of both monolayer carbon and monolayer boron nitride in the amorphous form, by reverse nonequilibrium molecular dynamics simulations. We find that the thermal conductivity of both monolayer amorphous carbon (MAC) and monolayer amorphous boron nitride (ma-BN) are about two orders of magnitude smaller than their crystalline counterparts. Moreover, the ultralow thermal conductivity is independent of the temperature due to the extremely short phonon mean free path in these amorphous materials. The relation between the structure disorder and the reduction of the thermal conductivity is analyzed in terms of the vibrational density of states and the participation ratio. ma-BN shows strong vibrational localization across the frequency range, while MAC exhibits a unique extended G' mode at high frequency due to its sp2 hybridization and the broken E2g symmetry. The present results pave the way for potential applications of MAC and ma-BN in thermal management.


title: Lifelong Topological Visual Navigation

abstract: Commonly, learning-based topological navigation approaches produce a local policy while preserving some loose connectivity of the space through a topological map. Nevertheless, spurious or missing edges in the topological graph often lead to navigation failure. In this work, we propose a sampling-based graph building method, which results in sparser graphs yet with higher navigation performance compared to baseline methods. We also propose graph maintenance strategies that eliminate spurious edges and expand the graph as needed, which improves lifelong navigation performance. Unlike controllers that learn from fixed training environments, we show that our model can be fine-tuned using only a small number of collected trajectory images from a real-world environment where the agent is deployed. We demonstrate successful navigation after fine-tuning on real-world environments, and notably show significant navigation improvements over time by applying our lifelong graph maintenance strategies.


title: Planar Carrollean dynamics, and the Carroll quantum equation

abstract: We expand on the known result that the Carroll algebra in $2+1$ dimensions admits two non-trivial central extensions by computing the associated Lie group, which we call extended Carroll group. The symplectic geometry associated to this group is then computed to describe the motion of planar Carroll elementary particles, in the free case, when coupled to an electromagnetic field, and to a gravitational field. We compare to the motions of Carroll particles in $3+1$ dimensions in the same conditions, and also give the dynamics of Carroll particles with spin. In an electromagnetic background, the planar Carroll dynamics differ from the known Carroll ones due to 2 new Casimir invariants, and turn out to be non-trivial. The coupling to a gravitational field leaves the dynamics trivial, however. Finally, we obtain the quantum equation obeyed by Carroll wave functions \textit{via} geometric quantization.


title: Collisions of the supercritical Keller-Segel particle system

abstract: We study a particle system naturally associated to the $2$-dimensional Keller-Segel equation. It consists of $N$ Brownian particles in the plane, interacting through a binary attraction in $\theta/(Nr)$, where $r$ stands for the distance between two particles. When the intensity $\theta$ of this attraction is greater than $2$, this particle system explodes in finite time. We assume that $N>3\theta$ and study in details what happens near explosion. There are two slightly different scenarios, depending on the values of $N$ and $\theta$, here is one: at explosion, a cluster consisting of precisely $k_0$ particles emerges, for some deterministic $k_0\geq 7$ depending on $N$ and $\theta$. Just before explosion, there are infinitely many $(k_0-1)$-ary collisions. There are also infinitely many $(k_0-2)$-ary collisions before each $(k_0-1)$-ary collision. And there are infinitely many binary collisions before each $(k_0-2)$-ary collision. Finally, collisions of subsets of $3,\dots,k_0-3$ particles never occur. The other scenario is similar except that there are no $(k_0-2)$-ary collisions.


title: Extremal metrics on toric manifolds and homogeneous toric bundles

abstract: In this paper, we prove the Yau-Tian-Donaldson conjecture of the filtration version for toric manifolds and homogeneous toric bundles.


title: Asymmetric coloring of locally finite graphs and profinite permutation groups: Tucker's Conjecture confirmed

abstract: An asymmetric coloring of a graph is a coloring of its vertices that is not preserved by any non-identity automorphism of the graph. The motion of a graph is the minimal degree of its automorphism group, i.e., the minimum number of elements displaced by any non-identity automorphism. In this paper we confirm Tom Tucker's "Infinite Motion Conjecture" that connected locally finite graphs with infinite motion admit an asymmetric 2-coloring. We infer this from the more general result that the inverse limit of a sequence of finite permutation groups with disjoint domains, viewed as a permutation group on the union of those domains, admits an asymmetric 2-coloring. The proof is based on the study of the interaction between epimorphisms of finite permutation groups and the structure of the setwise stabilizers of subsets of their domains.


title: Improvised Aerial Object Detection approach for YOLOv3 Using Weighted Luminance

abstract: Aerial imaging plays a crucial role in navigation and data acquisition for unmanned aerial vehicles and satellite imaging systems. In recent days, the employment of drones has been escalated in several applications that are not limited to surveillance, delivery systems, aerial warfare, and agricultural activities. Aerial imaging of ground targets is highly challenging because of various factors that affect light propagation through different mediums. Several convolutional neural network-based object detection algorithms that are developed require more robustness when applied in the field of aerial imaging and remote sensing. In order to handle the adverse effects of light propagation with respect to time and solar radiance, adaptive RGB filters for grayscale imaging based on weighted luminance are introduced that extensively solve the problem of rayleigh scattering effect. Images of objects that are easily diminished by rayleigh scattering are acquired in various timezones. The acquired images are labelled precisely and subjected to training and validation. The results show that the proposed method detects the object more accurately and efficiently than the traditional YOLOv3 approach.


title: Feedforward Control of DGs for a Self-healing Microgrid

abstract: Network reconfiguration (NR) has recently received significant attention due to its potential to improve grid resilience by realizing self-healing microgrids (MGs). This paper proposes a new strategy for the real-time frequency regulation of a reconfigurable MG, wherein the feedforward control of synchronous and inverter-interfaced distributed generators (DGs) is achieved in coordination with the operations of sectionalizing and tie switches (SWs). This enables DGs to compensate more quickly, and preemptively, for a forthcoming variation in load demand due to NR-aided restoration. An analytical dynamic model of a reconfigurable MG is developed to analyze the MG frequency response to NR and hence determine the desired dynamics of the feedforward controllers, with the integration of feedback loops for inertial response emulation and primary and secondary frequency control. A small-signal analysis is conducted to analyze the contribution of the supplementary feedforward control to the MG frequency regulation. Simulation case studies of NR-aided load restoration are also performed. The results of the small-signal analysis and case studies confirm that the proposed strategy is effective for improving the MG frequency regulation under various conditions of load demand, model parameter errors, and communication time delays.


title: Hybrid Mutimodal Fusion for Dimensional Emotion Recognition

abstract: In this paper, we extensively present our solutions for the MuSe-Stress sub-challenge and the MuSe-Physio sub-challenge of Multimodal Sentiment Challenge (MuSe) 2021. The goal of MuSe-Stress sub-challenge is to predict the level of emotional arousal and valence in a time-continuous manner from audio-visual recordings and the goal of MuSe-Physio sub-challenge is to predict the level of psycho-physiological arousal from a) human annotations fused with b) galvanic skin response (also known as Electrodermal Activity (EDA)) signals from the stressed people. The Ulm-TSST dataset which is a novel subset of the audio-visual textual Ulm-Trier Social Stress dataset that features German speakers in a Trier Social Stress Test (TSST) induced stress situation is used in both sub-challenges. For the MuSe-Stress sub-challenge, we highlight our solutions in three aspects: 1) the audio-visual features and the bio-signal features are used for emotional state recognition. 2) the Long Short-Term Memory (LSTM) with the self-attention mechanism is utilized to capture complex temporal dependencies within the feature sequences. 3) the late fusion strategy is adopted to further boost the model's recognition performance by exploiting complementary information scattered across multimodal sequences. Our proposed model achieves CCC of 0.6159 and 0.4609 for valence and arousal respectively on the test set, which both rank in the top 3. For the MuSe-Physio sub-challenge, we first extract the audio-visual features and the bio-signal features from multiple modalities. Then, the LSTM module with the self-attention mechanism, and the Gated Convolutional Neural Networks (GCNN) as well as the LSTM network are utilized for modeling the complex temporal dependencies in the sequence. Finally, the late fusion strategy is used. Our proposed method also achieves CCC of 0.5412 on the test set, which ranks in the top 3.


title: Rethinking Modern Communication from Semantic Coding to Semantic Communication

abstract: Modern communications are usually designed to pursue a higher bit-level precision and fewer bits while transmitting a message. This article rethinks these two major features and introduces the concept and advantage of semantics that characterizes a new kind of semantics-aware communication framework, incorporating both the semantic encoding and the semantic communication problem. After analyzing the underlying defects of existing semantics-aware techniques, we establish a confidence-based distillation mechanism for the joint semantics-noise coding (JSNC) problem and a reinforcement learning (RL)-powered semantic communication paradigm that endows a system the ability to convey the semantics instead of pursuing the bit level accuracy. On top of these technical contributions, this work provides a new insight to understand how the semantics are processed and represented in a semantics-aware coding and communication system, and verifies the significant benefits of doing so. Targeted on the next generation's semantics-aware communication, some critical concerns and open challenges such as the information overhead, semantic security and implementation cost are also discussed and envisioned.


title: Robust Maximum Capture Facility Location under Random Utility Maximization Models

abstract: We study a robust version of the maximum capture facility location problem in a competitive market, assuming that each customer chooses among all available facilities according to a random utility maximization (RUM) model. We employ the generalized extreme value (GEV) family of models and assume that the parameters of the RUM model are not given exactly but lie in convex uncertainty sets. The problem is to locate new facilities to maximize the worst-case captured user demand. We show that, interestingly, our robust model preserves the monotonicity and submodularity from its deterministic counterpart, implying that a simple greedy heuristic can guarantee a (1-1/e) approximation solution. We further show the concavity of the objective function under the classical multinomial logit (MNL) model, suggesting that an outer-approximation algorithm can be used to solve the robust model under MNL to optimality. We conduct experiments comparing our robust method to other deterministic and sampling approaches, using instances from different discrete choice models. Our results clearly demonstrate the advantages of our roust model in protecting the decision-maker from bad-case scenarios.


title: The $S_8$ Tension in Light of Updated Redshift-Space Distortion Data and PAge Approximation

abstract: One of the most prominent challenges to the standard Lambda cold dark matter ($\Lambda$CDM) cosmology is the tension between the structure growth parameter $S_8$ constrained by the cosmic microwave background (CMB) data and the smaller one suggested by the cosmic shear data. Recent studies show that, for $\Lambda$CDM cosmology, redshift-space distortion (RSD) data also prefers a smaller $S_8$ that is $\sim 2$-$3\sigma$ lower than the CMB value, but the result is sensitive to the cosmological model. In the present work we update the RSD constraint on $S_8$ with the most up-to-date RSD data set where the correlation between data points are properly taken into account. To reduce the model dependence, we add in our Monte Carlo Markov Chain calculation the most up-to-date data sets of Type Ia supernovae (SN) and baryon acoustic oscillations (BAO), whose correlation with RSD is also taken into account, to constrain the background geometry. For $\Lambda$CDM cosmology we find $S_8= 0.812 \pm 0.026$, which is $\sim 2\sigma$ larger than previous studies, and hence is consistent with the CMB constraint. By replacing $\Lambda$CDM with the Parameterization based on cosmic Age (PAge), an almost model-independent description of the late universe, we find that the RSD + SN + BAO constraint on $S_8$ is insensitive to the cosmological model.


title: PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization

abstract: We introduce PRIMERA, a pre-trained model for multi-document representation with a focus on summarization that reduces the need for dataset-specific architectures and large amounts of fine-tuning labeled data. PRIMERA uses our newly proposed pre-training objective designed to teach the model to connect and aggregate information across documents. It also uses efficient encoder-decoder transformers to simplify the processing of concatenated input documents. With extensive experiments on 6 multi-document summarization datasets from 3 different domains on zero-shot, few-shot and full-supervised settings, PRIMERA outperforms current state-of-the-art dataset-specific and pre-trained models on most of these settings with large margins. The code and pre-trained models can be found at \url{https://github.com/allenai/PRIMER}.


title: On Model Selection Consistency of Lasso for High-Dimensional Ising Models

abstract: We theoretically analyze the model selection consistency of least absolute shrinkage and selection operator (Lasso), both with and without post-thresholding, for high-dimensional Ising models. For random regular (RR) graphs of size $p$ with regular node degree $d$ and uniform couplings $\theta_0$, it is rigorously proved that Lasso \textit{without post-thresholding} is model selection consistent in the whole paramagnetic phase with the same order of sample complexity $n=\Omega{(d^3\log{p})}$ as that of $\ell_1$-regularized logistic regression ($\ell_1$-LogR). This result is consistent with the conjecture in Meng, Obuchi, and Kabashima 2021 using the non-rigorous replica method from statistical physics and thus complements it with a rigorous proof. For general tree-like graphs, it is demonstrated that the same result as RR graphs can be obtained under mild assumptions of the dependency condition and incoherence condition. Moreover, we provide a rigorous proof of the model selection consistency of Lasso with post-thresholding for general tree-like graphs in the paramagnetic phase without further assumptions on the dependency and incoherence conditions. Experimental results agree well with our theoretical analysis.


title: Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generation

abstract: Implicit knowledge, such as common sense, is key to fluid human conversations. Current neural response generation (RG) models are trained to generate responses directly, omitting unstated implicit knowledge. In this paper, we present Think-Before-Speaking (TBS), a generative approach to first externalize implicit commonsense knowledge (think) and use this knowledge to generate responses (speak). We expect that externalizing implicit knowledge allows more efficient learning, produces more informative responses, and enables more explainable models. We analyze different choices to collect knowledge-aligned dialogues, represent implicit knowledge, and transition between knowledge and dialogues. Empirical results show TBS models outperform end-to-end and knowledge-augmented RG baselines on most automatic metrics and generate more informative, specific, and commonsense-following responses, as evaluated by human annotators. TBS also generates knowledge that makes sense and is relevant to the dialogue around 85\% of the time.


title: Quark spin-orbit correlations in the pion meson in light-cone quark model

abstract: We study the correlation between the quark spin and orbital angular momentum inside the pion meson. Similar to the case inside the nucleon, the longitudinal spin-orbit correlation $C_z^{q/\pi}$ in pion meson can be expressed in terms of the corresponding generalized parton distributions (GPDs) and generalized transverse momentum distributions (GTMDs). This provides new information about the spin structure of the pion. Using the wavefunctions of the pion in the light-cone quark model and the overlap representation for GPDs and GTMDs, we present the analytical results for the quark longitudinal spin-orbit correlation. We find that the GPD approach and the GTMD approach lead to the same results. The numerical results is also obtained, showing that the correlation in pion is anti-aligned. In addition, we compare $C_z^{q/\pi}$ from the GPD approach and the GTMD approach, with $x$ and the transverse momentum $k_T$ unintegrated.


title: Ascribing quantum system to Schwarzschild spacetime with naked singularity

abstract: We quantize the Schwarzschild spacetime with naked singularity using the affine coherent states quantization method. The novelty of our approach is quantization of both temporal and spatial coordinates. Quantization smears the gravitational singularity indicated by the Kretschmann invariant avoiding its localization in the configuration space. This way we resolve the singularity problem of considered spacetime at quantum level.


title: The rationality about the assumption that the signal and decoy states are indistinguishable in decoy-state quantum key distribution

abstract: Decoy-state quantum key distribution (QKD) has become the most efficient method to resist the photon-number-splitting (PNS) attack and estimate the secure key rate. The decoy-state method has many assumptions, among which a critical one is that an eavesdropper (Eve) cannot distinguish between the signal and decoy states. However, a rigorous proof of the rationality about this assumption is not yet available so far. In fact, due to the difference of photon-number probability distribution between the signal and decoy states, Eve is able to distinguish the two states with a certain probability. In this work, we adopt the Bayesian decision to distinguish the signal and decoy states in one-decoy-state QKD, and perform different PNS attack strategies for the two states according to the previous decision. The numerical simulations indicate that the attack effect is not obvious or even failed. Thus, it is reasonable to assume that the signal and decoy states are indistinguishable in decoy-state QKD. In addition, we also provide the method to set the intensities of signal and decoy states properly, which can not only reduce the preparation cost and improve the communication efficiency, but also avoid the attack from Eve using the intensity difference between the signal and decoy states.


title: Mode and Ridge Estimation in Euclidean and Directional Product Spaces: A Mean Shift Approach

abstract: The set of local modes and the ridge lines estimated from a dataset are important summary characteristics of the data-generating distribution. In this work, we consider estimating the local modes and ridges from point cloud data in a product space with two or more Euclidean/directional metric spaces. Specifically, we generalize the well-known (subspace constrained) mean shift algorithm to the product space setting and illuminate some pitfalls in such generalization. We derive the algorithmic convergence of the proposed method, provide practical guidelines on the implementation, and demonstrate its effectiveness on both simulated and real datasets.


title: Domains of Magnetic Pressure Balance in Parker Solar Probe Observations of the Solar Wind

abstract: The Parker Solar Probe (PSP) spacecraft is performing the first in situ exploration of the solar wind within 0.2 au of the Sun. Initial observations confirmed the Alfv\'enic nature of aligned fluctuations of the magnetic field B and velocity V in solar wind plasma close to the Sun, in domains of nearly constant magnetic field magnitude $|{\bf B}|$, i.e., approximate magnetic pressure balance. Such domains are interrupted by particularly strong fluctuations, including but not limited to radial field (polarity) reversals, known as switchbacks. It has been proposed that nonlinear Kelvin-Helmholtz instabilities form near magnetic boundaries in the nascent solar wind leading to extensive shear-driven dynamics, strong turbulent fluctuations including switchbacks, and mixing layers that involve domains of approximate magnetic pressure balance. In this work we identify and analyze various aspects of such domains using data from the first five PSP solar encounters. The filling fraction of domains, a measure of Alfv\'enicity, varies from median values of 90% within 0.2 au to 38% outside 0.9 au, with strong fluctuations. We find an inverse association between the mean domain duration and plasma $\beta$. We examine whether the mean domain duration is also related to the crossing time of spatial structures frozen into the solar wind flow for extreme cases of the aspect ratio. Our results are inconsistent with long, thin domains aligned along the radial or Parker spiral direction, and compatible with isotropic domains, which is consistent with prior observations of isotropic density fluctuations or ``flocculae'' in the solar wind.


title: Can CAV Reduce Non-Recurrent Urban Road Congestion?

abstract: A well-designed resilient and sustainable urban transportation system can recover quickly from the non-recurrent road congestion (NRC), which is often caused by en-route events (e.g., road closure due to car collisions). Existing solutions, such as on-board navigation systems and temporary rerouting road signs, are not effective due to delayed responses. Connected Autonomous Vehicles (CAV) can be helpful in improving recurrent traffic as they can autonomously adjust their speed according to their real-time surrounding traffic, sensed by vehicular communications. Preliminary simulation results in this short paper show that CAV can also improve traffic when non-recurrent congestion occurs. Other results in fuel consumption, CO2 emission, and traditional traffic safety indicators are open for future discussions.


title: Improving Variational Autoencoders for New Physics Detection at the LHC with Normalizing Flows

abstract: We investigate how to improve new physics detection strategies exploiting variational autoencoders and normalizing flows for anomaly detection at the Large Hadron Collider. As a working example, we consider the DarkMachines challenge dataset. We show how different design choices (e.g., event representations, anomaly score definitions, network architectures) affect the result on specific benchmark new physics models. Once a baseline is established, we discuss how to improve the anomaly detection accuracy by exploiting normalizing flow layers in the latent space of the variational autoencoder.


title: BAPGAN: GAN-based Bone Age Progression of Femur and Phalange X-ray Images

abstract: Convolutional Neural Networks play a key role in bone age assessment for investigating endocrinology, genetic, and growth disorders under various modalities and body regions. However, no researcher has tackled bone age progression/regression despite its valuable potential applications: bone-related disease diagnosis, clinical knowledge acquisition, and museum education. Therefore, we propose Bone Age Progression Generative Adversarial Network (BAPGAN) to progress/regress both femur/phalange X-ray images while preserving identity and realism. We exhaustively confirm the BAPGAN's clinical potential via Frechet Inception Distance, Visual Turing Test by two expert orthopedists, and t-Distributed Stochastic Neighbor Embedding.


title: DFW-PP: Dynamic Feature Weighting based Popularity Prediction for Social Media Content

abstract: The increasing popularity of social media platforms makes it important to study user engagement, which is a crucial aspect of any marketing strategy or business model. The over-saturation of content on social media platforms has persuaded us to identify the important factors that affect content popularity. This comes from the fact that only an iota of the humongous content available online receives the attention of the target audience. Comprehensive research has been done in the area of popularity prediction using several Machine Learning techniques. However, we observe that there is still significant scope for improvement in analyzing the social importance of media content. We propose the DFW-PP framework, to learn the importance of different features that vary over time. Further, the proposed method controls the skewness of the distribution of the features by applying a log-log normalization. The proposed method is experimented with a benchmark dataset, to show promising results. The code will be made publicly available at https://github.com/chaitnayabasava/DFW-PP.


title: What can we learn from universal Turing machines?

abstract: In the present paper, we construct what we call a pedagogical universal Turing machine. We try to understand which comparisons with biological phenomena can be deduced from its encoding and from its working.


title: AugmentedCode: Examining the Effects of Natural Language Resources in Code Retrieval Models

abstract: Code retrieval is allowing software engineers to search codes through a natural language query, which relies on both natural language processing and software engineering techniques. There have been several attempts on code retrieval from searching snippet codes to function codes. In this paper, we introduce Augmented Code (AugmentedCode) retrieval which takes advantage of existing information within the code and constructs augmented programming language to improve the code retrieval models' performance. We curated a large corpus of Python and showcased the the framework and the results of augmented programming language which outperforms on CodeSearchNet and CodeBERT with a Mean Reciprocal Rank (MRR) of 0.73 and 0.96, respectively. The outperformed fine-tuned augmented code retrieval model is published in HuggingFace at https://huggingface.co/Fujitsu/AugCode and a demonstration video is available at: https://youtu.be/mnZrUTANjGs .


title: Deep Reinforcement Learning for Practical Phase Shift Optimization in RIS-aided MISO URLLC Systems

abstract: We study the joint active/passive beamforming and channel blocklength (CBL) allocation in a non-ideal reconfigurable intelligent surface (RIS)-aided ultra-reliable and low-latency communication (URLLC) system. The considered scenario is a finite blocklength (FBL) regime and the problem is solved by leveraging a novel deep reinforcement learning (DRL) algorithm named twin-delayed deep deterministic policy gradient (TD3). First, assuming an industrial automation system with multiple actuators, the signal-to-interference-plus-noise ratio and achievable rate in the FBL regime are identified for each actuator in terms of the phase shift configuration matrix at the RIS. Next, the joint active/passive beamforming and CBL optimization problem is formulated where the objective is to maximize the total achievable FBL rate in all actuators, subject to non-linear amplitude response at the RIS elements, BS transmit power budget, and total available CBL. Since the amplitude response equality constraint is highly non-convex and non-linear, we resort to employing an actor-critic policy gradient DRL algorithm based on TD3. The considered method relies on interacting RIS with the industrial automation environment by taking actions which are the phase shifts at the RIS elements, CBL variables, and BS beamforming to maximize the expected observed reward, i.e., the total FBL rate. We assess the performance loss of the system when the RIS is non-ideal, i.e., with non-linear amplitude response, and compare it with ideal RIS without impairments. The numerical results show that optimizing the RIS phase shifts, BS beamforming, and CBL variables via the proposed TD3 method is highly beneficial to improving the network total FBL rate as the proposed method with deterministic policy outperforms conventional methods.


title: Analyzing Dynamic Adversarial Training Data in the Limit

abstract: To create models that are robust across a wide range of test inputs, training datasets should include diverse examples that span numerous phenomena. Dynamic adversarial data collection (DADC), where annotators craft examples that challenge continually improving models, holds promise as an approach for generating such diverse training sets. Prior work has shown that running DADC over 1-3 rounds can help models fix some error types, but it does not necessarily lead to better generalization beyond adversarial test data. We argue that running DADC over many rounds maximizes its training-time benefits, as the different rounds can together cover many of the task-relevant phenomena. We present the first study of longer-term DADC, where we collect 20 rounds of NLI examples for a small set of premise paragraphs, with both adversarial and non-adversarial approaches. Models trained on DADC examples make 26% fewer errors on our expert-curated test set compared to models trained on non-adversarial data. Our analysis shows that DADC yields examples that are more difficult, more lexically and syntactically diverse, and contain fewer annotation artifacts compared to non-adversarial examples.


title: Multimodal Dialogue Response Generation

abstract: Responsing with image has been recognized as an important capability for an intelligent conversational agent. Yet existing works only focus on exploring the multimodal dialogue models which depend on retrieval-based methods, but neglecting generation methods. To fill in the gaps, we first present a multimodal dialogue generation model, which takes the dialogue history as input, then generates a textual sequence or an image as response. Learning such a model often requires multimodal dialogues containing both texts and images which are difficult to obtain. Motivated by the challenge in practice, we consider multimodal dialogue generation under a natural assumption that only limited training examples are available. In such a low-resource setting, we devise a novel conversational agent, Divter, in order to isolate parameters that depend on multimodal dialogues from the entire generation model. By this means, the major part of the model can be learned from a large number of text-only dialogues and text-image pairs respectively, then the whole parameters can be well fitted using the limited training examples. Extensive experiments demonstrate our method achieves state-of-the-art results in both automatic and human evaluation, and can generate informative text and high-resolution image responses.


title: All you need is time to generalise the Goman-Khrabrov dynamic stall model

abstract: Dynamic stall on airfoils negatively impacts their aerodynamic performance and can lead to structural damage. Accurate prediction and modelling of the dynamic stall loads are crucial for a more robust design of wings and blades that operate under unsteady conditions susceptible to dynamic stall and for widening the range of operation of these lifting surfaces. Many dynamic stall models rely on empirical parameters that need to be obtained from experimental or numerical data which limits their generalisability. Here, we introduce physically derived times scales to replace the empirical parameters in the Goman-Khrabrov dynamic stall model. The physics-based time constants correspond to the dynamic stall delay and the decay rate of post-stall load fluctuations. The dynamic stall delay is largely independent of the type of the motion, the Reynolds number, and the airfoil geometry and is described as a function of a normalised instantaneous pitch rate. The post-stall decay rate is independent of the motion kinematics and is directly related to the Strouhal number of the post-stall vortex shedding. The general validity of our physics-based time constants is demonstrated using three sets of experimental dynamic stall data covering various airfoil profiles, Reynolds numbers varying from 75'000 to 1'000'000, and sinusoidal and ramp-up pitching motions. The use of physics-based time constants generalises the Goman-Khrabrov dynamic stall model and extends its range of application.


title: Characterizing Improper Input Validation Vulnerabilities of Mobile Crowdsourcing Services

abstract: Mobile crowdsourcing services (MCS), enable fast and economical data acquisition at scale and find applications in a variety of domains. Prior work has shown that Foursquare and Waze (a location-based and a navigation MCS) are vulnerable to different kinds of data poisoning attacks. Such attacks can be upsetting and even dangerous especially when they are used to inject improper inputs to mislead users. However, to date, there is no comprehensive study on the extent of improper input validation (IIV) vulnerabilities and the feasibility of their exploits in MCSs across domains. In this work, we leverage the fact that MCS interface with their participants through mobile apps to design tools and new methodologies embodied in an end-to-end feedback-driven analysis framework which we use to study 10 popular and previously unexplored services in five different domains. Using our framework we send tens of thousands of API requests with automatically generated input values to characterize their IIV attack surface. Alarmingly, we found that most of them (8/10) suffer from grave IIV vulnerabilities which allow an adversary to launch data poisoning attacks at scale: 7400 spoofed API requests were successful in faking online posts for robberies, gunshots, and other dangerous incidents, faking fitness activities with supernatural speeds and distances among many others. Lastly, we discuss easy to implement and deploy mitigation strategies which can greatly reduce the IIV attack surface and argue for their use as a necessary complementary measure working toward trustworthy mobile crowdsourcing services.


title: MarkupLM: Pre-training of Text and Markup Language for Visually-rich Document Understanding

abstract: Multimodal pre-training with text, layout, and image has made significant progress for Visually Rich Document Understanding (VRDU), especially the fixed-layout documents such as scanned document images. While, there are still a large number of digital documents where the layout information is not fixed and needs to be interactively and dynamically rendered for visualization, making existing layout-based pre-training approaches not easy to apply. In this paper, we propose MarkupLM for document understanding tasks with markup languages as the backbone, such as HTML/XML-based documents, where text and markup information is jointly pre-trained. Experiment results show that the pre-trained MarkupLM significantly outperforms the existing strong baseline models on several document understanding tasks. The pre-trained model and code will be publicly available at https://aka.ms/markuplm.


title: Role of Parallel Solenoidal Electric Field on Energy Conversion in 2.5D Decaying Turbulence with a Guide Magnetic Field

abstract: We perform 2.5D particle-in-cell simulations of decaying turbulence in the presence of a guide (out-of-plane) background magnetic field. The fluctuating magnetic field initially consists of Fourier modes at low wavenumbers (long wavelengths). With time, the electromagnetic energy is converted to plasma kinetic energy (bulk flow+thermal energy) at the rate per unit volume of ${\pp J}\cdot{\pp E}$ for current density ${\pp J}$ and electric field ${\pp E}$. Such decaying turbulence is well known to evolve toward a state with strongly intermittent plasma current. Here we decompose the electric field into components that are irrotational, ${\pp E}_{\rm ir}$, and solenoidal (divergence-free), ${\pp E}_{\rm so}$. ${\pp E}_{\rm ir}$ is associated with charge separation, and ${\pp J}\cdot{\pp E}_{\rm ir}$ is a rate of energy transfer between ions and electrons with little net change in plasma kinetic energy. Therefore, the net rate of conversion of electromagnetic energy to plasma kinetic energy is strongly dominated by ${\pp J}\cdot{\pp E}_{\rm so}$, and for a strong guide magnetic field, this mainly involves the component ${\pp E}_{\rm so,\parallel}$ parallel to the total magnetic field ${\pp B}$. We examine various indicators of the spatial distribution of the energy transfer rate {\bf J$_\parallel\cdot$E$_{so,\parallel}$}, which relates to magnetic reconnection, the best of which are 1) the ratio of the out-of-plane electric field to the in-plane magnetic field, 2) the out-of-plane component of the non-ideal electric field, and 3) the magnitude of the estimate of current helicity.


title: DISAPERE: A Dataset for Discourse Structure in Peer Review Discussions

abstract: At the foundation of scientific evaluation is the labor-intensive process of peer review. This critical task requires participants to consume vast amounts of highly technical text. Prior work has annotated different aspects of review argumentation, but discourse relations between reviews and rebuttals have yet to be examined. We present DISAPERE, a labeled dataset of 20k sentences contained in 506 review-rebuttal pairs in English, annotated by experts. DISAPERE synthesizes label sets from prior work and extends them to include fine-grained annotation of the rebuttal sentences, characterizing their context in the review and the authors' stance towards review arguments. Further, we annotate every review and rebuttal sentence. We show that discourse cues from rebuttals can shed light on the quality and interpretation of reviews. Further, an understanding of the argumentative strategies employed by the reviewers and authors provides useful signal for area chairs and other decision makers.


title: Locally Adaptive Structure and Texture Similarity for Image Quality Assessment

abstract: The latest advances in full-reference image quality assessment (IQA) involve unifying structure and texture similarity based on deep representations. The resulting Deep Image Structure and Texture Similarity (DISTS) metric, however, makes rather global quality measurements, ignoring the fact that natural photographic images are locally structured and textured across space and scale. In this paper, we describe a locally adaptive structure and texture similarity index for full-reference IQA, which we term A-DISTS. Specifically, we rely on a single statistical feature, namely the dispersion index, to localize texture regions at different scales. The estimated probability (of one patch being texture) is in turn used to adaptively pool local structure and texture measurements. The resulting A-DISTS is adapted to local image content, and is free of expensive human perceptual scores for supervised training. We demonstrate the advantages of A-DISTS in terms of correlation with human data on ten IQA databases and optimization of single image super-resolution methods.


title: Giant magnetoresistance and topological Hall effect in the EuGa4 antiferromagnet

abstract: We report on systematic temperature- and magnetic field-dependent studies of the EuGa$_4$ binary compound, which crystallizes in a centrosymmetric tetragonal BaAl$_4$-type structure with space group $I4/mmm$. The electronic properties of EuGa$_4$ single crystals, with an antiferromagnetic (AFM) transition at $T_\mathrm{N} \sim 16.4$ K, were characterized via electrical resistivity and magnetization measurements. A giant nonsaturating magnetoresistance was observed at low temperatures, reaching $\sim 7 \times 10^4$ % at 2 K in a magnetic field of 9 T. In the AFM state, EuGa$_4$ undergoes a series of metamagnetic transitions in an applied magnetic field, clearly manifested in its field-dependent electrical resistivity. Below $T_\mathrm{N}$, in the $\sim$4-7 T field range, we observe also a clear hump-like anomaly in the Hall resistivity which is part of the anomalous Hall resistivity. We attribute such a hump-like feature to the topological Hall effect, usually occurring in noncentrosymmetric materials known to host topological spin textures (as e.g., magnetic skyrmions). Therefore, the family of materials with a tetragonal BaAl$_4$-type structure, to which EuGa$_4$ and EuAl$_4$ belong, seems to comprise suitable candidates on which one can study the interplay among correlated-electron phenomena (such as charge-density wave or exotic magnetism) with topological spin textures and topologically nontrivial bands.


title: Spectral measure of empirical autocovariance matrices of high dimensional Gaussian stationary processes

abstract: Consider the empirical autocovariance matrix at a given non-zero time lag based on observations from a multivariate complex Gaussian stationary time series. The spectral analysis of these autocovariance matrices can be useful in certain statistical problems, such as those related to testing for white noise. We study the behavior of their spectral measures in the asymptotic regime where the time series dimension and the observation window length both grow to infinity, and at the same rate. Following a general framework in the field of the spectral analysis of large random non-Hermitian matrices, at first the probabilistic behavior of the small singular values of the shifted versions of the autocovariance matrix are obtained. This is then used to infer about the large sample behaviour of the empirical spectral measure of the autocovariance matrices at any lag. Matrix orthogonal polynomials on the unit circle play a crucial role in our study.


title: Fock-space perturbed relativistic coupled-cluster theory for electric dipole polarizability of one-valence atomic systems: Application to Al and In

abstract: We have developed a Fock-space relativistic coupled-cluster theory based method for the calculation of electric dipole polarizability of one-valence atoms and ions. We employ this method to compute the ground-state and spin-orbit coupled excited state electric dipole polarizability of Al and In. To check the quality of many-electron wavefunctions, we also compute the excitation energies of some low-lying states of Al and In. The effects of Breit interaction and QED corrections from the Uehling potential and the self-energy are included to improve the accuracy of $\alpha$ further. Our recommended value of ground-state $\alpha$ for both atoms are in good agreement with the previous theoretical results. From our computations, we find that more than 65\% of contributions come from the dipolar mixing of $3p$($5p$) with $3d$($5d$) and $4s$($6s$)-electrons for Al(In). The largest Breit and QED contributions are found to be 1.3\% and 0.6\%, respectively.


title: The Power of Prompt Tuning for Low-Resource Semantic Parsing

abstract: Prompt tuning has recently emerged as an effective method for adapting pre-trained language models to a number of language understanding and generation tasks. In this paper, we investigate prompt tuning for semantic parsing -- the task of mapping natural language utterances onto formal meaning representations. On the low-resource splits of Overnight and TOPv2, we find that a prompt tuned T5-xl significantly outperforms its fine-tuned counterpart, as well as strong GPT-3 and BART baselines. We also conduct ablation studies across different model scales and target representations, finding that, with increasing model scale, prompt tuned T5 models improve at generating target representations that are far from the pre-training distribution.